toy_isa_opt

mediumcyclesText
results

Measured by CPU cycle count — lower is better.

9220 cycles1545 cycles
sota
Gemini-3.1-Pro
reward 1.000

Usage

Run the reference answer to verify your environment is set up correctly

$ harbor run -p tasks/toy_isa_opt

Test model

$ harbor run -p tasks/toy_isa_opt \
  -a claude-code -m claude-opus-4-6

Description

Write assembly for the PINC toy ISA to compute a 512-element integer dot product in as few simulated cycles as possible. The pipeline stalls until source registers are ready, with load and multiply instructions taking 5 cycles each. The challenge is scheduling instructions to hide latency through techniques like loop unrolling and interleaving independent operations.

Files

path
permission
/app/program.s✎ Edit
/app/main.cRead-only
/app/MakefileRead-only

Rules

  • 01Edit /app/program.s only.
  • 02r1 must equal the reference dot product at halt — wrong answer scores 0.

Tags

assemblyschedulingpipelineunrollingdot-productsimulated-hardwarecyclesISA

Model Results

Click a row to view its trajectory in Live Lab

model
reward
score
Gemini-3.1-Pro
1.000
Claude-Opus-4.6
0.980
GLM-5
0.970
Grok-4-20
0.970
GPT-5.4
0.890
MiMo-V2.5-Pro
0.840
MiniMax-M2.7
0.800
Hunyuan-3-Preview
0.650
DeepSeek-V4-Pro
0.590
Kimi-K2.6
0.000
Qwen-3.6-Plus
0.000