toy_isa_opt
mediumcyclesText
results
Measured by CPU cycle count — lower is better.
9220 cycles1545 cycles
sota
Usage
Run the reference answer to verify your environment is set up correctly
$ harbor run -p tasks/toy_isa_opt
Test model
$ harbor run -p tasks/toy_isa_opt \ -a claude-code -m claude-opus-4-6
Description
Write assembly for the PINC toy ISA to compute a 512-element integer dot product in as few simulated cycles as possible. The pipeline stalls until source registers are ready, with load and multiply instructions taking 5 cycles each. The challenge is scheduling instructions to hide latency through techniques like loop unrolling and interleaving independent operations.
Files
path
permission
/app/program.s✎ Edit/app/main.cRead-only/app/MakefileRead-onlyRules
- 01Edit /app/program.s only.
- 02r1 must equal the reference dot product at halt — wrong answer scores 0.
Tags
assemblyschedulingpipelineunrollingdot-productsimulated-hardwarecyclesISA
Model Results
Click a row to view its trajectory in Live Lab
model
reward
score
1.000
0.980
0.970
Grok-4-20
0.970
0.890
MiMo-V2.5-Pro
0.840
0.800
Hunyuan-3-Preview
0.650
DeepSeek-V4-Pro
0.590
Kimi-K2.6
0.000
Qwen-3.6-Plus
0.000