sha256_throughput

GitHub
expertruntimeC
results

Measured by wall-clock runtime in seconds — lower is better.

2.5s0.15s
sota
Claude-Opus-4.6
reward 0.460

Usage

Run the reference answer to verify your environment is set up correctly

$ harbor run -p tasks/sha256_throughput

Test model

$ harbor run -p tasks/sha256_throughput \
  -a claude-code -m claude-opus-4-6

Description

Optimize a SHA-256 implementation in C to hash a 512 MiB buffer as fast as possible. The output must match Python's hashlib.sha256 exactly. SIMD intrinsics (including SHA-NI extensions), GCC builtins, and inline assembly are all available.

Files

path
permission
/app/solve.c✎ Edit
/app/main.cRead-only
/app/solve.hRead-only
/app/MakefileRead-only

Rules

  • 01Edit /app/solve.c only.
  • 02C standard library, <immintrin.h>, and GCC extensions allowed.
  • 03Single-threaded only. Wrong results score 0.

Tags

sha256cryptographysimdsha-nithroughput

Model Results

Click a row to view its trajectory in Live Lab

model
reward
score
Claude-Opus-4.6
0.460
Kimi-K2.6
0.440
Gemini-3.1-Pro
0.350
MiMo-V2.5-Pro
0.260
GLM-5
0.180
Grok-4-20
0.150
GPT-5.4
0.140
MiniMax-M2.7
0.140
DeepSeek-V4-Pro
0.130
Qwen-3.6-Plus
0.130
Hunyuan-3-Preview
0.090
<- all tasks