concurrent_kv_wal

GitHub
hardruntimeGo
results

Measured by wall-clock runtime in seconds — lower is better.

9.5s1.1s
sota
Claude-Opus-4.6
reward 0.960

Usage

Run the reference answer to verify your environment is set up correctly

$ harbor run -p tasks/concurrent_kv_wal

Test model

$ harbor run -p tasks/concurrent_kv_wal \
  -a claude-code -m claude-opus-4-6

Description

Optimize a WAL-backed in-memory key-value store in Go that supports Put, Get, Delete, prefix counting, and statistics across 4 concurrent goroutines. The workload includes a load phase, a mixed read/write/query phase, and a read-heavy query phase, all requiring strict correctness.

Files

path
permission
/app/store.go✎ Edit
/app/index.go✎ Edit
/app/wal.go✎ Edit
/app/main.goRead-only
/app/types.goRead-only

Rules

  • 01Edit /app/store.go, /app/index.go, and /app/wal.go only.
  • 02Standard library only. No external modules, no cgo.
  • 03Goroutines, channels, sync, and sync/atomic are allowed.

Tags

goconcurrencykv-storewallock-contention

Model Results

Click a row to view its trajectory in Live Lab

model
reward
score
Claude-Opus-4.6
0.960
DeepSeek-V4-Pro
0.830
Gemini-3.1-Pro
0.760
GLM-5
0.630
Kimi-K2.6
0.560
GPT-5.4
0.530
Grok-4-20
0.530
MiMo-V2.5-Pro
0.470
Hunyuan-3-Preview
0.320
MiniMax-M2.7
0.280
Qwen-3.6-Plus
0.250
<- all tasks