// all tasks

All Tasks

23 tasks across model development, system optimization, and puzzle challenges. Each task presents a working but suboptimal program — the agent must optimize it as far as possible.

View on GitHub

System Optimization(12)

Low-level performance optimization across algorithms, data structures, and systems.

flash_attention

C
hardruntime

Compute scaled dot-product attention for n=4096, d=64, float32. The naive baseline allocates a full 128MB score matrix. Key optimization: Flash Attention tiling with online softmax.

sota:Claude-Opus-4.6
0.75s→0.10s

bm25_search_go

Go
mediumruntime

Optimize a Go BM25 search engine to compute exact top-10 results across a synthetic corpus as fast as possible. Goroutines are allowed; standard library only.

sota:Claude-Opus-4.6
2.1s→0.03s

aes128_ctr

C
hardruntime

Optimize AES-128 in CTR mode to encrypt 256 MiB of data as fast as possible. Output must match NIST SP 800-38A test vectors.

sota:Claude-Opus-4.6
3.0s→0.10s

bvh_raytracer

C++
mediumruntime

Build a BVH acceleration structure in C++ to reduce ray-triangle intersection tests from O(N) brute-force to O(log N) per ray for a 638×638 scene with 4096 triangles.

sota:Claude-Opus-4.6
3.8s→0.030s

concurrent_kv_wal

Go
hardruntime

Optimize a WAL-backed in-memory key-value store in Go running a deterministic multi-phase workload with 4 concurrent goroutines.

sota:Claude-Opus-4.6
9.5s→1.1s

fft_rust

Rust
mediumruntime

Implement a fast FFT in Rust for a length-32768 real signal. Replace the naive O(n²) DFT with an iterative Cooley-Tukey FFT with precomputed twiddle factors.

sota:DeepSeek-V4-Pro
10.0s→0.001s

gaussian_blur

C
expertruntime

Apply a 17×17 Gaussian blur (sigma=3.0) to a 4096×4096 grayscale image 5 times. Key avenues: separable filter decomposition, SIMD/AVX2, cache-friendly access.

sota:Claude-Opus-4.6
12.0s→0.25s

hash_join

C
mediumruntime

Optimize a C hash join between a 20K-row build table and 5M-row probe table. Replace the O(R×S) nested-loop baseline with an open-addressing hash table.

sota:Claude-Opus-4.6
20.0s→0.04s

regex_engine

Rust
expertruntime

Implement a fast regex engine in Rust that compiles patterns and searches 100,000 haystacks. Replace the recursive AST-walking NFA with a bytecode NFA using bitset-based active-state tracking.

sota:Claude-Opus-4.6
1.5s→0.37s

sstable_compaction_rs

Rust
hardruntime

Optimize an LSM-style SSTable compaction pipeline in Rust that merges prefix-compressed sorted tables, applies LSM visibility rules, and emits a new sorted output SSTable.

sota:Claude-Opus-4.6
0.099s→0.041s

radix_sort

C
mediumruntime

Sort 50 million random 32-bit unsigned integers in C as fast as possible. Replace the stdlib qsort baseline with a 2-pass LSD radix sort.

sota:Claude-Opus-4.6
4.5s→0.35s

sha256_throughput

C
expertruntime

Optimize SHA-256 in C to hash a 512 MiB buffer as fast as possible. Key optimization: runtime CPUID dispatch to Intel SHA-NI intrinsics.

sota:Claude-Opus-4.6
2.5s→0.15s