DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-16

kernel_fb_ratio · 1083 of 2149 · 0 warnings
findings mentioning this date
- **Kernel-bench days** (2026-04-16…2026-04-23) — headline metric is `kernel_fb_ratio`. Audit confirms `kernel_metric_not_kernel_classified` count = 0; every kernel-headline row is camp=`kernel`.
audit summary
{
  "date": "2026-04-16",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 2149,
  "render_records": 1083,
  "test_rows": 81,
  "warnings": 0
}
22 commits on 2026-04-16
  1. bfb2e128 12:22:35 parameter-golf-lab RECORD: SmearGate + Attention Output Gate + Legal TTT | val_bpb=1.07139
  2. 076ad6ca 12:39:37 parameter-golf-lab Update README.md
  3. b7a65b94 17:53:29 sota_crawler dim-576 attention-kernel body kernel: Triton fwd + FA3 bwd hybrid beats FA3 on production shapes
  4. b7a65b94 17:53:29 SOTA_FINAL dim-576 attention-kernel body kernel: Triton fwd + FA3 bwd hybrid beats FA3 on production shapes
  5. ecd35a81 18:39:18 sota_crawler Vortex split-head crawler scale gate fused kernel: fwd/bwd + autoresearch + T×depth effective potential
  6. c0d48661 19:20:49 sota_crawler dim-576 attention-kernel body bwd: pure-Triton reaches parity with FA3 via inline-Delta
  7. c0d48661 19:20:49 SOTA_FINAL dim-576 attention-kernel body bwd: pure-Triton reaches parity with FA3 via inline-Delta
  8. a5742928 19:46:36 sota_crawler Vortex split-head crawler scale gate bwd: K-parallel dK/dV + A_i cache
  9. ea0e603c 19:55:38 sota_crawler Vortex bwd: collapse mixer softmax Jacobian to a single expression
  10. ca25e4fe 20:09:47 sota_crawler dim-576 attention-kernel body bwd: on-device TMA variant (opt-in); goal not met
  11. ca25e4fe 20:09:47 SOTA_FINAL dim-576 attention-kernel body bwd: on-device TMA variant (opt-in); goal not met
  12. f79d5930 20:24:11 sota_crawler dim-576 attention-kernel body bwd profile: ncu blocked; kineto reveals 157us GPU gap to FA3
  13. f79d5930 20:24:11 SOTA_FINAL dim-576 attention-kernel body bwd profile: ncu blocked; kineto reveals 157us GPU gap to FA3
  14. 2e07aea4 20:38:41 sota_crawler dim-576 attention-kernel body fwd: add opt-in TMA kernel; confirms Triton 3.6 ceiling at 72us
  15. 2e07aea4 20:38:41 SOTA_FINAL dim-576 attention-kernel body fwd: add opt-in TMA kernel; confirms Triton 3.6 ceiling at 72us
  16. 3c1f6c8e 20:41:29 sota_crawler Vortex split-head crawler scale gate: v3 T\u00d7depth sweep (post-Jacobian-fix champion)
  17. 9702da27 20:49:02 sota_crawler Vortex bwd: gate dW/dscalars atomics on CHAOS_DEPTH > 0
  18. 67ab894f 21:31:24 sota_crawler Vortex split-head crawler scale gate: clean serial T×depth sweeps + FWD_NUM_STAGES=3 champion
  19. 5267399a 01:55:27 sota_crawler dim-576 attention-kernel body fwd: BM=192 autotune + bwd autotune-expand + early-exit + bench harness
  20. 5267399a 01:55:27 SOTA_FINAL dim-576 attention-kernel body fwd: BM=192 autotune + bwd autotune-expand + early-exit + bench harness
  21. 2d49d147 02:29:38 sota_crawler dim-576 attention-kernel body fwd: causal-split refactor lands -19% at (2,4096) - real long-T win
  22. 2d49d147 02:29:38 SOTA_FINAL dim-576 attention-kernel body fwd: causal-split refactor lands -19% at (2,4096) - real long-T win
DATE2026-04-16
DAY030
PRIMARY METRICCUSTOM/FA3 FB RATIO
TESTS RUN81 kernel benchmarks
ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×79) · CRAWLER ABLATION CONTROL SET (×2)
CLASSIFICATIONKERNEL 100% (81)
ARCHITECTURE RECIPE
DIM-576 ATTENTION-KERNEL BODYx79

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136
KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3
PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor

SECTION 1.0 — TRAJECTORY

CUSTOM/FA3 FB RATIO for 2026-04-16
csv data
CUSTOM/FA3 FB RATIO SPREADnminmedianmaxdownload
DIM-576 ATTENTION-KERNEL BODY790.948×1.446×3.246×download
CRAWLER ABLATION CONTROL SET21.134×1.330×1.526×—
ALL VALID810.948×1.446×3.246×—

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 81

KERNEL TEST RUNS

81 kernel rows81 measuredmin 0.948× / median 1.446× / max 3.246×H100SOTA_FINAL