DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-23

kernel_fb_ratio · 1425 of 1668 · 0 warnings
findings mentioning this date
- **Kernel-bench days** (2026-04-16…2026-04-23) — headline metric is `kernel_fb_ratio`. Audit confirms `kernel_metric_not_kernel_classified` count = 0; every kernel-headline row is camp=`kernel`.
audit summary
{
  "date": "2026-04-23",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 1668,
  "render_records": 1425,
  "test_rows": 3,
  "warnings": 0
}
6 commits on 2026-04-23
  1. a1e073e3 08:48:33 parameter-golf-lab feat(submission): PR #1736 + Polar Express NS + MIN_LR + Sparse Attn Gate + Fused CE — val_bpb 1.06378
  2. 7d3924d5 19:53:07 parameter-golf-lab Add run command (3-seed reproduction) to README
  3. b667ea25 20:10:38 parameter-golf-lab Add PR #1767 TTT improvements — 3-seed mean 1.06335 (was 1.06378)
  4. 2bd79161 22:03:06 parameter-golf-lab Record: 11L Muon TTT + Entropy-Adaptive Epochs (8xH100) — val_bpb 1.1179 (3-seed mean) (#1148)
  5. f56ef885 22:03:13 parameter-golf-lab Record: 1.1122 BPB — Coprime-Stride Loader + Full GPTQ + XSA-all (3-seed mean) (#1060)
  6. 8b148a09 22:03:27 parameter-golf-lab Record: Scylla + Full GPTQ + XSA-all + FA3 — val_bpb 0.9485 (3-seed mean) (#1184)
DATE2026-04-23
DAY037
PRIMARY METRICCUSTOM/FA3 FB RATIO
TESTS RUN3 kernel benchmarks
ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×3)
CLASSIFICATIONKERNEL 100% (3)
ARCHITECTURE RECIPE
DIM-576 ATTENTION-KERNEL BODYx3

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136
KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3
PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor

SECTION 1.0 — TRAJECTORY

CUSTOM/FA3 FB RATIO for 2026-04-23
csv data
CUSTOM/FA3 FB RATIO SPREADnminmedianmaxdownload
DIM-576 ATTENTION-KERNEL BODY30.834×0.933×0.936×download
ALL VALID30.834×0.933×0.936×—

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 3

KERNEL TEST RUNS

3 kernel rows3 measuredmin 0.834× / median 0.933× / max 0.936×hardware mixedSOTA_FINAL