DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-18

kernel_fb_ratio · 2421 of 2560 · 0 warnings
audit summary
{
  "date": "2026-04-18",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 2560,
  "render_records": 2421,
  "test_rows": 1282,
  "warnings": 0
}
2 commits on 2026-04-18
  1. e9a2b74a 15:34:29 sota_crawler Vortex v22-v51 sweep suite + kernel single-knob probe (v51)
  2. 59b55a5d 02:12:15 parameter-golf-lab Record: CaseOps Tokenizer + Tapered WD - val_bpb 1.0678 (3-seed mean)
DATE2026-04-18
DAY032
PRIMARY METRICCUSTOM/FA3 FB RATIO
TESTS RUN1282 kernel benchmarks
ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×1145) · STAGED ATTENTION-KERNEL BENCH (×137)
CLASSIFICATIONKERNEL 100% (1282)
ARCHITECTURE RECIPE
DIM-576 ATTENTION-KERNEL BODYx1145

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136
KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3
PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor
STAGED HYBRID BENCHx137

Attention-kernel sweep comparing staged primary/fallback kernels against hybridA/hybridB variants.

KERNEL SHAPEseq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom/FA3 fb ratio target
TILE SWEEPDQ=128,64,8,2 · DQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV=128,128,8,3 · QMR sweep=768..2304
MODESstaged_primary_vs_hybridB · staged_fallback_vs_hybridA · g0/g1 GPU lane split · kernel watchdog benchmark

SECTION 1.0 — TRAJECTORY

CUSTOM/FA3 FB RATIO for 2026-04-18 panel 1 of 2
csv data
CUSTOM/FA3 FB RATIO for 2026-04-18 panel 2 of 2
csv data
CUSTOM/FA3 FB RATIO SPREADnminmedianmaxdownload
DIM-576 ATTENTION-KERNEL BODY11450.748×0.952×2.599×download
STAGED ATTENTION-KERNEL BENCH1370.776×0.952×1.029×download
ALL VALID12820.748×0.952×2.599×—

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 1282

KERNEL TEST RUNS

1282 kernel rows1282 measuredmin 0.748× / median 0.952× / max 2.599×H100SOTA_FINAL