DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-17

kernel_fb_ratio · 837 of 1505 · 0 warnings
audit summary
{
  "date": "2026-04-17",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 1505,
  "render_records": 837,
  "test_rows": 74,
  "warnings": 0
}
16 commits on 2026-04-17
  1. 44cadfdb 05:30:53 sota_crawler research_brief: knowns / unknowns / goals + 10 research questions
  2. fe00657f 05:58:58 sota_crawler research_brief: Q1 spectral-norm design + Q4 quant diagnostic; SIREN chaos init gate
  3. f19a66b5 07:01:56 sota_crawler fused recurrence megakernel evening prep: deep-research ablation queue + v18-v21 scripts
  4. 8dbba84b 07:14:17 sota_crawler gitignore: exclude model weight artifacts and pod snapshots
  5. cf9f2998 07:14:23 sota_crawler Vortex kernel: NaN-safe tanh + head_dim parameterization
  6. e608f889 07:14:33 sota_crawler Vortex sweep launchers (v5-v17) + dim-576 attention-kernel body log archive
  7. 2bc65b07 07:14:42 sota_crawler Crawler rhythm recurrence vortex gate + v6 staging + attention-kernel-research
  8. f3b85bb3 07:59:25 parameter-golf-lab Update README.md
  9. 8825b6a7 16:18:21 parameter-golf-lab Inserted Dataset to download on README.md
  10. da487984 18:25:40 sota_crawler 4k SP BPE tokenizer: build package + G1-G7 validation (all PASS)
  11. 16cf4c5c 18:51:36 sota_crawler Preserve dim-576 attention-kernel body T2048 winner sweep evidence
  12. 16cf4c5c 18:51:36 SOTA_FINAL Preserve dim-576 attention-kernel body T2048 winner sweep evidence
  13. 16bdc9e5 01:47:38 sota_crawler Preserve dim-576 attention-kernel body T2048 2gpu breakthrough
  14. 16bdc9e5 01:47:38 SOTA_FINAL Preserve dim-576 attention-kernel body T2048 2gpu breakthrough
  15. ca865742 01:52:41 parameter-golf-lab Add FineWeb SP4096 tokenizer package
  16. 0d25820e 02:13:04 parameter-golf-lab Fix formatting in README.md
DATE2026-04-17
DAY031
PRIMARY METRICCUSTOM/FA3 FB RATIO
TESTS RUN74 kernel benchmarks
ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×71) · CRAWLER ABLATION CONTROL SET (×3)
CLASSIFICATIONKERNEL 100% (74)
ARCHITECTURE RECIPE
DIM-576 ATTENTION-KERNEL BODYx71

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136
KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3
PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor

SECTION 1.0 — TRAJECTORY

CUSTOM/FA3 FB RATIO for 2026-04-17 panel 1 of 2
csv data
CUSTOM/FA3 FB RATIO for 2026-04-17 panel 2 of 2
csv data
CUSTOM/FA3 FB RATIO SPREADnminmedianmaxdownload
DIM-576 ATTENTION-KERNEL BODY710.945×1.056×3.722×download
CRAWLER ABLATION CONTROL SET31.106×1.298×1.580×—
ALL VALID740.945×1.059×3.722×—

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 74

KERNEL TEST RUNS

74 kernel rows74 measuredmin 0.945× / median 1.059× / max 3.722×H100SOTA_FINAL