DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-19

kernel_fb_ratio · 1474 of 1789 · 0 warnings

audit summary

{
  "date": "2026-04-19",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 1789,
  "render_records": 1474,
  "test_rows": 1289,
  "warnings": 0
}

1 commits on 2026-04-19

e100586d 09:55:22 parameter-golf-lab Record: SP8192 + CaseOps + GatedAttn + QuantGate + Loop45 + PhasedTTT — val_bpb 1.06549

DATE2026-04-19

DAY033

PRIMARY METRICCUSTOM/FA3 FB RATIO

TESTS RUN1289 kernel benchmarks

ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×910) · STAGED ATTENTION-KERNEL BENCH (×379)

CLASSIFICATIONKERNEL 100% (1289)

ARCHITECTURE RECIPE

DIM-576 ATTENTION-KERNEL BODYx910

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136

KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3

PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor

STAGED HYBRID BENCHx379

Attention-kernel sweep comparing staged primary/fallback kernels against hybridA/hybridB variants.

KERNEL SHAPEseq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom/FA3 fb ratio target

TILE SWEEPDQ=128,64,8,2 · DQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV=128,128,8,3 · QMR sweep=768..2304

MODESstaged_primary_vs_hybridB · staged_fallback_vs_hybridA · g0/g1 GPU lane split · kernel watchdog benchmark

SECTION 1.0 — TRAJECTORY

DAILY SUMMARY

Kernel work: DIM-576 ATTENTION-KERNEL BODY (x910): A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3. Specs: num_layers=12; model_dim=576; embedding_dim=576; head_dim=64; matrix_bits=5; batch=2. STAGED HYBRID BENCH (x379): Attention-kernel sweep comparing staged primary/fallback kernels against hybridA/hybridB variants. Specs: head_dim=64; seq_len=2048; q_heads=8; kv_heads=4; custom/FA3 fb ratio target.

Day 033 measured 1289 kernel benchmarks against CUSTOM/FA3 FB RATIO, with 1289 custom-kernel-vs-FA3 timing rows. Techniques to copy/reference: custom attention path compared directly to FA3; custom/FA3 fb ratio target.

No new personal best. Best of the day = 0.794× (p175_overnight_fallback_vs_hybridB_04_g0_dq128_64_8_2_dkdv12); best-before-today = 0.748× still stands.

CUSTOM/FA3 FB RATIO for 2026-04-19 panel 1 of 2 — csv data

CUSTOM/FA3 FB RATIO for 2026-04-19 panel 2 of 2 — csv data

CUSTOM/FA3 FB RATIO SPREAD	n	min	median	max	download
DIM-576 ATTENTION-KERNEL BODY	910	0.806×	0.957×	1.210×	download
STAGED ATTENTION-KERNEL BENCH	379	0.794×	0.956×	1.369×	download
ALL VALID	1289	0.794×	0.957×	1.369×	—

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 1289

KERNEL TEST RUNS

1289 kernel rows1289 measuredmin 0.794× / median 0.957× / max 1.369×H100SOTA_FINAL