2026-04-21 — Research Day

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-21

kernel_fb_ratio · 212 of 434 · 0 warnings

audit summary

{
  "date": "2026-04-21",
  "fatal": 0,
  "headline_metric": "kernel_fb_ratio",
  "raw_records": 434,
  "render_records": 212,
  "test_rows": 7,
  "warnings": 0
}

1 commits on 2026-04-21

5bbb5574 03:35:45 parameter-golf-lab feat(submission): SP8192 CaseOps stack with MLP clip 10→12 retune

DATE2026-04-21

DAY035

PRIMARY METRICCUSTOM/FA3 FB RATIO

TESTS RUN7 kernel benchmarks

ARCHITECTURE FAMILYDIM-576 ATTENTION-KERNEL BODY (×7)

CLASSIFICATIONKERNEL 100% (7)

ARCHITECTURE RECIPE

DIM-576 ATTENTION-KERNEL BODYx7

A 12-layer dim-576 model body plus the custom attention-kernel benchmark shape used against FA3.

MODEL BODYnum_layers=12 · model_dim=576 · embedding_dim=576 · matrix_bits=5 · xsa_last_n=11 · parallel_residual_start=8 · model_params=48551136

KERNEL SHAPEbatch=2 · seq_len=2048 · q_heads=8 · kv_heads=4 · head_dim=64 · custom attention path compared directly to FA3

PROMOTED KERNELDQ=128,64,8,5 · DKDV=128,64,8,3 · DKDV_MAXNREG=256 · QMR=1984 for 2x primary · QMR=1664 single-GPU anchor

CUSTOM/FA3 FB RATIO SPREAD	n	min	median	max	download
DIM-576 ATTENTION-KERNEL BODY	7	0.834×	2.431×	2.824×	download
ALL VALID	7	0.834×	2.431×	2.824×	—

CUSTOM/FA3 FB RATIO SPREAD

min

median

max

download

DIM-576 ATTENTION-KERNEL BODY

0.834×

2.431×

2.824×

download

ALL VALID

0.834×

2.431×

2.824×

—

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-21

SECTION 1.0 — TRAJECTORY

SECTION 2.0 — TEST RUNS

KERNEL TEST RUNS — 7