DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-26

val_bpb · 474 of 1944 · 5 warnings
findings mentioning this date
| 2026-04-26 | 5 | 6 |
- **date:** 2026-04-26
  - **exact evidence:** audit JSON `warning_samples` filtered to date `2026-04-26` shows 5 entries; total `test_rows = 6` for Apr 26 in `day_summaries`.
audit summary
{
  "date": "2026-04-26",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 1944,
  "render_records": 474,
  "test_rows": 6,
  "warnings": 5
}
20 commits on 2026-04-26
  1. 936569ef 17:08:48 sota_crawler Add dim-576 attention-kernel body donor research bundle
  2. 936569ef 17:08:48 SOTA_FINAL Add dim-576 attention-kernel body donor research bundle
  3. f5c435eb 18:56:04 pg_whale Initial: sealed 4x-mechanics leg + dim-576 attention-kernel body donor research bundle
  4. e5f478ab 20:08:35 sota_rascal init 11L GQA U-Net body
  5. e5f478ab 20:08:35 rascal-private init 11L GQA U-Net body
  6. aa471539 20:44:52 sota_rascal seed repo: 4xgpu control + anchor + leaderboard rules
  7. 1cc5cc06 20:55:13 sota_rascal 12L GQA mixed-bit tower: fix invalid-line reporting bug + add 4xgpu variant
  8. 7f646cd1 20:56:48 sota_rascal restructure: control -> control_NOCHANGE; add 4k_vocab_lib; 4k_vocab_11L GQA U-Net body naming
  9. 3133b69b 02:36:27 sota_rascal Lab session 2026-04-26 → 2026-04-27: 4K vocab paydirt + salvage variants
  10. b24165c8 02:50:38 sota_rascal compact tokenizer body
  11. 37fe6ab2 02:59:54 sota_rascal compact tokenizer body seed 42
  12. 2e2e3afd 03:14:21 sota_rascal compact tokenizer body seed 300 (3-seed mean 0.87206316)
  13. 4af4ffbb 03:18:30 sota_rascal compact tokenizer body submission: submission.json + 3 seed logs
  14. 8fdd3a74 03:18:41 sota_rascal compact tokenizer body: 3 seed logs
  15. 7c2d7952 03:20:13 parameter-golf-lab compact tokenizer body (val_bpb 0.87206 mean across 3 seeds, 13.49MB)
  16. 1a1c0559 04:13:41 sota_rascal looped tokenizer body (val_bpb 0.86548 mean across 3 seeds, 15.65MB legal)
  17. d40c392e 04:18:09 sota_rascal looped tokenizer body: technique_summary
  18. fc52e361 04:18:55 sota_rascal looped tokenizer body: blank technique_summary
  19. 5626bbe7 04:23:16 parameter-golf-lab looped tokenizer body (val_bpb 0.86548 mean across 3 seeds, 15.65MB)
  20. db83141f 04:26:47 sota_rascal checkpoint: looped tokenizer body shipped as new SOTA (PR #1848, val_bpb 0.86548)
DATE2026-04-26
DAY040
PRIMARY METRICVAL_BPB
TESTS RUN6 unique (1 valid / 5 TTT leakage)
ARCHITECTURE FAMILYLOOPED TOKENIZER BODY (×2) · 11L GQA U-NET BODY (×1) · LEADERBOARD TRANSFORMER VARIANTS (×1) · PARALLEL RESIDUAL TRANSFORMER VARIANT (×1) · OTHER (×1)
CLASSIFICATIONEXPERIMENTAL 33% (2)/NEURAL 67% (4)
ARCHITECTURE RECIPE
11L GQA U-NET BODYx1

11-layer dim-512 GQA U-Net transformer base with XSA, BigramHash, value embedding, and SmearGate.

BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · head_dim=64 · mlp_mult=3.0 · tie_embeddings=1
STRUCTUREencoder_layers=5 · decoder_layers=6 · skip_weights=5 · GQA attention · RMSNorm · relu_sq MLP · Muon matrix optimizer path
FEATURESBigramHash vocab=2048 dim=128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10 · SmearGate · logit_softcap=30

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-26 panel 1 of 2
csv data
VAL_BPB for 2026-04-26 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
PARALLEL RESIDUAL TRANSFORMER VARIANT11.07291.07291.0729—
ALL VALID11.07291.07291.0729—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 2

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
203:20—compact tokenizer body (val_bpb 0.87206 mean across 3 seeds, 13.49MB)0.8721INVALID—
details
404:23—looped tokenizer body (val_bpb 0.86548 mean across 3 seeds, 15.65MB)0.8655INVALID—
details

NEURAL TEST RUNS — 4

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
102:36—Lab session 2026-04-26 → 2026-04-27: 4K vocab paydirt + salvage variants0.8672INVALID—
details
304:13—looped tokenizer body (val_bpb 0.86548 mean across 3 seeds, 15.65MB legal)0.8655INVALID—
details
504:26—checkpoint: looped tokenizer body shipped as new SOTA (PR #1848, val_bpb 0.86…0.8655INVALID—
details
614:37—SP8192 + 3-Layer Recurrence + Parallel Residuals + QK-Gain 5.25 + Score-First…1.0729OK↑0.5%
details