DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-13

val_bpb · 572 of 2188 · 0 warnings
{
  "date": "2026-04-13",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 2188,
  "render_records": 572,
  "test_rows": 2,
  "warnings": 0
}
34 commits on 2026-04-13
  1. 94393d71 05:06:46 sota_crawler rhythm recurrence: add 4F+4Cx2 graduated crawler test runner
  2. 94393d71 05:06:46 SOTA_FINAL rhythm recurrence: add 4F+4Cx2 graduated crawler test runner
  3. 99f883cc 05:34:07 sota_crawler rhythm recurrence: capture 4F+4Cx2 grad33 seed4 run metrics
  4. 99f883cc 05:34:07 SOTA_FINAL rhythm recurrence: capture 4F+4Cx2 grad33 seed4 run metrics
  5. b3ba49e6 06:19:44 sota_crawler rhythm recurrence: staged crawler schedule (delay 33%, ramp 33%)
  6. b3ba49e6 06:19:44 SOTA_FINAL rhythm recurrence: staged crawler schedule (delay 33%, ramp 33%)
  7. 8b5df728 14:31:14 sota_crawler Promote 12L GQA mixed-bit tower III.V qattn6 as legal SOTA
  8. 8b5df728 14:31:14 SOTA_FINAL Promote 12L GQA mixed-bit tower III.V qattn6 as legal SOTA
  9. 5c598b74 14:35:24 sota_crawler rhythm recurrence: capture legal 18.5M seed4 result block
  10. 5c598b74 14:35:24 SOTA_FINAL rhythm recurrence: capture legal 18.5M seed4 result block
  11. 7dca3ded 15:04:27 parameter-golf-lab add python-minifier dependency
  12. fb96363a 17:25:37 sota_crawler docs: add mandatory evidence protocol and references
  13. fb96363a 17:25:37 SOTA_FINAL docs: add mandatory evidence protocol and references
  14. 7dd98d49 17:55:31 sota_crawler rhythm recurrence: add 4F+3Cx2 staged d480 runner and dim sweep
  15. 7dd98d49 17:55:31 SOTA_FINAL rhythm recurrence: add 4F+3Cx2 staged d480 runner and dim sweep
  16. 1660ba44 18:33:11 sota_crawler rhythm recurrence: add crawler safety warmup for staged 4F+3Cx2 d480 run
  17. 1660ba44 18:33:11 SOTA_FINAL rhythm recurrence: add crawler safety warmup for staged 4F+3Cx2 d480 run
  18. cc829b52 18:50:11 sota_crawler rhythm recurrence: avoid Dynamo data-dependent guard in crawler scale gating
  19. cc829b52 18:50:11 SOTA_FINAL rhythm recurrence: avoid Dynamo data-dependent guard in crawler scale gating
  20. 5c65b981 18:53:18 sota_crawler rhythm recurrence: enforce FA3 head-size constraints and use safe dim defaults
  21. 5c65b981 18:53:18 SOTA_FINAL rhythm recurrence: enforce FA3 head-size constraints and use safe dim defaults
  22. f69a3c3a 19:08:54 sota_crawler rhythm recurrence: log 4F+3Cx2 staged d448 seed4 legal run results
  23. f69a3c3a 19:08:54 SOTA_FINAL rhythm recurrence: log 4F+3Cx2 staged d448 seed4 legal run results
  24. c075d357 19:38:29 sota_crawler rhythm recurrence: log d448 rerun (2026-04-13 19:24) from transcript
  25. c075d357 19:38:29 SOTA_FINAL rhythm recurrence: log d448 rerun (2026-04-13 19:24) from transcript
  26. 4bf44859 20:14:45 sota_crawler rhythm recurrence: add true crawler hard-skip + staged compute legacy fast2full runner
  27. 4bf44859 20:14:45 SOTA_FINAL rhythm recurrence: add true crawler hard-skip + staged compute legacy fast2full runner
  28. bb622b32 20:25:09 sota_crawler Add 12L GQA mixed-bit tower III.V v2 post-EMA GPTQ calibration leg
  29. bb622b32 20:25:09 SOTA_FINAL Add 12L GQA mixed-bit tower III.V v2 post-EMA GPTQ calibration leg
  30. ed6e0334 20:39:51 sota_crawler rhythm recurrence: add full-run legacy fast2full wrapper
  31. ed6e0334 20:39:51 SOTA_FINAL rhythm recurrence: add full-run legacy fast2full wrapper
  32. eb4fc073 02:55:28 sota_crawler Add multi-crawler descendant 4k ramp launchers (full 4x wrapper)
  33. eb4fc073 02:55:28 SOTA_FINAL Add multi-crawler descendant 4k ramp launchers (full 4x wrapper)
  34. afcde8bd 04:50:33 parameter-golf-lab Add phased global SGD TTT prefix submission
DATE2026-04-13
DAY027
PRIMARY METRICVAL_BPB
TESTS RUN2 unique (2 valid / 0 TTT leakage)
ARCHITECTURE FAMILY12L GQA MIXED-BIT TOWER (×2)
CLASSIFICATIONNEURAL 100% (2)
ARCHITECTURE RECIPE
12L GQA MIXED-BIT TOWERx2

12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging.

BODYnum_layers=12 · num_heads=8 · num_kv_heads=4 · rope_dims=16 · xsa_last_n=11 · BigramHash vocab=2048
QUANT / EVALattention int5 · mlp int6 · aux int6 · embed int8 · other int8 · Brotli artifact · 16 MB artifact cap
RUN SHAPE8xH100 · train_seq_len=2048 · eval_seq_len=2048 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-13
VAL_BPB SPREADnminmedianmaxdownload
12L GQA MIXED-BIT TOWER21.09161.09191.0923download
ALL VALID21.09161.09191.0923

SECTION 2.0 — TEST RUNS

NEURAL TEST RUNS — 2

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
104:448×H100full_seed444_20260413_044438.log1.0916OK↑2.3%
training_log
205:028×H100full_seed300_20260413_050254.log1.0923OK↑2.3%
training_log