DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-08

val_bpb · 173 of 1328 · 0 warnings
audit summary
{
  "date": "2026-04-08",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 1328,
  "render_records": 173,
  "test_rows": 16,
  "warnings": 0
}
53 commits on 2026-04-08
  1. a622d2e5 05:02:17 parameter-golf-lab Fix screen batch parser for non-gawk awk
  2. a622d2e5 05:02:17 sota_crawler Fix screen batch parser for non-gawk awk
  3. a622d2e5 05:02:17 SOTA_FINAL Fix screen batch parser for non-gawk awk
  4. 26b74692 05:04:10 parameter-golf-lab Reuse completed lanes in screen batch runs
  5. 26b74692 05:04:10 sota_crawler Reuse completed lanes in screen batch runs
  6. 26b74692 05:04:10 SOTA_FINAL Reuse completed lanes in screen batch runs
  7. 94cf4c4c 05:27:15 parameter-golf-lab Default Katta 1GPU sweeps to fast eval and parse roundtrip fallback
  8. 7d82d47d 05:27:15 parameter-golf-lab Default Katta 1GPU sweeps to fast eval and parse roundtrip fallback
  9. 94cf4c4c 05:27:15 sota_crawler Default Katta 1GPU sweeps to fast eval and parse roundtrip fallback
  10. 7d82d47d 05:27:15 sota_crawler Default Katta 1GPU sweeps to fast eval and parse roundtrip fallback
  11. 94cf4c4c 05:27:15 SOTA_FINAL Default Katta 1GPU sweeps to fast eval and parse roundtrip fallback
  12. d163f400 13:43:53 sota_nueral Add isolated smart U-Net routing ablations for 2k-step screens
  13. 5f6d0c28 13:47:45 parameter-golf-lab Add isolated smart U-Net routing ablations for 2k-step screens
  14. 5f6d0c28 13:47:45 sota_crawler Add isolated smart U-Net routing ablations for 2k-step screens
  15. 5f6d0c28 13:47:45 SOTA_FINAL Add isolated smart U-Net routing ablations for 2k-step screens
  16. 8168c16b 14:01:42 parameter-golf-lab Fix smart-U-Net batch parsing for ITERATIONS and stream lane logs
  17. 8168c16b 14:01:42 sota_crawler Fix smart-U-Net batch parsing for ITERATIONS and stream lane logs
  18. 8168c16b 14:01:42 SOTA_FINAL Fix smart-U-Net batch parsing for ITERATIONS and stream lane logs
  19. bc36fb32 14:15:20 parameter-golf-lab Tune smart routing sensitivity for actual decoder skipping
  20. bc36fb32 14:15:20 sota_crawler Tune smart routing sensitivity for actual decoder skipping
  21. bc36fb32 14:15:20 SOTA_FINAL Tune smart routing sensitivity for actual decoder skipping
  22. 91859c90 16:14:16 parameter-golf-lab Add 1200-step Smart U-Net build-signal runner
  23. 91859c90 16:14:16 sota_crawler Add 1200-step Smart U-Net build-signal runner
  24. 91859c90 16:14:16 SOTA_FINAL Add 1200-step Smart U-Net build-signal runner
  25. e3522672 16:42:47 parameter-golf-lab Harden smart U-Net build tests against compile and NCCL hangs
  26. e3522672 16:42:47 sota_crawler Harden smart U-Net build tests against compile and NCCL hangs
  27. e3522672 16:42:47 SOTA_FINAL Harden smart U-Net build tests against compile and NCCL hangs
  28. a119ed39 16:51:03 parameter-golf-lab Add crawler diff guard and repo skill
  29. a119ed39 16:51:03 sota_crawler Add crawler diff guard and repo skill
  30. 5e1fa354 16:51:46 parameter-golf-lab Make build-signal runner no-waste by default
  31. 5e1fa354 16:51:46 sota_crawler Make build-signal runner no-waste by default
  32. 5e1fa354 16:51:46 SOTA_FINAL Make build-signal runner no-waste by default
  33. fc9ebc95 17:07:33 parameter-golf-lab Print diff guard commands in new leg scaffold
  34. fc9ebc95 17:07:33 sota_crawler Print diff guard commands in new leg scaffold
  35. 5470a390 17:11:42 parameter-golf-lab Record: SP8192 + Parallel Residuals + Score-First TTT — val_bpb 1.0822 (3-seed mean)
  36. 5470a390 17:11:42 sota_crawler Record: SP8192 + Parallel Residuals + Score-First TTT — val_bpb 1.0822 (3-seed mean)
  37. 5470a390 17:11:42 SOTA_FINAL Record: SP8192 + Parallel Residuals + Score-First TTT — val_bpb 1.0822 (3-seed mean)
  38. 538c402b 17:59:28 parameter-golf-lab Add crawler diff guard and scaffold hook
  39. 538c402b 17:59:28 sota_crawler Add crawler diff guard and scaffold hook
  40. 538c402b 17:59:28 SOTA_FINAL Add crawler diff guard and scaffold hook
  41. 28edb0c1 19:48:26 parameter-golf-lab Housekeeping: sync crawler leader, science, and pipeline baselines
  42. 28edb0c1 19:48:26 sota_crawler Housekeeping: sync crawler leader, science, and pipeline baselines
  43. 28edb0c1 19:48:26 SOTA_FINAL Housekeeping: sync crawler leader, science, and pipeline baselines
  44. df59d965 21:07:19 parameter-golf-lab crawler variant: add economical 4x ablation + DGX smoke workflow and research matrix docs
  45. df59d965 21:07:19 sota_crawler crawler variant: add economical 4x ablation + DGX smoke workflow and research matrix docs
  46. df59d965 21:07:19 SOTA_FINAL crawler variant: add economical 4x ablation + DGX smoke workflow and research matrix docs
  47. e14e7925 21:20:33 parameter-golf-lab Add 12L GQA mixed-bit tower baseline mirror and 12L GQA mixed-bit tower ablation harness
  48. e14e7925 21:20:33 sota_crawler Add 12L GQA mixed-bit tower baseline mirror and 12L GQA mixed-bit tower ablation harness
  49. e14e7925 21:20:33 SOTA_FINAL Add 12L GQA mixed-bit tower baseline mirror and 12L GQA mixed-bit tower ablation harness
  50. ab15b6bc 00:50:13 sota_nueral Add 10-arm quant gap ablation series + Tier 4 concept scaffolds
  51. e4514342 01:41:11 parameter-golf-lab Crawler 9F corpus ablations v1: 16-arm mega-screen on 4xGPU @ 1500 steps
  52. e4514342 01:41:11 sota_crawler Crawler 9F corpus ablations v1: 16-arm mega-screen on 4xGPU @ 1500 steps
  53. e4514342 01:41:11 SOTA_FINAL Crawler 9F corpus ablations v1: 16-arm mega-screen on 4xGPU @ 1500 steps
DATE2026-04-08
DAY022
PRIMARY METRICVAL_BPB
TESTS RUN16 unique (8 valid / 0 TTT leakage)
ARCHITECTURE FAMILYCRAWLER-SAFE TRAIN/EVAL SURFACE (×5) · 12L GQA MIXED-BIT TOWER (×5) · OTHER (×4) · CRAWLER ABLATION CONTROL SET (×1) · COMPRESSION PACKAGING EXPERIMENT (×1)
CLASSIFICATIONEXPERIMENTAL 56% (9)/NEURAL 44% (7)
ARCHITECTURE RECIPE
CRAWLER-SAFE TRAIN/EVAL SURFACEx5

Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · shared crawler block · looped crawler passes
FEATURESBigramHash · XSA · RoPE · crawler loop rope scales · instruction bottleneck
QUANT / EVALint6 roundtrip · int6 sliding-window eval · int8 zlib roundtrip · 8xH100 · 600s wallclock
12L GQA MIXED-BIT TOWERx5

12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging.

BODYnum_layers=12 · num_heads=8 · num_kv_heads=4 · rope_dims=16 · xsa_last_n=11 · BigramHash vocab=2048
QUANT / EVALattention int5 · mlp int6 · aux int6 · embed int8 · other int8 · Brotli artifact · 16 MB artifact cap
RUN SHAPE8xH100 · train_seq_len=2048 · eval_seq_len=2048 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-08
csv data
VAL_BPB SPREADnminmedianmaxdownload
CRAWLER-SAFE TRAIN/EVAL SURFACE11.32921.32921.3292download
12L GQA MIXED-BIT TOWER51.10571.10601.4327download
OTHER21.32481.32671.3286—
ALL VALID81.10571.21561.4327—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 9

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
115:471×GB10crawler variant-02_smoke_s444_20260408_154713.log4.7563CRASH—
training_log
215:471×GB10crawler variant-00_smoke_s444_20260408_154713.log4.7275CRASH—
training_log
315:471×GB10crawler variant-03_smoke_s444_20260408_154713.log6.6782CRASH—
training_log
415:471×GB10crawler variant-01_smoke_s444_20260408_154713.log4.7673CRASH—
training_log
918:274×H100crawler_9f_gate.log1.3292OK↑24.5%
training_log
1220:174×H100 (runpod)warmdown_3000_seed444_20260408_201744.log1.4327OK↑34.3%
training_log
1320:578×H100train_seed300.log1.1058OK↑3.6%
training_log
1420:578×H100train_seed42.log1.1064OK↑3.7%
training_log
1620:578×H100train_seed444.log1.1057OK↑3.6%
training_log

NEURAL TEST RUNS — 7

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
518:274×H100ratio_balanced.log1.3248OK↑24.1%
training_log
618:274×H100chain_balanced_output.log4.1055CRASH—
training_log
718:274×H100overnight_run.log1.3286OK↑24.5%
training_log
818:274×H100quant_gap_series.log3.4345CRASH—
training_log
1018:274×H10039_v1_9_long-context causal tap mechanism compression packaging.log3.3369CRASH—
training_log
1118:274×H10040_v1_9_long-context causal tap mechanism compression packaging.log3.3407CRASH—
training_log
1520:57—12L GQA mixed-bit tower 12L1.1060OK↑3.6%
details