DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-03

val_bpb · 179 of 191 · 5 warnings
findings mentioning this date
| 2026-04-03 | 5 | 26 |
audit summary
{
  "date": "2026-04-03",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 191,
  "render_records": 179,
  "test_rows": 26,
  "warnings": 5
}
101 commits on 2026-04-03
  1. e1cf90a3 05:33:39 parameter-golf-lab Record: MuonEq-R + Depth Recurrence + WD=0.090 + All-Int6 — val_bpb 1.0912 (3-seed mean)
  2. e1cf90a3 05:33:39 sota_crawler Record: MuonEq-R + Depth Recurrence + WD=0.090 + All-Int6 — val_bpb 1.0912 (3-seed mean)
  3. e1cf90a3 05:33:39 SOTA_FINAL Record: MuonEq-R + Depth Recurrence + WD=0.090 + All-Int6 — val_bpb 1.0912 (3-seed mean)
  4. 9a8da75b 05:36:57 parameter-golf-lab Add SLOT-tuned transformer body IV submission — 1.09626897 BPB, 15.5MB
  5. decff737 15:54:00 parameter-golf-lab Log split-head crawler scale gate micro test findings — dim=64 is the breakout signal
  6. decff737 15:54:00 sota_crawler Log split-head crawler scale gate micro test findings — dim=64 is the breakout signal
  7. decff737 15:54:00 SOTA_FINAL Log split-head crawler scale gate micro test findings — dim=64 is the breakout signal
  8. ed973012 16:01:37 parameter-golf-lab split-head crawler scale gate micro suite 2: push dim ceiling, marco-polo, depth scaling (22 arms)
  9. ed973012 16:01:37 sota_crawler split-head crawler scale gate micro suite 2: push dim ceiling, marco-polo, depth scaling (22 arms)
  10. ed973012 16:01:37 SOTA_FINAL split-head crawler scale gate micro suite 2: push dim ceiling, marco-polo, depth scaling (22 arms)
  11. 979f7907 17:35:28 parameter-golf-lab Add 9-flat plus 1-crawler loop body crawler research (non-record) — 1.1364 BPB, 15.05MB
  12. 979f7907 17:35:28 sota_crawler Add 9-flat plus 1-crawler loop body crawler research (non-record) — 1.1364 BPB, 15.05MB
  13. b5137d65 19:39:59 parameter-golf-lab Add split-head crawler scale gate: flat layer depth recurrence + crawler interaction tests
  14. b5137d65 19:39:59 sota_crawler Add split-head crawler scale gate: flat layer depth recurrence + crawler interaction tests
  15. b5137d65 19:39:59 SOTA_FINAL Add split-head crawler scale gate: flat layer depth recurrence + crawler interaction tests
  16. 995d9dbd 20:04:03 parameter-golf-lab Ablation 2k gate: qk4, depth_recur, muoneq_r — 3 arms vs SLOT-tuned transformer body IV
  17. 995d9dbd 20:04:03 sota_crawler Ablation 2k gate: qk4, depth_recur, muoneq_r — 3 arms vs SLOT-tuned transformer body IV
  18. 995d9dbd 20:04:03 SOTA_FINAL Ablation 2k gate: qk4, depth_recur, muoneq_r — 3 arms vs SLOT-tuned transformer body IV
  19. 17df7650 20:27:41 parameter-golf-lab split-head crawler scale gate: recalibrate micro suite for 4×H100
  20. 17df7650 20:27:41 sota_crawler split-head crawler scale gate: recalibrate micro suite for 4×H100
  21. 17df7650 20:27:41 SOTA_FINAL split-head crawler scale gate: recalibrate micro suite for 4×H100
  22. 2cce9f0e 21:04:03 parameter-golf-lab Base model tuning sweep: 7 env-var arms vs SLOT-tuned transformer body IV
  23. 2cce9f0e 21:04:03 sota_crawler Base model tuning sweep: 7 env-var arms vs SLOT-tuned transformer body IV
  24. 2cce9f0e 21:04:03 SOTA_FINAL Base model tuning sweep: 7 env-var arms vs SLOT-tuned transformer body IV
  25. 4195a085 21:16:53 parameter-golf-lab Log split-head crawler scale gate suite 2 findings — dim=192 new champion, Marco-Polo broken
  26. 4195a085 21:16:53 sota_crawler Log split-head crawler scale gate suite 2 findings — dim=192 new champion, Marco-Polo broken
  27. 4195a085 21:16:53 SOTA_FINAL Log split-head crawler scale gate suite 2 findings — dim=192 new champion, Marco-Polo broken
  28. 2561ec7c 21:23:20 parameter-golf-lab Log 4×H100 depth recurrence findings + remaining arms script
  29. 2561ec7c 21:23:20 sota_crawler Log 4×H100 depth recurrence findings + remaining arms script
  30. 2561ec7c 21:23:20 SOTA_FINAL Log 4×H100 depth recurrence findings + remaining arms script
  31. ee9ec5ad 21:30:08 parameter-golf-lab Add Dark Horse: split-head crawler scale gate on PR #1296's competitive baseline
  32. ee9ec5ad 21:30:08 sota_crawler Add Dark Horse: split-head crawler scale gate on PR #1296's competitive baseline
  33. ee9ec5ad 21:30:08 SOTA_FINAL Add Dark Horse: split-head crawler scale gate on PR #1296's competitive baseline
  34. 48809144 21:35:58 parameter-golf-lab Dark Horse: add split-head crawler scale gate integration + A/B test script
  35. 48809144 21:35:58 sota_crawler Dark Horse: add split-head crawler scale gate integration + A/B test script
  36. 48809144 21:35:58 SOTA_FINAL Dark Horse: add split-head crawler scale gate integration + A/B test script
  37. 7d1f33e2 21:36:52 parameter-golf-lab Fix Dark Horse: ITERATIONS=2000 (was broken MAX_STEPS=500)
  38. 7d1f33e2 21:36:52 sota_crawler Fix Dark Horse: ITERATIONS=2000 (was broken MAX_STEPS=500)
  39. 7d1f33e2 21:36:52 SOTA_FINAL Fix Dark Horse: ITERATIONS=2000 (was broken MAX_STEPS=500)
  40. eac579b8 21:40:06 parameter-golf-lab Dark Horse: set RECUR_START_STEP=500 (proportional to 2k steps)
  41. eac579b8 21:40:06 sota_crawler Dark Horse: set RECUR_START_STEP=500 (proportional to 2k steps)
  42. eac579b8 21:40:06 SOTA_FINAL Dark Horse: set RECUR_START_STEP=500 (proportional to 2k steps)
  43. ef343803 21:47:46 parameter-golf-lab Dark Horse: use SP1024 (VOCAB_SIZE=1024) — testing architecture not tokenizer
  44. ef343803 21:47:46 sota_crawler Dark Horse: use SP1024 (VOCAB_SIZE=1024) — testing architecture not tokenizer
  45. ef343803 21:47:46 SOTA_FINAL Dark Horse: use SP1024 (VOCAB_SIZE=1024) — testing architecture not tokenizer
  46. fcebc097 22:00:06 parameter-golf-lab Dark Horse: split-head crawler scale gate on SLOT-tuned transformer body IV with cheap MLP crawler
  47. fcebc097 22:00:06 sota_crawler Dark Horse: split-head crawler scale gate on SLOT-tuned transformer body IV with cheap MLP crawler
  48. fcebc097 22:00:06 SOTA_FINAL Dark Horse: split-head crawler scale gate on SLOT-tuned transformer body IV with cheap MLP crawler
  49. 1a5fdc1e 22:16:52 parameter-golf-lab Add split-head crawler scale gate FlatServe: flat layers serve the crawler (14 arms)
  50. 1a5fdc1e 22:16:52 sota_crawler Add split-head crawler scale gate FlatServe: flat layers serve the crawler (14 arms)
  51. 1a5fdc1e 22:16:52 SOTA_FINAL Add split-head crawler scale gate FlatServe: flat layers serve the crawler (14 arms)
  52. 015b0a27 22:29:12 parameter-golf-lab SLOT-tuned transformer body V: MuonEq-R + QK_GAIN 5.0 + NS7 — stacked free wins
  53. 015b0a27 22:29:12 sota_crawler SLOT-tuned transformer body V: MuonEq-R + QK_GAIN 5.0 + NS7 — stacked free wins
  54. 015b0a27 22:29:12 SOTA_FINAL SLOT-tuned transformer body V: MuonEq-R + QK_GAIN 5.0 + NS7 — stacked free wins
  55. 54628a5e 22:40:09 parameter-golf-lab SLOT-tuned transformer body V: add SLOT 32 (from 24) — use eval time headroom
  56. 54628a5e 22:40:09 sota_crawler SLOT-tuned transformer body V: add SLOT 32 (from 24) — use eval time headroom
  57. 54628a5e 22:40:09 SOTA_FINAL SLOT-tuned transformer body V: add SLOT 32 (from 24) — use eval time headroom
  58. 624cf746 23:03:40 parameter-golf-lab Quant calibration sweep: 13 configs, single GPU, ~3 min total
  59. 624cf746 23:03:40 sota_crawler Quant calibration sweep: 13 configs, single GPU, ~3 min total
  60. 624cf746 23:03:40 SOTA_FINAL Quant calibration sweep: 13 configs, single GPU, ~3 min total
  61. 9cadcab5 23:06:56 parameter-golf-lab Fix quant_sweep: correct build_sentencepiece_luts signature
  62. 9cadcab5 23:06:56 sota_crawler Fix quant_sweep: correct build_sentencepiece_luts signature
  63. 9cadcab5 23:06:56 SOTA_FINAL Fix quant_sweep: correct build_sentencepiece_luts signature
  64. 16e0b8f2 23:09:09 parameter-golf-lab Fix quant_sweep: use proper shard loader (skip headers)
  65. 16e0b8f2 23:09:09 sota_crawler Fix quant_sweep: use proper shard loader (skip headers)
  66. 16e0b8f2 23:09:09 SOTA_FINAL Fix quant_sweep: use proper shard loader (skip headers)
  67. 256031b3 23:36:55 parameter-golf-lab SLOT-tuned transformer body V.1: Bank QAT stabilization from crawler track
  68. 256031b3 23:36:55 sota_crawler SLOT-tuned transformer body V.1: Bank QAT stabilization from crawler track
  69. 256031b3 23:36:55 SOTA_FINAL SLOT-tuned transformer body V.1: Bank QAT stabilization from crawler track
  70. 59a4ab84 23:52:26 parameter-golf-lab gdn implementation
  71. 095f9df9 02:15:49 parameter-golf-lab SLOT-tuned transformer body V.1: add EVAL_ONLY mode for SLOT LR sweep
  72. 095f9df9 02:15:49 sota_crawler SLOT-tuned transformer body V.1: add EVAL_ONLY mode for SLOT LR sweep
  73. 095f9df9 02:15:49 SOTA_FINAL SLOT-tuned transformer body V.1: add EVAL_ONLY mode for SLOT LR sweep
  74. 5d8f8d5d 02:29:14 parameter-golf-lab Add split-head crawler scale gate SplitHead: split-head cross-attention + 30-arm ablation suite
  75. 5d8f8d5d 02:29:14 sota_crawler Add split-head crawler scale gate SplitHead: split-head cross-attention + 30-arm ablation suite
  76. 5d8f8d5d 02:29:14 SOTA_FINAL Add split-head crawler scale gate SplitHead: split-head cross-attention + 30-arm ablation suite
  77. 847486c2 02:31:23 parameter-golf-lab SplitHead: add 4-GPU parallel ablation script (30 arms, ~40 min)
  78. 847486c2 02:31:23 sota_crawler SplitHead: add 4-GPU parallel ablation script (30 arms, ~40 min)
  79. 847486c2 02:31:23 SOTA_FINAL SplitHead: add 4-GPU parallel ablation script (30 arms, ~40 min)
  80. dded94d6 02:58:22 parameter-golf-lab SLOT-tuned transformer body V.2: SLOT_LR 0.005 → 0.05 — tuned from sweep
  81. dded94d6 02:58:22 sota_crawler SLOT-tuned transformer body V.2: SLOT_LR 0.005 → 0.05 — tuned from sweep
  82. dded94d6 02:58:22 SOTA_FINAL SLOT-tuned transformer body V.2: SLOT_LR 0.005 → 0.05 — tuned from sweep
  83. 11c71715 03:01:49 parameter-golf-lab Log SplitHead findings: full cross-attention + dim=192 = -0.078 BPB
  84. 11c71715 03:01:49 sota_crawler Log SplitHead findings: full cross-attention + dim=192 = -0.078 BPB
  85. 11c71715 03:01:49 SOTA_FINAL Log SplitHead findings: full cross-attention + dim=192 = -0.078 BPB
  86. 17ecdda9 03:39:40 parameter-golf-lab BW XII gate: split-head crawler scale gate SplitHead vs control, 2k steps, production scale
  87. 17ecdda9 03:39:40 sota_crawler BW XII gate: split-head crawler scale gate SplitHead vs control, 2k steps, production scale
  88. 17ecdda9 03:39:40 SOTA_FINAL BW XII gate: split-head crawler scale gate SplitHead vs control, 2k steps, production scale
  89. 4f5d0992 03:42:10 parameter-golf-lab Add BW XII — split-head crawler scale gate SplitHead production leg
  90. 4f5d0992 03:42:10 sota_crawler Add BW XII — split-head crawler scale gate SplitHead production leg
  91. 4f5d0992 03:42:10 SOTA_FINAL Add BW XII — split-head crawler scale gate SplitHead production leg
  92. dadc3a06 03:58:31 parameter-golf-lab SLOT-tuned transformer body V.3: SLOT_LR=0.04 — confirmed peak from sweep
  93. dadc3a06 03:58:31 sota_crawler SLOT-tuned transformer body V.3: SLOT_LR=0.04 — confirmed peak from sweep
  94. dadc3a06 03:58:31 SOTA_FINAL SLOT-tuned transformer body V.3: SLOT_LR=0.04 — confirmed peak from sweep
  95. 82618b60 04:06:58 parameter-golf-lab docs: add mergeability report and PR template
  96. 82618b60 04:06:58 sota_crawler docs: add mergeability report and PR template
  97. 82618b60 04:06:58 SOTA_FINAL docs: add mergeability report and PR template
  98. 8f1d8d97 04:13:07 parameter-golf-lab SLOT-tuned transformer body V.2: SLOT_LR 0.05 → 0.04 (sweep peak)
  99. 8f1d8d97 04:13:07 sota_crawler SLOT-tuned transformer body V.2: SLOT_LR 0.05 → 0.04 (sweep peak)
  100. 8f1d8d97 04:13:07 SOTA_FINAL SLOT-tuned transformer body V.2: SLOT_LR 0.05 → 0.04 (sweep peak)
  101. 6a9158b1 04:50:02 parameter-golf-lab Add SLOT-tuned transformer body V submission — 1.0875 BPB, 15.5MB
DATE2026-04-03
DAY017
PRIMARY METRICVAL_BPB
TESTS RUN26 unique (24 valid / 0 TTT leakage)
ARCHITECTURE FAMILYSPLIT-HEAD CRAWLER SCALE GATE (×20) · SLOT-TUNED TRANSFORMER BODY (×3) · 9-FLAT PLUS 1-CRAWLER LOOP BODY (×2) · CRAWLER ABLATION CONTROL SET (×1)
CLASSIFICATIONEXPERIMENTAL 96% (25)/NEURAL 4% (1)
ARCHITECTURE RECIPE
9-FLAT + 1-CRAWLER LOOP BODYx2

9-flat plus 1-crawler loop body: flat U-Net context around a shared crawler block fired twice.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · NUM_FLAT_LAYERS=9 · NUM_CRAWLER_LAYERS=1 · CRAWLER_LOOPS=2 · USE_CRAWLER=1
CRAWLERCRAWLER_MLP_MULT=6.0 · INST_DIM=32 · CRAWLER_MLP_CHOKE_DIM=0 · CRAWLER_LOOP_ROPE_SCALES=9,1,1 · CRAWLER_MLP_LEAKY_SLOPE=0.5
PACKAGINGLOOP_AWARE_GPTQ=1 · BigramHash 2048x128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-03 panel 1 of 2
csv data
VAL_BPB for 2026-04-03 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
SPLIT-HEAD CRAWLER SCALE GATE181.84901.92042.1172download
SLOT-TUNED TRANSFORMER BODY31.08751.08751.0963—
9-FLAT PLUS 1-CRAWLER LOOP BODY21.13641.13641.1364download
CRAWLER ABLATION CONTROL SET11.08971.08971.0897—
ALL VALID241.08751.90922.1172—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 25

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
103:58—SLOT-tuned transformer body V.3: SLOT_LR=0.04 — confirmed peak from sweep (×3)1.0875OK↑1.9%
details
311:171×GB10X1_ctrl_5flat_1loop_s444_20260403_111723.log1.9279OK↑80.6%
training_log
411:171×GB10H3_dim192_s1_s444_20260403_111723.log1.8490OK↑73.3%
training_log
511:171×GB10M4_marco_dim128_s444_20260403_111723.log2.1172OK↑98.4%
training_log
611:171×GB10K2_7f_marco_dim64_s444_20260403_111723.log8.3699CRASH—
training_log
711:171×GB10J1_s5_dim128_s444_20260403_111723.log1.9285OK↑80.7%
training_log
811:171×GB10K1_7f_dim64_s3_s444_20260403_111723.log1.9139OK↑79.3%
training_log
911:171×GB10K0_7f_dim64_s444_20260403_111723.log1.8870OK↑76.8%
training_log
1011:171×GB10M1_marco_dim32_s444_20260403_111723.log1.9193OK↑79.8%
training_log
1111:171×GB10H1_dim96_s1_s444_20260403_111723.log1.8635OK↑74.6%
training_log
1211:171×GB10J2_s3_dim64_s444_20260403_111723.log1.9323OK↑81.1%
training_log
1311:171×GB10H2_dim128_s1_s444_20260403_111723.log1.8717OK↑75.4%
training_log
1411:171×GB10H0_dim64_s1_s444_20260403_111723.log1.8768OK↑75.9%
training_log
1511:171×GB10M2_marco_dim64_s444_20260403_111723.log2.0323OK↑90.4%
training_log
1611:171×GB10X0_ctrl_7flat_2loop_s444_20260403_111723.log1.9187OK↑79.8%
training_log
1711:171×GB10K4_9f_marco_dim64_s444_20260403_111723.log9.4514CRASH—
training_log
1811:171×GB10M3_marco_dim64_s5_s444_20260403_111723.log1.9414OK↑81.9%
training_log
1911:171×GB10J3_s3_dim128_s444_20260403_111723.log1.9229OK↑80.2%
training_log
2011:171×GB10J0_s5_dim64_s444_20260403_111723.log1.9325OK↑81.1%
training_log
2111:171×GB10M0_marco_dim16_s444_20260403_111723.log1.9215OK↑80.1%
training_log
2211:171×GB10K3_9f_dim64_s444_20260403_111723.log1.9046OK↑78.5%
training_log
2313:46—9-flat plus 1-crawler loop body1.1364OK↑6.5%
details
2417:35—Add 9-flat plus 1-crawler loop body crawler research (non-record) — 1.1364 BP…1.1364OK↑6.5%
details
2521:30—Add Dark Horse: split-head crawler scale gate on PR #1296's competitive basel…1.0897OK↑2.1%
details
2622:00—Dark Horse: split-head crawler scale gate on SLOT-tuned transformer body IV w…1.0963OK↑2.7%
details

NEURAL TEST RUNS — 1

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
204:50—Add SLOT-tuned transformer body V submission — 1.0875 BPB, 15.5MB1.0875OK↑1.9%
details