DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-30

val_bpb · 260 of 440 · 5 warnings
findings mentioning this date
| 2026-03-30 | 5 | 22 |
audit summary
{
  "date": "2026-03-30",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 440,
  "render_records": 260,
  "test_rows": 22,
  "warnings": 5
}
212 commits on 2026-03-30
  1. 6d67d690 11:18:15 parameter-golf-lab Update README
  2. e3ea22ad 13:29:23 parameter-golf-lab Update README
  3. 1d48f9cd 13:46:02 parameter-golf-lab Add instructed-recurrence crawler: byte-identical backup of instructed-recurrence crawler
  4. cacef5f6 13:46:02 parameter-golf-lab Add instructed-recurrence crawler: byte-identical backup of instructed-recurrence crawler
  5. 1d48f9cd 13:46:02 sota_crawler Add instructed-recurrence crawler: byte-identical backup of instructed-recurrence crawler
  6. cacef5f6 13:46:02 sota_crawler Add instructed-recurrence crawler: byte-identical backup of instructed-recurrence crawler
  7. 1d48f9cd 13:46:02 SOTA_FINAL Add instructed-recurrence crawler: byte-identical backup of instructed-recurrence crawler
  8. 9a15ace5 14:00:26 parameter-golf-lab Add ChopShop (cleaned 11L GQA U-Net body base) and 11L GQA U-Net body smoke test
  9. 9a15ace5 14:00:26 sota_crawler Add ChopShop (cleaned 11L GQA U-Net body base) and 11L GQA U-Net body smoke test
  10. 9a15ace5 14:00:26 SOTA_FINAL Add ChopShop (cleaned 11L GQA U-Net body base) and 11L GQA U-Net body smoke test
  11. fe54b758 14:13:40 parameter-golf-lab Add Crawler Leg 2 ablation: loops=3 + mlp=5.0 additivity test
  12. fe54b758 14:13:40 sota_crawler Add Crawler Leg 2 ablation: loops=3 + mlp=5.0 additivity test
  13. 964fd8bd 14:32:11 parameter-golf-lab Add all research data: experiments, records, scripts, Nitrust, octavian
  14. 964fd8bd 14:32:11 sota_crawler Add all research data: experiments, records, scripts, Nitrust, octavian
  15. 964fd8bd 14:32:11 SOTA_FINAL Add all research data: experiments, records, scripts, Nitrust, octavian
  16. 7de84028 14:49:04 parameter-golf-lab Crawler_Leg_2: 5-arm sweep combining loops=3 + mlp=5.0 wins
  17. 7de84028 14:49:04 sota_crawler Crawler_Leg_2: 5-arm sweep combining loops=3 + mlp=5.0 wins
  18. 7de84028 14:49:04 SOTA_FINAL Crawler_Leg_2: 5-arm sweep combining loops=3 + mlp=5.0 wins
  19. da7a6b0c 14:56:32 parameter-golf-lab flat+crawler tap-off body: remove NGRAM code, apply optimal CL1 config
  20. da7a6b0c 14:56:32 sota_crawler flat+crawler tap-off body: remove NGRAM code, apply optimal CL1 config
  21. da7a6b0c 14:56:32 SOTA_FINAL flat+crawler tap-off body: remove NGRAM code, apply optimal CL1 config
  22. d2d1ecdb 14:56:49 parameter-golf-lab 11L GQA U-Net body: implement TurboMuon + EngramLite + TTT + CROWN-Q
  23. d2d1ecdb 14:56:49 sota_crawler 11L GQA U-Net body: implement TurboMuon + EngramLite + TTT + CROWN-Q
  24. d2d1ecdb 14:56:49 SOTA_FINAL 11L GQA U-Net body: implement TurboMuon + EngramLite + TTT + CROWN-Q
  25. 2d7022b7 14:58:08 parameter-golf-lab Crawler_Leg_2: set wallclock to 350s (~4k steps on 8xH100)
  26. 2d7022b7 14:58:08 sota_crawler Crawler_Leg_2: set wallclock to 350s (~4k steps on 8xH100)
  27. 2d7022b7 14:58:08 SOTA_FINAL Crawler_Leg_2: set wallclock to 350s (~4k steps on 8xH100)
  28. b39f23cb 15:23:41 parameter-golf-lab flat+crawler tap-off body: rewrite HYPOTHESIS.md for pure neural crawler campaign
  29. b39f23cb 15:23:41 sota_crawler flat+crawler tap-off body: rewrite HYPOTHESIS.md for pure neural crawler campaign
  30. b39f23cb 15:23:41 SOTA_FINAL flat+crawler tap-off body: rewrite HYPOTHESIS.md for pure neural crawler campaign
  31. 4f37849c 15:31:14 parameter-golf-lab 11L GQA U-Net body: fix CROWN-Q variable name collision (scale → q_scale)
  32. 4f37849c 15:31:14 sota_crawler 11L GQA U-Net body: fix CROWN-Q variable name collision (scale → q_scale)
  33. 4f37849c 15:31:14 SOTA_FINAL 11L GQA U-Net body: fix CROWN-Q variable name collision (scale → q_scale)
  34. 4603c484 15:34:41 parameter-golf-lab 11L GQA U-Net body: bump smoke test to 3200 steps (warmdown 800)
  35. 4603c484 15:34:41 sota_crawler 11L GQA U-Net body: bump smoke test to 3200 steps (warmdown 800)
  36. 4603c484 15:34:41 SOTA_FINAL 11L GQA U-Net body: bump smoke test to 3200 steps (warmdown 800)
  37. 206434c3 16:15:27 parameter-golf-lab CL2 results: 1.19593 BPB — loops=3+mlp=5.0+LOOP_AWARE_GPTQ+COMPILE wins on 8×H100
  38. 206434c3 16:15:27 sota_crawler CL2 results: 1.19593 BPB — loops=3+mlp=5.0+LOOP_AWARE_GPTQ+COMPILE wins on 8×H100
  39. 206434c3 16:15:27 SOTA_FINAL CL2 results: 1.19593 BPB — loops=3+mlp=5.0+LOOP_AWARE_GPTQ+COMPILE wins on 8×H100
  40. dd9f4fd1 16:25:39 parameter-golf-lab Crawler_Leg_3: full 600s run, loops=3 mlp=6.0, 11L GQA U-Net body warmdown style
  41. dd9f4fd1 16:25:39 sota_crawler Crawler_Leg_3: full 600s run, loops=3 mlp=6.0, 11L GQA U-Net body warmdown style
  42. dd9f4fd1 16:25:39 SOTA_FINAL Crawler_Leg_3: full 600s run, loops=3 mlp=6.0, 11L GQA U-Net body warmdown style
  43. 0e2286f5 16:45:40 parameter-golf-lab 11L GQA U-Net body: add ttt_calibrate.py — standalone TTT hyperparameter sweep tool
  44. 0e2286f5 16:45:40 sota_crawler 11L GQA U-Net body: add ttt_calibrate.py — standalone TTT hyperparameter sweep tool
  45. 0e2286f5 16:45:40 SOTA_FINAL 11L GQA U-Net body: add ttt_calibrate.py — standalone TTT hyperparameter sweep tool
  46. 9de1f3bc 16:46:27 parameter-golf-lab Crawler_Leg_3: multi-seed script + submission skeleton
  47. 9de1f3bc 16:46:27 sota_crawler Crawler_Leg_3: multi-seed script + submission skeleton
  48. 9de1f3bc 16:46:27 SOTA_FINAL Crawler_Leg_3: multi-seed script + submission skeleton
  49. 411970fd 16:48:31 parameter-golf-lab 11L GQA U-Net body: add ttt_sweep.sh — 3-config TTT calibration runner
  50. 411970fd 16:48:31 sota_crawler 11L GQA U-Net body: add ttt_sweep.sh — 3-config TTT calibration runner
  51. 411970fd 16:48:31 SOTA_FINAL 11L GQA U-Net body: add ttt_sweep.sh — 3-config TTT calibration runner
  52. 8b178676 16:58:08 parameter-golf-lab 11L GQA U-Net body III: TurboMuon + EngramLite combo runner (600s production)
  53. 8b178676 16:58:08 sota_crawler 11L GQA U-Net body III: TurboMuon + EngramLite combo runner (600s production)
  54. 8b178676 16:58:08 SOTA_FINAL 11L GQA U-Net body III: TurboMuon + EngramLite combo runner (600s production)
  55. 11949489 17:14:35 parameter-golf-lab Crawler submission: 3-seed complete, 1.1874 BPB mean
  56. 11949489 17:14:35 sota_crawler Crawler submission: 3-seed complete, 1.1874 BPB mean
  57. 11949489 17:14:35 SOTA_FINAL Crawler submission: 3-seed complete, 1.1874 BPB mean
  58. 9d070dfe 17:19:37 parameter-golf-lab Update README.md
  59. 9d070dfe 17:19:37 sota_crawler Update README.md
  60. 9d070dfe 17:19:37 SOTA_FINAL Update README.md
  61. 3d6dc3b4 17:44:58 parameter-golf-lab flat+crawler tap-off body: update to CL3 proven config (mlp=6.0, SKIP_GPTQ=1)
  62. 3d6dc3b4 17:44:58 sota_crawler flat+crawler tap-off body: update to CL3 proven config (mlp=6.0, SKIP_GPTQ=1)
  63. 3d6dc3b4 17:44:58 SOTA_FINAL flat+crawler tap-off body: update to CL3 proven config (mlp=6.0, SKIP_GPTQ=1)
  64. d31cd549 17:50:43 parameter-golf-lab flat+crawler tap-off body: clean HYPOTHESIS.md — remove stale oracle/proxy refs, fix mlp=6.0 in arms
  65. d31cd549 17:50:43 sota_crawler flat+crawler tap-off body: clean HYPOTHESIS.md — remove stale oracle/proxy refs, fix mlp=6.0 in arms
  66. d31cd549 17:50:43 SOTA_FINAL flat+crawler tap-off body: clean HYPOTHESIS.md — remove stale oracle/proxy refs, fix mlp=6.0 in arms
  67. c8a24684 17:59:55 parameter-golf-lab flat+crawler tap-off body: strip dead code from train_gpt.py (2378 → 1860 lines)
  68. c8a24684 17:59:55 sota_crawler flat+crawler tap-off body: strip dead code from train_gpt.py (2378 → 1860 lines)
  69. c8a24684 17:59:55 SOTA_FINAL flat+crawler tap-off body: strip dead code from train_gpt.py (2378 → 1860 lines)
  70. 78a4e475 18:03:03 parameter-golf-lab flat+crawler tap-off body: fix banner title
  71. 78a4e475 18:03:03 sota_crawler flat+crawler tap-off body: fix banner title
  72. 78a4e475 18:03:03 SOTA_FINAL flat+crawler tap-off body: fix banner title
  73. 2e3d5bf6 18:15:40 parameter-golf-lab pod_setup.sh: switch branch to TEST_LAB, remove dead FLA/DeltaNet install
  74. 2e3d5bf6 18:15:40 sota_crawler pod_setup.sh: switch branch to TEST_LAB, remove dead FLA/DeltaNet install
  75. 2e3d5bf6 18:15:40 SOTA_FINAL pod_setup.sh: switch branch to TEST_LAB, remove dead FLA/DeltaNet install
  76. 54175307 18:21:57 parameter-golf-lab flat+crawler tap-off body: add ad-hoc winddown A/B suite
  77. 54175307 18:21:57 sota_crawler flat+crawler tap-off body: add ad-hoc winddown A/B suite
  78. 54175307 18:21:57 SOTA_FINAL flat+crawler tap-off body: add ad-hoc winddown A/B suite
  79. 4ce945f9 18:29:48 parameter-golf-lab Add clean 11L GQA U-Net body A/B lab for baseline, turbomuon, engramlite, combo
  80. 4ce945f9 18:29:48 sota_crawler Add clean 11L GQA U-Net body A/B lab for baseline, turbomuon, engramlite, combo
  81. 4ce945f9 18:29:48 SOTA_FINAL Add clean 11L GQA U-Net body A/B lab for baseline, turbomuon, engramlite, combo
  82. 4401ff88 18:34:04 parameter-golf-lab BW-00 anchor: 1.18616 int6 SW BPB (seed 444, 8×H100, 600s)
  83. 4401ff88 18:34:04 sota_crawler BW-00 anchor: 1.18616 int6 SW BPB (seed 444, 8×H100, 600s)
  84. 4401ff88 18:34:04 SOTA_FINAL BW-00 anchor: 1.18616 int6 SW BPB (seed 444, 8×H100, 600s)
  85. d02bb2cc 18:37:38 parameter-golf-lab flat+crawler tap-off body: add run_ablations.sh — BW-01..04 back-to-back at 350s, warmdown=0
  86. d02bb2cc 18:37:38 sota_crawler flat+crawler tap-off body: add run_ablations.sh — BW-01..04 back-to-back at 350s, warmdown=0
  87. d02bb2cc 18:37:38 SOTA_FINAL flat+crawler tap-off body: add run_ablations.sh — BW-01..04 back-to-back at 350s, warmdown=0
  88. e135eb99 18:45:19 parameter-golf-lab flat+crawler tap-off body: run_ablations.sh default NPROC=1 (single GPU signal)
  89. e135eb99 18:45:19 sota_crawler flat+crawler tap-off body: run_ablations.sh default NPROC=1 (single GPU signal)
  90. e135eb99 18:45:19 SOTA_FINAL flat+crawler tap-off body: run_ablations.sh default NPROC=1 (single GPU signal)
  91. 8fc315d8 19:03:18 parameter-golf-lab Add 3-seed logs for 4ep legal TTT submission
  92. 8fc315d8 19:03:18 sota_crawler Add 3-seed logs for 4ep legal TTT submission
  93. 9e8b69f8 19:03:53 parameter-golf-lab flat+crawler tap-off body: fix run_ablations.sh env var passing (use env)
  94. 9e8b69f8 19:03:53 sota_crawler flat+crawler tap-off body: fix run_ablations.sh env var passing (use env)
  95. 9e8b69f8 19:03:53 SOTA_FINAL flat+crawler tap-off body: fix run_ablations.sh env var passing (use env)
  96. 56e3ff3b 19:04:22 parameter-golf-lab flat+crawler tap-off body: add 1-GPU winddown wrapper
  97. 56e3ff3b 19:04:22 sota_crawler flat+crawler tap-off body: add 1-GPU winddown wrapper
  98. 56e3ff3b 19:04:22 SOTA_FINAL flat+crawler tap-off body: add 1-GPU winddown wrapper
  99. 656622aa 19:05:32 parameter-golf-lab pod_setup.sh: download tokenizer (fineweb_1024_bpe.model) in step 6
  100. 656622aa 19:05:32 sota_crawler pod_setup.sh: download tokenizer (fineweb_1024_bpe.model) in step 6
  101. 656622aa 19:05:32 SOTA_FINAL pod_setup.sh: download tokenizer (fineweb_1024_bpe.model) in step 6
  102. b64efeb6 19:23:13 parameter-golf-lab flat+crawler tap-off body: run_ablations.sh step-based stopping (ABLATION_STEPS=500)
  103. b64efeb6 19:23:13 sota_crawler flat+crawler tap-off body: run_ablations.sh step-based stopping (ABLATION_STEPS=500)
  104. b64efeb6 19:23:13 SOTA_FINAL flat+crawler tap-off body: run_ablations.sh step-based stopping (ABLATION_STEPS=500)
  105. 33742df4 19:52:51 parameter-golf-lab Add fresh pod bootstrap and single-H100 signal runners
  106. 33742df4 19:52:51 sota_crawler Add fresh pod bootstrap and single-H100 signal runners
  107. 33742df4 19:52:51 SOTA_FINAL Add fresh pod bootstrap and single-H100 signal runners
  108. b04652b6 20:02:59 parameter-golf-lab Make 11L GQA U-Net body runners use portable torchrun default
  109. b04652b6 20:02:59 sota_crawler Make 11L GQA U-Net body runners use portable torchrun default
  110. b04652b6 20:02:59 SOTA_FINAL Make 11L GQA U-Net body runners use portable torchrun default
  111. e2b3ec09 21:10:55 parameter-golf-lab Add flat+crawler tap-off body: 4F vs 5F direct proxy comparison
  112. e2b3ec09 21:10:55 sota_crawler Add flat+crawler tap-off body: 4F vs 5F direct proxy comparison
  113. e2b3ec09 21:10:55 SOTA_FINAL Add flat+crawler tap-off body: 4F vs 5F direct proxy comparison
  114. 7a36bf84 21:22:16 parameter-golf-lab Add 11L GQA U-Net body race-ready TurboMuon-only variant
  115. 7a36bf84 21:22:16 sota_crawler Add 11L GQA U-Net body race-ready TurboMuon-only variant
  116. 7a36bf84 21:22:16 SOTA_FINAL Add 11L GQA U-Net body race-ready TurboMuon-only variant
  117. 3d675e0a 21:44:40 parameter-golf-lab flat+crawler tap-off body: 4F+1C confirmed optimal, 5F hypothesis denied
  118. 3d675e0a 21:44:40 sota_crawler flat+crawler tap-off body: 4F+1C confirmed optimal, 5F hypothesis denied
  119. 3d675e0a 21:44:40 SOTA_FINAL flat+crawler tap-off body: 4F+1C confirmed optimal, 5F hypothesis denied
  120. f3ecde94 21:55:21 parameter-golf-lab Add flat+crawler tap-off body: XSA coverage sweep on confirmed 4F+1C config
  121. f3ecde94 21:55:21 sota_crawler Add flat+crawler tap-off body: XSA coverage sweep on confirmed 4F+1C config
  122. f3ecde94 21:55:21 SOTA_FINAL Add flat+crawler tap-off body: XSA coverage sweep on confirmed 4F+1C config
  123. 550edbfa 22:01:33 parameter-golf-lab flat+crawler tap-off body: add 8xH100 launcher and checkpoint arch autodetect
  124. 550edbfa 22:01:33 sota_crawler flat+crawler tap-off body: add 8xH100 launcher and checkpoint arch autodetect
  125. 550edbfa 22:01:33 SOTA_FINAL flat+crawler tap-off body: add 8xH100 launcher and checkpoint arch autodetect
  126. 6a46f879 22:24:52 parameter-golf-lab Add flat+crawler tap-off body: crawler MLP leaky slope sweep
  127. 6a46f879 22:24:52 sota_crawler Add flat+crawler tap-off body: crawler MLP leaky slope sweep
  128. 6a46f879 22:24:52 SOTA_FINAL Add flat+crawler tap-off body: crawler MLP leaky slope sweep
  129. be8459a8 22:27:56 parameter-golf-lab flat+crawler tap-off body: XSA=15 (full coverage) wins on BPB AND speed
  130. be8459a8 22:27:56 sota_crawler flat+crawler tap-off body: XSA=15 (full coverage) wins on BPB AND speed
  131. be8459a8 22:27:56 SOTA_FINAL flat+crawler tap-off body: XSA=15 (full coverage) wins on BPB AND speed
  132. 07eb836b 22:45:26 parameter-golf-lab 11L GQA U-Net body: single run.py launcher
  133. 07eb836b 22:45:26 sota_crawler 11L GQA U-Net body: single run.py launcher
  134. 07eb836b 22:45:26 SOTA_FINAL 11L GQA U-Net body: single run.py launcher
  135. 7f773dec 23:06:27 parameter-golf-lab flat+crawler tap-off body: per-loop bottleneck choke sweep for crawler MLP
  136. 7f773dec 23:06:27 sota_crawler flat+crawler tap-off body: per-loop bottleneck choke sweep for crawler MLP
  137. 7f773dec 23:06:27 SOTA_FINAL flat+crawler tap-off body: per-loop bottleneck choke sweep for crawler MLP
  138. aeab6811 23:33:56 parameter-golf-lab flat+crawler tap-off body: LoopSmearGate — depth error damping between crawler loops
  139. aeab6811 23:33:56 sota_crawler flat+crawler tap-off body: LoopSmearGate — depth error damping between crawler loops
  140. aeab6811 23:33:56 SOTA_FINAL flat+crawler tap-off body: LoopSmearGate — depth error damping between crawler loops
  141. 0df29210 23:39:35 parameter-golf-lab Add single-H100 11L GQA U-Net body ablation matrix runner
  142. 0df29210 23:39:35 sota_crawler Add single-H100 11L GQA U-Net body ablation matrix runner
  143. 0df29210 23:39:35 SOTA_FINAL Add single-H100 11L GQA U-Net body ablation matrix runner
  144. 2958dca9 23:43:37 parameter-golf-lab flat+crawler tap-off body: per-loop gated encoder tap sweep (7 arms)
  145. 2958dca9 23:43:37 sota_crawler flat+crawler tap-off body: per-loop gated encoder tap sweep (7 arms)
  146. 2958dca9 23:43:37 SOTA_FINAL flat+crawler tap-off body: per-loop gated encoder tap sweep (7 arms)
  147. 37f1dcfe 23:51:21 parameter-golf-lab Add sparse skip-gram ngram ablation for single-H100 11L GQA U-Net body
  148. 37f1dcfe 23:51:21 sota_crawler Add sparse skip-gram ngram ablation for single-H100 11L GQA U-Net body
  149. 37f1dcfe 23:51:21 SOTA_FINAL Add sparse skip-gram ngram ablation for single-H100 11L GQA U-Net body
  150. 1b674cff 23:52:58 parameter-golf-lab Revert unvalidated sparse skip-gram integration from 11L GQA U-Net body runner path
  151. 1b674cff 23:52:58 sota_crawler Revert unvalidated sparse skip-gram integration from 11L GQA U-Net body runner path
  152. 1b674cff 23:52:58 SOTA_FINAL Revert unvalidated sparse skip-gram integration from 11L GQA U-Net body runner path
  153. fe3b7d77 23:57:44 parameter-golf-lab flat+crawler tap-off body: per-loop RoPE scale sweep + mega ablation runner
  154. fe3b7d77 23:57:44 sota_crawler flat+crawler tap-off body: per-loop RoPE scale sweep + mega ablation runner
  155. fe3b7d77 23:57:44 SOTA_FINAL flat+crawler tap-off body: per-loop RoPE scale sweep + mega ablation runner
  156. 38c88263 23:59:30 parameter-golf-lab Add isolated sparse skip-gram ablation (2200-step single-GPU)
  157. 38c88263 23:59:30 sota_crawler Add isolated sparse skip-gram ablation (2200-step single-GPU)
  158. 38c88263 23:59:30 SOTA_FINAL Add isolated sparse skip-gram ablation (2200-step single-GPU)
  159. c3d3b8f0 00:04:28 parameter-golf-lab flat+crawler tap-off body: log crawler variant results — slope insensitive, stay at 0.5
  160. c3d3b8f0 00:04:28 sota_crawler flat+crawler tap-off body: log crawler variant results — slope insensitive, stay at 0.5
  161. c3d3b8f0 00:04:28 SOTA_FINAL flat+crawler tap-off body: log crawler variant results — slope insensitive, stay at 0.5
  162. bac88a6d 00:06:05 parameter-golf-lab flat+crawler tap-off body: fix MLP.forward to accept optional loop_idx
  163. bac88a6d 00:06:05 sota_crawler flat+crawler tap-off body: fix MLP.forward to accept optional loop_idx
  164. bac88a6d 00:06:05 SOTA_FINAL flat+crawler tap-off body: fix MLP.forward to accept optional loop_idx
  165. 6b7f2051 00:10:26 parameter-golf-lab Remove ngram sparse ablation files; keep 11L GQA U-Net body path ngram-free
  166. 6b7f2051 00:10:26 sota_crawler Remove ngram sparse ablation files; keep 11L GQA U-Net body path ngram-free
  167. 6b7f2051 00:10:26 SOTA_FINAL Remove ngram sparse ablation files; keep 11L GQA U-Net body path ngram-free
  168. f7f301a8 01:38:20 parameter-golf-lab Add stripped 11L GQA U-Net body skip-gram 2200-step calibration runner
  169. f7f301a8 01:38:20 sota_crawler Add stripped 11L GQA U-Net body skip-gram 2200-step calibration runner
  170. f7f301a8 01:38:20 SOTA_FINAL Add stripped 11L GQA U-Net body skip-gram 2200-step calibration runner
  171. 5ccd09c9 01:47:30 parameter-golf-lab Add flat+crawler tap-off body experiment (BWCS series)
  172. 5ccd09c9 01:47:30 sota_crawler Add flat+crawler tap-off body experiment (BWCS series)
  173. 5ccd09c9 01:47:30 SOTA_FINAL Add flat+crawler tap-off body experiment (BWCS series)
  174. 34ce3e4e 01:59:36 parameter-golf-lab Log 2026-03-31 single-H100 11L GQA U-Net body ablation matrix results
  175. 34ce3e4e 01:59:36 sota_crawler Log 2026-03-31 single-H100 11L GQA U-Net body ablation matrix results
  176. 34ce3e4e 01:59:36 SOTA_FINAL Log 2026-03-31 single-H100 11L GQA U-Net body ablation matrix results
  177. cb25a929 02:02:59 parameter-golf-lab Add next calibrated single-GPU 11L GQA U-Net body ablation pack
  178. cb25a929 02:02:59 sota_crawler Add next calibrated single-GPU 11L GQA U-Net body ablation pack
  179. cb25a929 02:02:59 SOTA_FINAL Add next calibrated single-GPU 11L GQA U-Net body ablation pack
  180. 362b2204 02:20:46 parameter-golf-lab Crawler Leg3 README: add architecture philosophy
  181. 362b2204 02:20:46 sota_crawler Crawler Leg3 README: add architecture philosophy
  182. 362b2204 02:20:46 SOTA_FINAL Crawler Leg3 README: add architecture philosophy
  183. 6b81bb0e 02:21:07 parameter-golf-lab Crawler Leg3 README: add active ablation work section
  184. 6b81bb0e 02:21:07 sota_crawler Crawler Leg3 README: add active ablation work section
  185. 6b81bb0e 02:21:07 SOTA_FINAL Crawler Leg3 README: add active ablation work section
  186. bb5b3d4a 02:42:53 parameter-golf-lab Log skip-gram calibration seed444 results
  187. bb5b3d4a 02:42:53 sota_crawler Log skip-gram calibration seed444 results
  188. bb5b3d4a 02:42:53 SOTA_FINAL Log skip-gram calibration seed444 results
  189. f7edb50a 03:58:51 parameter-golf-lab Add BWCB ablation: battery scales on pyramid-512 choke
  190. f7edb50a 03:58:51 sota_crawler Add BWCB ablation: battery scales on pyramid-512 choke
  191. f7edb50a 03:58:51 SOTA_FINAL Add BWCB ablation: battery scales on pyramid-512 choke
  192. 66b94eb9 04:06:29 parameter-golf-lab Add loader-refine single-GPU ablation pack and notes
  193. 66b94eb9 04:06:29 sota_crawler Add loader-refine single-GPU ablation pack and notes
  194. 66b94eb9 04:06:29 SOTA_FINAL Add loader-refine single-GPU ablation pack and notes
  195. ed2ec71c 04:22:54 parameter-golf-lab Add BWCD ablation: descending battery on pyramid-512
  196. ed2ec71c 04:22:54 sota_crawler Add BWCD ablation: descending battery on pyramid-512
  197. ed2ec71c 04:22:54 SOTA_FINAL Add BWCD ablation: descending battery on pyramid-512
  198. dda1f5bd 04:25:46 parameter-golf-lab BWCD: add BWCD-03 wide-medium-wide bracket (9,3,9)
  199. dda1f5bd 04:25:46 sota_crawler BWCD: add BWCD-03 wide-medium-wide bracket (9,3,9)
  200. dda1f5bd 04:25:46 SOTA_FINAL BWCD: add BWCD-03 wide-medium-wide bracket (9,3,9)
  201. 1108f460 04:32:12 parameter-golf-lab Record mega ablation results in BWB HYPOTHESIS.md
  202. 1108f460 04:32:12 sota_crawler Record mega ablation results in BWB HYPOTHESIS.md
  203. 1108f460 04:32:12 SOTA_FINAL Record mega ablation results in BWB HYPOTHESIS.md
  204. 84f8fbe7 04:36:21 parameter-golf-lab Add race-ready 11L GQA U-Net body final submission package with loader_cache4 launcher
  205. 84f8fbe7 04:36:21 sota_crawler Add race-ready 11L GQA U-Net body final submission package with loader_cache4 launcher
  206. 84f8fbe7 04:36:21 SOTA_FINAL Add race-ready 11L GQA U-Net body final submission package with loader_cache4 launcher
  207. d4f8e746 04:47:41 parameter-golf-lab BWCB results: ascending battery hurts pyramid, all configs worse
  208. d4f8e746 04:47:41 sota_crawler BWCB results: ascending battery hurts pyramid, all configs worse
  209. d4f8e746 04:47:41 SOTA_FINAL BWCB results: ascending battery hurts pyramid, all configs worse
  210. 3c0ca4ca 04:59:10 parameter-golf-lab BWCB Run B (4 shards): 1,2,4+pyramid beats pyramid alone by -0.00210
  211. 3c0ca4ca 04:59:10 sota_crawler BWCB Run B (4 shards): 1,2,4+pyramid beats pyramid alone by -0.00210
  212. 3c0ca4ca 04:59:10 SOTA_FINAL BWCB Run B (4 shards): 1,2,4+pyramid beats pyramid alone by -0.00210
DATE2026-03-30
DAY013
PRIMARY METRICVAL_BPB
TESTS RUN22 unique (21 valid / 0 TTT leakage)
ARCHITECTURE FAMILYTRITON/MODEL CO-DESIGN BODY (×7) · 11L GQA U-NET BODY (×6) · CRAWLER-SAFE TRAIN/EVAL SURFACE (×5) · CRAWLER PLUS CUBRIC N-GRAM STACK (×3) · POST-TRAINING QUANTIZATION CALIBRATION (×1)
CLASSIFICATIONEXPERIMENTAL 95% (21)/NEURAL 5% (1)
ARCHITECTURE RECIPE
11L GQA U-NET BODYx6

11-layer dim-512 GQA U-Net transformer base with XSA, BigramHash, value embedding, and SmearGate.

BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · head_dim=64 · mlp_mult=3.0 · tie_embeddings=1
STRUCTUREencoder_layers=5 · decoder_layers=6 · skip_weights=5 · GQA attention · RMSNorm · relu_sq MLP · Muon matrix optimizer path
FEATURESBigramHash vocab=2048 dim=128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10 · SmearGate · logit_softcap=30
CRAWLER-SAFE TRAIN/EVAL SURFACEx5

Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · shared crawler block · looped crawler passes
FEATURESBigramHash · XSA · RoPE · crawler loop rope scales · instruction bottleneck
QUANT / EVALint6 roundtrip · int6 sliding-window eval · int8 zlib roundtrip · 8xH100 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-03-30 panel 1 of 2
csv data
VAL_BPB for 2026-03-30 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
TRITON/MODEL CO-DESIGN BODY61.10911.11051.1440download
11L GQA U-NET BODY61.10991.14401.1986download
CRAWLER-SAFE TRAIN/EVAL SURFACE51.14371.18721.1874download
CRAWLER PLUS CUBRIC N-GRAM STACK31.18741.51431.5236download
POST-TRAINING QUANTIZATION CALIBRATION11.19591.19591.1959download
ALL VALID211.10911.14401.5236—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 21

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
100:458×H100 (runpod)recurrent green-branch prototype.log1.1100OK↑4.0%
training_log
201:008×H100 (runpod)recurrent green-branch prototype.log1.1096OK↑4.0%
training_log
301:218×H100 (runpod)recurrent green-branch prototype.log1.1091OK↑3.9%
training_log
401:358×H100 (runpod)recurrent green-branch prototype.log1.1111OK↑4.1%
training_log
502:588×H100 (runpod)recurrent green-branch prototype.log1.1375OK↑6.6%
training_log
603:138×H100 (runpod)recurrent green-branch prototype.log4.1042CRASH—
training_log
703:238×H100 (runpod)recurrent green-branch prototype.log1.1440OK↑7.2%
training_log
803:578×H100 (runpod)11L GQA U-Net body.log1.1442OK↑7.2%
training_log
904:138×H100 (runpod)11L GQA U-Net body.log1.1438OK↑7.2%
training_log
1004:268×H100 (runpod)11L GQA U-Net body.log1.1437OK↑7.2%
training_log
1104:408×H100 (runpod)11L GQA U-Net body.log1.1986OK↑12.3%
training_log
1213:468×H100train_seed300.log (×2)1.1437OK↑7.2%
training_log 1
training_log 2
1313:468×H100train_seed1337.log1.1872OK↑11.2%
training_log
1413:468×H100train_seed42.log (×2)1.1438OK↑7.2%
training_log 1
training_log 2
1513:46—Crawler1.1874OK↑11.3%
details
1713:468×H100train_seed444.log1.1442OK↑7.2%
training_log
1816:15—CL2 results: 1.19593 BPB — loops=3+mlp=5.0+LOOP_AWARE_GPTQ+COMPILE wins on 8×…1.1959OK↑12.1%
details
1917:14—Crawler submission: 3-seed complete, 1.1874 BPB mean (×3)1.1874OK↑11.3%
details
2017:44—flat+crawler tap-off body: update to CL3 proven config (mlp=6.0, SKIP_GPTQ=1)…1.1874OK↑11.3%
details
2121:44—flat+crawler tap-off body: 4F+1C confirmed optimal, 5F hypothesis denied (×3)1.5236OK↑42.8%
details
2222:27—flat+crawler tap-off body: XSA=15 (full coverage) wins on BPB AND speed (×3)1.5143OK↑41.9%
details

NEURAL TEST RUNS — 1

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
1613:46—11L GQA U-Net body1.1099OK↑4.0%
details