DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-19

— · 52 of 529 · 0 warnings
audit summary
{
  "date": "2026-03-19",
  "fatal": 0,
  "headline_metric": null,
  "raw_records": 529,
  "render_records": 52,
  "test_rows": 0,
  "warnings": 0
}
199 commits on 2026-03-19
  1. e9930c5e 05:07:39 parameter-golf-lab chore: add 1xH100 10-minute launcher for minimal AttnRes test
  2. dce35598 05:34:26 parameter-golf-lab fix: avoid inductor autograd versioning hazard in AttnRes cache reads
  3. 339ffa28 06:05:44 parameter-golf-lab feat: AttnRes depth attention replacing U-Net skip connections
  4. 339ffa28 06:05:44 sota_crawler feat: AttnRes depth attention replacing U-Net skip connections
  5. 8f6218ea 06:20:31 parameter-golf-lab fix: use list+stack instead of cache __setitem__ for torch.compile safety
  6. 8f6218ea 06:20:31 sota_crawler fix: use list+stack instead of cache __setitem__ for torch.compile safety
  7. e35298ea 06:45:59 parameter-golf-lab results: Gen_1_aTTn AttnRes — 1.5224 BPB, does not beat 1.2244 baseline
  8. e35298ea 06:45:59 sota_crawler results: Gen_1_aTTn AttnRes — 1.5224 BPB, does not beat 1.2244 baseline
  9. 34fccfbf 07:18:05 parameter-golf-lab Add Seq2048 + FP16 Tied Embedding submission (mean val_bpb 1.2067)
  10. 34fccfbf 07:18:05 sota_crawler Add Seq2048 + FP16 Tied Embedding submission (mean val_bpb 1.2067)
  11. 34fccfbf 07:18:05 SOTA_FINAL Add Seq2048 + FP16 Tied Embedding submission (mean val_bpb 1.2067)
  12. 9d318e7d 07:33:51 parameter-golf-lab Record: Seq4096 + Sliding Window Eval, val_bpb=1.1808
  13. 9d318e7d 07:33:51 sota_crawler Record: Seq4096 + Sliding Window Eval, val_bpb=1.1808
  14. 9d318e7d 07:33:51 SOTA_FINAL Record: Seq4096 + Sliding Window Eval, val_bpb=1.1808
  15. b8a1426d 09:37:31 parameter-golf-lab Non-record: SwiGLU + warmdown fix + quarter batch (1x5090, 1.3281 bpb)
  16. b8a1426d 09:37:31 sota_crawler Non-record: SwiGLU + warmdown fix + quarter batch (1x5090, 1.3281 bpb)
  17. b8a1426d 09:37:31 SOTA_FINAL Non-record: SwiGLU + warmdown fix + quarter batch (1x5090, 1.3281 bpb)
  18. f85c8379 11:06:07 parameter-golf-lab Record: Mixed Quant (int6+int8) + Sliding Window, val_bpb=1.1630
  19. f85c8379 11:06:07 sota_crawler Record: Mixed Quant (int6+int8) + Sliding Window, val_bpb=1.1630
  20. f85c8379 11:06:07 SOTA_FINAL Record: Mixed Quant (int6+int8) + Sliding Window, val_bpb=1.1630
  21. 73a4a9dd 14:10:23 parameter-golf-lab Submission: 10L + lower LR + fp16 embed + int6 middle layers (val_bpb 1.2129)
  22. 73a4a9dd 14:10:23 sota_crawler Submission: 10L + lower LR + fp16 embed + int6 middle layers (val_bpb 1.2129)
  23. 73a4a9dd 14:10:23 SOTA_FINAL Submission: 10L + lower LR + fp16 embed + int6 middle layers (val_bpb 1.2129)
  24. c2b36217 15:46:20 parameter-golf-lab Update submission: 10L + int6 mid + sliding window (mean val_bpb 1.1793)
  25. c2b36217 15:46:20 sota_crawler Update submission: 10L + int6 mid + sliding window (mean val_bpb 1.1793)
  26. c2b36217 15:46:20 SOTA_FINAL Update submission: 10L + int6 mid + sliding window (mean val_bpb 1.1793)
  27. 6a08c9dc 16:35:33 parameter-golf-lab Add MLX_EAGER_EVAL flag to further reduce memory pressure by force-evaluating the graph after each sub-batch step
  28. 6a08c9dc 16:35:33 sota_crawler Add MLX_EAGER_EVAL flag to further reduce memory pressure by force-evaluating the graph after each sub-batch step
  29. 6a08c9dc 16:35:33 SOTA_FINAL Add MLX_EAGER_EVAL flag to further reduce memory pressure by force-evaluating the graph after each sub-batch step
  30. a5eb9edb 17:16:50 parameter-golf-lab fp16 tied embedding + lr/warmdown tuning — val_bpb 1.2197 (#42)
  31. a5eb9edb 17:16:50 sota_crawler fp16 tied embedding + lr/warmdown tuning — val_bpb 1.2197 (#42)
  32. a5eb9edb 17:16:50 SOTA_FINAL fp16 tied embedding + lr/warmdown tuning — val_bpb 1.2197 (#42)
  33. 929bfd42 17:18:59 parameter-golf-lab Update README.md
  34. 929bfd42 17:18:59 sota_crawler Update README.md
  35. b5ea566a 17:19:18 parameter-golf-lab Update README.md (#105)
  36. b5ea566a 17:19:18 sota_crawler Update README.md (#105)
  37. b5ea566a 17:19:18 SOTA_FINAL Update README.md (#105)
  38. 6e3e90db 17:23:02 parameter-golf-lab clarify torch version
  39. 6e3e90db 17:23:02 sota_crawler clarify torch version
  40. 6e3e90db 17:23:02 SOTA_FINAL clarify torch version
  41. e89fcf8a 17:25:29 parameter-golf-lab SOTA attempt (val_bpb=1.2064) (#49)
  42. e89fcf8a 17:25:29 sota_crawler SOTA attempt (val_bpb=1.2064) (#49)
  43. e89fcf8a 17:25:29 SOTA_FINAL SOTA attempt (val_bpb=1.2064) (#49)
  44. 194bb876 17:27:07 parameter-golf-lab Update README.md
  45. 194bb876 17:27:07 sota_crawler Update README.md
  46. 194bb876 17:27:07 SOTA_FINAL Update README.md
  47. d84a3e81 17:28:12 parameter-golf-lab Add record: Sliding Window Eval (stride=64), val_bpb=1.1925 (#50)
  48. d84a3e81 17:28:12 sota_crawler Add record: Sliding Window Eval (stride=64), val_bpb=1.1925 (#50)
  49. d84a3e81 17:28:12 SOTA_FINAL Add record: Sliding Window Eval (stride=64), val_bpb=1.1925 (#50)
  50. 9e7a4b83 18:18:27 parameter-golf-lab Update: full int6+zstd, MLP 1344, Muon 0.99 (mean val_bpb 1.1632)
  51. 9e7a4b83 18:18:27 sota_crawler Update: full int6+zstd, MLP 1344, Muon 0.99 (mean val_bpb 1.1632)
  52. 9e7a4b83 18:18:27 SOTA_FINAL Update: full int6+zstd, MLP 1344, Muon 0.99 (mean val_bpb 1.1632)
  53. 8e4f5d15 18:41:16 parameter-golf-lab Update submission: MLP 3x + QAT + Int6 + Sliding Window (val_bpb 1.1652)
  54. 8e4f5d15 18:41:16 sota_crawler Update submission: MLP 3x + QAT + Int6 + Sliding Window (val_bpb 1.1652)
  55. 8e4f5d15 18:41:16 SOTA_FINAL Update submission: MLP 3x + QAT + Int6 + Sliding Window (val_bpb 1.1652)
  56. 119e5b06 18:41:43 parameter-golf-lab phase1: experiment harness for baseline optimization — 66 sweeps across LR, batch, schedule, regularization, architecture
  57. 119e5b06 18:41:43 sota_crawler phase1: experiment harness for baseline optimization — 66 sweeps across LR, batch, schedule, regularization, architecture
  58. a6817dbb 18:53:10 parameter-golf-lab infra: git-based result syncing + setup scripts for H100 and Spark
  59. a6817dbb 18:53:10 sota_crawler infra: git-based result syncing + setup scripts for H100 and Spark
  60. 24c363a7 19:00:19 parameter-golf-lab Add experiment sweep scripts and ignore model checkpoints
  61. b2fb4b01 19:03:22 parameter-golf-lab Trim readme to basics
  62. c65f2522 19:03:39 parameter-golf-lab agent: autonomous Grok-powered experiment loop
  63. c65f2522 19:03:39 sota_crawler agent: autonomous Grok-powered experiment loop
  64. eab4bd83 19:05:53 parameter-golf-lab Update gitignore
  65. ccb03d76 19:09:17 parameter-golf-lab docs: add H100/X100 results report and quant robustness direction
  66. ccb03d76 19:09:17 sota_crawler docs: add H100/X100 results report and quant robustness direction
  67. 3bfa5bf1 19:44:10 parameter-golf-lab docs/scripts: add overnight artifacts and vocab sweep tooling
  68. 3bfa5bf1 19:44:10 sota_crawler docs/scripts: add overnight artifacts and vocab sweep tooling
  69. 34b418d0 19:45:56 parameter-golf-lab agent: switch to grok-4.20-0309-reasoning model
  70. 34b418d0 19:45:56 sota_crawler agent: switch to grok-4.20-0309-reasoning model
  71. 4f384b22 19:51:15 parameter-golf-lab agent: bypass container proxy for xAI API calls
  72. 4f384b22 19:51:15 sota_crawler agent: bypass container proxy for xAI API calls
  73. 40f05a72 19:58:22 parameter-golf-lab agent: use curl subprocess instead of urllib for xAI API
  74. 40f05a72 19:58:22 sota_crawler agent: use curl subprocess instead of urllib for xAI API
  75. 510e3f6a 20:06:54 parameter-golf-lab Update: STE int6 QAT, zero quant gap (mean val_bpb 1.1598)
  76. 510e3f6a 20:06:54 sota_crawler Update: STE int6 QAT, zero quant gap (mean val_bpb 1.1598)
  77. 510e3f6a 20:06:54 SOTA_FINAL Update: STE int6 QAT, zero quant gap (mean val_bpb 1.1598)
  78. 32ea218c 20:10:33 parameter-golf-lab agent: auto-download training data if missing
  79. 32ea218c 20:10:33 sota_crawler agent: auto-download training data if missing
  80. b2fd1e9c 20:15:46 parameter-golf-lab sweep: auto-detect GPU count for h100 preset
  81. b2fd1e9c 20:15:46 sota_crawler sweep: auto-detect GPU count for h100 preset
  82. 043cea08 20:40:07 parameter-golf-lab record: Run01 default config baseline (val_bpb=1.3446)
  83. 043cea08 20:40:07 sota_crawler record: Run01 default config baseline (val_bpb=1.3446)
  84. 3a6fec79 21:00:42 parameter-golf-lab Fix: score final partial window in sliding window eval (#124)
  85. 3a6fec79 21:00:42 sota_crawler Fix: score final partial window in sliding window eval (#124)
  86. 3a6fec79 21:00:42 SOTA_FINAL Fix: score final partial window in sliding window eval (#124)
  87. 2fc817ff 21:01:42 parameter-golf-lab feat: add fractal cadence test cadence test weight sharing via NUM_LOOPS env var
  88. af99703d 21:01:42 parameter-golf-lab feat: add fractal cadence test cadence test weight sharing via NUM_LOOPS env var
  89. 2fc817ff 21:01:42 sota_crawler feat: add fractal cadence test cadence test weight sharing via NUM_LOOPS env var
  90. af99703d 21:01:42 sota_crawler feat: add fractal cadence test cadence test weight sharing via NUM_LOOPS env var
  91. 6b409784 21:02:51 parameter-golf-lab Update README.md
  92. 6b409784 21:02:51 sota_crawler Update README.md
  93. 6b409784 21:02:51 SOTA_FINAL Update README.md
  94. 78c24e20 21:04:16 parameter-golf-lab New SOTA attempt (#52)
  95. 78c24e20 21:04:16 sota_crawler New SOTA attempt (#52)
  96. 78c24e20 21:04:16 SOTA_FINAL New SOTA attempt (#52)
  97. c8584263 21:04:39 parameter-golf-lab add run_fractal cadence test.sh — one-command H100 experiment runner
  98. c8584263 21:04:39 sota_crawler add run_fractal cadence test.sh — one-command H100 experiment runner
  99. b87b8837 21:05:35 parameter-golf-lab Update README.md
  100. b87b8837 21:05:35 sota_crawler Update README.md
  101. b87b8837 21:05:35 SOTA_FINAL Update README.md
  102. 2d6e9e0e 21:06:53 parameter-golf-lab Update README.md
  103. 2d6e9e0e 21:06:53 sota_crawler Update README.md
  104. 2d6e9e0e 21:06:53 SOTA_FINAL Update README.md
  105. ce6cf9ac 21:07:09 parameter-golf-lab Update README.md
  106. ce6cf9ac 21:07:09 sota_crawler Update README.md
  107. ce6cf9ac 21:07:09 SOTA_FINAL Update README.md
  108. a231e015 21:08:16 parameter-golf-lab fix: support non-power-of-2 GPU counts (e.g. 6xH100)
  109. a231e015 21:08:16 sota_crawler fix: support non-power-of-2 GPU counts (e.g. 6xH100)
  110. 9fbdf8c9 21:13:10 parameter-golf-lab Record: Sliding Window + FP16 Embed + 10L + Muon WD + Overtone Init (val_bpb=1.1748) (#60)
  111. 9fbdf8c9 21:13:10 sota_crawler Record: Sliding Window + FP16 Embed + 10L + Muon WD + Overtone Init (val_bpb=1.1748) (#60)
  112. 9fbdf8c9 21:13:10 SOTA_FINAL Record: Sliding Window + FP16 Embed + 10L + Muon WD + Overtone Init (val_bpb=1.1748) (#60)
  113. ad7b62c7 21:15:19 parameter-golf-lab Update README.md
  114. ad7b62c7 21:15:19 sota_crawler Update README.md
  115. ad7b62c7 21:15:19 SOTA_FINAL Update README.md
  116. 555669e8 21:28:57 parameter-golf-lab Int6 + MLP 3x + sliding window: val_bpb=1.1574 (#61)
  117. 555669e8 21:28:57 sota_crawler Int6 + MLP 3x + sliding window: val_bpb=1.1574 (#61)
  118. 555669e8 21:28:57 SOTA_FINAL Int6 + MLP 3x + sliding window: val_bpb=1.1574 (#61)
  119. cfa5726b 21:31:28 parameter-golf-lab Update README.md
  120. cfa5726b 21:31:28 sota_crawler Update README.md
  121. cfa5726b 21:31:28 SOTA_FINAL Update README.md
  122. f3897c16 21:33:47 parameter-golf-lab Update README.md
  123. f3897c16 21:33:47 sota_crawler Update README.md
  124. f3897c16 21:33:47 SOTA_FINAL Update README.md
  125. a3308db2 21:47:08 parameter-golf-lab Add H100 quant A/B treatment runner script
  126. a3308db2 21:47:08 sota_crawler Add H100 quant A/B treatment runner script
  127. 53535246 21:55:57 parameter-golf-lab Update README.md
  128. 53535246 21:55:57 sota_crawler Update README.md
  129. 53535246 21:55:57 SOTA_FINAL Update README.md
  130. d2bd7607 22:03:04 parameter-golf-lab Update README.md
  131. d2bd7607 22:03:04 sota_crawler Update README.md
  132. d2bd7607 22:03:04 SOTA_FINAL Update README.md
  133. a110a978 22:11:10 parameter-golf-lab Log 1xH100 quant A/B screening result (T1)
  134. a110a978 22:11:10 sota_crawler Log 1xH100 quant A/B screening result (T1)
  135. ae882089 22:26:36 parameter-golf-lab Update README.md
  136. ae882089 22:26:36 sota_crawler Update README.md
  137. ae882089 22:26:36 SOTA_FINAL Update README.md
  138. 9ac12c26 22:26:46 parameter-golf-lab Record: 10L Mixed Precision: val_bpb=1.2147 (10 layers + int6 middle layers) (#39)
  139. 9ac12c26 22:26:46 sota_crawler Record: 10L Mixed Precision: val_bpb=1.2147 (10 layers + int6 middle layers) (#39)
  140. 9ac12c26 22:26:46 SOTA_FINAL Record: 10L Mixed Precision: val_bpb=1.2147 (10 layers + int6 middle layers) (#39)
  141. 3b5dbf7f 22:29:41 parameter-golf-lab Run T2 by default in quant A/B script
  142. 3b5dbf7f 22:29:41 sota_crawler Run T2 by default in quant A/B script
  143. bd2463aa 22:30:26 parameter-golf-lab commit ttt record (#77)
  144. bd2463aa 22:30:26 sota_crawler commit ttt record (#77)
  145. bd2463aa 22:30:26 SOTA_FINAL commit ttt record (#77)
  146. 5e29bfd3 22:32:27 parameter-golf-lab Update README.md
  147. 5e29bfd3 22:32:27 sota_crawler Update README.md
  148. 5e29bfd3 22:32:27 SOTA_FINAL Update README.md
  149. fe7f7cbe 22:49:47 parameter-golf-lab Log T2 1xH100 quant robustness screening result
  150. fe7f7cbe 22:49:47 sota_crawler Log T2 1xH100 quant robustness screening result
  151. 2388b9ff 23:21:38 parameter-golf-lab Add vocab-3lane tooling onto fractal cadence test cadence test 1xH100 branch
  152. 2388b9ff 23:21:38 sota_crawler Add vocab-3lane tooling onto fractal cadence test cadence test 1xH100 branch
  153. 45bbccff 23:30:22 parameter-golf-lab Update README.md
  154. 45bbccff 23:30:22 sota_crawler Update README.md
  155. 45bbccff 23:30:22 SOTA_FINAL Update README.md
  156. 39206e51 23:30:33 parameter-golf-lab Make vocab 3-lane scripts portable and 1xH100-friendly
  157. 39206e51 23:30:33 sota_crawler Make vocab 3-lane scripts portable and 1xH100-friendly
  158. a7d367b2 23:41:33 parameter-golf-lab strategy: synthesize leaderboard techniques into fractal cadence test cadence test-Int6-QAT plan
  159. a7d367b2 23:41:33 sota_crawler strategy: synthesize leaderboard techniques into fractal cadence test cadence test-Int6-QAT plan
  160. 03329e12 23:51:13 parameter-golf-lab Add one-click 1xH100 fractal cadence test cadence test vocab L2 runner
  161. 03329e12 23:51:13 sota_crawler Add one-click 1xH100 fractal cadence test cadence test vocab L2 runner
  162. c3a96af1 00:35:45 parameter-golf-lab strategy: update leader to Bhautik Bavadiya (0.9695 BPB)
  163. c3a96af1 00:35:45 sota_crawler strategy: update leader to Bhautik Bavadiya (0.9695 BPB)
  164. ec8b9dc7 01:25:29 parameter-golf-lab strategy: decode Bavadiya's #1 techniques from PR #64
  165. ec8b9dc7 01:25:29 sota_crawler strategy: decode Bavadiya's #1 techniques from PR #64
  166. 6f6b2430 02:14:25 parameter-golf-lab Document 1xH100 fractal cadence test cadence test vocab runbook and ignore generated metadata
  167. 6f6b2430 02:14:25 sota_crawler Document 1xH100 fractal cadence test cadence test vocab runbook and ignore generated metadata
  168. fd53b754 02:20:07 parameter-golf-lab feat: int6 quantization with QAT + 3x MLP for 1xH100 testing
  169. fd53b754 02:20:07 sota_crawler feat: int6 quantization with QAT + 3x MLP for 1xH100 testing
  170. c94b999f 02:45:05 parameter-golf-lab feat: add QAT scheduling — warmup, stochastic quant, progressive bit annealing
  171. c94b999f 02:45:05 sota_crawler feat: add QAT scheduling — warmup, stochastic quant, progressive bit annealing
  172. 002e15b3 02:50:24 parameter-golf-lab results: first int6 QAT test — 1xH100, val_bpb 1.3488 (int8 roundtrip)
  173. 002e15b3 02:50:24 sota_crawler results: first int6 QAT test — 1xH100, val_bpb 1.3488 (int8 roundtrip)
  174. 3677fd1b 02:50:49 parameter-golf-lab Add sliding window eval + int6 QAT strategy with 1xH100 runner
  175. 3677fd1b 02:50:49 sota_crawler Add sliding window eval + int6 QAT strategy with 1xH100 runner
  176. 9ba5d0ec 02:51:48 parameter-golf-lab Remove baseline run from eval script, keep int6-only runs
  177. 9ba5d0ec 02:51:48 sota_crawler Remove baseline run from eval script, keep int6-only runs
  178. 3182f61c 03:16:39 parameter-golf-lab Set ITERATIONS=1080 to match 1xH100 wallclock so QAT actually activates
  179. 3182f61c 03:16:39 sota_crawler Set ITERATIONS=1080 to match 1xH100 wallclock so QAT actually activates
  180. e1098411 03:26:35 parameter-golf-lab SmearGate + OrthoInit + Muon WD + Int6 STE QAT + MLP 3x + Sliding Window
  181. e1098411 03:26:35 sota_crawler SmearGate + OrthoInit + Muon WD + Int6 STE QAT + MLP 3x + Sliding Window
  182. e1098411 03:26:35 SOTA_FINAL SmearGate + OrthoInit + Muon WD + Int6 STE QAT + MLP 3x + Sliding Window
  183. a4c19d28 03:27:30 parameter-golf-lab Restore ITERATIONS=20000 and support 8xGPU via NPROC
  184. a4c19d28 03:27:30 sota_crawler Restore ITERATIONS=20000 and support 8xGPU via NPROC
  185. 14cdf6f7 03:33:19 parameter-golf-lab Add submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA (mean val_bpb=1.1483, 3 seeds)
  186. 14cdf6f7 03:33:19 sota_crawler Add submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA (mean val_bpb=1.1483, 3 seeds)
  187. 14cdf6f7 03:33:19 SOTA_FINAL Add submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA (mean val_bpb=1.1483, 3 seeds)
  188. 614769fa 04:18:26 parameter-golf-lab Add MLP 3x and QAT ablation runs to eval suite
  189. 614769fa 04:18:26 sota_crawler Add MLP 3x and QAT ablation runs to eval suite
  190. f96aacc6 04:25:57 parameter-golf-lab Add SmearGate bigram embedding blending with isolated test script
  191. f96aacc6 04:25:57 sota_crawler Add SmearGate bigram embedding blending with isolated test script
  192. 58575865 04:46:08 parameter-golf-lab Add fractal cadence test cadence test with gravity, AttnRes, breathing + isolated test script
  193. 58575865 04:46:08 sota_crawler Add fractal cadence test cadence test with gravity, AttnRes, breathing + isolated test script
  194. 97a65df2 04:53:48 parameter-golf-lab Add 11L/512d deep config as run 4 to fill 16MB budget
  195. 97a65df2 04:53:48 sota_crawler Add 11L/512d deep config as run 4 to fill 16MB budget
  196. 429722f0 04:56:23 parameter-golf-lab Add standalone 11L/512d deep config test script
  197. 429722f0 04:56:23 sota_crawler Add standalone 11L/512d deep config test script
  198. 8e3d8892 04:57:41 parameter-golf-lab Update SmearGate test to use 11L/512d deep config
  199. 8e3d8892 04:57:41 sota_crawler Update SmearGate test to use 11L/512d deep config
DATE2026-03-19
DAY002
PRIMARY METRIC—
TESTS RUN0 measured rows
ARCHITECTURE FAMILY—
CLASSIFICATION—

SECTION 1.0 — TRAJECTORY

NO HEADLINE METRIC (VAL_BPB / VAL_LOSS / KERNEL RATIO) RECORDED ON THIS DATE.

SECTION 2.0 — TEST RUNS

No tests with measured METRIC on this date.