DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-06

val_bpb · 460 of 2087 · 1 warnings
findings mentioning this date
| 2026-04-06 | 1 | 33 |
audit summary
{
  "date": "2026-04-06",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 2087,
  "render_records": 460,
  "test_rows": 33,
  "warnings": 1
}
191 commits on 2026-04-06
  1. 3f1e8149 08:16:10 parameter-golf-lab Non-record: Parallel Residuals + Hessian-Aware SDClip (3-seed mean 1.08354 BPB)
  2. 3f1e8149 08:16:10 sota_crawler Non-record: Parallel Residuals + Hessian-Aware SDClip (3-seed mean 1.08354 BPB)
  3. 3f1e8149 08:16:10 SOTA_FINAL Non-record: Parallel Residuals + Hessian-Aware SDClip (3-seed mean 1.08354 BPB)
  4. 4b577913 08:23:14 parameter-golf-lab Fix LaTeX rendering
  5. 4b577913 08:23:14 sota_crawler Fix LaTeX rendering
  6. 4b577913 08:23:14 SOTA_FINAL Fix LaTeX rendering
  7. cd04a8b7 11:27:33 parameter-golf-lab Record: SP8192 + QK-Gain 5 + Legal Score-First TTT — val_bpb 1.08279 (3-seed mean)
  8. cd04a8b7 11:27:33 sota_crawler Record: SP8192 + QK-Gain 5 + Legal Score-First TTT — val_bpb 1.08279 (3-seed mean)
  9. cd04a8b7 11:27:33 SOTA_FINAL Record: SP8192 + QK-Gain 5 + Legal Score-First TTT — val_bpb 1.08279 (3-seed mean)
  10. 0e5b0788 14:27:07 parameter-golf-lab Add 11L GQA U-Net body II mixed-int lab + test_lab launch surface
  11. 0e5b0788 14:27:07 sota_crawler Add 11L GQA U-Net body II mixed-int lab + test_lab launch surface
  12. 0e5b0788 14:27:07 SOTA_FINAL Add 11L GQA U-Net body II mixed-int lab + test_lab launch surface
  13. 9b1ac893 14:40:35 parameter-golf-lab Fix test_lab launch scripts: walk up to find data/ at repo root
  14. 9b1ac893 14:40:35 sota_crawler Fix test_lab launch scripts: walk up to find data/ at repo root
  15. 9b1ac893 14:40:35 SOTA_FINAL Fix test_lab launch scripts: walk up to find data/ at repo root
  16. 0e2019aa 14:55:39 parameter-golf-lab Add 4xGPU control run: baseline quant policy (all int6, other=8)
  17. 0e2019aa 14:55:39 sota_crawler Add 4xGPU control run: baseline quant policy (all int6, other=8)
  18. 0e2019aa 14:55:39 SOTA_FINAL Add 4xGPU control run: baseline quant policy (all int6, other=8)
  19. ee20240e 15:02:39 parameter-golf-lab Add SplitHead QuantFix combo launchers
  20. ee20240e 15:02:39 sota_crawler Add SplitHead QuantFix combo launchers
  21. ee20240e 15:02:39 SOTA_FINAL Add SplitHead QuantFix combo launchers
  22. 3864434b 15:27:21 parameter-golf-lab Add 5-arm ablation sweep on 11L GQA U-Net body II mixed-int baseline
  23. 3864434b 15:27:21 sota_crawler Add 5-arm ablation sweep on 11L GQA U-Net body II mixed-int baseline
  24. 3864434b 15:27:21 SOTA_FINAL Add 5-arm ablation sweep on 11L GQA U-Net body II mixed-int baseline
  25. 3f285a5b 15:27:47 parameter-golf-lab Relax env preflight checks for modern torch/cuda and FA3 imports
  26. 3f285a5b 15:27:47 sota_crawler Relax env preflight checks for modern torch/cuda and FA3 imports
  27. 3f285a5b 15:27:47 SOTA_FINAL Relax env preflight checks for modern torch/cuda and FA3 imports
  28. 18041725 16:09:44 parameter-golf-lab Add 9-flat plus 1-crawler loop body 3-arm ablation sweep for 4xGPU
  29. 18041725 16:09:44 sota_crawler Add 9-flat plus 1-crawler loop body 3-arm ablation sweep for 4xGPU
  30. 18041725 16:09:44 SOTA_FINAL Add 9-flat plus 1-crawler loop body 3-arm ablation sweep for 4xGPU
  31. be1d225f 16:15:43 parameter-golf-lab Fix arms A+C: call torchrun directly instead of broken run.sh chain
  32. be1d225f 16:15:43 sota_crawler Fix arms A+C: call torchrun directly instead of broken run.sh chain
  33. be1d225f 16:15:43 SOTA_FINAL Fix arms A+C: call torchrun directly instead of broken run.sh chain
  34. ade7f828 17:12:00 parameter-golf-lab Add megarascal kernel fusion speed ablation (4x GPU) + gated attention gate
  35. ade7f828 17:12:00 sota_crawler Add megarascal kernel fusion speed ablation (4x GPU) + gated attention gate
  36. ade7f828 17:12:00 SOTA_FINAL Add megarascal kernel fusion speed ablation (4x GPU) + gated attention gate
  37. 879a31d2 17:13:14 parameter-golf-lab split-head crawler scale gate: gate script for SplitHead architecture isolation on 4xGPU
  38. 879a31d2 17:13:14 sota_crawler split-head crawler scale gate: gate script for SplitHead architecture isolation on 4xGPU
  39. 879a31d2 17:13:14 SOTA_FINAL split-head crawler scale gate: gate script for SplitHead architecture isolation on 4xGPU
  40. 8cdfe832 17:15:33 parameter-golf-lab 9-flat plus 1-crawler loop body ablation sweep results (seed=300, 4xGPU, 600s)
  41. 8cdfe832 17:15:33 sota_crawler 9-flat plus 1-crawler loop body ablation sweep results (seed=300, 4xGPU, 600s)
  42. 8cdfe832 17:15:33 SOTA_FINAL 9-flat plus 1-crawler loop body ablation sweep results (seed=300, 4xGPU, 600s)
  43. b8ac0071 17:29:27 parameter-golf-lab Log gated attention ablation result: DEAD, no signal on 11L GQA U-Net body II
  44. b8ac0071 17:29:27 sota_crawler Log gated attention ablation result: DEAD, no signal on 11L GQA U-Net body II
  45. b8ac0071 17:29:27 SOTA_FINAL Log gated attention ablation result: DEAD, no signal on 11L GQA U-Net body II
  46. ce2abb99 17:33:54 parameter-golf-lab Log full 11L GQA U-Net body II ablation sweep results + update pipeline
  47. ce2abb99 17:33:54 sota_crawler Log full 11L GQA U-Net body II ablation sweep results + update pipeline
  48. ce2abb99 17:33:54 SOTA_FINAL Log full 11L GQA U-Net body II ablation sweep results + update pipeline
  49. 05fb1d33 17:35:48 parameter-golf-lab 9-flat plus 1-crawler loop body stacked test + reorganize experiments into crawler/
  50. 05fb1d33 17:35:48 sota_crawler 9-flat plus 1-crawler loop body stacked test + reorganize experiments into crawler/
  51. 05fb1d33 17:35:48 SOTA_FINAL 9-flat plus 1-crawler loop body stacked test + reorganize experiments into crawler/
  52. f4b86cf7 17:45:06 parameter-golf-lab 11L GQA U-Net body III: mixed-int (attn=5, embed=8) + Brotli compression packaging compression packaging-11 + byte-shuffle
  53. f4b86cf7 17:45:06 sota_crawler 11L GQA U-Net body III: mixed-int (attn=5, embed=8) + Brotli compression packaging compression packaging-11 + byte-shuffle
  54. f4b86cf7 17:45:06 SOTA_FINAL 11L GQA U-Net body III: mixed-int (attn=5, embed=8) + Brotli compression packaging compression packaging-11 + byte-shuffle
  55. 01a805b5 17:48:04 parameter-golf-lab Add isolated megarascal arm C (fused norm+MLP) script
  56. 01a805b5 17:48:04 sota_crawler Add isolated megarascal arm C (fused norm+MLP) script
  57. 01a805b5 17:48:04 SOTA_FINAL Add isolated megarascal arm C (fused norm+MLP) script
  58. dab953d7 18:08:55 parameter-golf-lab 9-flat plus 1-crawler loop body II: full run with all improvements + mixed-bit quant
  59. dab953d7 18:08:55 sota_crawler 9-flat plus 1-crawler loop body II: full run with all improvements + mixed-bit quant
  60. dab953d7 18:08:55 SOTA_FINAL 9-flat plus 1-crawler loop body II: full run with all improvements + mixed-bit quant
  61. b1dd5442 18:10:28 parameter-golf-lab 9-flat plus 1-crawler loop body II: fix to 8xH100 production run + enable loop-aware GPTQ
  62. b1dd5442 18:10:28 sota_crawler 9-flat plus 1-crawler loop body II: fix to 8xH100 production run + enable loop-aware GPTQ
  63. b1dd5442 18:10:28 SOTA_FINAL 9-flat plus 1-crawler loop body II: fix to 8xH100 production run + enable loop-aware GPTQ
  64. 75fe2e85 18:49:56 parameter-golf-lab 11L GQA U-Net body III: SLOT-tuned transformer body V base (SLOT stripped) + mixed-int + Brotli compression packaging compression packaging
  65. 75fe2e85 18:49:56 sota_crawler 11L GQA U-Net body III: SLOT-tuned transformer body V base (SLOT stripped) + mixed-int + Brotli compression packaging compression packaging
  66. 75fe2e85 18:49:56 SOTA_FINAL 11L GQA U-Net body III: SLOT-tuned transformer body V base (SLOT stripped) + mixed-int + Brotli compression packaging compression packaging
  67. 404c999d 19:06:21 parameter-golf-lab E2E TTT ablation: 4-arm gate for both 9-flat plus 1-crawler loop body and split-head crawler scale gate
  68. 404c999d 19:06:21 sota_crawler E2E TTT ablation: 4-arm gate for both 9-flat plus 1-crawler loop body and split-head crawler scale gate
  69. 404c999d 19:06:21 SOTA_FINAL E2E TTT ablation: 4-arm gate for both 9-flat plus 1-crawler loop body and split-head crawler scale gate
  70. a897d16f 19:09:25 parameter-golf-lab Add SSM/TTT concept PR 3-arm ablation suite
  71. a897d16f 19:09:25 sota_crawler Add SSM/TTT concept PR 3-arm ablation suite
  72. a897d16f 19:09:25 SOTA_FINAL Add SSM/TTT concept PR 3-arm ablation suite
  73. 4673d531 19:20:50 parameter-golf-lab 11L GQA U-Net body III v2: vault baseline + Brotli compression packaging compression packaging + mixed-int ONLY
  74. 4673d531 19:20:50 sota_crawler 11L GQA U-Net body III v2: vault baseline + Brotli compression packaging compression packaging + mixed-int ONLY
  75. 4673d531 19:20:50 SOTA_FINAL 11L GQA U-Net body III v2: vault baseline + Brotli compression packaging compression packaging + mixed-int ONLY
  76. 0e2627a8 19:24:18 parameter-golf-lab 9-flat plus 1-crawler loop body III: rebuild on correct BWX 9F base (CRAWLER_LOOPS=3)
  77. 0e2627a8 19:24:18 sota_crawler 9-flat plus 1-crawler loop body III: rebuild on correct BWX 9F base (CRAWLER_LOOPS=3)
  78. 0e2627a8 19:24:18 SOTA_FINAL 9-flat plus 1-crawler loop body III: rebuild on correct BWX 9F base (CRAWLER_LOOPS=3)
  79. 96e4e8ee 19:31:54 parameter-golf-lab TTT ablation: fix 9-flat plus 1-crawler loop body arms to use BWX 9F base (NUM_FLAT_LAYERS=9)
  80. 96e4e8ee 19:31:54 sota_crawler TTT ablation: fix 9-flat plus 1-crawler loop body arms to use BWX 9F base (NUM_FLAT_LAYERS=9)
  81. 96e4e8ee 19:31:54 SOTA_FINAL TTT ablation: fix 9-flat plus 1-crawler loop body arms to use BWX 9F base (NUM_FLAT_LAYERS=9)
  82. 94a24d77 19:51:41 parameter-golf-lab Fix 11L GQA U-Net body III loader defaults and add ranked edge queue
  83. 94a24d77 19:51:41 sota_crawler Fix 11L GQA U-Net body III loader defaults and add ranked edge queue
  84. 94a24d77 19:51:41 SOTA_FINAL Fix 11L GQA U-Net body III loader defaults and add ranked edge queue
  85. e31287e2 20:06:48 parameter-golf-lab split-head crawler scale gate: record HAB3 gate results (seed 444) and mark fail
  86. e31287e2 20:06:48 sota_crawler split-head crawler scale gate: record HAB3 gate results (seed 444) and mark fail
  87. e31287e2 20:06:48 SOTA_FINAL split-head crawler scale gate: record HAB3 gate results (seed 444) and mark fail
  88. c479f9ff 20:48:13 parameter-golf-lab TTT ablation: disable torch.compile when TTT is enabled
  89. c479f9ff 20:48:13 sota_crawler TTT ablation: disable torch.compile when TTT is enabled
  90. c479f9ff 20:48:13 SOTA_FINAL TTT ablation: disable torch.compile when TTT is enabled
  91. 75e9e415 21:02:17 sota_nueral Initial import of sota_nueral workspace
  92. 44b960c5 21:20:03 parameter-golf-lab Add 11L GQA U-Net body IV clean runner and guarded test_lab launchers
  93. 44b960c5 21:20:03 sota_crawler Add 11L GQA U-Net body IV clean runner and guarded test_lab launchers
  94. 44b960c5 21:20:03 SOTA_FINAL Add 11L GQA U-Net body IV clean runner and guarded test_lab launchers
  95. 8a7c2369 21:22:40 parameter-golf-lab Fix 11L GQA U-Net body IV test_lab wrapper paths under neural/
  96. 8a7c2369 21:22:40 sota_crawler Fix 11L GQA U-Net body IV test_lab wrapper paths under neural/
  97. 8a7c2369 21:22:40 SOTA_FINAL Fix 11L GQA U-Net body IV test_lab wrapper paths under neural/
  98. 4c36850c 21:24:13 parameter-golf-lab Fix 11L GQA U-Net body IV train script path for neural workspace layout
  99. 4c36850c 21:24:13 sota_crawler Fix 11L GQA U-Net body IV train script path for neural workspace layout
  100. 4c36850c 21:24:13 SOTA_FINAL Fix 11L GQA U-Net body IV train script path for neural workspace layout
  101. bbb58449 21:29:01 sota_nueral Add test_lab launcher for PR_sidelane 8x linked sweep
  102. e7cb028a 21:35:37 parameter-golf-lab Pin 11L GQA U-Net body III launcher to neural/experiments path
  103. e7cb028a 21:35:37 sota_crawler Pin 11L GQA U-Net body III launcher to neural/experiments path
  104. e7cb028a 21:35:37 SOTA_FINAL Pin 11L GQA U-Net body III launcher to neural/experiments path
  105. b015909c 21:35:52 parameter-golf-lab Log resolved 11L GQA U-Net body III training script path at startup
  106. b015909c 21:35:52 sota_crawler Log resolved 11L GQA U-Net body III training script path at startup
  107. b015909c 21:35:52 SOTA_FINAL Log resolved 11L GQA U-Net body III training script path at startup
  108. e14f33a7 21:37:45 parameter-golf-lab Harden 11L GQA U-Net body III launcher defaults and disable legacy TTT/SLOT env drift
  109. e14f33a7 21:37:45 sota_crawler Harden 11L GQA U-Net body III launcher defaults and disable legacy TTT/SLOT env drift
  110. e14f33a7 21:37:45 SOTA_FINAL Harden 11L GQA U-Net body III launcher defaults and disable legacy TTT/SLOT env drift
  111. 05b877be 22:04:04 parameter-golf-lab Promote legacy 11L GQA U-Net body III runner2778 to canonical neural path
  112. 05b877be 22:04:04 sota_crawler Promote legacy 11L GQA U-Net body III runner2778 to canonical neural path
  113. 05b877be 22:04:04 SOTA_FINAL Promote legacy 11L GQA U-Net body III runner2778 to canonical neural path
  114. a5d5a4db 22:08:38 parameter-golf-lab 11L GQA U-Net body: hard-skip ttt eval when disabled
  115. a5d5a4db 22:08:38 sota_crawler 11L GQA U-Net body: hard-skip ttt eval when disabled
  116. a5d5a4db 22:08:38 SOTA_FINAL 11L GQA U-Net body: hard-skip ttt eval when disabled
  117. 92797205 22:26:05 parameter-golf-lab test_lab: add PR_sidelane 8x linked launcher
  118. 92797205 22:26:05 sota_crawler test_lab: add PR_sidelane 8x linked launcher
  119. 92797205 22:26:05 SOTA_FINAL test_lab: add PR_sidelane 8x linked launcher
  120. bb6cfaac 22:35:31 parameter-golf-lab 11L GQA U-Net body: add mixed+Brotli compression packaging compression packaging exporter and checkpoint eval mode
  121. bb6cfaac 22:35:31 sota_crawler 11L GQA U-Net body: add mixed+Brotli compression packaging compression packaging exporter and checkpoint eval mode
  122. bb6cfaac 22:35:31 SOTA_FINAL 11L GQA U-Net body: add mixed+Brotli compression packaging compression packaging exporter and checkpoint eval mode
  123. 743cd9a0 23:00:50 parameter-golf-lab test_lab: make PR_sidelane launcher path-portable
  124. 743cd9a0 23:00:50 sota_crawler test_lab: make PR_sidelane launcher path-portable
  125. 743cd9a0 23:00:50 SOTA_FINAL test_lab: make PR_sidelane launcher path-portable
  126. ad970d97 23:00:56 sota_nueral Add checkpoint-only 11L GQA U-Net body III GPTQ export launcher
  127. 5419a792 23:03:49 parameter-golf-lab Add 11L GQA U-Net body III checkpoint-only GPTQ export runner
  128. 5419a792 23:03:49 sota_crawler Add 11L GQA U-Net body III checkpoint-only GPTQ export runner
  129. 5419a792 23:03:49 SOTA_FINAL Add 11L GQA U-Net body III checkpoint-only GPTQ export runner
  130. 7a8d0b43 23:05:49 parameter-golf-lab crawler: add SSM/long-context research scaffolding and fix TTT eval grad path
  131. 7a8d0b43 23:05:49 sota_crawler crawler: add SSM/long-context research scaffolding and fix TTT eval grad path
  132. 7a8d0b43 23:05:49 SOTA_FINAL crawler: add SSM/long-context research scaffolding and fix TTT eval grad path
  133. 3a96606a 23:06:03 parameter-golf-lab Handle skip_weights shape drift when loading INIT_MODEL_PATH
  134. 3a96606a 23:06:03 sota_crawler Handle skip_weights shape drift when loading INIT_MODEL_PATH
  135. 3a96606a 23:06:03 SOTA_FINAL Handle skip_weights shape drift when loading INIT_MODEL_PATH
  136. 54d741c4 23:09:01 parameter-golf-lab crawler/ttt: log strike-1 and strike-2 gate outcomes
  137. 6b540cd3 23:09:09 parameter-golf-lab Add guarded checkpoint-export launcher for 11L GQA U-Net body
  138. 7af85b4f 23:09:09 parameter-golf-lab Add guarded checkpoint-export launcher for 11L GQA U-Net body
  139. 6b540cd3 23:09:09 sota_crawler Add guarded checkpoint-export launcher for 11L GQA U-Net body
  140. 6b540cd3 23:09:09 SOTA_FINAL Add guarded checkpoint-export launcher for 11L GQA U-Net body
  141. 4057e51c 00:40:24 parameter-golf-lab Normalize INIT_MODEL_PATH keys for runner2778 export
  142. 4057e51c 00:40:24 sota_crawler Normalize INIT_MODEL_PATH keys for runner2778 export
  143. 4057e51c 00:40:24 SOTA_FINAL Normalize INIT_MODEL_PATH keys for runner2778 export
  144. b95eb6a2 00:43:37 parameter-golf-lab Add auto checkpoint finder for runner2778 export
  145. b95eb6a2 00:43:37 sota_crawler Add auto checkpoint finder for runner2778 export
  146. b95eb6a2 00:43:37 SOTA_FINAL Add auto checkpoint finder for runner2778 export
  147. 9ac7f48f 00:56:37 parameter-golf-lab Add bounded quant sweep script for runner2778 export
  148. 9ac7f48f 00:56:37 sota_crawler Add bounded quant sweep script for runner2778 export
  149. 9ac7f48f 00:56:37 SOTA_FINAL Add bounded quant sweep script for runner2778 export
  150. 793a34b8 01:10:08 parameter-golf-lab Make runner2778 quant sweep quality-gated and safer
  151. 793a34b8 01:10:08 sota_crawler Make runner2778 quant sweep quality-gated and safer
  152. 793a34b8 01:10:08 SOTA_FINAL Make runner2778 quant sweep quality-gated and safer
  153. cf1fde3d 01:10:58 parameter-golf-lab test_lab: auto-bootstrap linked 8x sweep runner
  154. cf1fde3d 01:10:58 sota_crawler test_lab: auto-bootstrap linked 8x sweep runner
  155. cf1fde3d 01:10:58 SOTA_FINAL test_lab: auto-bootstrap linked 8x sweep runner
  156. 7af63f2f 01:25:51 parameter-golf-lab crawler/ttt: fix DDP forward_logits access in TTT eval
  157. 9cd8ac4c 01:52:04 parameter-golf-lab test_lab: vendor linked 8x sweep files in-repo
  158. 9cd8ac4c 01:52:04 sota_crawler test_lab: vendor linked 8x sweep files in-repo
  159. 9cd8ac4c 01:52:04 SOTA_FINAL test_lab: vendor linked 8x sweep files in-repo
  160. c98641c9 02:09:31 parameter-golf-lab crawler/ttt: avoid sliding-eval OOM by scoping grads to inner TTT step
  161. 3dc57271 02:28:32 parameter-golf-lab Add pinned 1.110 baseline file and one-shot runner
  162. 4e235817 02:28:32 parameter-golf-lab Add pinned 1.110 baseline file and one-shot runner
  163. 3dc57271 02:28:32 sota_crawler Add pinned 1.110 baseline file and one-shot runner
  164. 3dc57271 02:28:32 SOTA_FINAL Add pinned 1.110 baseline file and one-shot runner
  165. 683cd344 03:14:01 parameter-golf-lab test_lab: add V1 non-ngram longctx submission lane
  166. 683cd344 03:14:01 sota_crawler test_lab: add V1 non-ngram longctx submission lane
  167. 683cd344 03:14:01 SOTA_FINAL test_lab: add V1 non-ngram longctx submission lane
  168. 5039df4e 03:20:01 parameter-golf-lab test_lab: make V1 runner wallclock-profile driven
  169. 5039df4e 03:20:01 sota_crawler test_lab: make V1 runner wallclock-profile driven
  170. 5039df4e 03:20:01 SOTA_FINAL test_lab: make V1 runner wallclock-profile driven
  171. e189c9f3 04:02:31 parameter-golf-lab test_lab: add v1.2 non-ngram longctx runner with Brotli compression packaging compression packaging enforcement
  172. e189c9f3 04:02:31 sota_crawler test_lab: add v1.2 non-ngram longctx runner with Brotli compression packaging compression packaging enforcement
  173. e189c9f3 04:02:31 SOTA_FINAL test_lab: add v1.2 non-ngram longctx runner with Brotli compression packaging compression packaging enforcement
  174. d77e9afe 04:27:54 sota_nueral Add Brotli compression packaging compression packaging-capable 11L GQA U-Net body II experiment (2026-04-06)
  175. 85fea3dc 04:32:57 parameter-golf-lab Add Brotli compression packaging compression packaging-capable 11L GQA U-Net body II experiment (2026-04-06)
  176. 85fea3dc 04:32:57 sota_crawler Add Brotli compression packaging compression packaging-capable 11L GQA U-Net body II experiment (2026-04-06)
  177. 85fea3dc 04:32:57 SOTA_FINAL Add Brotli compression packaging compression packaging-capable 11L GQA U-Net body II experiment (2026-04-06)
  178. dd7d4dc9 04:34:44 parameter-golf-lab Fix nounset crash in Brotli compression packaging compression packaging run.sh — use export for env vars
  179. dd7d4dc9 04:34:44 sota_crawler Fix nounset crash in Brotli compression packaging compression packaging run.sh — use export for env vars
  180. dd7d4dc9 04:34:44 SOTA_FINAL Fix nounset crash in Brotli compression packaging compression packaging run.sh — use export for env vars
  181. 46301afb 04:34:45 sota_nueral Fix nounset crash in Brotli compression packaging compression packaging run.sh — use export for env vars
  182. 2615b89f 04:36:57 parameter-golf-lab test_lab: add v1.3 non-ngram Brotli compression packaging compression packaging depth/schedule sweep
  183. 2615b89f 04:36:57 sota_crawler test_lab: add v1.3 non-ngram Brotli compression packaging compression packaging depth/schedule sweep
  184. 2615b89f 04:36:57 SOTA_FINAL test_lab: add v1.3 non-ngram Brotli compression packaging compression packaging depth/schedule sweep
  185. 1b15aaf6 04:51:34 sota_nueral Record Brotli compression packaging compression packaging 8xH100 seed=444 run: 1.10942 BPB, 15.42MB (-135KB vs zstd)
  186. e19406b3 04:51:51 parameter-golf-lab Record Brotli compression packaging compression packaging 8xH100 seed=444 run: 1.10942 BPB, 15.42MB (-135KB vs zstd)
  187. e19406b3 04:51:51 sota_crawler Record Brotli compression packaging compression packaging 8xH100 seed=444 run: 1.10942 BPB, 15.42MB (-135KB vs zstd)
  188. e19406b3 04:51:51 SOTA_FINAL Record Brotli compression packaging compression packaging 8xH100 seed=444 run: 1.10942 BPB, 15.42MB (-135KB vs zstd)
  189. 31b910b2 04:55:16 parameter-golf-lab Add Brotli compression packaging compression packaging + mixed-int experiment (attn=5, mlp=6, embed=8)
  190. 31b910b2 04:55:16 sota_crawler Add Brotli compression packaging compression packaging + mixed-int experiment (attn=5, mlp=6, embed=8)
  191. 31b910b2 04:55:16 SOTA_FINAL Add Brotli compression packaging compression packaging + mixed-int experiment (attn=5, mlp=6, embed=8)
DATE2026-04-06
DAY020
PRIMARY METRICVAL_BPB
TESTS RUN33 unique (7 valid / 1 TTT leakage)
ARCHITECTURE FAMILYOTHER (×13) · JEPA (×6) · COMPRESSION PACKAGING EXPERIMENT (×4) · STATE-SPACE TTT VARIANT (×3) · LEADERBOARD TRANSFORMER VARIANTS (×3) · 9-FLAT PLUS 1-CRAWLER LOOP BODY (×2) · +2 MORE (×2)
CLASSIFICATIONEXPERIMENTAL 94% (31)/NEURAL 6% (2)
ARCHITECTURE RECIPE
9-FLAT + 1-CRAWLER LOOP BODYx2

9-flat plus 1-crawler loop body: flat U-Net context around a shared crawler block fired twice.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · NUM_FLAT_LAYERS=9 · NUM_CRAWLER_LAYERS=1 · CRAWLER_LOOPS=2 · USE_CRAWLER=1
CRAWLERCRAWLER_MLP_MULT=6.0 · INST_DIM=32 · CRAWLER_MLP_CHOKE_DIM=0 · CRAWLER_LOOP_ROPE_SCALES=9,1,1 · CRAWLER_MLP_LEAKY_SLOPE=0.5
PACKAGINGLOOP_AWARE_GPTQ=1 · BigramHash 2048x128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10
11L GQA U-NET BODYx1

11-layer dim-512 GQA U-Net transformer base with XSA, BigramHash, value embedding, and SmearGate.

BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · head_dim=64 · mlp_mult=3.0 · tie_embeddings=1
STRUCTUREencoder_layers=5 · decoder_layers=6 · skip_weights=5 · GQA attention · RMSNorm · relu_sq MLP · Muon matrix optimizer path
FEATURESBigramHash vocab=2048 dim=128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10 · SmearGate · logit_softcap=30
CRAWLER-SAFE TRAIN/EVAL SURFACEx1

Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · shared crawler block · looped crawler passes
FEATURESBigramHash · XSA · RoPE · crawler loop rope scales · instruction bottleneck
QUANT / EVALint6 roundtrip · int6 sliding-window eval · int8 zlib roundtrip · 8xH100 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-06 panel 1 of 2
csv data
VAL_BPB for 2026-04-06 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
COMPRESSION PACKAGING EXPERIMENT51.10941.11021.1442—
9-FLAT PLUS 1-CRAWLER LOOP BODY21.16181.20351.2451download
ALL VALID71.10941.14301.2451—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 31

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
304:51—Record Brotli compression packaging compression packaging 8xH100 seed=444 run…1.1094OK↑4.0%
details
413:468×H100Brotli compression packaging compression packaging.log1.1102OK↑4.0%
training_log
513:468×H100proven_seed444.log1.1442OK↑7.2%
training_log
613:468×H100Brotli compression packaging compression packaging.log1.1430OK↑7.1%
training_log
713:464×H1009-flat plus 1-crawler loop body.log1.1618OK↑8.9%
training_log
817:474×H100stacked_s444_20260406_174738.log1.2451OK↑16.7%
training_log
918:541×GB1010_jepa_proxy_distill_light.log (×3)3.6501CRASH—
training_log 1
training_log 2
training_log 3
1018:551×GB1011_jepa_proxy_distill_mid.log (×3)3.6969CRASH—
training_log 1
training_log 2
training_log 3
1118:561×GB1012_jepa_proxy_distill_plus_corr.log (×3)3.7129CRASH—
training_log 1
training_log 2
training_log 3
1219:021×GB1010_diff_proxy_dtg_gate.log (×2)3.6737CRASH—
training_log 1
training_log 2
1319:031×GB1011_diff_proxy_dtg_plus_ve.log (×2)3.7153CRASH—
training_log 1
training_log 2
1419:031×GB1012_diff_proxy_high_temp_distill.log (×2)3.7348CRASH—
training_log 1
training_log 2
1519:051×GB1010_hnet_proxy_bigram_dense.log4.1406CRASH—
training_log
1619:081×GB1010_ssm_proxy_crawler_loops4.log4.1395CRASH—
training_log
1719:111×GB1011_longctx_2k.log (×2)4.1458CRASH—
training_log 1
training_log 2
1819:141×GB1012_longctx_ttt_proxy.log (×3)4.1458CRASH—
training_log 1
training_log 2
training_log 3
1919:151×GB1000_control.log (×15)3.6457CRASH—
training_log 1
training_log 2
training_log 3
training_log 4
training_log 5
training_log 6
training_log 7
training_log 8
training_log 9
training_log 10
training_log 11
training_log 12
training_log 13
training_log 14
training_log 15
2019:151×GB1010_rlm_adapter_rank2.log (×2)3.6670CRASH—
training_log 1
training_log 2
2119:161×GB1011_rlm_adapter_rank4.log (×2)3.7059CRASH—
training_log 1
training_log 2
2219:171×GB1012_rlm_adapter_rank8_sparseproxy.log (×2)3.7125CRASH—
training_log 1
training_log 2
2319:211×GB1011_hnet_proxy_phrase_cache.log (×2)4.1395CRASH—
training_log 1
training_log 2
2419:231×GB1012_hnet_proxy_combo.log (×3)3.6714CRASH—
training_log 1
training_log 2
training_log 3
2519:551×GB1013_jepa_proxy_alpha005_densehash.log (×2)3.6681CRASH—
training_log 1
training_log 2
2619:561×GB1014_jepa_proxy_alpha005_densehash_vr.log3.6805CRASH—
training_log
2719:581×GB1015_jepa_proxy_alpha010_densehash.log3.6690CRASH—
training_log
2820:001×GB1013_diff_proxy_mtp_tiny_densehash.log3.6867CRASH—
training_log
2920:011×GB1014_diff_proxy_mtp_tiny.log3.6708CRASH—
training_log
3020:031×GB1015_diff_proxy_mtp_ultratiny_dtg.log3.7055CRASH—
training_log
3120:151×GB1016_diff_proxy_denoise_complement_densehash.log (×2)3.6688CRASH—
training_log 1
training_log 2
3220:181×GB1013_rlm_adapter_densehash.log (×2)3.6619CRASH—
training_log 1
training_log 2
3320:371×GB1013_longctx_ttt_densehash.log4.1397CRASH—
training_log

NEURAL TEST RUNS — 2

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
102:39—11L GQA U-Net body (×2)1.1099OK↑4.0%
details
204:03—FILL_IN_NAME (×2)0.0000INVALID—
details