DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-29

val_bpb · 204 of 807 · 2 warnings
findings mentioning this date
| 2026-03-29 | 2 | 38 |
audit summary
{
  "date": "2026-03-29",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 807,
  "render_records": 204,
  "test_rows": 38,
  "warnings": 2
}
116 commits on 2026-03-29
  1. 556b2fc9 13:47:26 parameter-golf-lab loop-instructed DeltaNet crawler body: causality fix + shard header fix + DeltaNet ablation
  2. 556b2fc9 13:47:26 sota_crawler loop-instructed DeltaNet crawler body: causality fix + shard header fix + DeltaNet ablation
  3. 556b2fc9 13:47:26 SOTA_FINAL loop-instructed DeltaNet crawler body: causality fix + shard header fix + DeltaNet ablation
  4. 6786f3ec 13:49:14 parameter-golf-lab Small fix to script.
  5. 3e096957 14:29:40 parameter-golf-lab loop-instructed DeltaNet crawler body: add ablation results
  6. 3e096957 14:29:40 sota_crawler loop-instructed DeltaNet crawler body: add ablation results
  7. 3e096957 14:29:40 SOTA_FINAL loop-instructed DeltaNet crawler body: add ablation results
  8. f74b9c9c 14:42:44 parameter-golf-lab crawler plus cubric n-gram stack: crawler-only ngram export body crawler + cubric n-gram mixer ngram oracle
  9. f74b9c9c 14:42:44 sota_crawler crawler plus cubric n-gram stack: crawler-only ngram export body crawler + cubric n-gram mixer ngram oracle
  10. f74b9c9c 14:42:44 SOTA_FINAL crawler plus cubric n-gram stack: crawler-only ngram export body crawler + cubric n-gram mixer ngram oracle
  11. 3a75282c 15:02:02 parameter-golf-lab crawler plus cubric n-gram stack: fix GPTQ wallclock violation (GPTQ_RESERVE_MS=30s)
  12. 3a75282c 15:02:02 sota_crawler crawler plus cubric n-gram stack: fix GPTQ wallclock violation (GPTQ_RESERVE_MS=30s)
  13. 3a75282c 15:02:02 SOTA_FINAL crawler plus cubric n-gram stack: fix GPTQ wallclock violation (GPTQ_RESERVE_MS=30s)
  14. 4efa746c 15:49:54 parameter-golf-lab crawler plus cubric n-gram stack: crawler-only ngram export body Crawler x Cubric Ngram9 — 0.4961 BPB (3-seed mean)
  15. 4efa746c 15:49:54 sota_crawler crawler plus cubric n-gram stack: crawler-only ngram export body Crawler x Cubric Ngram9 — 0.4961 BPB (3-seed mean)
  16. 4efa746c 15:49:54 SOTA_FINAL crawler plus cubric n-gram stack: crawler-only ngram export body Crawler x Cubric Ngram9 — 0.4961 BPB (3-seed mean)
  17. ad662c0f 18:28:53 parameter-golf-lab Add single-GPU crawler Nitrust runner package
  18. ad662c0f 18:28:53 sota_crawler Add single-GPU crawler Nitrust runner package
  19. 043a29d8 19:22:46 parameter-golf-lab Add Nitrust Rust modules and preflight/run scripts
  20. 043a29d8 19:22:46 sota_crawler Add Nitrust Rust modules and preflight/run scripts
  21. 3ec77bf9 19:40:46 parameter-golf-lab recurrent green-branch prototype: expose compile knobs in phrase-cache variant run.sh
  22. 3ec77bf9 19:40:46 sota_crawler recurrent green-branch prototype: expose compile knobs in phrase-cache variant run.sh
  23. bfa1d21c 19:40:54 parameter-golf-lab Crawler_Ablations_v1: add BKD backend ablation suite
  24. bfa1d21c 19:40:54 sota_crawler Crawler_Ablations_v1: add BKD backend ablation suite
  25. 3039fc66 19:42:14 parameter-golf-lab Nitrust: stage Rust modules and scripts (sync with remote)
  26. 3039fc66 19:42:14 sota_crawler Nitrust: stage Rust modules and scripts (sync with remote)
  27. 2dab7f0a 19:56:24 parameter-golf-lab Add recurrent green-branch prototype garage and coprime loader start
  28. 2dab7f0a 19:56:24 sota_crawler Add recurrent green-branch prototype garage and coprime loader start
  29. 9bbee273 20:13:06 parameter-golf-lab Fix recurrent green-branch prototype runner repo and data paths
  30. 9bbee273 20:13:06 sota_crawler Fix recurrent green-branch prototype runner repo and data paths
  31. 58fe1510 20:15:03 parameter-golf-lab Fix coprime loader CPU indexing dtype
  32. 58fe1510 20:15:03 sota_crawler Fix coprime loader CPU indexing dtype
  33. 6c24ae22 20:21:34 parameter-golf-lab Reduce coprime loader shard thrash
  34. 6c24ae22 20:21:34 sota_crawler Reduce coprime loader shard thrash
  35. aa30c720 20:24:02 parameter-golf-lab Let recurrent green-branch prototype runner honor loader overrides
  36. aa30c720 20:24:02 sota_crawler Let recurrent green-branch prototype runner honor loader overrides
  37. fd2aa43d 20:53:12 parameter-golf-lab Archive recurrent green-branch prototype sequential loser
  38. fd2aa43d 20:53:12 sota_crawler Archive recurrent green-branch prototype sequential loser
  39. 1c3bc247 20:59:54 parameter-golf-lab Add recurrent green-branch prototype JR-02 Triton candidate
  40. 1c3bc247 20:59:54 sota_crawler Add recurrent green-branch prototype JR-02 Triton candidate
  41. d79c58cf 21:06:23 parameter-golf-lab Fix recurrent green-branch prototype Triton bench cudagraph reuse
  42. d79c58cf 21:06:23 sota_crawler Fix recurrent green-branch prototype Triton bench cudagraph reuse
  43. 68e71097 21:08:02 parameter-golf-lab Add JR-02 Triton activation kernel path
  44. 68e71097 21:08:02 sota_crawler Add JR-02 Triton activation kernel path
  45. 24ab902e 21:08:16 parameter-golf-lab Crawler_Ablations_v1: make NPROC_PER_NODE overridable (was hardcoded 1)
  46. 24ab902e 21:08:16 sota_crawler Crawler_Ablations_v1: make NPROC_PER_NODE overridable (was hardcoded 1)
  47. 23364606 21:23:30 parameter-golf-lab Add recurrent green-branch prototype Triton track workspace
  48. 23364606 21:23:30 sota_crawler Add recurrent green-branch prototype Triton track workspace
  49. f4711267 21:24:21 parameter-golf-lab Archive JR-02 Triton activation result
  50. f4711267 21:24:21 sota_crawler Archive JR-02 Triton activation result
  51. b4f753a1 21:32:26 parameter-golf-lab Add Triton delta pop-test sequence
  52. b4f753a1 21:32:26 sota_crawler Add Triton delta pop-test sequence
  53. 4bf48712 21:58:48 parameter-golf-lab CrawlerT_Leg_1: Triton kernel fusion speed test
  54. 4bf48712 21:58:48 sota_crawler CrawlerT_Leg_1: Triton kernel fusion speed test
  55. 1392b8ea 22:07:04 parameter-golf-lab CrawlerT_Leg_1: bench results — max-autotune NO SIGNAL
  56. 1392b8ea 22:07:04 sota_crawler CrawlerT_Leg_1: bench results — max-autotune NO SIGNAL
  57. ff1e057c 22:11:18 parameter-golf-lab Add fixed-step 1GPU Nitrust A/B runner script
  58. ff1e057c 22:11:18 sota_crawler Add fixed-step 1GPU Nitrust A/B runner script
  59. 5be2d16d 22:17:52 parameter-golf-lab Add one-shot Nitrust setup script (deps + rust + build + preflight)
  60. 5be2d16d 22:17:52 sota_crawler Add one-shot Nitrust setup script (deps + rust + build + preflight)
  61. b3113f33 22:22:11 parameter-golf-lab Harden single-GPU Nitrust scripts for missing data/tokenizer
  62. b3113f33 22:22:11 sota_crawler Harden single-GPU Nitrust scripts for missing data/tokenizer
  63. 540af1db 22:27:04 parameter-golf-lab Crawler_Ablations_v1: add run record (2x failed attempts, pod setup needed)
  64. 540af1db 22:27:04 sota_crawler Crawler_Ablations_v1: add run record (2x failed attempts, pod setup needed)
  65. fa0c6e8b 22:27:06 parameter-golf-lab crawler_looped: per-loop LoRA adapters to break fixed-point collapse
  66. fa0c6e8b 22:27:06 sota_crawler crawler_looped: per-loop LoRA adapters to break fixed-point collapse
  67. 52937ff1 22:36:09 parameter-golf-lab pod_setup: download tokenizer + fix cargo hard-exit; preflight: add tokenizer check
  68. 52937ff1 22:36:09 sota_crawler pod_setup: download tokenizer + fix cargo hard-exit; preflight: add tokenizer check
  69. 8e121d8c 22:41:43 parameter-golf-lab Fix Triton pop-test wallclock overrides
  70. 8e121d8c 22:41:43 sota_crawler Fix Triton pop-test wallclock overrides
  71. 8a12b542 22:48:06 parameter-golf-lab Log Triton delta sweep results
  72. 8a12b542 22:48:06 sota_crawler Log Triton delta sweep results
  73. 2620800e 22:59:01 parameter-golf-lab crawler_looped: fix orphaned adapter params — add to Muon optimizer
  74. 2620800e 22:59:01 sota_crawler crawler_looped: fix orphaned adapter params — add to Muon optimizer
  75. 6e6a2eb8 22:59:28 parameter-golf-lab Add recurrent green-branch prototype MLP fusion branch
  76. 6e6a2eb8 22:59:28 sota_crawler Add recurrent green-branch prototype MLP fusion branch
  77. 989efcb0 23:47:30 parameter-golf-lab [Non-record] 1-Stage Byte-level H-Net at 17.5M: Dynamic Chunking Learns Word Boundaries
  78. dea0514e 23:58:06 parameter-golf-lab Fix typos in README
  79. 86a45e0a 00:21:45 parameter-golf-lab crawler plus cubric n-gram stack: crawler + cubric n-gram mixer oracle with confirmed LOOP_AWARE_GPTQ
  80. 86a45e0a 00:21:45 sota_crawler crawler plus cubric n-gram stack: crawler + cubric n-gram mixer oracle with confirmed LOOP_AWARE_GPTQ
  81. ed08ba8b 00:40:42 parameter-golf-lab Non-record: MDLM Diffusion — val_var_bpb 1.1465 (2xH100)
  82. c94de0ab 01:37:10 parameter-golf-lab 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  83. c94de0ab 01:37:10 sota_crawler 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  84. 799ee5cf 01:42:08 parameter-golf-lab 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  85. 52a2c7a6 01:42:08 parameter-golf-lab 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  86. 799ee5cf 01:42:08 sota_crawler 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  87. 52a2c7a6 01:42:08 sota_crawler 11L GQA U-Net body: recurrent green-branch prototype v1 + Coprime Loader — 3-seed base quality submission
  88. 17c5faef 01:53:35 parameter-golf-lab 11L GQA U-Net body: add 3-seed training logs (seeds 300, 42, 444)
  89. cd4c4d28 01:53:35 parameter-golf-lab 11L GQA U-Net body: add 3-seed training logs (seeds 300, 42, 444)
  90. 17c5faef 01:53:35 sota_crawler 11L GQA U-Net body: add 3-seed training logs (seeds 300, 42, 444)
  91. cd4c4d28 01:53:35 sota_crawler 11L GQA U-Net body: add 3-seed training logs (seeds 300, 42, 444)
  92. e6d11d87 01:58:14 parameter-golf-lab Log JR-03 fused MLP result as loser (with Triton-node caveat)
  93. e6d11d87 01:58:14 sota_crawler Log JR-03 fused MLP result as loser (with Triton-node caveat)
  94. e6d11d87 01:58:14 SOTA_FINAL Log JR-03 fused MLP result as loser (with Triton-node caveat)
  95. 0fd7d8de 02:51:22 parameter-golf-lab 11L GQA U-Net body: attach GPTQ+ZSTD compression pipeline for submission
  96. 0fd7d8de 02:51:22 sota_crawler 11L GQA U-Net body: attach GPTQ+ZSTD compression pipeline for submission
  97. 2dbe4a54 02:53:15 parameter-golf-lab 11L GQA U-Net body: lock all settings in run.sh, seed remains overridable
  98. 2dbe4a54 02:53:15 sota_crawler 11L GQA U-Net body: lock all settings in run.sh, seed remains overridable
  99. 820ea9e3 02:57:58 parameter-golf-lab 11L GQA U-Net body: fix REPO_ROOT depth (was experiments/, needs repo root)
  100. 820ea9e3 02:57:58 sota_crawler 11L GQA U-Net body: fix REPO_ROOT depth (was experiments/, needs repo root)
  101. a7f01de8 03:21:34 parameter-golf-lab 11L GQA U-Net body: fix bank quantization — int6 per-row instead of int8 scalar
  102. a7f01de8 03:21:34 sota_crawler 11L GQA U-Net body: fix bank quantization — int6 per-row instead of int8 scalar
  103. c637bbe9 03:27:06 parameter-golf-lab 11L GQA U-Net body: add standalone JR recovery compression block copy
  104. c637bbe9 03:27:06 sota_crawler 11L GQA U-Net body: add standalone JR recovery compression block copy
  105. 1a8501a9 03:40:57 parameter-golf-lab Crawler_Leg_1: add run_all.sh sequencer for all 11 ablation arms
  106. 1a8501a9 03:40:57 sota_crawler Crawler_Leg_1: add run_all.sh sequencer for all 11 ablation arms
  107. 1a8501a9 03:40:57 SOTA_FINAL Crawler_Leg_1: add run_all.sh sequencer for all 11 ablation arms
  108. 946f0a75 03:52:08 parameter-golf-lab 11L GQA U-Net body II: skip GPTQ + embed int6 — full 600s, target <16MB
  109. 946f0a75 03:52:08 sota_crawler 11L GQA U-Net body II: skip GPTQ + embed int6 — full 600s, target <16MB
  110. 946f0a75 03:52:08 SOTA_FINAL 11L GQA U-Net body II: skip GPTQ + embed int6 — full 600s, target <16MB
  111. f1ce7c9b 04:13:38 parameter-golf-lab SOTA: 11L GQA U-Net body II — new best legal submission 1.10986874 BPB, 15.44MB
  112. f1ce7c9b 04:13:38 sota_crawler SOTA: 11L GQA U-Net body II — new best legal submission 1.10986874 BPB, 15.44MB
  113. f1ce7c9b 04:13:38 SOTA_FINAL SOTA: 11L GQA U-Net body II — new best legal submission 1.10986874 BPB, 15.44MB
  114. 39ed402b 04:53:35 parameter-golf-lab Record: 11L GQA U-Net body — val_bpb 1.1099 (3-seed mean)
  115. 39ed402b 04:53:35 sota_crawler Record: 11L GQA U-Net body — val_bpb 1.1099 (3-seed mean)
  116. 39ed402b 04:53:35 SOTA_FINAL Record: 11L GQA U-Net body — val_bpb 1.1099 (3-seed mean)
DATE2026-03-29
DAY012
PRIMARY METRICVAL_BPB
TESTS RUN38 unique (17 valid / 5 TTT leakage)
ARCHITECTURE FAMILYCRAWLER PLUS CUBRIC N-GRAM STACK (×12) · TRITON/MODEL CO-DESIGN BODY (×12) · TRACE AND FLOW-CAPTURE WRAPPER (×6) · LOOP-INSTRUCTED DELTANET CRAWLER BODY (×5) · CRAWLER-ONLY NGRAM EXPORT BODY (×2) · 11L GQA U-NET BODY (×1)
CLASSIFICATIONEXPERIMENTAL 97% (37)/NEURAL 3% (1)
ARCHITECTURE RECIPE
LOOP-INSTRUCTED DELTANET CRAWLER BODYx5

Crawler-capable GQA body with loop instruction projection, optional DeltaNet memory, and loop-aware GPTQ experiments.

BASE BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · mlp_mult=3.0 · BigramHash 2048x128 · XSA last_n=11 · rope_dims=16
CRAWLER BODYflat transformer blocks around shared crawler block · crawler_mlp_mult=4.0 default · inst_dim=32 · loop instruction projection · crawler_loop_rope_scales=1,1,1 default · optional DeltaNet memory
QUANT PATHloop-aware GPTQ option · crawler Hessian collection · EMA / no-EMA ablations · int6 sliding-window export path
CRAWLER-ONLY NGRAM EXPORT BODYx2

Crawler body with the fast ngram finish: crawler architecture retained, CPU-heavy phrase/regime paths removed.

MODEL BODYcrawler-only instructed-recurrence body · DELTA_NET_HEADS=0 · model_dim=512 · num_heads=8 · num_kv_heads=4 · int6+zstd target under 11 MB
EVAL FINISHngram9 eval stack · NGRAM_DIRICHLET=1 · remove NGRAM_CHUNK_TOKENS=65536 · remove PHRASE_CACHE · remove REGIME_TRACKER
11L GQA U-NET BODYx1

11-layer dim-512 GQA U-Net transformer base with XSA, BigramHash, value embedding, and SmearGate.

BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · head_dim=64 · mlp_mult=3.0 · tie_embeddings=1
STRUCTUREencoder_layers=5 · decoder_layers=6 · skip_weights=5 · GQA attention · RMSNorm · relu_sq MLP · Muon matrix optimizer path
FEATURESBigramHash vocab=2048 dim=128 · XSA last_n=11 · rope_dims=16 · VE dim=128 layers=9,10 · SmearGate · logit_softcap=30

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-03-29 panel 1 of 2
csv data
VAL_BPB for 2026-03-29 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
CRAWLER PLUS CUBRIC N-GRAM STACK41.18241.18641.1874download
TRITON/MODEL CO-DESIGN BODY101.11061.13481.1356download
LOOP-INSTRUCTED DELTANET CRAWLER BODY21.18231.18911.1958download
11L GQA U-NET BODY11.10991.10991.1099download
ALL VALID171.10991.13521.1958—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 37

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
100:028×H100 (runpod)loop-instructed DeltaNet crawler body.log1.0251INVALID—
training_log
200:198×H100 (runpod)loop-instructed DeltaNet crawler body.log0.8469INVALID—
training_log
300:348×H100 (runpod)loop-instructed DeltaNet crawler body.log0.7744INVALID—
training_log
402:471×GB10trace and flow-capture wrapper.log (×2)3.3254CRASH—
training_log 1
training_log 2
613:46—crawler plus cubric n-gram stack: crawler-only ngram export body Crawler x Cu…0.4961INVALID—
details
713:518×H100 (runpod)loop-instructed DeltaNet crawler body.log1.1823OK↑10.8%
training_log
814:128×H100 (runpod)loop-instructed DeltaNet crawler body.log1.1958OK↑12.0%
training_log
914:468×H100 (runpod)crawler plus cubric n-gram stack.log1.1824OK↑10.8%
training_log
1015:038×H100 (runpod)crawler plus cubric n-gram stack.log1.1874OK↑11.3%
training_log
1115:188×H100 (runpod)crawler plus cubric n-gram stack.log1.1860OK↑11.1%
training_log
1215:348×H100 (runpod)crawler plus cubric n-gram stack.log1.1868OK↑11.2%
training_log
1315:49—crawler plus cubric n-gram stack: crawler-only ngram export body Crawler x Cu…0.4961INVALID—
details
1418:001×GB10trace and flow-capture wrapper.log3.4656CRASH—
training_log
1518:001×GB10trace and flow-capture wrapper.log3.4631CRASH—
training_log
1618:111×GB10trace and flow-capture wrapper.log3.4523CRASH—
training_log
1718:431×RTX 5090BW_LOOPVIZ_ANCHOR.log4.4298CRASH—
training_log
1818:431×GB10BW_LOOPVIZ_WIDTH640.log5.5728CRASH—
training_log
1918:441×GB10BW_LOOPVIZ_DEPTH6.log4.6313CRASH—
training_log
2018:561×GB10BW-00_anchor.log4.4928CRASH—
training_log
2118:571×GB10BW-01_width_576.log5.0865CRASH—
training_log
2218:571×GB10BW-02_width_640.log5.6237CRASH—
training_log
2318:571×GB10BW-03_depth_5flat.log4.5447CRASH—
training_log
2418:571×GB10BW-04_depth_6flat.log4.6790CRASH—
training_log
2520:158×H100 (runpod)recurrent green-branch prototype.log4.1054CRASH—
training_log
2620:181×GB10trace and flow-capture wrapper.log3.5409CRASH—
training_log
2720:208×H100 (runpod)recurrent green-branch prototype.log4.1054CRASH—
training_log
2820:228×H100 (runpod)recurrent green-branch prototype.log1.1106OK↑4.1%
training_log
2920:368×H100 (runpod)recurrent green-branch prototype.log1.1118OK↑4.2%
training_log
3021:088×H100 (runpod)recurrent green-branch prototype.log1.1110OK↑4.1%
training_log
3121:348×H100 (runpod)recurrent green-branch prototype.log1.1349OK↑6.3%
training_log
3221:478×H100 (runpod)recurrent green-branch prototype.log1.1351OK↑6.4%
training_log
3321:588×H100 (runpod)recurrent green-branch prototype.log1.1352OK↑6.4%
training_log
3422:098×H100 (runpod)recurrent green-branch prototype.log1.1354OK↑6.4%
training_log
3522:208×H100 (runpod)recurrent green-branch prototype.log1.1347OK↑6.3%
training_log
3622:318×H100 (runpod)recurrent green-branch prototype.log1.1356OK↑6.4%
training_log
3722:498×H100 (runpod)recurrent green-branch prototype.log1.1106OK↑4.1%
training_log
3823:571×GB10trace and flow-capture wrapper.log3.5290CRASH—
training_log

NEURAL TEST RUNS — 1

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
504:53—Record: 11L GQA U-Net body — val_bpb 1.1099 (3-seed mean) (×3)1.1099OK↑4.0%
details