DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-27

val_bpb · 457 of 565 · 4 warnings
findings mentioning this date
| 2026-03-27 | 4 | 60 |
audit summary
{
  "date": "2026-03-27",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 565,
  "render_records": 457,
  "test_rows": 60,
  "warnings": 4
}
212 commits on 2026-03-27
  1. b7e9a07d 05:06:36 parameter-golf-lab recurrent green-branch prototype v5: Synapse v2 — GPU-native hash bridge (<1ms/step)
  2. b7e9a07d 05:06:36 sota_crawler recurrent green-branch prototype v5: Synapse v2 — GPU-native hash bridge (<1ms/step)
  3. b7e9a07d 05:06:36 SOTA_FINAL recurrent green-branch prototype v5: Synapse v2 — GPU-native hash bridge (<1ms/step)
  4. e11298f9 05:15:47 parameter-golf-lab Freeze SOTA: legal n-gram GPU mixer base 1.1129 ngram 0.4489 (2026-03-27)
  5. e11298f9 05:15:47 sota_crawler Freeze SOTA: legal n-gram GPU mixer base 1.1129 ngram 0.4489 (2026-03-27)
  6. e11298f9 05:15:47 SOTA_FINAL Freeze SOTA: legal n-gram GPU mixer base 1.1129 ngram 0.4489 (2026-03-27)
  7. 7d2b5206 05:16:20 parameter-golf-lab Add SOTA folder README: only add, never delete or modify
  8. 7d2b5206 05:16:20 sota_crawler Add SOTA folder README: only add, never delete or modify
  9. 7d2b5206 05:16:20 SOTA_FINAL Add SOTA folder README: only add, never delete or modify
  10. 8ec6a615 05:29:39 parameter-golf-lab Fix: remove step counter that breaks torch.compile fullgraph
  11. 8ec6a615 05:29:39 sota_crawler Fix: remove step counter that breaks torch.compile fullgraph
  12. 8ec6a615 05:29:39 SOTA_FINAL Fix: remove step counter that breaks torch.compile fullgraph
  13. e3ae59a4 05:48:15 parameter-golf-lab Log v4/v5 Synapse + VALUE_RESIDUAL results — all dead
  14. e3ae59a4 05:48:15 sota_crawler Log v4/v5 Synapse + VALUE_RESIDUAL results — all dead
  15. e3ae59a4 05:48:15 SOTA_FINAL Log v4/v5 Synapse + VALUE_RESIDUAL results — all dead
  16. 6ae55ed0 06:16:10 parameter-golf-lab recurrent green-branch prototype: training oracle + Dirichlet mixing + matrix_lr=0.03
  17. 6ae55ed0 06:16:10 sota_crawler recurrent green-branch prototype: training oracle + Dirichlet mixing + matrix_lr=0.03
  18. 6ae55ed0 06:16:10 SOTA_FINAL recurrent green-branch prototype: training oracle + Dirichlet mixing + matrix_lr=0.03
  19. c48c0604 06:23:17 parameter-golf-lab phrase-cache variant: disable training oracle by default (legally gray)
  20. c48c0604 06:23:17 sota_crawler phrase-cache variant: disable training oracle by default (legally gray)
  21. c48c0604 06:23:17 SOTA_FINAL phrase-cache variant: disable training oracle by default (legally gray)
  22. f8caa0c0 06:33:57 parameter-golf-lab recurrent green-branch prototype: add zero-cost H100 sweeps and robust trainer toggles
  23. f8caa0c0 06:33:57 sota_crawler recurrent green-branch prototype: add zero-cost H100 sweeps and robust trainer toggles
  24. f8caa0c0 06:33:57 SOTA_FINAL recurrent green-branch prototype: add zero-cost H100 sweeps and robust trainer toggles
  25. 9e826d96 06:38:57 parameter-golf-lab phrase-cache variant: phrase cache + regime tracker + warmdown=2000 + chunk=65K
  26. 9e826d96 06:38:57 sota_crawler phrase-cache variant: phrase cache + regime tracker + warmdown=2000 + chunk=65K
  27. 9e826d96 06:38:57 SOTA_FINAL phrase-cache variant: phrase cache + regime tracker + warmdown=2000 + chunk=65K
  28. c185a8d6 07:20:34 parameter-golf-lab Add Siphon: ensemble-objective training + WARMDOWN2000 SOTA entry
  29. c185a8d6 07:20:34 sota_crawler Add Siphon: ensemble-objective training + WARMDOWN2000 SOTA entry
  30. c185a8d6 07:20:34 SOTA_FINAL Add Siphon: ensemble-objective training + WARMDOWN2000 SOTA entry
  31. 63c27e13 07:30:01 parameter-golf-lab instructed-recurrence crawler: Instructed Recurrence — content-derived loop instructions for shared crawler
  32. 63c27e13 07:30:01 sota_crawler instructed-recurrence crawler: Instructed Recurrence — content-derived loop instructions for shared crawler
  33. 63c27e13 07:30:01 SOTA_FINAL instructed-recurrence crawler: Instructed Recurrence — content-derived loop instructions for shared crawler
  34. 4ab4ced6 07:31:45 parameter-golf-lab instructed-recurrence crawler: add hypothesis and ablation plan
  35. 4ab4ced6 07:31:45 sota_crawler instructed-recurrence crawler: add hypothesis and ablation plan
  36. 4ab4ced6 07:31:45 SOTA_FINAL instructed-recurrence crawler: add hypothesis and ablation plan
  37. 7a81eece 07:44:59 parameter-golf-lab Reorganize: move master runner to experiments/Biology_concepts/run_all.sh
  38. 7a81eece 07:44:59 sota_crawler Reorganize: move master runner to experiments/Biology_concepts/run_all.sh
  39. 7a81eece 07:44:59 SOTA_FINAL Reorganize: move master runner to experiments/Biology_concepts/run_all.sh
  40. 95e93330 07:49:26 parameter-golf-lab Add recurrent green-branch prototype variant (optimized SOTA): v1 + WARMDOWN_ITERS=2000
  41. 95e93330 07:49:26 sota_crawler Add recurrent green-branch prototype variant (optimized SOTA): v1 + WARMDOWN_ITERS=2000
  42. 95e93330 07:49:26 SOTA_FINAL Add recurrent green-branch prototype variant (optimized SOTA): v1 + WARMDOWN_ITERS=2000
  43. 52680822 08:06:55 parameter-golf-lab Add Biology Concepts sweep findings — EMA teacher/student integration vs baseline analysis
  44. 52680822 08:06:55 sota_crawler Add Biology Concepts sweep findings — EMA teacher/student integration vs baseline analysis
  45. 52680822 08:06:55 SOTA_FINAL Add Biology Concepts sweep findings — EMA teacher/student integration vs baseline analysis
  46. 516e2c80 08:23:23 parameter-golf-lab Add recurrent green-branch prototype variant: v6 + complement-mix alpha=0.5
  47. 516e2c80 08:23:23 sota_crawler Add recurrent green-branch prototype variant: v6 + complement-mix alpha=0.5
  48. 516e2c80 08:23:23 SOTA_FINAL Add recurrent green-branch prototype variant: v6 + complement-mix alpha=0.5
  49. 9a58d144 08:31:36 parameter-golf-lab instructed-recurrence crawler: fix compile — COMPILE_FULLGRAPH=0 for crawler loop
  50. 9a58d144 08:31:36 sota_crawler instructed-recurrence crawler: fix compile — COMPILE_FULLGRAPH=0 for crawler loop
  51. 9a58d144 08:31:36 SOTA_FINAL instructed-recurrence crawler: fix compile — COMPILE_FULLGRAPH=0 for crawler loop
  52. 15c66fcc 08:37:37 parameter-golf-lab instructed-recurrence crawler: CRAWLER_LOOPS=4 — exploit weight-sharing compression
  53. 15c66fcc 08:37:37 sota_crawler instructed-recurrence crawler: CRAWLER_LOOPS=4 — exploit weight-sharing compression
  54. 15c66fcc 08:37:37 SOTA_FINAL instructed-recurrence crawler: CRAWLER_LOOPS=4 — exploit weight-sharing compression
  55. 909901e6 08:42:36 parameter-golf-lab Log v7 results: complement-mix alpha=0.5 worse than v1
  56. 909901e6 08:42:36 sota_crawler Log v7 results: complement-mix alpha=0.5 worse than v1
  57. 909901e6 08:42:36 SOTA_FINAL Log v7 results: complement-mix alpha=0.5 worse than v1
  58. 812599db 15:10:16 parameter-golf-lab instructed-recurrence crawler: CRAWLER_QUANT_INT8 — int8 precision for shared crawler block
  59. 812599db 15:10:16 sota_crawler instructed-recurrence crawler: CRAWLER_QUANT_INT8 — int8 precision for shared crawler block
  60. 812599db 15:10:16 SOTA_FINAL instructed-recurrence crawler: CRAWLER_QUANT_INT8 — int8 precision for shared crawler block
  61. c641e5e4 15:15:18 parameter-golf-lab Add vast_instructed-recurrence crawler.sh — single GPU instructed-recurrence crawler launcher for Vast.ai
  62. c641e5e4 15:15:18 sota_crawler Add vast_instructed-recurrence crawler.sh — single GPU instructed-recurrence crawler launcher for Vast.ai
  63. c641e5e4 15:15:18 SOTA_FINAL Add vast_instructed-recurrence crawler.sh — single GPU instructed-recurrence crawler launcher for Vast.ai
  64. 8811d79c 15:30:04 parameter-golf-lab recurrent green-branch prototype Green SOTA: 1.1129 sliding / 0.4489 ngram (8xH100 600s)
  65. 8811d79c 15:30:04 sota_crawler recurrent green-branch prototype Green SOTA: 1.1129 sliding / 0.4489 ngram (8xH100 600s)
  66. ce5e317e 15:56:50 parameter-golf-lab Add biology-inspired DeltaNet seam sweep: DeltaNet × Biology Concepts architecture
  67. ce5e317e 15:56:50 sota_crawler Add biology-inspired DeltaNet seam sweep: DeltaNet × Biology Concepts architecture
  68. ce5e317e 15:56:50 SOTA_FINAL Add biology-inspired DeltaNet seam sweep: DeltaNet × Biology Concepts architecture
  69. 38479b9d 16:20:06 parameter-golf-lab biology-inspired DeltaNet seam sweep-0: GatedDeltaNet × Bio Seam architecture skeleton
  70. 38479b9d 16:20:06 sota_crawler biology-inspired DeltaNet seam sweep-0: GatedDeltaNet × Bio Seam architecture skeleton
  71. 38479b9d 16:20:06 SOTA_FINAL biology-inspired DeltaNet seam sweep-0: GatedDeltaNet × Bio Seam architecture skeleton
  72. 2df9c72e 16:26:58 parameter-golf-lab Fix bio concept scripts: make MAX_WALLCLOCK_SECONDS env-overridable
  73. 2df9c72e 16:26:58 sota_crawler Fix bio concept scripts: make MAX_WALLCLOCK_SECONDS env-overridable
  74. 2df9c72e 16:26:58 SOTA_FINAL Fix bio concept scripts: make MAX_WALLCLOCK_SECONDS env-overridable
  75. 8b93705a 16:40:50 parameter-golf-lab biology-inspired DeltaNet seam sweep-1: Add four bio seam controllers (Myelin, Circadian, Clonal, Astrocyte)
  76. 8b93705a 16:40:50 sota_crawler biology-inspired DeltaNet seam sweep-1: Add four bio seam controllers (Myelin, Circadian, Clonal, Astrocyte)
  77. 8b93705a 16:40:50 SOTA_FINAL biology-inspired DeltaNet seam sweep-1: Add four bio seam controllers (Myelin, Circadian, Clonal, Astrocyte)
  78. b0776f18 16:48:18 parameter-golf-lab instructed-recurrence crawler micro: device-flexible concept test for GB10 Blackwell DGX Spark
  79. b0776f18 16:48:18 sota_crawler instructed-recurrence crawler micro: device-flexible concept test for GB10 Blackwell DGX Spark
  80. b0776f18 16:48:18 SOTA_FINAL instructed-recurrence crawler micro: device-flexible concept test for GB10 Blackwell DGX Spark
  81. da80af1d 16:57:27 parameter-golf-lab instructed-recurrence crawler: add DeltaNet associative memory to crawler reservoir
  82. da80af1d 16:57:27 sota_crawler instructed-recurrence crawler: add DeltaNet associative memory to crawler reservoir
  83. da80af1d 16:57:27 SOTA_FINAL instructed-recurrence crawler: add DeltaNet associative memory to crawler reservoir
  84. fa21139e 18:05:58 parameter-golf-lab instructed-recurrence crawler micro: add -u flag for unbuffered stdout through tee pipe
  85. fa21139e 18:05:58 sota_crawler instructed-recurrence crawler micro: add -u flag for unbuffered stdout through tee pipe
  86. fa21139e 18:05:58 SOTA_FINAL instructed-recurrence crawler micro: add -u flag for unbuffered stdout through tee pipe
  87. 531f98f6 18:10:46 parameter-golf-lab vast: blacklist offer 33510639 (103.42.50.244 — SSH never connects)
  88. 531f98f6 18:10:46 sota_crawler vast: blacklist offer 33510639 (103.42.50.244 — SSH never connects)
  89. 531f98f6 18:10:46 SOTA_FINAL vast: blacklist offer 33510639 (103.42.50.244 — SSH never connects)
  90. ff7069b5 18:34:08 parameter-golf-lab instructed-recurrence crawler DeltaNet: disable compile on forward to prevent T-loop OOM
  91. ff7069b5 18:34:08 sota_crawler instructed-recurrence crawler DeltaNet: disable compile on forward to prevent T-loop OOM
  92. ff7069b5 18:34:08 SOTA_FINAL instructed-recurrence crawler DeltaNet: disable compile on forward to prevent T-loop OOM
  93. 36845e34 18:37:31 parameter-golf-lab instructed-recurrence crawler run.sh: DELTA_NET_HEADS=0 for core concept test
  94. 36845e34 18:37:31 sota_crawler instructed-recurrence crawler run.sh: DELTA_NET_HEADS=0 for core concept test
  95. 36845e34 18:37:31 SOTA_FINAL instructed-recurrence crawler run.sh: DELTA_NET_HEADS=0 for core concept test
  96. fa4c218c 18:41:42 parameter-golf-lab instructed-recurrence crawler: suppress inductor NaN in RoPE bounds analysis (PyTorch 2.4 bug)
  97. fa4c218c 18:41:42 sota_crawler instructed-recurrence crawler: suppress inductor NaN in RoPE bounds analysis (PyTorch 2.4 bug)
  98. fa4c218c 18:41:42 SOTA_FINAL instructed-recurrence crawler: suppress inductor NaN in RoPE bounds analysis (PyTorch 2.4 bug)
  99. b4968bec 18:46:35 parameter-golf-lab biology-inspired DeltaNet seam sweep: disable torch.compile on GatedDeltaNet.forward
  100. b4968bec 18:46:35 sota_crawler biology-inspired DeltaNet seam sweep: disable torch.compile on GatedDeltaNet.forward
  101. b4968bec 18:46:35 SOTA_FINAL biology-inspired DeltaNet seam sweep: disable torch.compile on GatedDeltaNet.forward
  102. f74175d4 18:48:41 parameter-golf-lab biology-inspired DeltaNet seam sweep run.sh: set COMPILE_FULLGRAPH=0
  103. f74175d4 18:48:41 sota_crawler biology-inspired DeltaNet seam sweep run.sh: set COMPILE_FULLGRAPH=0
  104. f74175d4 18:48:41 SOTA_FINAL biology-inspired DeltaNet seam sweep run.sh: set COMPILE_FULLGRAPH=0
  105. 3247b115 18:50:14 parameter-golf-lab Add root static Research Hub for Vercel deploy
  106. 3247b115 18:50:14 sota_crawler Add root static Research Hub for Vercel deploy
  107. 3247b115 18:50:14 SOTA_FINAL Add root static Research Hub for Vercel deploy
  108. cea3b8b9 18:58:34 parameter-golf-lab Fix astrocyte gate shape bug: view(B,1,1) not unsqueeze(1).unsqueeze(2)
  109. cea3b8b9 18:58:34 sota_crawler Fix astrocyte gate shape bug: view(B,1,1) not unsqueeze(1).unsqueeze(2)
  110. cea3b8b9 18:58:34 SOTA_FINAL Fix astrocyte gate shape bug: view(B,1,1) not unsqueeze(1).unsqueeze(2)
  111. 5fac1c8d 19:01:22 parameter-golf-lab hybrid GatedDeltaNet-attention body X_1: Hybrid DeltaNet + Attention engine
  112. 5fac1c8d 19:01:22 sota_crawler hybrid GatedDeltaNet-attention body X_1: Hybrid DeltaNet + Attention engine
  113. 5fac1c8d 19:01:22 SOTA_FINAL hybrid GatedDeltaNet-attention body X_1: Hybrid DeltaNet + Attention engine
  114. b55a4214 19:03:19 parameter-golf-lab biology-inspired DeltaNet seam sweep: forward PYTORCH_CUDA_ALLOC_CONF to torchrun (expandable_segments default)
  115. b55a4214 19:03:19 sota_crawler biology-inspired DeltaNet seam sweep: forward PYTORCH_CUDA_ALLOC_CONF to torchrun (expandable_segments default)
  116. b55a4214 19:03:19 SOTA_FINAL biology-inspired DeltaNet seam sweep: forward PYTORCH_CUDA_ALLOC_CONF to torchrun (expandable_segments default)
  117. 15714f9b 19:13:30 parameter-golf-lab biology-inspired DeltaNet seam sweep: remove @torch.compiler.disable from GDN.forward
  118. 15714f9b 19:13:30 sota_crawler biology-inspired DeltaNet seam sweep: remove @torch.compiler.disable from GDN.forward
  119. 15714f9b 19:13:30 SOTA_FINAL biology-inspired DeltaNet seam sweep: remove @torch.compiler.disable from GDN.forward
  120. 24dd5505 19:24:34 parameter-golf-lab instructed-recurrence crawler: flow instructions + DeltaNet + hypothesis
  121. 24dd5505 19:24:34 sota_crawler instructed-recurrence crawler: flow instructions + DeltaNet + hypothesis
  122. 24dd5505 19:24:34 SOTA_FINAL instructed-recurrence crawler: flow instructions + DeltaNet + hypothesis
  123. 6470fbe0 19:30:24 parameter-golf-lab Upgrade research hub: SOTA/hypothesis/ablation visual dashboard
  124. 6470fbe0 19:30:24 sota_crawler Upgrade research hub: SOTA/hypothesis/ablation visual dashboard
  125. 6470fbe0 19:30:24 SOTA_FINAL Upgrade research hub: SOTA/hypothesis/ablation visual dashboard
  126. 0b2164d4 19:33:36 parameter-golf-lab biology-inspired DeltaNet seam sweep: restore @torch.compiler.disable, default wallclock 600s
  127. 0b2164d4 19:33:36 sota_crawler biology-inspired DeltaNet seam sweep: restore @torch.compiler.disable, default wallclock 600s
  128. 0b2164d4 19:33:36 SOTA_FINAL biology-inspired DeltaNet seam sweep: restore @torch.compiler.disable, default wallclock 600s
  129. 9c34b423 19:34:27 parameter-golf-lab instructed-recurrence crawler: n-gram entropy as smoothing reference hypothesis
  130. 9c34b423 19:34:27 sota_crawler instructed-recurrence crawler: n-gram entropy as smoothing reference hypothesis
  131. 9c34b423 19:34:27 SOTA_FINAL instructed-recurrence crawler: n-gram entropy as smoothing reference hypothesis
  132. 0c623c7a 19:50:19 parameter-golf-lab Add biology-inspired DeltaNet seam sweep bio seam sweep script
  133. 0c623c7a 19:50:19 sota_crawler Add biology-inspired DeltaNet seam sweep bio seam sweep script
  134. 0c623c7a 19:50:19 SOTA_FINAL Add biology-inspired DeltaNet seam sweep bio seam sweep script
  135. d1d28c71 19:51:42 parameter-golf-lab Research hub: independent top-3 rankings (BPB/base/file size)
  136. d1d28c71 19:51:42 sota_crawler Research hub: independent top-3 rankings (BPB/base/file size)
  137. d1d28c71 19:51:42 SOTA_FINAL Research hub: independent top-3 rankings (BPB/base/file size)
  138. 96bc2b4f 20:10:29 parameter-golf-lab instructed-recurrence crawler: disable DeltaNet for flow-only test, add inductor patch
  139. 96bc2b4f 20:10:29 sota_crawler instructed-recurrence crawler: disable DeltaNet for flow-only test, add inductor patch
  140. 96bc2b4f 20:10:29 SOTA_FINAL instructed-recurrence crawler: disable DeltaNet for flow-only test, add inductor patch
  141. 3adddb09 20:20:58 parameter-golf-lab instructed-recurrence crawler: DeltaNet with gradient checkpointing + truncated BPTT
  142. 3adddb09 20:20:58 sota_crawler instructed-recurrence crawler: DeltaNet with gradient checkpointing + truncated BPTT
  143. 3adddb09 20:20:58 SOTA_FINAL instructed-recurrence crawler: DeltaNet with gradient checkpointing + truncated BPTT
  144. 7b5e09cc 20:39:02 parameter-golf-lab Fix biology-inspired DeltaNet seam sweep hang: SKIP_FINAL_EVAL=1 + process cleanup
  145. 7b5e09cc 20:39:02 sota_crawler Fix biology-inspired DeltaNet seam sweep hang: SKIP_FINAL_EVAL=1 + process cleanup
  146. 7b5e09cc 20:39:02 SOTA_FINAL Fix biology-inspired DeltaNet seam sweep hang: SKIP_FINAL_EVAL=1 + process cleanup
  147. c7ffeec9 21:00:12 parameter-golf-lab Deprecate instructed-recurrence crawler* experiments; add flow-instruction crawler hybrid gitignore
  148. c7ffeec9 21:00:12 sota_crawler Deprecate instructed-recurrence crawler* experiments; add flow-instruction crawler hybrid gitignore
  149. c7ffeec9 21:00:12 SOTA_FINAL Deprecate instructed-recurrence crawler* experiments; add flow-instruction crawler hybrid gitignore
  150. c9600c75 21:12:20 parameter-golf-lab Add biology-inspired DeltaNet seam sweep agent instructions for Vast.ai sweep
  151. c9600c75 21:12:20 sota_crawler Add biology-inspired DeltaNet seam sweep agent instructions for Vast.ai sweep
  152. c9600c75 21:12:20 SOTA_FINAL Add biology-inspired DeltaNet seam sweep agent instructions for Vast.ai sweep
  153. 03f98384 21:16:20 parameter-golf-lab Add flow-instruction crawler hybrid (flow instructions + DeltaNet); gitignore both flow-instruction crawler hybrid experiments
  154. 03f98384 21:16:20 sota_crawler Add flow-instruction crawler hybrid (flow instructions + DeltaNet); gitignore both flow-instruction crawler hybrid experiments
  155. 03f98384 21:16:20 SOTA_FINAL Add flow-instruction crawler hybrid (flow instructions + DeltaNet); gitignore both flow-instruction crawler hybrid experiments
  156. 7c197c7e 21:19:01 parameter-golf-lab Add flow-instruction crawler hybrid and flow-instruction crawler hybrid experiment code
  157. 7c197c7e 21:19:01 sota_crawler Add flow-instruction crawler hybrid and flow-instruction crawler hybrid experiment code
  158. 7c197c7e 21:19:01 SOTA_FINAL Add flow-instruction crawler hybrid and flow-instruction crawler hybrid experiment code
  159. 0a89f4a7 21:21:31 parameter-golf-lab Fix REPO_ROOT depth in flow-instruction crawler hybrid run.sh files (../.. not ../../..)
  160. 0a89f4a7 21:21:31 sota_crawler Fix REPO_ROOT depth in flow-instruction crawler hybrid run.sh files (../.. not ../../..)
  161. 0a89f4a7 21:21:31 SOTA_FINAL Fix REPO_ROOT depth in flow-instruction crawler hybrid run.sh files (../.. not ../../..)
  162. 8037fce7 21:27:43 parameter-golf-lab Fix DDP unused-params crash: disable VE in flow-instruction crawler hybrid crawler runs
  163. 8037fce7 21:27:43 sota_crawler Fix DDP unused-params crash: disable VE in flow-instruction crawler hybrid crawler runs
  164. 8037fce7 21:27:43 SOTA_FINAL Fix DDP unused-params crash: disable VE in flow-instruction crawler hybrid crawler runs
  165. 3651d352 23:01:36 parameter-golf-lab Add crawler-only ngram export body experiment; restore instructed-recurrence crawler from deprecated
  166. 3651d352 23:01:36 sota_crawler Add crawler-only ngram export body experiment; restore instructed-recurrence crawler from deprecated
  167. 3651d352 23:01:36 SOTA_FINAL Add crawler-only ngram export body experiment; restore instructed-recurrence crawler from deprecated
  168. f2a4f5fe 23:10:00 parameter-golf-lab crawler-only ngram export body: disable ngram eval — sliding window baseline only
  169. f2a4f5fe 23:10:00 sota_crawler crawler-only ngram export body: disable ngram eval — sliding window baseline only
  170. f2a4f5fe 23:10:00 SOTA_FINAL crawler-only ngram export body: disable ngram eval — sliding window baseline only
  171. 5ae2be59 23:38:12 parameter-golf-lab Add crawler-only ngram export body: canonical FLA DeltaNet + Crawler symbiotic pairing
  172. 5ae2be59 23:38:12 sota_crawler Add crawler-only ngram export body: canonical FLA DeltaNet + Crawler symbiotic pairing
  173. 5ae2be59 23:38:12 SOTA_FINAL Add crawler-only ngram export body: canonical FLA DeltaNet + Crawler symbiotic pairing
  174. ba4a2a74 23:44:39 parameter-golf-lab Fix crawler-only ngram export body/II run.sh: add missing crawler flags (USE_CRAWLER=1 etc.)
  175. ba4a2a74 23:44:39 sota_crawler Fix crawler-only ngram export body/II run.sh: add missing crawler flags (USE_CRAWLER=1 etc.)
  176. ba4a2a74 23:44:39 SOTA_FINAL Fix crawler-only ngram export body/II run.sh: add missing crawler flags (USE_CRAWLER=1 etc.)
  177. 87ad173f 02:09:08 parameter-golf-lab crawler-only ngram export body: add FLA ops preflight check to confirm canonical kernel loads
  178. 87ad173f 02:09:08 sota_crawler crawler-only ngram export body: add FLA ops preflight check to confirm canonical kernel loads
  179. 87ad173f 02:09:08 SOTA_FINAL crawler-only ngram export body: add FLA ops preflight check to confirm canonical kernel loads
  180. e3ba2818 02:12:41 parameter-golf-lab Fix crawler-only ngram export body: cast q/k/v/beta to x.dtype before chunk_delta_rule
  181. e3ba2818 02:12:41 sota_crawler Fix crawler-only ngram export body: cast q/k/v/beta to x.dtype before chunk_delta_rule
  182. e3ba2818 02:12:41 SOTA_FINAL Fix crawler-only ngram export body: cast q/k/v/beta to x.dtype before chunk_delta_rule
  183. c0cf2ac5 02:34:41 parameter-golf-lab Add crawler-only ngram export body: GPTQ bypass + state dtype fix
  184. c0cf2ac5 02:34:41 sota_crawler Add crawler-only ngram export body: GPTQ bypass + state dtype fix
  185. c0cf2ac5 02:34:41 SOTA_FINAL Add crawler-only ngram export body: GPTQ bypass + state dtype fix
  186. 5d9e0b23 02:47:15 parameter-golf-lab Fix crawler-only ngram export body: revert state dtype cast — only change is SKIP_GPTQ=1
  187. 5d9e0b23 02:47:15 sota_crawler Fix crawler-only ngram export body: revert state dtype cast — only change is SKIP_GPTQ=1
  188. 5d9e0b23 02:47:15 SOTA_FINAL Fix crawler-only ngram export body: revert state dtype cast — only change is SKIP_GPTQ=1
  189. a7d53c88 02:50:33 parameter-golf-lab crawler-only ngram export body: SKIP_GPTQ only — restored from known-good e3ba281
  190. a7d53c88 02:50:33 sota_crawler crawler-only ngram export body: SKIP_GPTQ only — restored from known-good e3ba281
  191. a7d53c88 02:50:33 SOTA_FINAL crawler-only ngram export body: SKIP_GPTQ only — restored from known-good e3ba281
  192. baceb10f 03:22:39 parameter-golf-lab crawler-only ngram export body: reset to crawler-only ngram export body base + EMA_DECAY=0.99
  193. baceb10f 03:22:39 sota_crawler crawler-only ngram export body: reset to crawler-only ngram export body base + EMA_DECAY=0.99
  194. baceb10f 03:22:39 SOTA_FINAL crawler-only ngram export body: reset to crawler-only ngram export body base + EMA_DECAY=0.99
  195. e587c917 03:31:07 parameter-golf-lab crawler-only ngram export body: remove GPTQ, use naive int6
  196. e587c917 03:31:07 sota_crawler crawler-only ngram export body: remove GPTQ, use naive int6
  197. e587c917 03:31:07 SOTA_FINAL crawler-only ngram export body: remove GPTQ, use naive int6
  198. c2620863 03:52:28 parameter-golf-lab Add crawler-only ngram export body and loop-instructed DeltaNet crawler body: skip EMA + naive int6
  199. c2620863 03:52:28 sota_crawler Add crawler-only ngram export body and loop-instructed DeltaNet crawler body: skip EMA + naive int6
  200. c2620863 03:52:28 SOTA_FINAL Add crawler-only ngram export body and loop-instructed DeltaNet crawler body: skip EMA + naive int6
  201. 07a57bfd 03:53:49 parameter-golf-lab pod_setup: add fla + attr install for DeltaNet
  202. 07a57bfd 03:53:49 sota_crawler pod_setup: add fla + attr install for DeltaNet
  203. 07a57bfd 03:53:49 SOTA_FINAL pod_setup: add fla + attr install for DeltaNet
  204. d9db34d9 04:25:54 parameter-golf-lab Add crawler-only ngram export body: loop-aware 2-phase GPTQ + no EMA
  205. d9db34d9 04:25:54 sota_crawler Add crawler-only ngram export body: loop-aware 2-phase GPTQ + no EMA
  206. d9db34d9 04:25:54 SOTA_FINAL Add crawler-only ngram export body: loop-aware 2-phase GPTQ + no EMA
  207. cc06d3bc 04:27:18 parameter-golf-lab loop-instructed DeltaNet crawler body: sync to crawler-only ngram export body (loop-aware GPTQ + no EMA)
  208. cc06d3bc 04:27:18 sota_crawler loop-instructed DeltaNet crawler body: sync to crawler-only ngram export body (loop-aware GPTQ + no EMA)
  209. cc06d3bc 04:27:18 SOTA_FINAL loop-instructed DeltaNet crawler body: sync to crawler-only ngram export body (loop-aware GPTQ + no EMA)
  210. ebc4b84a 04:53:16 parameter-golf-lab Add loop-instructed DeltaNet crawler body: late-start EMA (step 4400) + loop-aware GPTQ
  211. ebc4b84a 04:53:16 sota_crawler Add loop-instructed DeltaNet crawler body: late-start EMA (step 4400) + loop-aware GPTQ
  212. ebc4b84a 04:53:16 SOTA_FINAL Add loop-instructed DeltaNet crawler body: late-start EMA (step 4400) + loop-aware GPTQ
DATE2026-03-27
DAY010
PRIMARY METRICVAL_BPB
TESTS RUN60 unique (18 valid / 21 TTT leakage)
ARCHITECTURE FAMILYBIOLOGY-INSPIRED DELTANET SEAM SWEEP (×18) · RECURRENT GREEN-BRANCH PROTOTYPE (×8) · CRAWLER ABLATION CONTROL SET (×8) · FLOW-INSTRUCTION CRAWLER HYBRID (×7) · TRAINING SCHEDULE SWEEP (×5) · CRAWLER-ONLY NGRAM EXPORT BODY (×4) · +4 MORE (×10)
CLASSIFICATIONEXPERIMENTAL 100% (60)
ARCHITECTURE RECIPE
BIOLOGY-INSPIRED DELTANET SEAM SWEEPx18

DeltaNet chunk-seam experiments testing biology-inspired state controllers before the crawler line was carried forward.

BASE BODYGatedDeltaNet recurrent body · chunked state passed across sequence seams · XSA attention stack above recurrent memory · Muon optimizer · entropy-adaptive n-gram eval path
SEAM CONTROLLERSmyelin Fibonacci chunk bridges · circadian phi-gated state flow · astrocyte state-norm erase-gate modulation · clonal top-k state amplification · all-controller sweep arm
LOCAL / POD TESTSGB10 local probes for myelin, circadian, astrocyte, and clonal-selection arms · 8-GPU biology-inspired sweep covering baseline, individual seam-controller arms, and all-controller arm · crawler line retained as the stronger follow-on direction
RECURRENT GREEN-BRANCH PROTOTYPEx8

Fast prototype line around green-branch recurrence, complement mixing, and residual/value-routing variants before later crawler consolidation.

BODYgreen-branch recurrent path · value-residual variants · complement-mix alpha variants · high-speed prototype iteration
SWEEPSremote fast A/B runs · synthetic branch variants · green v7 follow-up · warmdown and SWA schedule probes
CRAWLER-ONLY NGRAM EXPORT BODYx4

Crawler body with the fast ngram finish: crawler architecture retained, CPU-heavy phrase/regime paths removed.

MODEL BODYcrawler-only instructed-recurrence body · DELTA_NET_HEADS=0 · model_dim=512 · num_heads=8 · num_kv_heads=4 · int6+zstd target under 11 MB
EVAL FINISHngram9 eval stack · NGRAM_DIRICHLET=1 · remove NGRAM_CHUNK_TOKENS=65536 · remove PHRASE_CACHE · remove REGIME_TRACKER
HYBRID GATEDDELTANET-ATTENTION BODYx3

Hybrid GreenRod branch combining GatedDeltaNet-style memory with attention-body changes as part of the March 27 exploratory campaign.

BODYGatedDeltaNet-attention hybrid · X1 experimental branch · H100/runpod measurement path
LOOP-INSTRUCTED DELTANET CRAWLER BODYx1

Crawler-capable GQA body with loop instruction projection, optional DeltaNet memory, and loop-aware GPTQ experiments.

BASE BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · mlp_mult=3.0 · BigramHash 2048x128 · XSA last_n=11 · rope_dims=16
CRAWLER BODYflat transformer blocks around shared crawler block · crawler_mlp_mult=4.0 default · inst_dim=32 · loop instruction projection · crawler_loop_rope_scales=1,1,1 default · optional DeltaNet memory
QUANT PATHloop-aware GPTQ option · crawler Hessian collection · EMA / no-EMA ablations · int6 sliding-window export path

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-03-27 panel 1 of 2
csv data
VAL_BPB for 2026-03-27 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
RECURRENT GREEN-BRANCH PROTOTYPE81.17131.36391.4111download
FLOW-INSTRUCTION CRAWLER HYBRID41.11291.63132.0817download
CRAWLER-ONLY NGRAM EXPORT BODY31.12301.18121.5100download
HYBRID GATEDDELTANET-ATTENTION BODY21.20202.03212.8623download
REGULARIZATION/CONTROL SWEEP11.36351.36351.3635download
ALL VALID181.11291.35702.8623—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 60

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
102:34—Add crawler-only ngram export body: GPTQ bypass + state dtype fix (×3)1.0427INVALID—
details
203:098×H100 (runpod)recurrent green-branch prototype.log0.4489INVALID—
training_log
303:251×GB10local chunk-bridge seam arm.log0.9110INVALID—
training_log
403:251×GB10myelin_s1337_20260327_032513.log0.9110INVALID—
training_log
503:318×H100 (runpod)recurrent green-branch prototype.log0.4490INVALID—
training_log
604:068×H100 (runpod)RoPE ablation arm.log0.4702INVALID—
training_log
704:178×H100 (runpod)RoPE ablation arm.log0.4701INVALID—
training_log
804:25—Add crawler-only ngram export body: loop-aware 2-phase GPTQ + no EMA (×3)1.5100OK↑41.5%
details
904:378×H100 (runpod)recurrent green-branch prototype.log1.1713OK↑9.8%
training_log
1004:441×GB10SMK-01_rust_on.log5.9723CRASH—
training_log
1104:441×GB10SMK-02_delta0.log4.9038CRASH—
training_log
1204:451×GB10SMK-03_no_crawler_int8.log5.9722CRASH—
training_log
1304:461×GB10SMK-04_inst0.log5.9534CRASH—
training_log
1404:548×H100 (runpod)value-residual ablation off arm.log0.4702INVALID—
training_log
1505:078×H100 (runpod)value-residual ablation on arm.log0.4704INVALID—
training_log
1605:308×H100 (runpod)recurrent green-branch prototype.log0.4534INVALID—
training_log
1705:488×H100recurrent green-branch prototype.log1.3215OK↑23.8%
training_log
1805:488×H100recurrent green-branch prototype.log1.3188OK↑23.6%
training_log
1906:088×H100warmdown schedule sweep arm.log1.3775OK↑29.1%
training_log
2006:088×H100warmdown schedule sweep arm.log1.4111OK↑32.2%
training_log
2106:088×H100warmdown schedule sweep arm.log1.3504OK↑26.5%
training_log
2206:218×H100SWA schedule sweep arm.log1.3773OK↑29.1%
training_log
2306:218×H100SWA schedule sweep arm.log1.3778OK↑29.1%
training_log
2406:461×GB10astrocyte_s1337_h512_20260327_064618.log0.9139INVALID—
training_log
2506:461×GB10local erase-gate seam arm.log0.9139INVALID—
training_log
2607:208×H100 (runpod)siphon ablation off arm.log0.4674INVALID—
training_log
2707:30—instructed-recurrence crawler: Instructed Recurrence — content-derived loop i…1.1129OK↑4.3%
details
2807:318×H100 (runpod)siphon ablation on arm.log0.4841INVALID—
training_log
2907:448×H100 (runpod)baseline_s1337_20260327_074433.log0.4742INVALID—
training_log
3007:548×H100 (runpod)EMA teacher/student integration.1_20260327_075441.log0.5221INVALID—
training_log
3108:028×H100 (runpod)theta-gamma regularization arm regularization arm.1_20260327_080237.log1.3635OK↑27.8%
training_log
3208:138×H100instructed-recurrence crawler.log2.0817OK↑95.1%
training_log
3308:138×H100instructed-recurrence crawler.log2.0817OK↑95.1%
training_log
3408:211×GB10arm0_baseline__no_EMA teacher/student integration.log4.1049CRASH—
training_log
3508:23—Add recurrent green-branch prototype variant: v6 + complement-mix alpha=0.5 (×3)0.4420INVALID—
details
3608:248×H100 (runpod)recurrent green-branch prototype.log0.4500INVALID—
training_log
3710:051×GB10local state-amplification seam arm.log0.9110INVALID—
training_log
3810:051×GB10clonal_selection_s1337_k96_b64_20260327_100526.log0.9110INVALID—
training_log
3912:131×GB10instructed-recurrence crawler.log3.8469CRASH—
training_log
4013:411×H100 (vast.ai)instructed-recurrence crawler.log4.6423CRASH—
training_log
4113:46—loop-instructed DeltaNet crawler body: DeltaNet (DELTA_NET_HEADS=4) + Loop-Aw…0.9984INVALID—
details
4218:431×H100 (vast.ai)instructed-recurrence crawler.log4.6423CRASH—
training_log
4319:431×H100 (vast.ai)remote_run_nongdn_v4.log4.1095CRASH—
training_log
4419:431×H100 (vast.ai)remote_proxy_ab_v8_run2.log2.8623OK↑168.2%
training_log
4520:108×H100 (runpod)DeltaNet crawler recurrence variant.log1.1809OK↑10.7%
training_log
4620:468×H100 (runpod)biology-inspired DeltaNet seam sweep.log3.3328CRASH—
training_log
4720:558×H100 (runpod)biology-inspired DeltaNet seam sweep.log3.2150CRASH—
training_log
4821:048×H100 (runpod)biology-inspired DeltaNet seam sweep.log3.3292CRASH—
training_log
4921:358×H100 (runpod)hybrid GatedDeltaNet-attention body.log1.2020OK↑12.6%
training_log
5021:458×H100 (vast.ai)biology-inspired DeltaNet seam sweep.log3.1823CRASH—
training_log
5121:558×H100 (vast.ai)gdn_base.log3.1823CRASH—
training_log
5221:558×H100 (vast.ai)biology-inspired DeltaNet seam sweep.log3.2090CRASH—
training_log
5322:048×H100 (vast.ai)GDN chunk-bridge seam arm.log3.2090CRASH—
training_log
5422:048×H100 (vast.ai)biology-inspired DeltaNet seam sweep.log3.1895CRASH—
training_log
5522:138×H100 (vast.ai)GDN state-flow seam arm.log3.1895CRASH—
training_log
5622:138×H100 (vast.ai)biology-inspired DeltaNet seam sweep.log3.8659CRASH—
training_log
5722:178×H100 (vast.ai)biology-inspired DeltaNet seam sweep.log3.1823CRASH—
training_log
5822:178×H100 (vast.ai)GDN state-amplification seam arm.log3.8659CRASH—
training_log
5923:118×H100 (runpod)crawler-only ngram export body.log1.1230OK↑5.2%
training_log
6023:518×H100 (runpod)crawler-only ngram export body.log1.1812OK↑10.7%
training_log