DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-10

val_bpb · 227 of 2401 · 2 warnings
findings mentioning this date
| 2026-04-10 | 2 | 12 |
audit summary
{
  "date": "2026-04-10",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 2401,
  "render_records": 227,
  "test_rows": 12,
  "warnings": 2
}
106 commits on 2026-04-10
  1. f107afab 05:55:23 parameter-golf-lab Add fixed crawler runners for 7F3C/8F2C and crawler variant full run
  2. f107afab 05:55:23 sota_crawler Add fixed crawler runners for 7F3C/8F2C and crawler variant full run
  3. 5c8fd1d9 06:08:41 sota_nueral Crawler corpus: recursive weight-sharing transformer through multi-crawler descendant (2026-03-18 to 04-09)
  4. 66141894 06:51:57 parameter-golf-lab TK1: add 7F3C loop-aware GPTQ + pyminify runners; record recovered seed444 run
  5. 66141894 06:51:57 sota_crawler TK1: add 7F3C loop-aware GPTQ + pyminify runners; record recovered seed444 run
  6. cc70b9b6 06:53:42 sota_nueral Bridge ablation suite: 6-arm gate series vs bigbag #1493
  7. f9f5299c 07:17:52 sota_nueral Crawler corpus: professional narrative + Sankey diagram
  8. 2fa09287 07:22:07 parameter-golf-lab TK1: clarify pyminify runner header and one-line launch usage
  9. 2fa09287 07:22:07 sota_crawler TK1: clarify pyminify runner header and one-line launch usage
  10. 52f8f436 14:07:55 sota_nueral Fix TTT legality: TTT was never banned, only causality violations
  11. ec4ded0d 14:46:58 parameter-golf-lab TK1: preserve run artifacts and recover 06:56 GPTQ log
  12. ec4ded0d 14:46:58 sota_crawler TK1: preserve run artifacts and recover 06:56 GPTQ log
  13. a4f326f0 15:11:05 sota_nueral Forensic recovery: 12L GQA mixed-bit tower results + corpus corrections
  14. e6971c0c 15:19:41 parameter-golf-lab Crawler housekeeping: finalize 9F2C notes and archive grid TSV
  15. e6971c0c 15:19:41 sota_crawler Crawler housekeeping: finalize 9F2C notes and archive grid TSV
  16. b27db1fe 15:19:44 parameter-golf-lab Submission housekeeping: require seed 4 in templates and validator
  17. b27db1fe 15:19:44 sota_crawler Submission housekeeping: require seed 4 in templates and validator
  18. f88648c9 15:20:07 parameter-golf-lab Forensic recovery: Crawler_Katta results from Codex agent logs
  19. f88648c9 15:20:07 sota_crawler Forensic recovery: Crawler_Katta results from Codex agent logs
  20. f88648c9 15:20:07 SOTA_FINAL Forensic recovery: Crawler_Katta results from Codex agent logs
  21. 74fc5f25 15:20:12 sota_nueral Corpus: Crawler_Katta recovered from Codex logs — DEAD (RK2 +0.002 worse)
  22. 3219b5bf 15:27:15 sota_nueral Forensic cleanup: replace all lazy "never ran" with actual dispositions
  23. 1a718347 15:35:41 sota_nueral Corpus once-over: fix stale claims, bad comparisons, duplicates
  24. 119b125e 15:40:06 sota_nueral Add 30k-view goals to each day section
  25. 488e09ef 15:55:58 sota_nueral Remove cost accounting — inaccurate estimates
  26. 558732e2 16:03:24 sota_nueral Redesign Sankey: big picture + 14 per-day mini diagrams
  27. 6ae900b8 16:08:16 sota_nueral Rebuild Sankey as real flow diagrams with transition states
  28. 6a3f7684 16:17:14 sota_nueral Fix Sankey: dead branches terminate short, only winners reach the right
  29. 5a0767a5 16:39:42 sota_nueral Proper Sankey diagrams: Plotly + Playwright PNG rendering
  30. f9b63f48 16:43:12 sota_nueral Dark purple theme matching GitHub dark mode
  31. 671507f1 16:50:40 sota_nueral Fix Sankey positioning: dead branches terminate early, winner alone at right
  32. d5eb0d14 17:15:24 sota_nueral Forensic master results: 300+ BPB values recovered from all sessions
  33. 3ff6d1d1 17:55:02 sota_nueral index on crawler-corpus-narrative: d5eb0d1 Forensic master results: 300+ BPB values recovered from all sessions
  34. 249a4fab 18:02:21 sota_nueral Cross-reference forensic data into corpus: 70+ data points added
  35. 0eb1aeb4 18:49:07 sota_nueral Appendix C updated + data conflicts fixed
  36. 73276df0 18:56:24 sota_nueral Major corpus gaps filled: symmetry data, grid expansion, appendix cleanup
  37. a2243217 19:18:57 sota_nueral Add Tailnet Lab mission workspace scaffold
  38. 0a1646ae 20:03:16 sota_nueral Expand crawler forensic corpus and rebuild campaign graphs
  39. f4fb2108 20:26:25 sota_nueral Refine crawler corpus into campaign report
  40. 15637b07 20:36:14 parameter-golf-lab Add TK1 7f3c prune runner
  41. 15637b07 20:36:14 sota_crawler Add TK1 7f3c prune runner
  42. daf27d8c 21:23:41 parameter-golf-lab Freeze legal TK1 crawler result
  43. daf27d8c 21:23:41 sota_crawler Freeze legal TK1 crawler result
  44. 78997033 21:55:42 parameter-golf-lab Freeze confirmed crawler winner
  45. 78997033 21:55:42 sota_crawler Freeze confirmed crawler winner
  46. 2ad1b351 22:56:06 parameter-golf-lab Add widened crawler bottleneck folding probe
  47. 2ad1b351 22:56:06 sota_crawler Add widened crawler bottleneck folding probe
  48. 99c7b400 23:07:40 parameter-golf-lab Add 3-deep folding runner
  49. 99c7b400 23:07:40 sota_crawler Add 3-deep folding runner
  50. 29cc53b6 23:22:24 parameter-golf-lab Record widened crawler bottleneck logs and folding result
  51. 29cc53b6 23:22:24 sota_crawler Record widened crawler bottleneck logs and folding result
  52. 23c8257f 23:37:10 sota_nueral Add crawler chart package and visual foundations
  53. ef625811 23:42:21 parameter-golf-lab Harden multi-crawler descendant runners
  54. ef625811 23:42:21 sota_crawler Harden multi-crawler descendant runners
  55. 5de7d62a 23:59:02 parameter-golf-lab Fix pod setup branch and FA3 loader path
  56. 5de7d62a 23:59:02 sota_crawler Fix pod setup branch and FA3 loader path
  57. 859404a1 00:15:28 parameter-golf-lab Add multi-crawler descendant 4h runner to TEST_LAB
  58. 859404a1 00:15:28 sota_crawler Add multi-crawler descendant 4h runner to TEST_LAB
  59. 859404a1 00:15:28 SOTA_FINAL Add multi-crawler descendant 4h runner to TEST_LAB
  60. 18793431 00:17:41 sota_crawler Prefer /venv/main in pod setup
  61. 6ce11228 00:17:52 parameter-golf-lab Prefer /venv/main in pod setup
  62. 6ce11228 00:17:52 sota_crawler Prefer /venv/main in pod setup
  63. 6ce11228 00:17:52 SOTA_FINAL Prefer /venv/main in pod setup
  64. b4385619 00:18:56 parameter-golf-lab add record
  65. ad268616 00:22:06 parameter-golf-lab add logs
  66. f8dd9110 01:13:23 sota_nueral Tighten corpus chronology and source-date recoveries
  67. 307272c5 01:36:30 sota_crawler index on universal-transformer-crawler: 1879343 Prefer /venv/main in pod setup
  68. 709cb8ec 01:41:47 sota_nueral Add day-by-day crawler mining framework
  69. de7154f9 02:35:15 sota_nueral Rebuild visuals on chronology spine
  70. 13a86673 02:44:45 parameter-golf-lab Add 7-arm direct SOTA ablation suite for 2xH100 screening
  71. 13a86673 02:44:45 sota_crawler Add 7-arm direct SOTA ablation suite for 2xH100 screening
  72. 13a86673 02:44:45 SOTA_FINAL Add 7-arm direct SOTA ablation suite for 2xH100 screening
  73. 2216c573 02:50:20 sota_nueral Align corpus narrative with updated visuals
  74. e19dda6b 03:17:17 sota_nueral Refocus visuals on chapter-based day chunks
  75. c420a7a1 03:25:56 parameter-golf-lab Record screen results: control (1.3181) and muon_wd_095 (1.3160)
  76. c420a7a1 03:25:56 sota_crawler Record screen results: control (1.3181) and muon_wd_095 (1.3160)
  77. c420a7a1 03:25:56 SOTA_FINAL Record screen results: control (1.3181) and muon_wd_095 (1.3160)
  78. dac1ad0e 03:34:51 parameter-golf-lab Record screen result: matrix_lr_022 (1.3045) — best arm, -0.0136 vs control
  79. dac1ad0e 03:34:51 sota_crawler Record screen result: matrix_lr_022 (1.3045) — best arm, -0.0136 vs control
  80. dac1ad0e 03:34:51 SOTA_FINAL Record screen result: matrix_lr_022 (1.3045) — best arm, -0.0136 vs control
  81. 5e520bf3 03:35:58 sota_nueral Replace repo visuals with Excel package
  82. 87eea2f9 03:37:30 sota_nueral Add strict Excel workbook template spec
  83. c1ac655d 03:43:26 parameter-golf-lab Record screen result: parallel_residual (1.3085) — -0.0096 vs control
  84. c1ac655d 03:43:26 sota_crawler Record screen result: parallel_residual (1.3085) — -0.0096 vs control
  85. c1ac655d 03:43:26 SOTA_FINAL Record screen result: parallel_residual (1.3085) — -0.0096 vs control
  86. d90f03eb 03:46:32 sota_nueral Add verified workbook publication specs
  87. 08005743 03:53:46 parameter-golf-lab Record screen result: depth_recurrence (1.3201) — NEGATIVE, +0.0020 vs control
  88. 08005743 03:53:46 sota_crawler Record screen result: depth_recurrence (1.3201) — NEGATIVE, +0.0020 vs control
  89. 08005743 03:53:46 SOTA_FINAL Record screen result: depth_recurrence (1.3201) — NEGATIVE, +0.0020 vs control
  90. 76a96b09 04:03:58 parameter-golf-lab Record screen result: stack_core (1.3243) — WORST arm, +0.0062 vs control
  91. 76a96b09 04:03:58 sota_crawler Record screen result: stack_core (1.3243) — WORST arm, +0.0062 vs control
  92. 76a96b09 04:03:58 SOTA_FINAL Record screen result: stack_core (1.3243) — WORST arm, +0.0062 vs control
  93. 5f533a72 04:05:18 sota_nueral Add final five-chart workbook package
  94. 6b1d0bd3 04:12:53 sota_nueral Add browser review pages for final charts
  95. 33b1950b 04:13:08 parameter-golf-lab Add 12L GQA mixed-bit tower III: full 5-arm stack for 8xH100 600s run
  96. 33b1950b 04:13:08 sota_crawler Add 12L GQA mixed-bit tower III: full 5-arm stack for 8xH100 600s run
  97. 33b1950b 04:13:08 SOTA_FINAL Add 12L GQA mixed-bit tower III: full 5-arm stack for 8xH100 600s run
  98. c71189cf 04:22:44 sota_nueral Add PNG and JPG exports for final charts
  99. 2208f876 04:26:46 sota_nueral Embed final chart images in corpus
  100. 994dd024 04:47:48 sota_nueral Recenter corpus on widened crawler bottleneck thesis
  101. bd76ebfe 04:53:53 parameter-golf-lab Record 12L GQA mixed-bit tower III 8xH100 result: 1.10616680 BPB — 0.0005 off leader
  102. bd76ebfe 04:53:53 sota_crawler Record 12L GQA mixed-bit tower III 8xH100 result: 1.10616680 BPB — 0.0005 off leader
  103. bd76ebfe 04:53:53 SOTA_FINAL Record 12L GQA mixed-bit tower III 8xH100 result: 1.10616680 BPB — 0.0005 off leader
  104. e17feb85 04:58:31 parameter-golf-lab Save 12L GQA mixed-bit tower III raw training logs from 8xH100 pod
  105. e17feb85 04:58:31 sota_crawler Save 12L GQA mixed-bit tower III raw training logs from 8xH100 pod
  106. e17feb85 04:58:31 SOTA_FINAL Save 12L GQA mixed-bit tower III raw training logs from 8xH100 pod
DATE2026-04-10
DAY024
PRIMARY METRICVAL_BPB
TESTS RUN12 unique (12 valid / 0 TTT leakage)
ARCHITECTURE FAMILYWIDENED CRAWLER BOTTLENECK (×8) · 12L GQA MIXED-BIT TOWER (×2) · CRAWLER-SAFE TRAIN/EVAL SURFACE (×2)
CLASSIFICATIONEXPERIMENTAL 92% (11)/NEURAL 8% (1)
ARCHITECTURE RECIPE
WIDENED CRAWLER BOTTLENECKx8

Widened crawler bottleneck body: 5 flat blocks, 1 shared crawler block, 5 flat blocks.

BODYMODEL_DIM=512 · NUM_FLAT_LAYERS=5 · NUM_CRAWLER_LAYERS=1 · CRAWLER_LOOPS=3 · USE_CRAWLER=1 · num_heads=8 · num_kv_heads=4
CRAWLERCRAWLER_MLP_MULT=6.0 · INST_DIM=32 · CRAWLER_QUANT_INT8=1 · CRAWLER_LOOP_ROPE_SCALES=9,1,1 · CRAWLER_TAP_DIM=32 · CRAWLER_TAP_LAYERS=all
PACKAGINGBIGRAM_VOCAB_SIZE=2048 · XSA_LAST_N=11 · ROPE_DIMS=16 · SKIP_EMA=1 · SKIP_GPTQ=1 · MTP_NUM_HEADS=0
12L GQA MIXED-BIT TOWERx2

12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging.

BODYnum_layers=12 · num_heads=8 · num_kv_heads=4 · rope_dims=16 · xsa_last_n=11 · BigramHash vocab=2048
QUANT / EVALattention int5 · mlp int6 · aux int6 · embed int8 · other int8 · Brotli artifact · 16 MB artifact cap
RUN SHAPE8xH100 · train_seq_len=2048 · eval_seq_len=2048 · 600s wallclock
CRAWLER-SAFE TRAIN/EVAL SURFACEx2

Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · shared crawler block · looped crawler passes
FEATURESBigramHash · XSA · RoPE · crawler loop rope scales · instruction bottleneck
QUANT / EVALint6 roundtrip · int6 sliding-window eval · int8 zlib roundtrip · 8xH100 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-10 panel 1 of 2
csv data
VAL_BPB for 2026-04-10 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
WIDENED CRAWLER BOTTLENECK101.07421.13591.1385download
12L GQA MIXED-BIT TOWER21.10621.10721.1083download
ALL VALID121.07421.13541.1385—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 11

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
104:58—Save 12L GQA mixed-bit tower III raw training logs from 8xH100 pod (×3)1.1062OK↑3.7%
details
205:568×H100train_seed444_20260410_055647.log1.1368OK↑6.5%
training_log
306:398×H100train_seed300.log1.1385OK↑6.7%
training_log
406:398×H100train_seed4.log1.1354OK↑6.4%
training_log
506:39—multi-crawler descendant1.1364OK↑6.5%
details
606:398×H100train_seed4_4h.log1.0742OK↑0.7%
training_log
706:398×H100train_seed444.log1.1368OK↑6.5%
training_log
813:468×H100train_seed444_20260410_065634_recovered_from_chat.log1.1342OK↑6.3%
training_log
1020:588×H100best_crawler_SOTA_CRAWLER_SAFE_seed444_20260410_205837.log1.1354OK↑6.4%
training_log
1121:178×H100train_seed300_20260410_211710.log1.1385OK↑6.7%
training_log
1221:338×H100best_crawler_SOTA_CRAWLER_SAFE_seed4_20260410_213324.log1.1354OK↑6.4%
training_log

NEURAL TEST RUNS — 1

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
915:11—Forensic recovery: 12L GQA mixed-bit tower results + corpus corrections1.1083OK↑3.9%
details