DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-14

val_bpb · 183 of 1220 · 2 warnings
findings mentioning this date
| 2026-04-14 | 2 | 4 |
audit summary
{
  "date": "2026-04-14",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 1220,
  "render_records": 183,
  "test_rows": 4,
  "warnings": 2
}
76 commits on 2026-04-14
  1. 61b3e24f 05:27:43 parameter-golf-lab Refresh phased TTT submission logs and results
  2. ca191953 05:43:21 parameter-golf-lab Add artifact sizes to phased TTT README
  3. 5b62a446 06:26:41 sota_crawler Add 4x warmdown rescue legs and remove new_leg scaffold
  4. 5b62a446 06:26:41 SOTA_FINAL Add 4x warmdown rescue legs and remove new_leg scaffold
  5. 41bb4a65 15:10:24 parameter-golf-lab Update submission.json
  6. 8cca67c2 18:07:57 sota_crawler Lock down Im_sorry pod setup and enforce launch guardrails
  7. 8cca67c2 18:07:57 SOTA_FINAL Lock down Im_sorry pod setup and enforce launch guardrails
  8. 8f0b704d 18:39:41 sota_crawler Add missing 4x run-chain legs and lock Im_sorry setup updates
  9. 8f0b704d 18:39:41 SOTA_FINAL Add missing 4x run-chain legs and lock Im_sorry setup updates
  10. 4a705fe1 19:27:47 sota_crawler Fix pod setup: cu128→cu130, restore venv PATH and FA3 symlink fallback
  11. 4a705fe1 19:27:47 SOTA_FINAL Fix pod setup: cu128→cu130, restore venv PATH and FA3 symlink fallback
  12. 00e6f38f 19:36:54 sota_crawler Disk pressure: warn and continue instead of FATAL on fresh pods
  13. 00e6f38f 19:36:54 SOTA_FINAL Disk pressure: warn and continue instead of FATAL on fresh pods
  14. cf8e52f6 19:40:21 sota_crawler Fix WORKSPACE: fall back to repo root when pod env has no data helper
  15. cf8e52f6 19:40:21 SOTA_FINAL Fix WORKSPACE: fall back to repo root when pod env has no data helper
  16. a700601c 19:45:22 sota_crawler Add tokenizer safety net after dataset downloads
  17. a700601c 19:45:22 SOTA_FINAL Add tokenizer safety net after dataset downloads
  18. 6bcb9733 20:03:28 sota_crawler Add bank-aware online GPTQ leg for 12L GQA mixed-bit tower III.V quant damage fix
  19. 6bcb9733 20:03:28 SOTA_FINAL Add bank-aware online GPTQ leg for 12L GQA mixed-bit tower III.V quant damage fix
  20. 11fa777a 20:22:25 sota_crawler Remove diff guard from bank_gptq_fix run.sh — framework-level leg
  21. 11fa777a 20:22:25 SOTA_FINAL Remove diff guard from bank_gptq_fix run.sh — framework-level leg
  22. 1227510f 20:30:38 sota_crawler Add 12L GQA mixed-bit tower III.V submission leg — current legal SOTA (1.0916 BPB)
  23. 1227510f 20:30:38 SOTA_FINAL Add 12L GQA mixed-bit tower III.V submission leg — current legal SOTA (1.0916 BPB)
  24. 91e3efa2 20:36:39 sota_crawler Fix torch.compile recompile crash: make _gptq_ctx a stable attribute
  25. 91e3efa2 20:36:39 SOTA_FINAL Fix torch.compile recompile crash: make _gptq_ctx a stable attribute
  26. f157b082 20:48:37 sota_crawler Raise dynamo recompile limit to 32 for online GPTQ state transitions
  27. f157b082 20:48:37 SOTA_FINAL Raise dynamo recompile limit to 32 for online GPTQ state transitions
  28. 82770648 21:18:09 sota_crawler Fix bank quantization and quant-escape evaluation bug
  29. 82770648 21:18:09 SOTA_FINAL Fix bank quantization and quant-escape evaluation bug
  30. 8ed50f03 21:22:45 sota_crawler Add multi-crawler descendant 8k ramp launcher (7F+3C staged 33/66)
  31. 8ed50f03 21:22:45 SOTA_FINAL Add multi-crawler descendant 8k ramp launcher (7F+3C staged 33/66)
  32. 9c5a5792 23:51:52 parameter-golf-lab Record: VarLen Attention + Fused MLP + Multi-Phase Global SGD TTT — val_bpb 1.07193 (3-seed mean)
  33. 0827c2fb 00:12:41 sota_crawler Optimize SOTA: Bank-Aware QAT, Legal TTT, and refined bit-policy
  34. 0827c2fb 00:12:41 SOTA_FINAL Optimize SOTA: Bank-Aware QAT, Legal TTT, and refined bit-policy
  35. 4a772b69 01:36:54 sota_crawler Add sink token + fused RMSNorm crawler and RWKV RWKV-style recurrence body
  36. 4a772b69 01:36:54 SOTA_FINAL Add sink token + fused RMSNorm crawler and RWKV RWKV-style recurrence body
  37. dd8c062c 01:40:51 sota_crawler Add non-ramped sink+fused gate script for clean signal test
  38. dd8c062c 01:40:51 SOTA_FINAL Add non-ramped sink+fused gate script for clean signal test
  39. b4902bad 01:42:45 sota_crawler Add 8xGPU full-run wrappers for all three variants
  40. b4902bad 01:42:45 SOTA_FINAL Add 8xGPU full-run wrappers for all three variants
  41. 071999d5 01:55:09 sota_crawler Fix pod compatibility: auto-detect paths, venv, use python3 -m torch.distributed.run
  42. 071999d5 01:55:09 SOTA_FINAL Fix pod compatibility: auto-detect paths, venv, use python3 -m torch.distributed.run
  43. c296bf64 02:15:59 sota_crawler Fix: 600s (10min) wallclock for all production runners
  44. c296bf64 02:15:59 SOTA_FINAL Fix: 600s (10min) wallclock for all production runners
  45. af350b28 02:19:55 sota_crawler Fix pod pathing: Hardcode project defaults in Hyperparameters
  46. af350b28 02:19:55 SOTA_FINAL Fix pod pathing: Hardcode project defaults in Hyperparameters
  47. 092b5228 02:21:22 sota_crawler Restore 8192 vocab and SOTA settings
  48. 092b5228 02:21:22 SOTA_FINAL Restore 8192 vocab and SOTA settings
  49. 03312746 02:25:12 sota_crawler Force absolute pod paths: kill placeholder overrides
  50. 03312746 02:25:12 SOTA_FINAL Force absolute pod paths: kill placeholder overrides
  51. d3fe96e5 02:26:42 sota_crawler Fix AttributeError: restore scale_init hyperparameters
  52. d3fe96e5 02:26:42 SOTA_FINAL Fix AttributeError: restore scale_init hyperparameters
  53. 6a983edc 02:29:05 sota_crawler Strip stale path detection from intermediate scripts
  54. 6a983edc 02:29:05 SOTA_FINAL Strip stale path detection from intermediate scripts
  55. b762ae8a 02:29:48 sota_crawler Optimize Triton: Implement autotuning and fix kernel trigger
  56. b762ae8a 02:29:48 SOTA_FINAL Optimize Triton: Implement autotuning and fix kernel trigger
  57. d6d00262 02:34:01 sota_crawler Log Triton tuning data: capture best kernel configs after warmup
  58. d6d00262 02:34:01 SOTA_FINAL Log Triton tuning data: capture best kernel configs after warmup
  59. c1c2b7d2 02:43:39 sota_crawler Add The Witch: dim=1024, 3 layers, 4x loops — 87% H100 utilization
  60. c1c2b7d2 02:43:39 SOTA_FINAL Add The Witch: dim=1024, 3 layers, 4x loops — 87% H100 utilization
  61. 72727a1e 03:04:51 sota_crawler Fix RWKV-style recurrence body hang: 64x memory reduction + bf16 precision + compile compat
  62. 72727a1e 03:04:51 SOTA_FINAL Fix RWKV-style recurrence body hang: 64x memory reduction + bf16 precision + compile compat
  63. 4fa046dd 03:43:25 sota_crawler rhythm recurrence: add RWKV-style recurrence body + stacked 4loop-anchor launchers, log sink+fused fail
  64. 4fa046dd 03:43:25 SOTA_FINAL rhythm recurrence: add RWKV-style recurrence body + stacked 4loop-anchor launchers, log sink+fused fail
  65. e7b83de7 03:47:30 sota_crawler fix RWKV-style recurrence body wrapper: non-ramped, no wallclock cap
  66. e7b83de7 03:47:30 SOTA_FINAL fix RWKV-style recurrence body wrapper: non-ramped, no wallclock cap
  67. 1da107fe 03:50:54 sota_crawler add non-ramped RWKV-style recurrence body 8k launcher
  68. 1da107fe 03:50:54 SOTA_FINAL add non-ramped RWKV-style recurrence body 8k launcher
  69. 37e2c953 03:52:00 sota_crawler fix RWKV-style recurrence body full wrapper: non-ramped, no wallclock cap
  70. 37e2c953 03:52:00 SOTA_FINAL fix RWKV-style recurrence body full wrapper: non-ramped, no wallclock cap
  71. 07e48144 03:52:19 sota_crawler add stacked 7F+3C: 4-loop ROPE + anchor, no ramp
  72. 07e48144 03:52:19 SOTA_FINAL add stacked 7F+3C: 4-loop ROPE + anchor, no ramp
  73. ace6f5b4 03:52:22 sota_crawler add stacked 7F+3C full 8xH100 wrapper
  74. ace6f5b4 03:52:22 SOTA_FINAL add stacked 7F+3C full 8xH100 wrapper
  75. 4001e49d 03:53:14 sota_crawler Add 12L eval fix leg: correct quant eval pipeline
  76. 4001e49d 03:53:14 SOTA_FINAL Add 12L eval fix leg: correct quant eval pipeline
DATE2026-04-14
DAY028
PRIMARY METRICVAL_BPB
TESTS RUN4 unique (4 valid / 0 TTT leakage)
ARCHITECTURE FAMILY12L GQA MIXED-BIT TOWER (×3) · CRAWLER-SAFE TRAIN/EVAL SURFACE (×1)
CLASSIFICATIONEXPERIMENTAL 50% (2)/NEURAL 50% (2)
ARCHITECTURE RECIPE
12L GQA MIXED-BIT TOWERx3

12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging.

BODYnum_layers=12 · num_heads=8 · num_kv_heads=4 · rope_dims=16 · xsa_last_n=11 · BigramHash vocab=2048
QUANT / EVALattention int5 · mlp int6 · aux int6 · embed int8 · other int8 · Brotli artifact · 16 MB artifact cap
RUN SHAPE8xH100 · train_seq_len=2048 · eval_seq_len=2048 · 600s wallclock
CRAWLER-SAFE TRAIN/EVAL SURFACEx1

Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks.

BODYvocab_size=1024 · model_dim=512 · num_heads=8 · num_kv_heads=4 · shared crawler block · looped crawler passes
FEATURESBigramHash · XSA · RoPE · crawler loop rope scales · instruction bottleneck
QUANT / EVALint6 roundtrip · int6 sliding-window eval · int8 zlib roundtrip · 8xH100 · 600s wallclock

SECTION 1.0 — TRAJECTORY

VAL_BPB for 2026-04-14 panel 1 of 2
csv data
VAL_BPB for 2026-04-14 panel 2 of 2
csv data
VAL_BPB SPREADnminmedianmaxdownload
12L GQA MIXED-BIT TOWER31.09161.42391.8505download
CRAWLER-SAFE TRAIN/EVAL SURFACE11.09001.09001.0900download
ALL VALID41.09001.25771.8505—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 2

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
320:30—Add 12L GQA mixed-bit tower III.V submission leg — current legal SOTA (1.0916…1.0916OK↑2.3%
details
421:18—Fix bank quantization and quant-escape evaluation bug (×2)1.0900OK↑2.1%
details

NEURAL TEST RUNS — 2

#TIMEHWABLATIONVAL_BPBSTATUSΔ %OPEN
102:424×H100full_seed444_20260414_024259.log1.4239OK↑33.4%
training_log
203:194×RTX 4090full_seed444_20260414_031919.log1.8505OK↑73.4%
training_log