2026-03-21 — Research Day

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-21

val_bpb · 310 of 337 · 18 warnings

findings mentioning this date

| 2026-03-21 | 18 | 21 |
  - **exact evidence:** SQLite `metrics_json` shows `{"val_bpb": 1.1428, "val_bpb_source": "commit_message"}`. `audit_daily_accuracy.is_commit_only` returned True (only sources for the row are `git_commit` rows). `render_day.best_date(rec) == "2026-03-20"` matches the page; `mtime_iso = 2026-03-21T00:04:49Z` is correctly converted to local CDT 2026-03-20.
- **date:** 2026-03-21
  - **exact evidence:** `metrics_json = {"val_bpb": 1.124, "val_bpb_source": "commit_message"}`. No corresponding training_log was scraped for this commit's PR315+TTT path on 2026-03-21.

audit summary

{
  "date": "2026-03-21",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 337,
  "render_records": 310,
  "test_rows": 21,
  "warnings": 18
}

284 commits on 2026-03-21

2951651b 06:10:19 parameter-golf-lab Record: 11L Partial RoPE + LN Scale + EMA + XSA4 (val_bpb: 1.1248)
2951651b 06:10:19 sota_crawler Record: 11L Partial RoPE + LN Scale + EMA + XSA4 (val_bpb: 1.1248)
2951651b 06:10:19 SOTA_FINAL Record: 11L Partial RoPE + LN Scale + EMA + XSA4 (val_bpb: 1.1248)
1a921fde 13:52:23 parameter-golf-lab Add PR #198 clone script — SOTA baseline + our edges (XSA, TTT 3ep)
1a921fde 13:52:23 sota_crawler Add PR #198 clone script — SOTA baseline + our edges (XSA, TTT 3ep)
270d5809 15:00:37 parameter-golf-lab Clean start from PR #198 record + XSA + TTT SGD 3ep
270d5809 15:00:37 sota_crawler Clean start from PR #198 record + XSA + TTT SGD 3ep
4260c9cb 15:36:29 parameter-golf-lab Add QKV attention variants + int5 MLP default quantization
bb214425 15:41:07 parameter-golf-lab Add PR #180 progressive MLP test test A/B test experiment
bb214425 15:41:07 sota_crawler Add PR #180 progressive MLP test test A/B test experiment
665a3e4f 15:45:26 parameter-golf-lab Convert PR #180 progressive MLP test test experiment to FA3
665a3e4f 15:45:26 sota_crawler Convert PR #180 progressive MLP test test experiment to FA3
8926429f 16:19:34 parameter-golf-lab Fix grammar in README
8926429f 16:19:34 sota_crawler Fix grammar in README
8926429f 16:19:34 SOTA_FINAL Fix grammar in README
6db5e2fd 16:32:33 parameter-golf-lab Add A/B/C test: progressive MLP test test + fat BigramHash compensation
6db5e2fd 16:32:33 sota_crawler Add A/B/C test: progressive MLP test test + fat BigramHash compensation
5e0a2554 16:46:56 parameter-golf-lab Add test D: progressive attention gain (soft-early, sharp-late)
5e0a2554 16:46:56 sota_crawler Add test D: progressive attention gain (soft-early, sharp-late)
bc7f59c6 17:21:50 parameter-golf-lab Switch FA3 import to FA2 (pre-built wheel, same API)
bc7f59c6 17:21:50 sota_crawler Switch FA3 import to FA2 (pre-built wheel, same API)
f30f1273 18:11:05 parameter-golf-lab Add run D (progressive attn gain) + FA3 fallback to PyTorch SDP
f30f1273 18:11:05 sota_crawler Add run D (progressive attn gain) + FA3 fallback to PyTorch SDP
bff38a15 19:10:34 parameter-golf-lab Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
c96ec49c 19:10:34 parameter-golf-lab Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
203e59dc 19:10:34 parameter-golf-lab Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
aa206004 19:10:34 parameter-golf-lab Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
bff38a15 19:10:34 sota_crawler Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
203e59dc 19:10:34 sota_crawler Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
aa206004 19:10:34 sota_crawler Add exact clone of PR #254 — best pending SOTA (1.1313 BPB)
7f511e39 19:16:52 parameter-golf-lab Add LightBlock and HybridBlock: attention-free alternatives
64ff1ad4 22:17:49 parameter-golf-lab Add XSA last 3 layers to #254 SOTA clone
5e31538e 22:17:49 parameter-golf-lab Add XSA last 3 layers to #254 SOTA clone
caf1fc79 22:17:49 parameter-golf-lab Add XSA last 3 layers to #254 SOTA clone
2636011f 22:17:49 parameter-golf-lab Add XSA last 3 layers to #254 SOTA clone
64ff1ad4 22:17:49 sota_crawler Add XSA last 3 layers to #254 SOTA clone
caf1fc79 22:17:49 sota_crawler Add XSA last 3 layers to #254 SOTA clone
2636011f 22:17:49 sota_crawler Add XSA last 3 layers to #254 SOTA clone
334565d1 22:26:52 parameter-golf-lab Fix XSA GQA broadcast bug — expand KV heads before manual attention
75ef44f5 22:26:52 parameter-golf-lab Fix XSA GQA broadcast bug — expand KV heads before manual attention
23427120 22:26:52 parameter-golf-lab Fix XSA GQA broadcast bug — expand KV heads before manual attention
4e4cc7fa 22:26:52 parameter-golf-lab Fix XSA GQA broadcast bug — expand KV heads before manual attention
334565d1 22:26:52 sota_crawler Fix XSA GQA broadcast bug — expand KV heads before manual attention
23427120 22:26:52 sota_crawler Fix XSA GQA broadcast bug — expand KV heads before manual attention
4e4cc7fa 22:26:52 sota_crawler Fix XSA GQA broadcast bug — expand KV heads before manual attention
ff1834cd 22:35:46 parameter-golf-lab Add COMPILE=0 env var to skip torch.compile for fast local testing
44e662fe 22:53:34 parameter-golf-lab Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
8f6a8cca 22:53:34 parameter-golf-lab Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
0fa4ea33 22:53:34 parameter-golf-lab Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
44d290db 22:53:34 parameter-golf-lab Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
44e662fe 22:53:34 sota_crawler Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
0fa4ea33 22:53:34 sota_crawler Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
44d290db 22:53:34 sota_crawler Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536
d975df5a 23:11:02 parameter-golf-lab Add FarnsworthEngine v2: full improvement stack on SOTA254 base
18c0e662 23:11:02 parameter-golf-lab Add FarnsworthEngine v2: full improvement stack on SOTA254 base
d5f22078 23:11:02 parameter-golf-lab Add FarnsworthEngine v2: full improvement stack on SOTA254 base
83efa9c1 23:11:02 parameter-golf-lab Add FarnsworthEngine v2: full improvement stack on SOTA254 base
d975df5a 23:11:02 sota_crawler Add FarnsworthEngine v2: full improvement stack on SOTA254 base
d5f22078 23:11:02 sota_crawler Add FarnsworthEngine v2: full improvement stack on SOTA254 base
83efa9c1 23:11:02 sota_crawler Add FarnsworthEngine v2: full improvement stack on SOTA254 base
a288184a 23:20:21 parameter-golf-lab Add FA3→FA2→SDPA fallback chain for pod restart resilience
d0d47752 23:20:21 parameter-golf-lab Add FA3→FA2→SDPA fallback chain for pod restart resilience
fe35f950 23:20:21 parameter-golf-lab Add FA3→FA2→SDPA fallback chain for pod restart resilience
e0d06d07 23:20:21 parameter-golf-lab Add FA3→FA2→SDPA fallback chain for pod restart resilience
a288184a 23:20:21 sota_crawler Add FA3→FA2→SDPA fallback chain for pod restart resilience
fe35f950 23:20:21 sota_crawler Add FA3→FA2→SDPA fallback chain for pod restart resilience
e0d06d07 23:20:21 sota_crawler Add FA3→FA2→SDPA fallback chain for pod restart resilience
9ecba65c 23:24:57 parameter-golf-lab Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
82c06249 23:24:57 parameter-golf-lab Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
2aa53150 23:24:57 parameter-golf-lab Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
d94c7a1c 23:24:57 parameter-golf-lab Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
9ecba65c 23:24:57 sota_crawler Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
2aa53150 23:24:57 sota_crawler Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
d94c7a1c 23:24:57 sota_crawler Revert FA3 fallback chain — was unauthorized code change to baseline + untested v2
0e5d8397 23:41:55 parameter-golf-lab Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
a768362f 23:41:55 parameter-golf-lab Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
cb95d033 23:41:55 parameter-golf-lab Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
7171b6a7 23:41:55 parameter-golf-lab Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
0e5d8397 23:41:55 sota_crawler Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
cb95d033 23:41:55 sota_crawler Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
7171b6a7 23:41:55 sota_crawler Fix FA3 NaN: cast qkv to bf16 before FA3 call, disable dynamo DDP opt
e6a4f552 23:52:13 parameter-golf-lab Add 2-seed validation scripts for exp A/B/C
ae0afa0b 23:52:13 parameter-golf-lab Add 2-seed validation scripts for exp A/B/C
960ada44 23:52:13 parameter-golf-lab Add 2-seed validation scripts for exp A/B/C
c0adf168 23:52:13 parameter-golf-lab Add 2-seed validation scripts for exp A/B/C
e6a4f552 23:52:13 sota_crawler Add 2-seed validation scripts for exp A/B/C
960ada44 23:52:13 sota_crawler Add 2-seed validation scripts for exp A/B/C
c0adf168 23:52:13 sota_crawler Add 2-seed validation scripts for exp A/B/C
ee693e26 00:15:52 parameter-golf-lab Log exp A/B results: both behind baseline, zlib fallback bug found
4abe6f52 00:15:52 parameter-golf-lab Log exp A/B results: both behind baseline, zlib fallback bug found
abdfdeae 00:15:52 parameter-golf-lab Log exp A/B results: both behind baseline, zlib fallback bug found
a54066ac 00:15:52 parameter-golf-lab Log exp A/B results: both behind baseline, zlib fallback bug found
ee693e26 00:15:52 sota_crawler Log exp A/B results: both behind baseline, zlib fallback bug found
abdfdeae 00:15:52 sota_crawler Log exp A/B results: both behind baseline, zlib fallback bug found
a54066ac 00:15:52 sota_crawler Log exp A/B results: both behind baseline, zlib fallback bug found
c0889712 00:27:59 parameter-golf-lab Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
ac31eebb 00:27:59 parameter-golf-lab Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
4ef403f6 00:27:59 parameter-golf-lab Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
065bd065 00:27:59 parameter-golf-lab Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
c0889712 00:27:59 sota_crawler Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
4ef403f6 00:27:59 sota_crawler Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
065bd065 00:27:59 sota_crawler Fix XSA NaN: position 0 has no valid targets when self-mask + causal combine
432051b1 00:35:23 parameter-golf-lab Disable XSA in ttt_only run — manual attention too slow vs FA3
c916c9f9 00:35:23 parameter-golf-lab Disable XSA in ttt_only run — manual attention too slow vs FA3
b356a91e 00:35:23 parameter-golf-lab Disable XSA in ttt_only run — manual attention too slow vs FA3
0b2c73ca 00:35:23 parameter-golf-lab Disable XSA in ttt_only run — manual attention too slow vs FA3
432051b1 00:35:23 sota_crawler Disable XSA in ttt_only run — manual attention too slow vs FA3
b356a91e 00:35:23 sota_crawler Disable XSA in ttt_only run — manual attention too slow vs FA3
0b2c73ca 00:35:23 sota_crawler Disable XSA in ttt_only run — manual attention too slow vs FA3
1f02d0b3 00:38:01 parameter-golf-lab Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
c68de2c2 00:38:01 parameter-golf-lab Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
c8bfd590 00:38:01 parameter-golf-lab Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
2d79228d 00:38:01 parameter-golf-lab Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
1f02d0b3 00:38:01 sota_crawler Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
c8bfd590 00:38:01 sota_crawler Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
2d79228d 00:38:01 sota_crawler Add run_v2_ttt_noXSA.sh — TTT v2 + temp scaling, all FA3, max speed
660abd0c 00:38:11 parameter-golf-lab Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
27889d62 00:38:11 parameter-golf-lab Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
12f37dc9 00:38:11 parameter-golf-lab Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
508cdf1f 00:38:11 parameter-golf-lab Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
660abd0c 00:38:11 sota_crawler Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
12f37dc9 00:38:11 sota_crawler Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
508cdf1f 00:38:11 sota_crawler Restore XSA_LAST_N=3 in run_v2_ttt_only.sh (keep existing test intact)
d89ea7d3 00:49:58 parameter-golf-lab Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
277511f5 00:49:58 parameter-golf-lab Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
0c4d8616 00:49:58 parameter-golf-lab Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
c1e74ba5 00:49:58 parameter-golf-lab Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
d89ea7d3 00:49:58 sota_crawler Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
0c4d8616 00:49:58 sota_crawler Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
c1e74ba5 00:49:58 sota_crawler Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline)
bc11dc6c 00:51:37 parameter-golf-lab Strip verbose logging from v2 train loop — match baseline format
c269e904 00:51:37 parameter-golf-lab Strip verbose logging from v2 train loop — match baseline format
ecc4755f 00:51:37 parameter-golf-lab Strip verbose logging from v2 train loop — match baseline format
f263214a 00:51:37 parameter-golf-lab Strip verbose logging from v2 train loop — match baseline format
bc11dc6c 00:51:37 sota_crawler Strip verbose logging from v2 train loop — match baseline format
ecc4755f 00:51:37 sota_crawler Strip verbose logging from v2 train loop — match baseline format
f263214a 00:51:37 sota_crawler Strip verbose logging from v2 train loop — match baseline format
812535ed 01:05:53 parameter-golf-lab Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
bcfb4752 01:05:53 parameter-golf-lab Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
7a11286a 01:05:53 parameter-golf-lab Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
7bdf6dea 01:05:53 parameter-golf-lab Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
812535ed 01:05:53 sota_crawler Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
7a11286a 01:05:53 sota_crawler Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
7bdf6dea 01:05:53 sota_crawler Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline
5e222b7a 01:08:23 parameter-golf-lab Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
2c00f0a5 01:08:23 parameter-golf-lab Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
f56f6959 01:08:23 parameter-golf-lab Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
2620ec3f 01:08:23 parameter-golf-lab Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
5e222b7a 01:08:23 sota_crawler Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
f56f6959 01:08:23 sota_crawler Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
2620ec3f 01:08:23 sota_crawler Log exp_a/b/c results: all worse than 1.1301 baseline, exp_c never ran
114a4476 01:10:38 parameter-golf-lab Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
ee44ac00 01:10:38 parameter-golf-lab Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
35110f97 01:10:38 parameter-golf-lab Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
aea1e39a 01:10:38 parameter-golf-lab Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
114a4476 01:10:38 sota_crawler Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
35110f97 01:10:38 sota_crawler Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
aea1e39a 01:10:38 sota_crawler Add exp D: TTT 8 epochs + stride 32 (eval-only improvement)
3eecc334 01:15:09 parameter-golf-lab Add SAM (Sharpness-Aware Minimization) option for TTT
d1ab62e0 01:15:09 parameter-golf-lab Add SAM (Sharpness-Aware Minimization) option for TTT
07f0bba3 01:15:09 parameter-golf-lab Add SAM (Sharpness-Aware Minimization) option for TTT
e407bea1 01:15:09 parameter-golf-lab Add SAM (Sharpness-Aware Minimization) option for TTT
3eecc334 01:15:09 sota_crawler Add SAM (Sharpness-Aware Minimization) option for TTT
07f0bba3 01:15:09 sota_crawler Add SAM (Sharpness-Aware Minimization) option for TTT
e407bea1 01:15:09 sota_crawler Add SAM (Sharpness-Aware Minimization) option for TTT
e79ec97a 01:17:56 parameter-golf-lab Add baseline reproduction script — verify 1.1303 on current FA3 build
853bce82 01:17:56 parameter-golf-lab Add baseline reproduction script — verify 1.1303 on current FA3 build
4b100ac7 01:17:56 parameter-golf-lab Add baseline reproduction script — verify 1.1303 on current FA3 build
4fb1becb 01:17:56 parameter-golf-lab Add baseline reproduction script — verify 1.1303 on current FA3 build
e79ec97a 01:17:56 sota_crawler Add baseline reproduction script — verify 1.1303 on current FA3 build
4b100ac7 01:17:56 sota_crawler Add baseline reproduction script — verify 1.1303 on current FA3 build
4fb1becb 01:17:56 sota_crawler Add baseline reproduction script — verify 1.1303 on current FA3 build
d0a88bce 01:23:28 parameter-golf-lab Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
56d9a790 01:23:28 parameter-golf-lab Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
4bfbe607 01:23:28 parameter-golf-lab Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
35838893 01:23:28 parameter-golf-lab Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
d0a88bce 01:23:28 sota_crawler Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
4bfbe607 01:23:28 sota_crawler Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
35838893 01:23:28 sota_crawler Add SAM to baseline TTT — test sharpness-aware adaptation on proven code
fc89b547 01:29:45 parameter-golf-lab Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
fcf812f5 01:29:45 parameter-golf-lab Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
723d095f 01:29:45 parameter-golf-lab Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
9d86a37c 01:29:45 parameter-golf-lab Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
fc89b547 01:29:45 sota_crawler Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
723d095f 01:29:45 sota_crawler Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
9d86a37c 01:29:45 sota_crawler Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline)
bc6b8419 01:47:05 parameter-golf-lab Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
39064eff 01:47:05 parameter-golf-lab Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
2bf61711 01:47:05 parameter-golf-lab Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
79c9c2aa 01:47:05 parameter-golf-lab Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
bc6b8419 01:47:05 sota_crawler Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
2bf61711 01:47:05 sota_crawler Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
79c9c2aa 01:47:05 sota_crawler Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301)
a00e8553 02:05:00 parameter-golf-lab Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
38fb7cc6 02:05:00 parameter-golf-lab Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
a1b9703a 02:05:00 parameter-golf-lab Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
87c2831f 02:05:00 parameter-golf-lab Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
a00e8553 02:05:00 sota_crawler Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
a1b9703a 02:05:00 sota_crawler Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
87c2831f 02:05:00 sota_crawler Add exp_d SAM variant — TTT 8ep + stride 32 + sharpness-aware TTT
440366fc 02:06:36 parameter-golf-lab Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
473aa628 02:06:36 parameter-golf-lab Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
ef4dc442 02:06:36 parameter-golf-lab Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
e24283ad 02:06:36 parameter-golf-lab Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
440366fc 02:06:36 sota_crawler Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
ef4dc442 02:06:36 sota_crawler Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
e24283ad 02:06:36 sota_crawler Log exp D seed 7: 1.1313 BPB but 16.18 MB — over size limit
2700346d 02:19:21 parameter-golf-lab Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
33a1276d 02:19:21 parameter-golf-lab Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
74292852 02:19:21 parameter-golf-lab Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
e6d3dc59 02:19:21 parameter-golf-lab Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
2700346d 02:19:21 sota_crawler Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
74292852 02:19:21 sota_crawler Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
e6d3dc59 02:19:21 sota_crawler Add Partial RoPE + LN Scale (from PR #315) to sota254 + run_sam
196a5045 02:19:28 parameter-golf-lab Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
86ef9af9 02:19:28 parameter-golf-lab Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
32de9e9b 02:19:28 parameter-golf-lab Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
753ebd15 02:19:28 parameter-golf-lab Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
196a5045 02:19:28 sota_crawler Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
32de9e9b 02:19:28 sota_crawler Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
753ebd15 02:19:28 sota_crawler Add exp_d/run_sam_clean.sh — pure SAM A/B test, no other changes
418c4409 02:23:36 parameter-golf-lab Log exp D seeds 7+137: both over size limit
d2750e96 02:23:36 parameter-golf-lab Log exp D seeds 7+137: both over size limit
3cc6006b 02:23:36 parameter-golf-lab Log exp D seeds 7+137: both over size limit
d8053e69 02:23:36 parameter-golf-lab Log exp D seeds 7+137: both over size limit
418c4409 02:23:36 sota_crawler Log exp D seeds 7+137: both over size limit
3cc6006b 02:23:36 sota_crawler Log exp D seeds 7+137: both over size limit
d8053e69 02:23:36 sota_crawler Log exp D seeds 7+137: both over size limit
e1dd24c3 02:33:35 parameter-golf-lab Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
12ca289d 02:33:35 parameter-golf-lab Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
aa4b1c06 02:33:35 parameter-golf-lab Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
169e4a35 02:33:35 parameter-golf-lab Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
e1dd24c3 02:33:35 sota_crawler Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
aa4b1c06 02:33:35 sota_crawler Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
169e4a35 02:33:35 sota_crawler Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-only improvement
964fe7bc 02:38:53 parameter-golf-lab Add PR#315 clone with TTT 8ep + run script
1b9a2dc5 02:38:53 parameter-golf-lab Add PR#315 clone with TTT 8ep + run script
f9ef3637 02:38:53 parameter-golf-lab Add PR#315 clone with TTT 8ep + run script
e65d662b 02:38:53 parameter-golf-lab Add PR#315 clone with TTT 8ep + run script
964fe7bc 02:38:53 sota_crawler Add PR#315 clone with TTT 8ep + run script
f9ef3637 02:38:53 sota_crawler Add PR#315 clone with TTT 8ep + run script
e65d662b 02:38:53 sota_crawler Add PR#315 clone with TTT 8ep + run script
551d81c7 02:45:38 parameter-golf-lab Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
fdd256e8 02:45:38 parameter-golf-lab Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
8dd0e89d 02:45:38 parameter-golf-lab Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
9de9e704 02:45:38 parameter-golf-lab Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
551d81c7 02:45:38 sota_crawler Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
8dd0e89d 02:45:38 sota_crawler Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
9de9e704 02:45:38 sota_crawler Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script
91589f33 03:23:15 parameter-golf-lab Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
b10ef8a8 03:23:15 parameter-golf-lab Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
719b69d7 03:23:15 parameter-golf-lab Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
24267e1a 03:23:15 parameter-golf-lab Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
91589f33 03:23:15 sota_crawler Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
719b69d7 03:23:15 sota_crawler Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
24267e1a 03:23:15 sota_crawler Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned)
cdc12fa7 04:11:05 parameter-golf-lab Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
ca939f26 04:11:05 parameter-golf-lab Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
72573d96 04:11:05 parameter-golf-lab Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
f7c1a70d 04:11:05 parameter-golf-lab Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
cdc12fa7 04:11:05 sota_crawler Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
72573d96 04:11:05 sota_crawler Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
f7c1a70d 04:11:05 sota_crawler Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@1024 + EMA
b038850f 04:45:40 parameter-golf-lab Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
0fa2d63d 04:45:40 parameter-golf-lab Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
6f88e84d 04:45:40 parameter-golf-lab Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
511428d5 04:45:40 parameter-golf-lab Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
b038850f 04:45:40 sota_crawler Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
6f88e84d 04:45:40 sota_crawler Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
511428d5 04:45:40 sota_crawler Add RunPod 8xH100 setup guide — every gotcha we've hit 3 times
f6b692f6 04:46:16 parameter-golf-lab Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
2d47e82b 04:46:16 parameter-golf-lab Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
b27e1346 04:46:16 parameter-golf-lab Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
23696543 04:46:16 parameter-golf-lab Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
f6b692f6 04:46:16 sota_crawler Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
b27e1346 04:46:16 sota_crawler Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
23696543 04:46:16 sota_crawler Add fractal cadence test cadence test cadence experiment: F/N alternation pattern
208a4d56 04:56:26 parameter-golf-lab Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
9782e189 04:56:26 parameter-golf-lab Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
63714e4c 04:56:26 parameter-golf-lab Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
fbc18889 04:56:26 parameter-golf-lab Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
208a4d56 04:56:26 sota_crawler Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
63714e4c 04:56:26 sota_crawler Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged
fbc18889 04:56:26 sota_crawler Add PR374-safe: EMA + earlier QAT + longer warmdown only, shape unchanged

DATE2026-03-21

DAY004

PRIMARY METRICVAL_BPB

TESTS RUN21 unique (21 valid / 0 TTT leakage)

ARCHITECTURE FAMILYLEADERBOARD TRANSFORMER VARIANTS (×8) · CRAWLER ABLATION CONTROL SET (×5) · PROGRESSIVE MLP AND FRACTAL CADENCE TESTS (×4) · TTT8 STRIDE-32 TEST FAMILY (×3) · STATE-SPACE TTT VARIANT (×1)

CLASSIFICATIONEXPERIMENTAL 90% (19)/NEURAL 10% (2)

SECTION 1.0 — TRAJECTORY

VAL_BPB SPREAD	n	min	median	max	download
LEADERBOARD TRANSFORMER VARIANTS	8	1.1210	1.1288	1.1318	—
CRAWLER ABLATION CONTROL SET	5	1.1295	1.1326	1.1982	—
PROGRESSIVE MLP AND FRACTAL CADENCE TESTS	4	1.1428	1.4355	2.6276	—
TTT8 STRIDE-32 TEST FAMILY	3	1.1307	1.1313	1.1313	download
STATE-SPACE TTT VARIANT	1	1.1303	1.1303	1.1303	—
ALL VALID	21	1.1210	1.1313	2.6276	—

VAL_BPB SPREAD

min

median

max

download

LEADERBOARD TRANSFORMER VARIANTS

1.1210

1.1288

1.1318

—

CRAWLER ABLATION CONTROL SET

1.1295

1.1326

1.1982

—

PROGRESSIVE MLP AND FRACTAL CADENCE TESTS

1.1428

1.4355

2.6276

—

TTT8 STRIDE-32 TEST FAMILY

1.1307

1.1313

download

STATE-SPACE TTT VARIANT

1.1303

—

ALL VALID

1.1210

1.1313

2.6276

—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 19

#	TIME	HW	ABLATION	VAL_BPB	STATUS	Δ %	OPEN
1	00:15	—	Log exp A/B results: both behind baseline, zlib fallback bug found (×7)	1.1619	OK	↑2.7%	details

2	00:49	—	Log v2 TTT-only + XSA=3 result: 1.1982 BPB (worse than 1.1301 baseline) (×7)	1.1982	OK	↑5.9%	details

3	01:05	—	Log v2 noXSA result: 1.1538/1.1315 BPB — TTT v2 hurt, no edge over baseline (×7)	1.1315	OK	↑0.0%	details

4	01:29	—	Log exp D result: 1.1295 BPB — new best (-0.0008 vs baseline) (×7)	1.1295	OK	↓0.2%	details

5	01:47	—	Log exp D seed 42: 1.1307 BPB — confirms improvement (mean 1.1301) (×7)	1.1307	OK	↓0.1%	details

7	02:23	—	Log exp D seeds 7+137: both over size limit (×7)	1.1313	OK	0.0%	details

8	02:33	—	Add TTT stride-32 eval-only experiment experiment: TTT 8ep + stride 32 eval-o…	1.1303	OK	↓0.1%	details

9	02:45	—	Log D+SAM+PR315tricks: 1.1274 BPB new best; add SAM to pr315 run script (×7)	1.1274	OK	↓0.3%	details

10	03:23	—	Log PR315+TTT results: 1.1240 BPB (invalidated — TTT now banned) (×7)	1.1240	OK	↓0.6%	details

11	04:11	—	Add PR374 12L/2KV/2.75xMLP experiment experiment: 12L/2KV/2.75xMLP + train@10…	1.1246	OK	↓0.6%	details

12	04:46	—	Add fractal cadence test cadence test cadence experiment: F/N alternation pat…	2.6276	OK	↑132.3%	details

13	13:52	—	Add PR #198 clone script — SOTA baseline + our edges (XSA, TTT 3ep) (×2)	1.1326	OK	↑0.1%	details

15	15:41	—	Add PR #180 progressive MLP test test A/B test experiment (×2)	1.1428	OK	↑1.0%	details

16	18:46	1×GB10	A_uniform.log	1.5020	OK	↑32.8%	training_log

17	19:05	1×GB10	B_progressive.log	1.3691	OK	↑21.0%	training_log

18	19:10	—	Add exact clone of PR #254 — best pending SOTA (1.1313 BPB) (×7)	1.1313	OK	0.0%	details

19	22:17	—	Add XSA last 3 layers to #254 SOTA clone (×7)	1.1210	OK	↓0.9%	details

20	22:53	—	Add 3 SOTA improvement experiments: MTP, SwiGLU, Vocab1536 (×7)	1.1303	OK	↓0.1%	details

21	23:58	8×H100	run_s1337.log (×3)	1.1301	OK	↓0.1%	training_log 1 training_log 2 training_log 3

TIME

ABLATION

VAL_BPB

STATUS

Δ %

OPEN