2026-03-20 — Research Day

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-20

val_bpb · 84 of 174 · 9 warnings

findings mentioning this date

- **2026-03-20** (formerly missing) — now renders 9 test rows, headline `val_bpb`. Row dates and source records check out via `render_day.best_date`. (All 9 rows are `commit_only_metric` warnings; see Suspect Rows.)
| 2026-03-20 | 9 | 9 |
- **date:** 2026-03-20
  - **exact evidence:** SQLite `metrics_json` shows `{"val_bpb": 1.1428, "val_bpb_source": "commit_message"}`. `audit_daily_accuracy.is_commit_only` returned True (only sources for the row are `git_commit` rows). `render_day.best_date(rec) == "2026-03-20"` matches the page; `mtime_iso = 2026-03-21T00:04:49Z` is correctly converted to local CDT 2026-03-20.

audit summary

{
  "date": "2026-03-20",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 174,
  "render_records": 84,
  "test_rows": 9,
  "warnings": 9
}

139 commits on 2026-03-20

97442548 05:00:56 parameter-golf-lab Bump fractal cadence test cadence test test to 960d to fill 16MB budget
97442548 05:00:56 sota_crawler Bump fractal cadence test cadence test test to 960d to fill 16MB budget
82164cb6 05:07:42 parameter-golf-lab Add Suite 1 results: sliding window + int6 QAT on 8xH100
82164cb6 05:07:42 sota_crawler Add Suite 1 results: sliding window + int6 QAT on 8xH100
0d379397 05:15:40 parameter-golf-lab Add MLP 3× QAT tuning suite to close 0.069 quant BPB gap
0d379397 05:15:40 sota_crawler Add MLP 3× QAT tuning suite to close 0.069 quant BPB gap
81f754b5 05:43:05 parameter-golf-lab Add Muon weight decay, FP16 embeddings, and leaderboard chase suite
81f754b5 05:43:05 sota_crawler Add Muon weight decay, FP16 embeddings, and leaderboard chase suite
3c458dcd 05:46:18 parameter-golf-lab Update submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA — improved config (Muon WD=0.04, SWA every 50), mean val_bpb=1.1458
3c458dcd 05:46:18 sota_crawler Update submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA — improved config (Muon WD=0.04, SWA every 50), mean val_bpb=1.1458
3c458dcd 05:46:18 SOTA_FINAL Update submission: 2026-03-20_Int6_MLP3x_SmearGate_BigramHash_MuonWD_SWA — improved config (Muon WD=0.04, SWA every 50), mean val_bpb=1.1458
1812afba 05:49:28 parameter-golf-lab Add debug logging for QAT_START_FRAC and other hyperparams
1812afba 05:49:28 sota_crawler Add debug logging for QAT_START_FRAC and other hyperparams
b28c1bb3 06:01:39 parameter-golf-lab Add best shot script: full stack MLP3x + stride64 + fp16embed + muonWD
b28c1bb3 06:01:39 sota_crawler Add best shot script: full stack MLP3x + stride64 + fp16embed + muonWD
9ea3e1e3 06:37:52 parameter-golf-lab Add BigramHash + OrthoInit + leaderboard compact transformer recipe script
9ea3e1e3 06:37:52 sota_crawler Add BigramHash + OrthoInit + leaderboard compact transformer recipe script
5f1a8226 06:38:40 parameter-golf-lab Strip ablation run from compact transformer recipe script — one shot, full stack only
5f1a8226 06:38:40 sota_crawler Strip ablation run from compact transformer recipe script — one shot, full stack only
1b9f143f 06:46:54 parameter-golf-lab Add MLP_HIDDEN override + size-optimized compact transformer recipe script
1b9f143f 06:46:54 sota_crawler Add MLP_HIDDEN override + size-optimized compact transformer recipe script
47683588 06:54:29 parameter-golf-lab Record all test results: suite 1 (with 11L + QAT tuning) and suite 2
47683588 06:54:29 sota_crawler Record all test results: suite 1 (with 11L + QAT tuning) and suite 2
ab9ecb2f 06:54:48 parameter-golf-lab Record: 10L Int5-MLP + MuonWD=0.04 + SWA/50 (val_bpb=1.1453)
ab9ecb2f 06:54:48 sota_crawler Record: 10L Int5-MLP + MuonWD=0.04 + SWA/50 (val_bpb=1.1453)
ab9ecb2f 06:54:48 SOTA_FINAL Record: 10L Int5-MLP + MuonWD=0.04 + SWA/50 (val_bpb=1.1453)
800e496d 07:09:02 parameter-golf-lab Record compact transformer recipe v1 results (1.1725 BPB, 15.58MB) + bump MLP to 1472 for v2
800e496d 07:09:02 sota_crawler Record compact transformer recipe v1 results (1.1725 BPB, 15.58MB) + bump MLP to 1472 for v2
a320f7cc 07:22:47 parameter-golf-lab Update records/track_10min_16mb/2026-03-20_10L_Int5MLP_MuonWD04_SWA50/submission.json
a320f7cc 07:22:47 sota_crawler Update records/track_10min_16mb/2026-03-20_10L_Int5MLP_MuonWD04_SWA50/submission.json
a320f7cc 07:22:47 SOTA_FINAL Update records/track_10min_16mb/2026-03-20_10L_Int5MLP_MuonWD04_SWA50/submission.json
5462b79f 07:26:11 parameter-golf-lab v3: MLP 1408 — split difference between 1344 (under) and 1472 (over)
5462b79f 07:26:11 sota_crawler v3: MLP 1408 — split difference between 1344 (under) and 1472 (over)
b3692ea6 07:31:35 parameter-golf-lab Add SWA + bump MuonWD to 0.04 (matching #1 entry)
b3692ea6 07:31:35 sota_crawler Add SWA + bump MuonWD to 0.04 (matching #1 entry)
5c1a1c42 07:33:12 parameter-golf-lab Record compact transformer recipe v2 results: 1.1686 BPB but 16.42MB (over limit)
5c1a1c42 07:33:12 sota_crawler Record compact transformer recipe v2 results: 1.1686 BPB but 16.42MB (over limit)
dc97c26e 07:40:40 parameter-golf-lab Add fractal cadence test cadence test compact transformer recipe: novel architecture + full leaderboard stack
dc97c26e 07:40:40 sota_crawler Add fractal cadence test cadence test compact transformer recipe: novel architecture + full leaderboard stack
1d89418c 07:43:30 parameter-golf-lab fractal cadence test cadence test breathing: full,cheap,cheap — one workhorse loop, two refinement
1d89418c 07:43:30 sota_crawler fractal cadence test cadence test breathing: full,cheap,cheap — one workhorse loop, two refinement
1e59face 07:44:06 parameter-golf-lab Add standalone fractal cadence test cadence test breathing test: full,cheap,cheap + full stack
1e59face 07:44:06 sota_crawler Add standalone fractal cadence test cadence test breathing test: full,cheap,cheap + full stack
7919a880 07:46:14 parameter-golf-lab Add final edge: v1 compact transformer recipe + SWA + MLP1376, MuonWD stays at 0.01
7919a880 07:46:14 sota_crawler Add final edge: v1 compact transformer recipe + SWA + MLP1376, MuonWD stays at 0.01
0d8b3f09 07:49:42 parameter-golf-lab The compact transformer recipe Recipe — 1.1725 BPB, 15.58MB
0d8b3f09 07:49:42 sota_crawler The compact transformer recipe Recipe — 1.1725 BPB, 15.58MB
019a7819 08:05:39 parameter-golf-lab Record fractal cadence test cadence test breathing results: 1.2373 BPB, too slow for 10-min cap
019a7819 08:05:39 sota_crawler Record fractal cadence test cadence test breathing results: 1.2373 BPB, too slow for 10-min cap
27cf46f7 08:10:46 parameter-golf-lab Add progressive loop unrolling for fractal cadence test cadence test architecture
27cf46f7 08:10:46 sota_crawler Add progressive loop unrolling for fractal cadence test cadence test architecture
64b92ff4 08:36:18 parameter-golf-lab Add research insights: FP16 embed is worth 0.1 BPB (most impactful technique)
64b92ff4 08:36:18 sota_crawler Add research insights: FP16 embed is worth 0.1 BPB (most impactful technique)
35fdf204 08:40:59 parameter-golf-lab Record fractal cadence test cadence test progressive results: 1.2438 BPB, 9086 steps
35fdf204 08:40:59 sota_crawler Record fractal cadence test cadence test progressive results: 1.2438 BPB, 9086 steps
1641a234 14:27:19 parameter-golf-lab Update: 11L MLP3x + WD=0.04 + zstd-22 (val_bpb 1.1502)
1641a234 14:27:19 sota_crawler Update: 11L MLP3x + WD=0.04 + zstd-22 (val_bpb 1.1502)
1641a234 14:27:19 SOTA_FINAL Update: 11L MLP3x + WD=0.04 + zstd-22 (val_bpb 1.1502)
9f9d5334 16:38:24 parameter-golf-lab Update: val_bpb=1.1428 (mean 3 seeds) — bigram=10240 + SWA(0.4) + WD=0.04
9f9d5334 16:38:24 sota_crawler Update: val_bpb=1.1428 (mean 3 seeds) — bigram=10240 + SWA(0.4) + WD=0.04
9f9d5334 16:38:24 SOTA_FINAL Update: val_bpb=1.1428 (mean 3 seeds) — bigram=10240 + SWA(0.4) + WD=0.04
1a8be36c 16:44:48 parameter-golf-lab Add 3-seed training logs (seed=42, 1337, 2024)
1a8be36c 16:44:48 sota_crawler Add 3-seed training logs (seed=42, 1337, 2024)
1a8be36c 16:44:48 SOTA_FINAL Add 3-seed training logs (seed=42, 1337, 2024)
49581973 19:15:46 parameter-golf-lab Update README.md
49581973 19:15:46 sota_crawler Update README.md
49581973 19:15:46 SOTA_FINAL Update README.md
f427d59d 19:33:33 parameter-golf-lab Update README.md
f427d59d 19:33:33 sota_crawler Update README.md
f427d59d 19:33:33 SOTA_FINAL Update README.md
f6e75fe1 19:34:38 parameter-golf-lab Create leaderboard-best-score-over-time.svg
f6e75fe1 19:34:38 sota_crawler Create leaderboard-best-score-over-time.svg
f6e75fe1 19:34:38 SOTA_FINAL Create leaderboard-best-score-over-time.svg
a9d5c777 20:04:18 parameter-golf-lab Update README.md
a9d5c777 20:04:18 sota_crawler Update README.md
a9d5c777 20:04:18 SOTA_FINAL Update README.md
e7214241 20:04:41 parameter-golf-lab Delete assets directory
e7214241 20:04:41 sota_crawler Delete assets directory
e7214241 20:04:41 SOTA_FINAL Delete assets directory
a81f85bd 20:38:41 parameter-golf-lab Record: 11L + Efficient Partial XSA (val_bpb: 1.1307) — NEW SOTA
a81f85bd 20:38:41 sota_crawler Record: 11L + Efficient Partial XSA (val_bpb: 1.1307) — NEW SOTA
a81f85bd 20:38:41 SOTA_FINAL Record: 11L + Efficient Partial XSA (val_bpb: 1.1307) — NEW SOTA
4b141e5e 21:08:24 parameter-golf-lab Add RDQuant submission: 11L QAT + per-layer R-D quantization
48404cd4 21:15:21 parameter-golf-lab Restore train_gpt.py before bd2463a
48404cd4 21:15:21 sota_crawler Restore train_gpt.py before bd2463a
48404cd4 21:15:21 SOTA_FINAL Restore train_gpt.py before bd2463a
2cff08e1 21:25:54 parameter-golf-lab Update README.md
2cff08e1 21:25:54 sota_crawler Update README.md
2cff08e1 21:25:54 SOTA_FINAL Update README.md
c2920e67 21:44:22 parameter-golf-lab Add multi-seed validation script for compact transformer recipe Recipe
c2920e67 21:44:22 sota_crawler Add multi-seed validation script for compact transformer recipe Recipe
8d25a3bc 21:45:50 parameter-golf-lab Reduce to 2 seeds — original seed 1337 already validated
8d25a3bc 21:45:50 sota_crawler Reduce to 2 seeds — original seed 1337 already validated
05f3145e 21:53:18 parameter-golf-lab Fix GQA for PyTorch 2.4 compatibility
59c57390 22:27:36 parameter-golf-lab Fix FP16 pattern for 11L, default QAT off for size testing
ecabe077 22:29:47 parameter-golf-lab Add 1-GPU edge A/B testing script for compact transformer recipe optimization
ecabe077 22:29:47 sota_crawler Add 1-GPU edge A/B testing script for compact transformer recipe optimization
9a60d167 23:25:16 parameter-golf-lab Update README.md
9a60d167 23:25:16 sota_crawler Update README.md
9a60d167 23:25:16 SOTA_FINAL Update README.md
d7583288 23:25:48 parameter-golf-lab Record: 11L XSA + EMA + Int6 MLP3x + WD=0.04 (val_bpb: 1.1271)
d7583288 23:25:48 sota_crawler Record: 11L XSA + EMA + Int6 MLP3x + WD=0.04 (val_bpb: 1.1271)
d7583288 23:25:48 SOTA_FINAL Record: 11L XSA + EMA + Int6 MLP3x + WD=0.04 (val_bpb: 1.1271)
fc6332a9 23:36:51 parameter-golf-lab Update README.md
fc6332a9 23:36:51 sota_crawler Update README.md
fc6332a9 23:36:51 SOTA_FINAL Update README.md
80e4ec5e 00:04:49 parameter-golf-lab Add int5-MLP mixed quant, zstd compression, magnitude pruning, and seq ramp
80e4ec5e 00:04:49 sota_crawler Add int5-MLP mixed quant, zstd compression, magnitude pruning, and seq ramp
40a4f207 00:06:24 parameter-golf-lab Add seq ramp 1-GPU test script for novel technique validation
40a4f207 00:06:24 sota_crawler Add seq ramp 1-GPU test script for novel technique validation
8fada2c9 00:12:34 parameter-golf-lab Add XSA (Exclusive Self Attention) + corrected SOTA config for v2
8fada2c9 00:12:34 sota_crawler Add XSA (Exclusive Self Attention) + corrected SOTA config for v2
ab7cfa48 00:26:04 parameter-golf-lab Fix fullgraph=True crash with seq ramp (dynamic tensor shapes)
ab7cfa48 00:26:04 sota_crawler Fix fullgraph=True crash with seq ramp (dynamic tensor shapes)
415a3d4b 01:27:11 parameter-golf-lab Fix DDP crash on seq ramp transition
415a3d4b 01:27:11 sota_crawler Fix DDP crash on seq ramp transition
9e942367 01:28:14 parameter-golf-lab Add production 8xH100 script for compact transformer recipe V2
9e942367 01:28:14 sota_crawler Add production 8xH100 script for compact transformer recipe V2
083917a6 01:31:33 parameter-golf-lab Upgrade TTT: SGD 3 epochs with momentum, freeze first 2 blocks
083917a6 01:31:33 sota_crawler Upgrade TTT: SGD 3 epochs with momentum, freeze first 2 blocks
f7589d57 01:37:23 parameter-golf-lab Remove fractal cadence test cadence test architecture code — saves ~7KB artifact space
f7589d57 01:37:23 sota_crawler Remove fractal cadence test cadence test architecture code — saves ~7KB artifact space
52185733 01:41:43 parameter-golf-lab Add batch size warmup ramp + V3 script
52185733 01:41:43 sota_crawler Add batch size warmup ramp + V3 script
7328aee0 01:46:10 parameter-golf-lab Fix seq ramp: skip torch.compile entirely for dynamic shapes
7328aee0 01:46:10 sota_crawler Fix seq ramp: skip torch.compile entirely for dynamic shapes
e8bd3a25 01:48:14 parameter-golf-lab Record V2 results: 1.1877 BPB but 20.7MB artifact (4.7MB over limit)
e8bd3a25 01:48:14 sota_crawler Record V2 results: 1.1877 BPB but 20.7MB artifact (4.7MB over limit)
7d8c625e 01:49:19 parameter-golf-lab Fix V3 to fit 16MB: MLP1024 + BigramHash(4096) for 11L
7d8c625e 01:49:19 sota_crawler Fix V3 to fit 16MB: MLP1024 + BigramHash(4096) for 11L
b74033fa 01:57:49 parameter-golf-lab Add V3 FINAL 8xH100 production script
b74033fa 01:57:49 sota_crawler Add V3 FINAL 8xH100 production script
ca9ddb1b 02:04:28 parameter-golf-lab Add LocalContextConv for pre-attention local context
be8989b6 02:27:55 parameter-golf-lab Use torch.compile(dynamic=True) for seq ramp instead of skipping compile
be8989b6 02:27:55 sota_crawler Use torch.compile(dynamic=True) for seq ramp instead of skipping compile
b027e8c1 02:32:39 parameter-golf-lab Drop seq ramp — keep torch.compile fullgraph for speed
b027e8c1 02:32:39 sota_crawler Drop seq ramp — keep torch.compile fullgraph for speed
17c44eab 02:45:56 parameter-golf-lab Add V3 multi-seed validation script (seeds 42, 137)
17c44eab 02:45:56 sota_crawler Add V3 multi-seed validation script (seeds 42, 137)

DATE2026-03-20

DAY003

PRIMARY METRICVAL_BPB

TESTS RUN9 unique (9 valid / 0 TTT leakage)

ARCHITECTURE FAMILYCOMPACT TRANSFORMER RECIPE (×5) · PROGRESSIVE MLP AND FRACTAL CADENCE TESTS (×2) · MIXED-PRECISION QUANTIZATION VARIANT (×1) · STATE-SPACE TTT VARIANT (×1)

CLASSIFICATIONEXPERIMENTAL 78% (7)/NEURAL 22% (2)

SECTION 1.0 — TRAJECTORY

VAL_BPB SPREAD	n	min	median	max	download
COMPACT TRANSFORMER RECIPE	5	1.1686	1.1725	1.1877	—
PROGRESSIVE MLP AND FRACTAL CADENCE TESTS	2	1.2373	1.2406	1.2438	—
MIXED-PRECISION QUANTIZATION VARIANT	1	1.1428	1.1428	1.1428	—
STATE-SPACE TTT VARIANT	1	1.1313	1.1313	1.1313	—
ALL VALID	9	1.1313	1.1725	1.2438	—

VAL_BPB SPREAD

min

median

max

download

COMPACT TRANSFORMER RECIPE

1.1686

1.1725

1.1877

—

PROGRESSIVE MLP AND FRACTAL CADENCE TESTS

1.2373

1.2406

1.2438

—

MIXED-PRECISION QUANTIZATION VARIANT

1.1428

—

STATE-SPACE TTT VARIANT

1.1313

—

ALL VALID

1.1313

1.1725

1.2438

—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 7

#	TIME	HW	ABLATION	VAL_BPB	STATUS	Δ %	OPEN
1	00:04	—	Add int5-MLP mixed quant, zstd compression, magnitude pruning, and seq ramp (×2)	1.1428	OK	—	details

3	01:48	—	Record V2 results: 1.1877 BPB but 20.7MB artifact (4.7MB over limit) (×2)	1.1877	OK	—	details

4	07:09	—	Record compact transformer recipe v1 results (1.1725 BPB, 15.58MB) + bump MLP…	1.1725	OK	—	details

5	07:33	—	Record compact transformer recipe v2 results: 1.1686 BPB but 16.42MB (over li…	1.1686	OK	—	details

6	07:49	—	The compact transformer recipe Recipe — 1.1725 BPB, 15.58MB (×2)	1.1725	OK	—	details

8	08:40	—	Record fractal cadence test cadence test progressive results: 1.2438 BPB, 908…	1.2438	OK	—	details

9	21:44	—	Add multi-seed validation script for compact transformer recipe Recipe (×2)	1.1725	OK	—	details

TIME

ABLATION

VAL_BPB

STATUS

Δ %

OPEN