2026-03-28 — Research Day

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-03-28

val_bpb · 77 of 496 · 4 warnings

findings mentioning this date

| 2026-03-28 | 4 | 33 |

audit summary

{
  "date": "2026-03-28",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 496,
  "render_records": 77,
  "test_rows": 33,
  "warnings": 4
}

42 commits on 2026-03-28

4aa704b2 05:52:50 parameter-golf-lab loop-instructed DeltaNet crawler body: add short exit-only unravel A/B harness
4aa704b2 05:52:50 sota_crawler loop-instructed DeltaNet crawler body: add short exit-only unravel A/B harness
4aa704b2 05:52:50 SOTA_FINAL loop-instructed DeltaNet crawler body: add short exit-only unravel A/B harness
9d1be624 06:15:55 parameter-golf-lab Add loop-instructed DeltaNet crawler body: copy of loop-instructed DeltaNet crawler body (winning 1.0366 config)
9d1be624 06:15:55 sota_crawler Add loop-instructed DeltaNet crawler body: copy of loop-instructed DeltaNet crawler body (winning 1.0366 config)
9d1be624 06:15:55 SOTA_FINAL Add loop-instructed DeltaNet crawler body: copy of loop-instructed DeltaNet crawler body (winning 1.0366 config)
4b1c51cf 06:32:59 parameter-golf-lab loop-instructed DeltaNet crawler body: force finish-only A/B and add one-command launcher
4b1c51cf 06:32:59 sota_crawler loop-instructed DeltaNet crawler body: force finish-only A/B and add one-command launcher
4b1c51cf 06:32:59 SOTA_FINAL loop-instructed DeltaNet crawler body: force finish-only A/B and add one-command launcher
d2f47e2d 06:34:50 parameter-golf-lab Add loop-instructed DeltaNet crawler body: fix state dtype cast (new_state.to(dtype))
d2f47e2d 06:34:50 sota_crawler Add loop-instructed DeltaNet crawler body: fix state dtype cast (new_state.to(dtype))
d2f47e2d 06:34:50 SOTA_FINAL Add loop-instructed DeltaNet crawler body: fix state dtype cast (new_state.to(dtype))
0c383231 06:42:47 parameter-golf-lab loop-instructed DeltaNet crawler body: add additional-only unravel check runner
0c383231 06:42:47 sota_crawler loop-instructed DeltaNet crawler body: add additional-only unravel check runner
0c383231 06:42:47 SOTA_FINAL loop-instructed DeltaNet crawler body: add additional-only unravel check runner
d74538fa 07:01:03 parameter-golf-lab Add loop-instructed DeltaNet crawler body: frozen SOTA config snapshot
d74538fa 07:01:03 sota_crawler Add loop-instructed DeltaNet crawler body: frozen SOTA config snapshot
d74538fa 07:01:03 SOTA_FINAL Add loop-instructed DeltaNet crawler body: frozen SOTA config snapshot
9fa4fecd 07:18:40 parameter-golf-lab Add loop-instructed DeltaNet crawler body: DeltaNet projections → CastedLinear for QAT coverage
9fa4fecd 07:18:40 sota_crawler Add loop-instructed DeltaNet crawler body: DeltaNet projections → CastedLinear for QAT coverage
9fa4fecd 07:18:40 SOTA_FINAL Add loop-instructed DeltaNet crawler body: DeltaNet projections → CastedLinear for QAT coverage
d7fbe3d1 13:32:13 parameter-golf-lab Record: AR Self-Gen GPTQ + XSA-all + BigramHash 3072×112 — val_bpb 1.11473 (3-seed mean)
d7fbe3d1 13:32:13 sota_crawler Record: AR Self-Gen GPTQ + XSA-all + BigramHash 3072×112 — val_bpb 1.11473 (3-seed mean)
d7fbe3d1 13:32:13 SOTA_FINAL Record: AR Self-Gen GPTQ + XSA-all + BigramHash 3072×112 — val_bpb 1.11473 (3-seed mean)
0ce12a69 15:39:34 parameter-golf-lab Records: fill loop-instructed DeltaNet crawler body known results (seeds 300, 1337)
0ce12a69 15:39:34 sota_crawler Records: fill loop-instructed DeltaNet crawler body known results (seeds 300, 1337)
0ce12a69 15:39:34 SOTA_FINAL Records: fill loop-instructed DeltaNet crawler body known results (seeds 300, 1337)
a4a5447c 15:59:16 parameter-golf-lab Records: loop-instructed DeltaNet crawler body Unstable README with known results
a4a5447c 15:59:16 sota_crawler Records: loop-instructed DeltaNet crawler body Unstable README with known results
a4a5447c 15:59:16 SOTA_FINAL Records: loop-instructed DeltaNet crawler body Unstable README with known results
5f731b38 16:03:55 parameter-golf-lab Records: loop-instructed DeltaNet crawler body 3-seed complete — seed 42=0.8104 BPB (best), mean=0.9984, std=0.1724
5f731b38 16:03:55 sota_crawler Records: loop-instructed DeltaNet crawler body 3-seed complete — seed 42=0.8104 BPB (best), mean=0.9984, std=0.1724
5f731b38 16:03:55 SOTA_FINAL Records: loop-instructed DeltaNet crawler body 3-seed complete — seed 42=0.8104 BPB (best), mean=0.9984, std=0.1724
d9299177 21:36:49 parameter-golf-lab Add 4ep LeakyReLU legal TTT submission
d9299177 21:36:49 sota_crawler Add 4ep LeakyReLU legal TTT submission
f627fa33 22:07:43 parameter-golf-lab Updated train_jepa_ssm.py to save SIGReg to the checkpoint, as on a checkpoint load before a new random SIGReg would be generated based on the seed.
37df3009 23:32:24 parameter-golf-lab loop-instructed DeltaNet crawler body: DeltaNet crawler, 0.9984 mean BPB, 0.8104 best seed (seed 42)
79f45ae7 23:57:56 parameter-golf-lab Add loop-instructed DeltaNet crawler body: fix GPTQ training-data access after wallclock cap
79f45ae7 23:57:56 sota_crawler Add loop-instructed DeltaNet crawler body: fix GPTQ training-data access after wallclock cap
79f45ae7 23:57:56 SOTA_FINAL Add loop-instructed DeltaNet crawler body: fix GPTQ training-data access after wallclock cap
37975042 00:52:39 parameter-golf-lab Add loop-instructed DeltaNet crawler body: Unstable S2 — legal resubmission of PR #1028 (GPTQ timing fix)
99d34869 00:55:57 parameter-golf-lab Update seed 300 log + exact results in submission.json/README

DATE2026-03-28

DAY011

PRIMARY METRICVAL_BPB

TESTS RUN33 unique (17 valid / 14 TTT leakage)

ARCHITECTURE FAMILYLOOP-INSTRUCTED DELTANET CRAWLER BODY (×25) · CRAWLER-ONLY NGRAM EXPORT BODY (×7) · LEADERBOARD TRANSFORMER VARIANTS (×1)

CLASSIFICATIONEXPERIMENTAL 91% (30)/NEURAL 9% (3)

ARCHITECTURE RECIPE

LOOP-INSTRUCTED DELTANET CRAWLER BODYx25

Crawler-capable GQA body with loop instruction projection, optional DeltaNet memory, and loop-aware GPTQ experiments.

BASE BODYvocab_size=1024 · num_layers=11 · model_dim=512 · num_heads=8 · num_kv_heads=4 · mlp_mult=3.0 · BigramHash 2048x128 · XSA last_n=11 · rope_dims=16

CRAWLER BODYflat transformer blocks around shared crawler block · crawler_mlp_mult=4.0 default · inst_dim=32 · loop instruction projection · crawler_loop_rope_scales=1,1,1 default · optional DeltaNet memory

QUANT PATHloop-aware GPTQ option · crawler Hessian collection · EMA / no-EMA ablations · int6 sliding-window export path

CRAWLER-ONLY NGRAM EXPORT BODYx7

Crawler body with the fast ngram finish: crawler architecture retained, CPU-heavy phrase/regime paths removed.

MODEL BODYcrawler-only instructed-recurrence body · DELTA_NET_HEADS=0 · model_dim=512 · num_heads=8 · num_kv_heads=4 · int6+zstd target under 11 MB

EVAL FINISHngram9 eval stack · NGRAM_DIRICHLET=1 · remove NGRAM_CHUNK_TOKENS=65536 · remove PHRASE_CACHE · remove REGIME_TRACKER

VAL_BPB SPREAD	n	min	median	max	download
LOOP-INSTRUCTED DELTANET CRAWLER BODY	12	1.1532	1.2774	1.4976	download
CRAWLER-ONLY NGRAM EXPORT BODY	5	1.1524	1.1815	1.2168	download
ALL VALID	17	1.1524	1.2365	1.4976	—

VAL_BPB SPREAD

min

median

max

download

LOOP-INSTRUCTED DELTANET CRAWLER BODY

1.1532

1.2774

1.4976

download

CRAWLER-ONLY NGRAM EXPORT BODY

1.1524

1.1815

1.2168

download

ALL VALID

1.1524

1.2365

1.4976

—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 30

#	TIME	HW	ABLATION	VAL_BPB	STATUS	Δ %	OPEN
1	00:06	8×H100 (runpod)	crawler-only ngram export body s42 baseline	1.1815	OK	↑10.7%	training_log

2	00:19	8×H100 (runpod)	crawler-only ngram export body s123	1.1813	OK	↑10.7%	training_log

4	02:14	8×H100 (runpod)	crawler-only ngram export body.log	`1.0427`	INVALID	—	training_log

5	02:36	8×H100 (runpod)	crawler-only ngram export body.log	1.1905	OK	↑11.6%	training_log

6	02:47	8×H100 (runpod)	crawler-only ngram export body.log	4.1035	CRASH	—	training_log

7	02:51	8×H100 (runpod)	crawler-only ngram export body.log	1.1524	OK	↑8.0%	training_log

8	03:25	8×H100 (runpod)	crawler-only ngram export body.log	1.2168	OK	↑14.0%	training_log

9	03:55	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.4976	OK	↑40.3%	training_log

10	04:34	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.1879	OK	↑11.3%	training_log

11	04:54	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0366`	INVALID	—	training_log

12	05:40	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2365	OK	↑15.9%	training_log

13	05:59	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2780	OK	↑19.7%	training_log

14	05:59	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2775	OK	↑19.7%	training_log

15	05:59	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	4.1506	CRASH	—	training_log

16	06:10	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2774	OK	↑19.7%	training_log

17	06:10	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2774	OK	↑19.7%	training_log

18	06:10	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2774	OK	↑19.7%	training_log

19	06:16	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`0.9578`	INVALID	—	training_log

20	06:34	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0047`	INVALID	—	training_log

21	06:34	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0047`	INVALID	—	training_log

22	06:34	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0047`	INVALID	—	training_log

24	06:43	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0047`	INVALID	—	training_log

25	06:43	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.3797	OK	↑29.3%	training_log

26	06:43	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0047`	INVALID	—	training_log

27	06:46	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.3797	OK	↑29.3%	training_log

28	06:50	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`1.0463`	INVALID	—	training_log

30	07:20	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.1532	OK	↑8.1%	training_log

31	07:37	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	1.2269	OK	↑15.0%	training_log

32	15:42	8×H100 (runpod)	loop-instructed DeltaNet crawler body.log	`0.8104`	INVALID	—	training_log

33	16:03	—	Records: loop-instructed DeltaNet crawler body 3-seed complete — seed 42=0.81…	`0.8104`	INVALID	—	details

TIME

ABLATION

VAL_BPB

STATUS

Δ %

OPEN

00:06

8×H100 (runpod)

crawler-only ngram export body s42 baseline

1.1815

↑10.7%

training_log

00:19

8×H100 (runpod)

crawler-only ngram export body s123

1.1813

↑10.7%

training_log

02:14

8×H100 (runpod)

crawler-only ngram export body.log

1.0427

INVALID

—

training_log

02:36

8×H100 (runpod)

crawler-only ngram export body.log

1.1905

↑11.6%

training_log

02:47

8×H100 (runpod)

crawler-only ngram export body.log

4.1035

CRASH

—

training_log