2026-04-24 — Research Day

DAILY RESEARCH REPORTBACK TO MASTER SHEET2026-04-24

val_bpb · 767 of 894 · 0 warnings

audit summary

{
  "date": "2026-04-24",
  "fatal": 0,
  "headline_metric": "val_bpb",
  "raw_records": 894,
  "render_records": 767,
  "test_rows": 177,
  "warnings": 0
}

3 commits on 2026-04-24

f47b26c5 15:35:32 parameter-golf-lab Update leaderboard with recent record submissions
a33d6953 19:43:22 sota_crawler Add reboot baseline for blessed dim-576 attention-kernel body
a33d6953 19:43:22 SOTA_FINAL Add reboot baseline for blessed dim-576 attention-kernel body

DATE2026-04-24

DAY038

PRIMARY METRICVAL_BPB

TESTS RUN177 unique (177 valid / 0 TTT leakage)

ARCHITECTURE FAMILYFUSED RECURRENCE MEGAKERNEL (×166) · CRAWLER ABLATION CONTROL SET (×10) · PROGRESSIVE MLP AND FRACTAL CADENCE TESTS (×1)

CLASSIFICATIONEXPERIMENTAL 100% (177)

VAL_BPB SPREAD	n	min	median	max	download
FUSED RECURRENCE MEGAKERNEL	166	1.3225	2.0744	2.4697	download
CRAWLER ABLATION CONTROL SET	10	1.8947	2.0303	2.4027	—
PROGRESSIVE MLP AND FRACTAL CADENCE TESTS	1	1.9665	1.9665	1.9665	—
ALL VALID	177	1.3225	2.0709	2.4697	—

VAL_BPB SPREAD

min

median

max

download

FUSED RECURRENCE MEGAKERNEL

166

1.3225

2.0744

2.4697

download

CRAWLER ABLATION CONTROL SET

1.8947

2.0303

2.4027

—

PROGRESSIVE MLP AND FRACTAL CADENCE TESTS

1.9665

—

ALL VALID

177

1.3225

2.0709

2.4697

—

SECTION 2.0 — TEST RUNS

EXPERIMENTAL TEST RUNS — 177

#	TIME	HW	ABLATION	VAL_BPB	STATUS	Δ %	OPEN
1	00:03	1×GB10	steps5.log	2.1153	OK	↑98.2%	training_log

2	00:03	1×GB10	steps7.log	2.1130	OK	↑98.0%	training_log

3	00:05	1×GB10	chaos_d2_p0_long_seed65535.log	1.8682	OK	↑75.1%	training_log

4	00:14	1×GB10	tail_baseline_seed16180.log	2.4027	OK	↑125.1%	training_log

5	00:30	1×GB10	chaos_d2_p0_long_seed88888.log	1.8756	OK	↑75.7%	training_log

6	00:53	1×GB10	seed42_attn0p25.log	2.1253	OK	↑99.1%	training_log

7	00:54	1×GB10	seed2025_attn0p25.log	2.1174	OK	↑98.4%	training_log

8	01:04	1×GB10	qk045.log	2.1116	OK	↑97.9%	training_log

9	01:04	1×GB10	qk055.log	2.1117	OK	↑97.9%	training_log

10	01:18	1×GB10	seed42_qk0p35.log	2.1257	OK	↑99.2%	training_log

11	01:19	1×GB10	seed42_qk0p45.log	2.1253	OK	↑99.1%	training_log

12	01:19	1×GB10	seed2025_qk0p35.log	2.1157	OK	↑98.2%	training_log

13	01:20	1×GB10	seed2025_qk0p45.log	2.1173	OK	↑98.4%	training_log

14	01:24	1×GB10	seed1337_attn0p25.log	2.1126	OK	↑98.0%	training_log

15	01:40	1×GB10	seed42_attn0p15.log	2.1214	OK	↑98.8%	training_log

16	01:41	1×GB10	seed42_attn0p20.log	2.1250	OK	↑99.1%	training_log

17	01:41	1×GB10	seed2025_attn0p15.log	2.1164	OK	↑98.3%	training_log

18	01:42	1×GB10	seed2025_attn0p20.log	2.1154	OK	↑98.2%	training_log

19	01:49	1×GB10	seed1337_attn0p15.log	2.0683	OK	↑93.8%	training_log

20	01:50	1×GB10	seed1337_attn0p20.log	2.0671	OK	↑93.7%	training_log

21	01:52	1×GB10	seed42_scalar0p015.log	2.1241	OK	↑99.0%	training_log

22	01:53	1×GB10	seed42_scalar0p020.log	2.1256	OK	↑99.2%	training_log

23	01:53	1×GB10	seed2025_scalar0p015.log	2.1173	OK	↑98.4%	training_log

24	01:54	1×GB10	seed2025_scalar0p020.log	2.1156	OK	↑98.2%	training_log

25	02:05	1×GB10	baseline200.log	2.0668	OK	↑93.7%	training_log

26	02:05	1×GB10	chaos_d2_p0_long_seed4242.log (×3)	1.8514	OK	↑73.5%	training_log 1 training_log 2 training_log 3

27	02:07	1×GB10	qk040.log	2.1118	OK	↑97.9%	training_log

28	02:08	1×GB10	attn022.log	2.1137	OK	↑98.1%	training_log

29	02:11	1×GB10	scalar015.log (×2)	2.1117	OK	↑97.9%	training_log 1 training_log 2

30	02:11	1×GB10	scalar020.log (×2)	2.1092	OK	↑97.6%	training_log 1 training_log 2

31	02:12	1×GB10	scalar025.log	2.1119	OK	↑97.9%	training_log

32	02:30	1×GB10	baseline_s42.log (×3)	2.0881	OK	↑95.7%	training_log 1 training_log 2 training_log 3

33	02:31	1×GB10	qk030_s42.log (×2)	2.0297	OK	↑90.2%	training_log 1 training_log 2

34	02:32	1×GB10	baseline_s2025.log (×3)	2.0755	OK	↑94.5%	training_log 1 training_log 2 training_log 3

35	02:33	1×GB10	qk030_s2025.log	2.0755	OK	↑94.5%	training_log

36	02:34	1×GB10	qk030_m045_s42.log	2.0932	OK	↑96.1%	training_log

37	02:35	1×GB10	qk030_m050_s42.log	2.0921	OK	↑96.0%	training_log

38	02:36	1×GB10	qk030_m045_s2025.log	2.0781	OK	↑94.7%	training_log

39	02:37	1×GB10	qk030_m050_s2025.log	2.0793	OK	↑94.8%	training_log

40	02:45	1×GB10	chaos_d2_p0_long_seed51515.log (×3)	1.8651	OK	↑74.8%	training_log 1 training_log 2 training_log 3

41	02:46	1×GB10	attn018_s42.log	2.0910	OK	↑95.9%	training_log

42	02:48	1×GB10	attn018_s2025.log	2.0758	OK	↑94.5%	training_log

43	02:49	1×GB10	scalar015_s42.log	2.0900	OK	↑95.8%	training_log

44	02:50	1×GB10	scalar015_s2025.log	2.0790	OK	↑94.8%	training_log

45	03:02	1×GB10	qk025_s2025.log	2.0709	OK	↑94.0%	training_log

46	03:03	1×GB10	attn016_s42.log	2.0947	OK	↑96.3%	training_log

47	03:04	1×GB10	attn016_s2025.log	2.0760	OK	↑94.5%	training_log

48	03:08	1×GB10	tail_baseline_seed4242.log	1.8961	OK	↑77.7%	training_log

49	03:08	1×GB10	tail_fused_seed4242.log (×3)	1.3266	OK	↑24.3%	training_log 1 training_log 2 training_log 3

50	03:14	1×GB10	qk030_s1337.log	1.9925	OK	↑86.7%	training_log

51	03:16	1×GB10	qk025_s1337.log	1.9939	OK	↑86.8%	training_log

52	03:21	1×GB10	qk025_s42.log (×2)	2.0258	OK	↑89.8%	training_log 1 training_log 2

53	03:23	1×RTX 5090	tail_baseline_seed51515.log	1.8947	OK	↑77.5%	training_log

54	03:32	1×GB10	qk030_s2025_1k.log	1.9938	OK	↑86.8%	training_log

55	03:37	1×GB10	qk025_s2025_1k.log	1.9943	OK	↑86.9%	training_log

56	04:20	1×GB10	tail_fused_seed51515.log (×3)	1.3321	OK	↑24.8%	training_log 1 training_log 2 training_log 3

57	04:56	1×GB10	tail_fused_fc1_seed51515.log	1.9384	OK	↑81.6%	training_log

58	04:56	1×GB10	tail_fused_fc1_seed4242.log	1.9196	OK	↑79.9%	training_log

59	05:24	1×GB10	queued.nohup.out (×2)	1.9961	OK	↑87.0%	training_log 1 training_log 2

60	05:49	1×GB10	tail_fused_prep_seed88888.log	1.4200	OK	↑33.1%	training_log

61	05:55	1×GB10	tail_fused_seed7777.log	1.3260	OK	↑24.3%	training_log

62	06:06	1×GB10	baseline_full.log	1.9938	OK	↑86.8%	training_log

63	06:19	1×GB10	tail_fused_qkprep_prep_seed4242.log	1.4153	OK	↑32.6%	training_log

64	06:19	1×GB10	tail_fused_qkprep_seed4242.log	1.4209	OK	↑33.1%	training_log

65	06:21	1×GB10	no_mlp.log (×2)	2.4697	OK	↑131.4%	training_log 1 training_log 2

66	06:36	1×GB10	no_perturb.log	1.9653	OK	↑84.2%	training_log

67	06:51	1×GB10	attn_only.log	1.9682	OK	↑84.4%	training_log

68	07:06	1×GB10	chaos_only.log	1.8906	OK	↑77.2%	training_log

69	07:14	1×GB10	tail_fused_seed27182.log	1.3337	OK	↑25.0%	training_log

70	07:21	1×GB10	fractal cadence test cadence test.log	1.9665	OK	↑84.3%	training_log

71	07:49	1×GB10	tail_fused_qkv_prep_seed51515.log	1.4126	OK	↑32.4%	training_log

72	07:49	1×GB10	tail_fused_qkv_seed4242.log	1.4254	OK	↑33.6%	training_log

73	09:15	1×GB10	tail_fused_qkv_seed8888.log	1.4764	OK	↑38.3%	training_log

74	13:56	1×GB10	struct_baseline_s42.log	1.9746	OK	↑85.0%	training_log

75	14:01	1×GB10	tail_rnorm512_w8_s2_seed4242.log	1.4876	OK	↑39.4%	training_log

76	14:11	1×GB10	struct_best_s42.log	1.8987	OK	↑77.9%	training_log

77	14:16	1×GB10	tail_rnorm512_w4_s2_seed4242.log	1.4766	OK	↑38.4%	training_log

78	14:23	1×GB10	tail_fused_qkv_qkprep_seed4242.log	1.4118	OK	↑32.3%	training_log

79	14:26	1×GB10	struct_baseline_s1337.log	1.9118	OK	↑79.1%	training_log

80	14:39	1×GB10	tail_fused_qkv_qkprep_prep_seed51515.log	1.4293	OK	↑33.9%	training_log

81	14:42	1×GB10	struct_best_s1337.log	1.8993	OK	↑78.0%	training_log

82	14:44	1×GB10	tail_fused_block_entry_seed4242.log	1.4262	OK	↑33.6%	training_log

83	14:52	1×GB10	qk025.log	1.9147	OK	↑79.4%	training_log

84	15:02	1×GB10	qk030.log (×2)	1.9106	OK	↑79.0%	training_log 1 training_log 2

85	15:12	1×GB10	qk035.log (×3)	1.9132	OK	↑79.3%	training_log 1 training_log 2 training_log 3

86	15:22	1×GB10	attn016.log	1.9126	OK	↑79.2%	training_log

87	15:32	1×GB10	attn018.log (×2)	1.9099	OK	↑79.0%	training_log 1 training_log 2

88	15:42	1×GB10	attn020.log (×2)	1.9159	OK	↑79.5%	training_log 1 training_log 2

89	15:52	1×GB10	matrix040.log (×2)	1.9115	OK	↑79.1%	training_log 1 training_log 2

90	16:02	1×GB10	matrix045.log (×3)	1.9118	OK	↑79.1%	training_log 1 training_log 2 training_log 3

91	16:13	1×GB10	matrix050.log (×2)	1.9081	OK	↑78.8%	training_log 1 training_log 2

92	16:53	1×GB10	best40m_seed2025.log	1.8632	OK	↑74.6%	training_log

93	17:20	2×H100	chaos2g_seed2025.log	2.4018	OK	↑125.1%	training_log

94	17:33	1×GB10	best40m_seed42.log	1.8633	OK	↑74.6%	training_log

95	17:51	2×H100	chaos2g_seed42.log	2.4018	OK	↑125.1%	training_log

96	17:52	1×GB10	chaos_d1_p0_seed2025.log	1.8942	OK	↑77.5%	training_log

97	18:07	1×GB10	chaos_d1_p1_seed2025.log	1.9137	OK	↑79.3%	training_log

98	18:20	1×GB10	chaos_d1_p0_seed42.log	1.9011	OK	↑78.1%	training_log

99	18:22	1×GB10	chaos_d2_p0_seed2025.log	1.9073	OK	↑78.7%	training_log

100	18:33	1×GB10	tail_fused_block_entry_cublas_seed16180.log	1.4260	OK	↑33.6%	training_log

101	18:35	1×GB10	chaos_d1_p1_seed42.log	1.9118	OK	↑79.1%	training_log

102	18:37	1×GB10	chaos_d2_p1_seed2025.log	1.9368	OK	↑81.5%	training_log

103	18:50	1×GB10	chaos_d2_p0_seed42.log	1.9002	OK	↑78.1%	training_log

104	18:59	1×GB10	tail_fused_qkv_qkprep_seed16180.log	1.4229	OK	↑33.3%	training_log

105	18:59	1×GB10	tail_fused_qkv_qkprep_prep_seed16180.log	1.4245	OK	↑33.5%	training_log

106	19:05	1×GB10	chaos_d2_p1_seed42.log	1.9327	OK	↑81.1%	training_log

107	19:15	1×GB10	tail_rnorm1024_w2_s3_seed16180.log	1.4058	OK	↑31.7%	training_log

108	19:15	1×GB10	tail_rnorm2048_w8_s2_seed16180.log	1.4106	OK	↑32.2%	training_log

109	19:18	1×GB10	chaos_d1_p0_long_seed2025.log	1.8646	OK	↑74.7%	training_log

110	19:29	1×GB10	bs64_s4w8_allw4.nohup.out	2.1363	OK	↑100.2%	training_log

111	19:30	1×GB10	tail_rnorm512_w8_s3_seed16180.log	1.4062	OK	↑31.8%	training_log

112	19:30	1×GB10	tail_rnorm2048_w8_s3_seed16180.log	1.4120	OK	↑32.3%	training_log

113	19:36	1×GB10	lr20.log	2.1428	OK	↑100.8%	training_log

114	19:36	1×GB10	chaos3.log	2.1302	OK	↑99.6%	training_log

115	19:37	1×GB10	chaos0.log	2.1429	OK	↑100.8%	training_log

116	19:42	1×GB10	qk050.log	2.1324	OK	↑99.8%	training_log

117	19:46	1×RTX 4090	chaos_d1_p0_long_seed42.log	1.8663	OK	↑74.9%	training_log

118	19:46	1×GB10	tail_rnorm512_w16_s3_seed16180.log	1.4015	OK	↑31.3%	training_log

119	19:46	1×GB10	tail_rnorm2048_w4_s3_seed16180.log	1.4112	OK	↑32.2%	training_log

120	19:48	1×GB10	chaos3_qk060.nohup.out	2.1328	OK	↑99.9%	training_log

121	19:58	1×GB10	chaos_d2_p0_long_seed2025.log	1.8635	OK	↑74.6%	training_log

122	19:58	1×GB10	baseline.log (×3)	2.1305	OK	↑99.6%	training_log 1 training_log 2 training_log 3

123	19:58	1×GB10	perturb0.log	2.1349	OK	↑100.0%	training_log

124	19:59	1×GB10	gate_attn.log	2.1372	OK	↑100.3%	training_log

125	20:00	1×GB10	gate_attn_perturb0.log	2.1423	OK	↑100.7%	training_log

126	20:00	1×GB10	gate_attn_perturb0_attn05.log	2.1321	OK	↑99.8%	training_log

127	20:01	1×GB10	tail_rnorm2048_w16_s3_seed16180.log	1.4078	OK	↑31.9%	training_log

128	20:01	1×GB10	tail_rnorm1024_w8_s5_seed16180.log	1.4082	OK	↑32.0%	training_log

129	20:08	1×GB10	seed42_depth3.log	2.1405	OK	↑100.6%	training_log

130	20:09	1×GB10	seed2025_depth3.log	2.1337	OK	↑99.9%	training_log

131	20:09	1×GB10	seed42_depth4.log	2.1390	OK	↑100.4%	training_log

132	20:10	1×GB10	seed2025_depth4.log	2.1367	OK	↑100.2%	training_log

133	20:13	1×GB10	attn05.log	2.1230	OK	↑98.9%	training_log

134	20:13	1×GB10	skip05.log	2.1372	OK	↑100.3%	training_log

135	20:14	1×GB10	skip00.log	2.1487	OK	↑101.3%	training_log

136	20:17	1×GB10	seed42_attn1p0.log	2.1399	OK	↑100.5%	training_log

137	20:18	1×GB10	seed2025_attn1p0.log	2.1355	OK	↑100.1%	training_log

138	20:20	1×GB10	tail_fused_mlp_resid_seed16180.log (×6)	1.4061	OK	↑31.8%	training_log 1 training_log 2 training_log 3 training_log 4 training_log 5 training_log 6

139	20:26	1×GB10	chaos_d2_p0_long_seed42.log	1.8663	OK	↑74.9%	training_log

140	20:27	1×GB10	depth1.log	2.1208	OK	↑98.7%	training_log

141	20:27	1×GB10	depth2.log	2.1222	OK	↑98.9%	training_log

142	20:28	1×GB10	depth3.log	2.1232	OK	↑99.0%	training_log

143	20:29	1×GB10	depth4.log	2.1228	OK	↑98.9%	training_log

144	20:30	1×GB10	seed42_depth1.log	2.1284	OK	↑99.4%	training_log

145	20:31	1×GB10	seed2025_depth1.log	2.1189	OK	↑98.5%	training_log

146	20:31	1×GB10	seed42_depth2.log	2.1271	OK	↑99.3%	training_log

147	20:32	1×GB10	seed2025_depth2.log	2.1235	OK	↑99.0%	training_log

148	20:44	1×GB10	chaos_d1_p0_long_seed1337.log	1.8659	OK	↑74.8%	training_log

149	20:45	1×GB10	tail_fused_seed16180.log (×70)	1.3225	OK	↑23.9%	training_log 1 training_log 2 training_log 3 training_log 4 training_log 5 training_log 6 training_log 7 training_log 8 training_log 9 training_log 10 training_log 11 training_log 12 training_log 13 training_log 14 training_log 15 training_log 16 training_log 17 training_log 18 training_log 19 training_log 20 training_log 21 training_log 22 training_log 23 training_log 24 training_log 25 training_log 26 training_log 27 training_log 28 training_log 29 training_log 30 training_log 31 training_log 32 training_log 33 training_log 34 training_log 35 training_log 36 training_log 37 training_log 38 training_log 39 training_log 40 training_log 41 training_log 42 training_log 43 training_log 44 training_log 45 training_log 46 training_log 47 training_log 48 training_log 49 training_log 50 training_log 51 training_log 52 training_log 53 training_log 54 training_log 55 training_log 56 training_log 57 training_log 58 training_log 59 training_log 60 training_log 61 training_log 62 training_log 63 training_log 64 training_log 65 training_log 66 training_log 67 training_log 68 training_log 69 training_log 70

150	21:06	1×GB10	chaos_d1_p0_long_seed31415.log	1.8711	OK	↑75.3%	training_log

151	21:22	1×GB10	seed1337_attn0p65.log	2.1248	OK	↑99.1%	training_log

152	21:24	1×GB10	chaos_d2_p0_long_seed1337.log	1.8585	OK	↑74.1%	training_log

153	21:24	1×GB10	seed42_attn0p35.log	2.1230	OK	↑98.9%	training_log

154	21:25	1×GB10	seed2025_attn0p35.log	2.1221	OK	↑98.8%	training_log

155	21:42	1×GB10	qk060.log	2.1215	OK	↑98.8%	training_log

156	21:43	1×GB10	qk075.log	2.1214	OK	↑98.8%	training_log

157	21:46	1×GB10	chaos_d2_p0_long_seed31415.log	1.8647	OK	↑74.7%	training_log

158	21:46	1×GB10	seed42_qk0p60.log	2.1282	OK	↑99.4%	training_log

159	21:48	1×GB10	seed2025_qk0p60.log	2.1201	OK	↑98.7%	training_log

160	21:50	1×GB10	seed1337_attn0p35.log	2.1185	OK	↑98.5%	training_log

161	21:51	1×GB10	seed1337_attn0p5.log	2.1186	OK	↑98.5%	training_log

162	21:53	1×GB10	seed42_attn0p5.log	2.1273	OK	↑99.3%	training_log

163	21:54	1×GB10	seed2025_attn0p5.log	2.1194	OK	↑98.6%	training_log

164	22:00	1×GB10	scalar030.log	2.1175	OK	↑98.4%	training_log

165	22:04	1×GB10	chaos_d1_p0_long_seed27182.log	1.8738	OK	↑75.6%	training_log

166	22:29	1×GB10	chaos_d1_p0_long_seed16180.log	1.8645	OK	↑74.7%	training_log

167	22:44	1×GB10	chaos_d2_p0_long_seed27182.log	1.8662	OK	↑74.9%	training_log

168	23:10	1×GB10	chaos_d2_p0_long_seed16180.log	1.8721	OK	↑75.4%	training_log

169	23:24	1×GB10	matrix025.log	2.1251	OK	↑99.1%	training_log

170	23:25	1×GB10	matrix035.log	2.1170	OK	↑98.4%	training_log

171	23:32	1×GB10	seed42_matrix0p035.log	2.1212	OK	↑98.8%	training_log

172	23:33	1×GB10	seed42_matrix0p045.log	2.1241	OK	↑99.0%	training_log

173	23:33	1×GB10	seed2025_matrix0p035.log	2.1181	OK	↑98.5%	training_log

174	23:34	1×GB10	seed2025_matrix0p045.log	2.1166	OK	↑98.3%	training_log

175	23:50	1×GB10	chaos_d2_p0_long_seed7777.log	1.8617	OK	↑74.4%	training_log

176	23:56	1×GB10	seed1337_matrix0p035.log	2.0733	OK	↑94.3%	training_log

177	23:57	1×GB10	seed1337_matrix0p045.log	2.0668	OK	↑93.7%	training_log

TIME

ABLATION

VAL_BPB

STATUS

Δ %

OPEN