Experimental work: CRAWLER-SAFE TRAIN/EVAL SURFACE (x17): Crawler-safe training/eval surface around a widened shared-crawler stack with final int6 and int8 checks. Specs: model_dim=512; vocab_size=1024; num_heads=8; num_kv_heads=4; BigramHash. WIDENED CRAWLER BOTTLENECK (x9): Widened crawler bottleneck body: 5 flat blocks, 1 shared crawler block, 5 flat blocks. Specs: MODEL_DIM=512; num_heads=8; num_kv_heads=4; ROPE_DIMS=16. 12L GQA MIXED-BIT TOWER (x6): 12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging. Specs: num_layers=12; num_heads=8; num_kv_heads=4; rope_dims=16; eval_seq_len=2048.
Neural work: 12L GQA MIXED-BIT TOWER (x21): 12-layer GQA tower: 8/4 GQA, RoPE-16, Bigram 2048, XSA on the last 11 layers, and mixed-bit packaging. Specs: num_layers=12; num_heads=8; num_kv_heads=4; rope_dims=16; eval_seq_len=2048. COMPRESSION PACKAGING EXPERIMENT (x1): architecture family detected in measured rows; exact flags are preserved in the row details. CRAWLER ABLATION CONTROL SET (x1): architecture family detected in measured rows; exact flags are preserved in the row details.
Week 04 covers 7 daily reports from 2026-04-08 through 2026-04-14. Measured surfaces: 6 daily datapoints across VAL_BPB (×6).
Techniques to copy/reference this week: attention int5; mlp int6; aux int6; embed int8; other int8; Brotli artifact; 16 MB artifact cap; BigramHash; XSA; RoPE.