prime-grokking.git/tests/test_data.py, branch main
Prime Grokking — can minimal architectures grok next-prime? Pre-registered negative-class experiment (weight-tied RNN vs transformer).
http://git.jayrup.me/c/prime-grokking.git/atom?h=main
2026-08-20T16:02:15Z
fix(eval): correct sieve-rank indexing + test expectations
2026-08-20T16:02:15Z
Void Agent
void@jayrup.hermes
2026-08-20T16:02:15Z
urn:sha1:cf83937689bb30e2b5fa6e3efaa2f115016a030b
- _compute_sieve_rank: find LARGEST k (not smallest) whose signature
contains all error preds — fixes P5(4) vs P5(1) bug
- _sieve_rank_signature: iterate all small_primes (not just p²≤n) to
catch composites like 209=11*19 where 11²>209
- Test expectations updated for [101,200] range (209 outside it)
- is_prime task: P1→P3 (no sieve-rank for classification tasks)
48/48 green.
fix(eval): P5/P6 sieve-rank ladder replaces hardcoded FLAGGED_SIEVE_PREDS
2026-08-20T15:55:49Z
Void Agent
void@jayrup.hermes
2026-08-20T15:55:49Z
urn:sha1:f8995751de925571d4eec669ab7ab8b1c3d76cb9
- probe_report: dynamic lo/hi (no more hardcoded [101,200])
- main(): probe range derived from range_end ([range_end+1, range_end+1000])
- P6 = exact (no probe misses), P5(k) = errors match rank-k sieve signature
- _sieve_rank_signature: computes composites with all factors > p_k
- _compute_sieve_rank: identifies rank from model's error predictions
- build_report.py: probe_fig uses sieve rank for coloring
- Tests updated for P5/P6 codes (48/48 green)
eval: P1 diagnostic prediction-based (flagged set +209), classifier regression suite (10 tests, stub ground truth); 34 tests green
2026-08-14T12:27:54Z
Void Agent
void@jayrup.hermes
2026-08-14T12:27:54Z
urn:sha1:39b8218a5fe660200a833c03b36afbde6c119467
fix codex BLOCKERs: global fixed layout invariance, min_steps off-by-one, integers EOS alias, rerun guard, eval prereg-literal codes + dual-checkpoint honesty; +7 regression tests
2026-08-14T12:21:03Z
Void Agent
void@jayrup.hermes
2026-08-14T12:21:03Z
urn:sha1:9fecbe58cc0750e9e39b261a672b0c6e85e6ed4e
implement Experiment 1: data pipeline, tied-RNN w/ ACT halting, transformer baseline, train/eval/plot, 16 tests
2026-08-14T12:11:02Z
Void Agent
void@jayrup.hermes
2026-08-14T12:11:02Z
urn:sha1:898a0570dfe619ec2bcf330b07dce9b23cb63d54