summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
9 daysGPT-2 J-lens: use local Shakespeare + fix summaryVoid Agent
9 daysGPT-2 Small J-lens: frequency + dimensionality samplingVoid Agent
9 daysAdd Pythia-70m test scriptVoid Agent
9 daysFix: lr→learning_rate in configure_optimizersVoid Agent
9 daysAdd dimensional starvation experiment (d_model=16,32,64,128 vs 384)Void Agent
9 daysAdd controlled frequency ablation experiment (doubled-q)Void Agent
10 daysjlens_v2: fix import path for src/ -> root layoutVoid Agent
10 daysAdd jlens_v2.py: simplified gradient approach for J-lensVoid Agent
10 daysjlens.py: fix hooks — don't detach activations, preserve gradient graphVoid Agent
10 daysjlens.py: fix load_model for dict-format nanoGPT checkpointsVoid Agent
10 daysFix jlens.py import path: src/ -> project rootVoid Agent
10 daysRestructure: nanoGPT at root, custom code in src/Void Agent
- Move model.py, train.py, configurator.py to root for nanoGPT compatibility - data/ and config/ directories at root with Shakespeare dataset prep scripts - src/jlens.py updated to import model from project root - Cleaned up stale src/config/ and duplicate src/ files - Fixed .gitignore: exclude out-shakespeare-char/ instead of raw data dirs
10 daysInitial project setup: J-lens implementation for nanoGPTVoid Agent
- Core J-lens computation (batched per-layer, per-token gradient method) - Project README with background and experiment plan - Sync script for meru Docker container deployment - Upstream nanoGPT model code copied to src/ Architecture: Computes d(log_p(token))/d(residual_stream) averaged over corpus contexts, replicating Anthropic's Jacobian Lens technique.