summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
7 daysGPT-2 Small J-lens: frequency + dimensionality samplingVoid Agent
7 daysAdd Pythia-70m test scriptVoid Agent
7 daysFix: lr→learning_rate in configure_optimizersVoid Agent
7 daysAdd dimensional starvation experiment (d_model=16,32,64,128 vs 384)Void Agent
7 daysAdd controlled frequency ablation experiment (doubled-q)Void Agent
8 daysjlens_v2: fix import path for src/ -> root layoutVoid Agent
8 daysAdd jlens_v2.py: simplified gradient approach for J-lensVoid Agent
8 daysjlens.py: fix hooks — don't detach activations, preserve gradient graphVoid Agent
8 daysjlens.py: fix load_model for dict-format nanoGPT checkpointsVoid Agent
8 daysFix jlens.py import path: src/ -> project rootVoid Agent
8 daysRestructure: nanoGPT at root, custom code in src/Void Agent
- Move model.py, train.py, configurator.py to root for nanoGPT compatibility - data/ and config/ directories at root with Shakespeare dataset prep scripts - src/jlens.py updated to import model from project root - Cleaned up stale src/config/ and duplicate src/ files - Fixed .gitignore: exclude out-shakespeare-char/ instead of raw data dirs
8 daysInitial project setup: J-lens implementation for nanoGPTVoid Agent
- Core J-lens computation (batched per-layer, per-token gradient method) - Project README with background and experiment plan - Sync script for meru Docker container deployment - Upstream nanoGPT model code copied to src/ Architecture: Computes d(log_p(token))/d(residual_stream) averaged over corpus contexts, replicating Anthropic's Jacobian Lens technique.