summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
7 daysAdd jlens_v2.py: simplified gradient approach for J-lensVoid Agent
7 daysjlens.py: fix hooks — don't detach activations, preserve gradient graphVoid Agent
7 daysjlens.py: fix load_model for dict-format nanoGPT checkpointsVoid Agent
7 daysFix jlens.py import path: src/ -> project rootVoid Agent
8 daysMaxwell GPU fixes: disable bf16 SDPA, force fp32Void Agent
- model.py: honor config.flash flag (defaults True, False disables SDPA) - config: force dtype=float32 and flash=False for K2200 (compute 5.0) - Maxwell GPUs don't support bf16; SDPA internally uses bf16 operations
8 daysRestructure: nanoGPT at root, custom code in src/Void Agent
- Move model.py, train.py, configurator.py to root for nanoGPT compatibility - data/ and config/ directories at root with Shakespeare dataset prep scripts - src/jlens.py updated to import model from project root - Cleaned up stale src/config/ and duplicate src/ files - Fixed .gitignore: exclude out-shakespeare-char/ instead of raw data dirs
8 daysInitial project setup: J-lens implementation for nanoGPTVoid Agent
- Core J-lens computation (batched per-layer, per-token gradient method) - Project README with background and experiment plan - Sync script for meru Docker container deployment - Upstream nanoGPT model code copied to src/ Architecture: Computes d(log_p(token))/d(residual_stream) averaged over corpus contexts, replicating Anthropic's Jacobian Lens technique.