| Age | Commit message (Collapse) | Author |
|
- model.py: honor config.flash flag (defaults True, False disables SDPA)
- config: force dtype=float32 and flash=False for K2200 (compute 5.0)
- Maxwell GPUs don't support bf16; SDPA internally uses bf16 operations
|
|
- Move model.py, train.py, configurator.py to root for nanoGPT compatibility
- data/ and config/ directories at root with Shakespeare dataset prep scripts
- src/jlens.py updated to import model from project root
- Cleaned up stale src/config/ and duplicate src/ files
- Fixed .gitignore: exclude out-shakespeare-char/ instead of raw data dirs
|
|
- Core J-lens computation (batched per-layer, per-token gradient method)
- Project README with background and experiment plan
- Sync script for meru Docker container deployment
- Upstream nanoGPT model code copied to src/
Architecture: Computes d(log_p(token))/d(residual_stream) averaged
over corpus contexts, replicating Anthropic's Jacobian Lens technique.
|