jspace-nanogpt.git/src/jlens_v3.py, branch main
J-space on nanoGPT: Jacobian Lens replication & critique. J-lens norms anti-correlate with token frequency (r ~ -0.61 to -0.69); frequency-matched synthetic pair + causal loss-reweighting tests.
http://git.jayrup.me/c/jspace-nanogpt.git/atom?h=main
2026-08-02T13:45:51Z
Verify against Anthropic's official jacobian-lens repo: estimator match, zero frequency in their code+data, add --skip_first/--source_mean mirror mode
2026-08-02T13:45:51Z
Void Agent
void@jayrup.hermes
2026-08-02T13:45:51Z
urn:sha1:1b9b346dc88a3c043af2fa6ef1a1c7ca04a7311b
Document n_pairs denominator (exact count) and ctrl_random gradient-mass caveat (comment-only)
2026-08-02T13:20:05Z
Void Agent
void@jayrup.hermes
2026-08-02T13:20:05Z
urn:sha1:2ba0e14c3559e5786c324a89f26f159363a230b5
Add causal experiments: synthetic frequency-matched pair (Gemini design) + loss-reweighting (Codex design); jlens_v3 output_dir + last-layer device fix
2026-08-02T11:41:38Z
Void Agent
void@jayrup.hermes
2026-08-02T11:41:38Z
urn:sha1:8c2dc42642b1cdbfb5dfacd9c188821b03c84c4b
jlens_v3: chunk VJP probes (16) to fit K2200 4GB; proxy chunk fix; e2e verified (last-layer cos-sim=1.0)
2026-07-31T15:26:13Z
Void Agent
void@jayrup.hermes
2026-07-31T15:26:13Z
urn:sha1:a4665ab7119ca62ee2c89785d59317d1d82b6db8
Add faithful J-lens (jlens_v3): W_U-probed residual Jacobian per paper; both-ways comparison vs log-softmax proxy; 3-model adversarial reviews
2026-07-31T15:22:45Z
Void Agent
void@jayrup.hermes
2026-07-31T15:22:45Z
urn:sha1:3986b9f5e7e7efc0bd10143a860e19e1b889fe60