jspace-nanogpt.git - J-space on nanoGPT: Jacobian Lens replication & critique. J-lens norms anti-correlate with token frequency (r ~ -0.61 to -0.69); frequency-matched synthetic pair + causal loss-reweighting tests.

Age	Commit message (Collapse)	Author
30 hours	at-scale W_U row-norm check (GPT-2): geometric confound generalizes, ↵main	Void Agent
	r(log10)≈-0.45/-0.49; blog draft: drop 'Actually', log-freq lead, probe transparency, norm-vs-readout concession
4 days	Polish per review: results.md GPT-2 -0.18 demoted to do-not-cite footnote; ↵	Void Agent
	blog section 10 adds W_U-at-init scale prediction (one-line GPT-2 unembedding check)
4 days	Blog revision per reviewer feedback: de-emphasize reviewer name-drops, ↵	Void Agent
	promote LN technical note, willkn as Related-work, table footnote, section 8 power reframe (~13 seeds/arm needed); add W_U-at-init finding (learned geometry, r~0 at init vs -0.61 trained)
4 days	Clean-boundary synthetic-pair control: ratio 1.311 (CI [1.258,1.402]) vs ↵	Void Agent
	1.471 — corruption inflated by ~12%, structure signal survives at 0% word-slicing; blog section 7 + results.md resolved
4 days	Robustness confirmed: freq correlation identical under Anthropic's exact ↵	Void Agent
	estimator (skip16+source_mean), max delta 0.008 all layers
4 days	Fix in-word metric: strict (both-sides, 58% random / 0% clean) vs touches ↵	Void Agent
	(95%); blog/results caveat corrected to the strict discriminator
4 days	Loss-reweighting results: q/control 0.944 (CI crosses 1), q/ctrl_random ↵	Void Agent
	0.985 — small non-significant causal demotion; freq corr invariant (r~-0.66) across all 9 models; blog section 8 + results.md section 3 filled honestly
4 days	Add willkn GreaterWrong corroboration: independent GPT-2-medium finding that ↵	Void Agent
	raw J-lens misweights structural (high-frequency) tokens + full-rank Jacobian; shrinkage J+lambda I as untested next experiment
4 days	Verify against Anthropic's official jacobian-lens repo: estimator match, ↵	Void Agent
	zero frequency in their code+data, add --skip_first/--source_mean mirror mode
4 days	Address Gemini+Opus repo reviews: W_U decomposition, Spearman+p-values, ↵	Void Agent
	synthetic-pair CIs + corruption caveat, accurate fact-check, softened burden-of-proof, LayerNorm note, reviews caveat
4 days	Docs: Feynman-style blog draft, MIT license, requirements, results.md, ↵	Void Agent
	README rewrite with repro steps; reviews -> docs/reviews