From 7ca6d8bcfd0db4feb89456100ccf766d02d5f258 Mon Sep 17 00:00:00 2001 From: Void Agent Date: Sun, 2 Aug 2026 16:46:43 +0100 Subject: Polish per review: results.md GPT-2 -0.18 demoted to do-not-cite footnote; blog section 10 adds W_U-at-init scale prediction (one-line GPT-2 unembedding check) --- results.md | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) (limited to 'results.md') diff --git a/results.md b/results.md index 692ce03..7acbc56 100644 --- a/results.md +++ b/results.md @@ -186,7 +186,9 @@ Reading: - Original proxy finding (r = -0.65, `jlens_v2`): superseded by the faithful implementation; kept only for the both-ways comparison. -- GPT-2 correlation (r = -0.18, `gpt2_jlens.py`): UNDER-POWERED (96 token - positions, n=100 sampled tokens) and computed a different quantity - (norm-per-batch vs norm-of-mean). Directionally consistent but not - publishable evidence on its own. +- GPT-2 correlation: an early directional probe on GPT-2 small + (`gpt2_jlens.py`) gave avg r = -0.18 across layers — UNDER-POWERED + (96 token positions, n=100 sampled tokens) and a different quantity + (norm-per-batch vs norm-of-mean). Kept here only as a reproducibility + warning: **do not cite the -0.18 as evidence**; the at-scale test with the + faithful lens is future work. -- cgit v1.2.3