summaryrefslogtreecommitdiff
path: root/results.md
diff options
context:
space:
mode:
authorVoid Agent <void@jayrup.hermes>2026-08-02 16:46:43 +0100
committerVoid Agent <void@jayrup.hermes>2026-08-02 16:46:43 +0100
commit7ca6d8bcfd0db4feb89456100ccf766d02d5f258 (patch)
tree839907d1d00b98e87e465f48ad5cd5e45b7820a8 /results.md
parentb1c232ebc00eaa115a1009d9a9f477721777ffe8 (diff)
Polish per review: results.md GPT-2 -0.18 demoted to do-not-cite footnote; blog section 10 adds W_U-at-init scale prediction (one-line GPT-2 unembedding check)
Diffstat (limited to 'results.md')
-rw-r--r--results.md10
1 files changed, 6 insertions, 4 deletions
diff --git a/results.md b/results.md
index 692ce03..7acbc56 100644
--- a/results.md
+++ b/results.md
@@ -186,7 +186,9 @@ Reading:
- Original proxy finding (r = -0.65, `jlens_v2`): superseded by the faithful
implementation; kept only for the both-ways comparison.
-- GPT-2 correlation (r = -0.18, `gpt2_jlens.py`): UNDER-POWERED (96 token
- positions, n=100 sampled tokens) and computed a different quantity
- (norm-per-batch vs norm-of-mean). Directionally consistent but not
- publishable evidence on its own.
+- GPT-2 correlation: an early directional probe on GPT-2 small
+ (`gpt2_jlens.py`) gave avg r = -0.18 across layers — UNDER-POWERED
+ (96 token positions, n=100 sampled tokens) and a different quantity
+ (norm-per-batch vs norm-of-mean). Kept here only as a reproducibility
+ warning: **do not cite the -0.18 as evidence**; the at-scale test with the
+ faithful lens is future work.