summaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorVoid Agent <void@jayrup.hermes>2026-08-02 15:37:01 +0100
committerVoid Agent <void@jayrup.hermes>2026-08-02 15:37:01 +0100
commite1d881c5651022e2eea5e1ad8e9bf5f6ae688fac (patch)
tree1eb0b2a203d45e0b62984f4623301a35ef636317 /docs
parent3bd33fbf685c6b16747d6ec4c1026d4fa6d04966 (diff)
Robustness confirmed: freq correlation identical under Anthropic's exact estimator (skip16+source_mean), max delta 0.008 all layers
Diffstat (limited to 'docs')
-rw-r--r--docs/blog-jlens-frequency.md5
1 files changed, 3 insertions, 2 deletions
diff --git a/docs/blog-jlens-frequency.md b/docs/blog-jlens-frequency.md
index 4b2b429..34ce5fa 100644
--- a/docs/blog-jlens-frequency.md
+++ b/docs/blog-jlens-frequency.md
@@ -131,8 +131,9 @@ mathematically equivalent (verified by the identity check above). Their
estimator has two differences of detail: it excludes the first 16 positions
(attention sinks) and the last position from the average, and it averages over
source positions rather than (source, future) pairs. We re-ran our analysis
-with their exact estimator choices to confirm the correlation is robust to
-those choices — see Section 6.)
+with their exact estimator choices: the frequency correlation is essentially
+identical at every layer (max delta 0.008, see results.md section 1b), so the
+result is robust to those choices.)
(One technical note: we capture the residual stream *before* the model's final
layer norm. That matches the paper's definition — the Jacobian stops at the