summaryrefslogtreecommitdiff
path: root/blog/prime-grokking-2.qmd
diff options
context:
space:
mode:
Diffstat (limited to 'blog/prime-grokking-2.qmd')
-rw-r--r--blog/prime-grokking-2.qmd5
1 files changed, 5 insertions, 0 deletions
diff --git a/blog/prime-grokking-2.qmd b/blog/prime-grokking-2.qmd
index f97dcfc..ed23fe6 100644
--- a/blog/prime-grokking-2.qmd
+++ b/blog/prime-grokking-2.qmd
@@ -3,6 +3,11 @@ title: "Still No Grokking: The Weight-Decay Sweep"
date: "2026-08-16"
---
+<nav>
+[Home](https://jayrup.me) | [Blog](https://jayrup.me/blog) | [Projects](https://jayrup.me/projects) | [CV](https://jayrup.me/cv) | [Dissertation](https://jayrup.me/dissertation) | [Git](https://git.jayrup.me)
+</nav>
+
+
*Part 1 found no grokking at weight decay 1.0, and the seed replication
confirmed it. So I did the obvious thing: swept the weight decay across
five orders of magnitude and watched. Still no grokking. The way it