readme.md « shakespeare_char « data - jspace-nanogpt.git - J-space on nanoGPT: Jacobian Lens replication & critique. J-lens norms anti-correlate with token frequency (r ~ -0.61 to -0.69); frequency-matched synthetic pair + causal loss-reweighting tests.

summary refs log tree commit diff

path: root/data/shakespeare_char/readme.md

blob: d597b79cd3f1245292c3fdd89dd6ae5d00c96646 (plain)


# tiny shakespeare, character-level

Tiny shakespeare, of the good old char-rnn fame :) Treated on character-level.

After running `prepare.py`:

- train.bin has 1,003,854 tokens
- val.bin has 111,540 tokens