Update README.md

4 years ago · f11b97ae48
parent 88e921bf10
commit f11b97ae48
1 changed files with 2 additions and 0 deletions
--- a/README.md
+++ b/README.md
@ -8,6 +8,8 @@ You only need x_t, a_t, b_t of position t to compute the vectors for position t+

 Hence it can be 100x faster than GPT, and 100x more VRAM friendly.

+See the release for a 27M params model on enwik8 with 1.65 dev perplexity (0.72 BPC).
+
 ## How it works

 The a b c d factors work together to build a time-decay curve: X, 1, W, W^2, W^3, ...