Update README.md

main
PENG Bo 4 years ago committed by GitHub
parent 0c6ffa710d
commit 940a67ec27
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -6,6 +6,8 @@ RWKV-2 is a RNN with Transformer-level performance, which can also be directly t
So it's combining the best of RNN and transformer - **great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding** (using the final hidden state).
Join our Discord! https://discord.gg/bDSBUMeFpc :)
Reddit discussion: https://www.reddit.com/r/MachineLearning/comments/umq908/r_rwkvv2rnn_a_parallelizable_rnn_with/
Tweet from Sepp Hochreiter (thank you!): https://twitter.com/HochreiterSepp/status/1524270961314484227

Loading…
Cancel
Save