@ -6,6 +6,8 @@ RWKV is a RNN with Transformer-level LLM performance, which can also be directly
So it's combining the best of RNN and transformer - **great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding** (using the final hidden state).