@ -6,6 +6,8 @@ RWKV-2 is a RNN with Transformer-level performance, which can also be directly t
So it's combining the best of RNN and transformer - **great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding** (using the final hidden state).