|
|
|
|
@ -8,6 +8,10 @@ So it's combining the best of RNN and transformer - **great performance, fast in
|
|
|
|
|
|
|
|
|
|
**Download RWKV-4 0.1/0.4/1.5/3/7/14B weights**: https://huggingface.co/BlinkDL
|
|
|
|
|
|
|
|
|
|
**RWKV chatbot**: https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v4neo/chat.py
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
I am training RWKV-4 14B on the Pile (final release around Jan-31-2023): https://wandb.ai/blinkdl/RWKV-v4-Pile
|
|
|
|
|
|
|
|
|
|

|
|
|
|
|
|