|
|
|
|
@ -8,6 +8,8 @@ So it's combining the best of RNN and transformer - **great performance, fast in
|
|
|
|
|
|
|
|
|
|
**Download RWKV-4 0.1/0.4/1.5/3/7/14B weights**: https://huggingface.co/BlinkDL
|
|
|
|
|
|
|
|
|
|
**RWKV in 150 lines** (model, inference, text generation): https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_in_150_lines.py
|
|
|
|
|
|
|
|
|
|
**ChatRWKV v2:** with "stream" and "split" strategies. **3G VRAM is enough to run RWKV 14B :)** https://github.com/BlinkDL/ChatRWKV/tree/main/v2
|
|
|
|
|
```
|
|
|
|
|
os.environ["RWKV_JIT_ON"] = '1'
|
|
|
|
|
|