novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
PENG Bo 3 years ago committed by GitHub
parent eaac3f7e66
commit 7bdfd1cb64
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File

4
README.md
Unescape Escape View File

@ -8,6 +8,10 @@ So it's combining the best of RNN and transformer - **great performance, fast in
**Download RWKV-4 0.1/0.4/1.5/3/7/14B weights**: https://huggingface.co/BlinkDL **Download RWKV-4 0.1/0.4/1.5/3/7/14B weights**: https://huggingface.co/BlinkDL
**RWKV chatbot**: https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v4neo/chat.py
---
I am training RWKV-4 14B on the Pile (final release around Jan-31-2023): https://wandb.ai/blinkdl/RWKV-v4-Pile I am training RWKV-4 14B on the Pile (final release around Jan-31-2023): https://wandb.ai/blinkdl/RWKV-v4-Pile
![RWKV-eval2](RWKV-eval2.png) ![RWKV-eval2](RWKV-eval2.png)

Write Preview
Loading…
Cancel
Save