novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
PENG Bo 3 years ago committed by GitHub
parent 8a4a41a3aa
commit 737fb7dc8e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File

4
README.md
Unescape Escape View File

@ -18,9 +18,7 @@ I am doing image experiments too (For example: https://huggingface.co/BlinkDL/cl
You are welcome to join the RWKV discord https://discord.gg/bDSBUMeFpc to build upon it. We have plenty of potential compute (A100 40Gs) now (thanks to Stability and EleutherAI), so if you have interesting ideas I can run them. You are welcome to join the RWKV discord https://discord.gg/bDSBUMeFpc to build upon it. We have plenty of potential compute (A100 40Gs) now (thanks to Stability and EleutherAI), so if you have interesting ideas I can run them.
I am training RWKV-4 3B and 7B on the Pile (https://wandb.ai/blinkdl/RWKV-v4-Pile and https://huggingface.co/BlinkDL). Download RWKV-4 0.1/0.4/1.5/3B: https://huggingface.co/BlinkDL. I am training RWKV-4 7/14/24B on the Pile (https://wandb.ai/blinkdl/RWKV-v4-Pile).
![RWKV-v4-1.5B-Pile](RWKV-v4-1.5B-Pile.png)
![RWKV-eval](RWKV-eval.png) ![RWKV-eval](RWKV-eval.png)

Write Preview
Loading…
Cancel
Save