diff --git a/README.md b/README.md index 634490a..a7f8a8d 100644 --- a/README.md +++ b/README.md @@ -18,9 +18,11 @@ I am doing image experiments too (For example: https://huggingface.co/BlinkDL/cl You are welcome to join the RWKV discord https://discord.gg/bDSBUMeFpc to build upon it. We have plenty of potential compute (A100 40Gs) now (thanks to Stability and EleutherAI), so if you have interesting ideas I can run them. -**Download RWKV-4 0.1/0.4/1.5/3/7B weights**: https://huggingface.co/BlinkDL +Twitter: https://twitter.com/BlinkDL_AI -I am training RWKV-4 7/14B on the Pile: https://wandb.ai/blinkdl/RWKV-v4-Pile +**Download RWKV-4 0.1/0.4/1.5/3/7/14B weights**: https://huggingface.co/BlinkDL + +I am training RWKV-4 14B on the Pile: https://wandb.ai/blinkdl/RWKV-v4-Pile ![RWKV-eval](RWKV-eval.png) @@ -41,8 +43,6 @@ User feedback: > *dear god rwkv is fast. i switched to another tab after starting training it from scratch & when i returned it was emitting plausible english & maori words, i left to go microwave some coffee & when i came back it was producing fully grammatically correct sentences.* -Latest news on RWKV: https://twitter.com/BlinkDL_AI - Tweet from Sepp Hochreiter (thank you!): https://twitter.com/HochreiterSepp/status/1524270961314484227 You can find me (BlinkDL) in the EleutherAI Discord too: https://www.eleuther.ai/get-involved/