From d1bb270fb37339a76513b59f145b879aac8b3a3c Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Sun, 22 Jan 2023 05:00:26 +0800 Subject: [PATCH] Update README.md --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index 7c5baa8..070cfae 100644 --- a/README.md +++ b/README.md @@ -12,6 +12,10 @@ So it's combining the best of RNN and transformer - **great performance, fast in ![RWKV-chat](RWKV-chat.png) +**You can run RWKV-4 14B on any GPU using this fork (choose pytorch-stream):** https://github.com/harrisonvanderbyl/rwkv_chatbot + +--- + I am training RWKV-4 14B on the Pile (final release around Jan-31-2023): https://wandb.ai/blinkdl/RWKV-v4-Pile ![RWKV-eval2](RWKV-eval2.png)