From 9e09fafd5970f2c4bb546e0a8e412b84e6fc77ae Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Wed, 11 May 2022 05:12:29 +0800 Subject: [PATCH] Update README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index c4128b9..bceb69c 100644 --- a/README.md +++ b/README.md @@ -16,6 +16,8 @@ All of the trained models will be open-source. Inference is very fast (only matr See the release for a 27M params model on enwik8 with 0.72 BPC(dev). Run run.py in https://github.com/BlinkDL/RWKV-LM/tree/main/RWKV-v2-RNN :) +See https://github.com/BlinkDL/RWKV-v2-RNN-Pile for models trained on the Pile. + ## How it works RWKV is inspired by Apple's AFT (https://arxiv.org/abs/2105.14103).