From 7212d75e7caba0e0ea26c32f70ad90c9bf3f7300 Mon Sep 17 00:00:00 2001
From: PENG Bo <33809201+BlinkDL@users.noreply.github.com>
Date: Mon, 2 May 2022 02:30:13 +0800
Subject: [PATCH] Update README.md

---
 README.md | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/README.md b/README.md
index f245f18..8916ebf 100644
--- a/README.md
+++ b/README.md
@@ -4,6 +4,8 @@
 
 RWKV v2 is a RNN which can also be directly trained like a GPT transformer (parallelizable). You only need x_t, a_t, b_t of position t to compute the vectors for position t+1. Hence it can be 100x faster than GPT, and 100x more VRAM friendly, and you get a free sentence embedding.
 
+I am training it on the Pile: https://github.com/BlinkDL/RWKV-v2-RNN-Pile
+
 See the release for a **27M params model on enwik8 with 0.72 BPC(dev)**.
 
 ![RWKV-v2-RNN](RWKV-v2-RNN-run.png)