From 619c8add7ae82e16512e78f4df50bcf1fd0b6002 Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Tue, 29 Mar 2022 03:49:48 +0800 Subject: [PATCH] Update README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e5d0dab..b939a44 100644 --- a/README.md +++ b/README.md @@ -6,6 +6,8 @@ RWKV v2 is a RNN which can also be directly trained like a GPT transformer. You See the release for a **27M params model on enwik8 with 0.72 BPC(dev)**. +![RWKV-v2-RNN](RWKV-v2-RNN-run.png) + ## How it works The a b c d factors work together to build a time-decay curve: X, 1, W, W^2, W^3, ...