novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
PENG Bo 4 years ago committed by GitHub
parent c4e8057a63
commit bc85865775
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File

4
README.md
Unescape Escape View File

@ -101,6 +101,10 @@ I need a better CUDA kernel to (1) pull off maxK so there's need to clamp k to 6
Removing the maxK limitation will also make it easy to clean the state of a KV-V channel, by using a huge K. Removing the maxK limitation will also make it easy to clean the state of a KV-V channel, by using a huge K.
Namely, this is what I plan to do:
![RWKV-v3-plan](RWKV-v3-plan.png)
======================================================================== ========================================================================
### Explaining the code for RWKV v2+ GPT mode ### Explaining the code for RWKV v2+ GPT mode

Write Preview
Loading…
Cancel
Save