novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
PENG Bo 4 years ago committed by GitHub
parent bc85865775
commit a2de885fdd
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File

2
README.md
Unescape Escape View File

@ -101,7 +101,7 @@ I need a better CUDA kernel to (1) pull off maxK so there's need to clamp k to 6
Removing the maxK limitation will also make it easy to clean the state of a KV-V channel, by using a huge K.
Namely, this is what I plan to do:
Namely, this is my plan (there's a typo: the range shall be [e^10, (n+1) * e^10]):
![RWKV-v3-plan](RWKV-v3-plan.png)

Write Preview
Loading…
Cancel
Save