Update README.md

main
PENG Bo 4 years ago committed by GitHub
parent c4e8057a63
commit bc85865775
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -101,6 +101,10 @@ I need a better CUDA kernel to (1) pull off maxK so there's need to clamp k to 6
Removing the maxK limitation will also make it easy to clean the state of a KV-V channel, by using a huge K.
Namely, this is what I plan to do:
![RWKV-v3-plan](RWKV-v3-plan.png)
========================================================================
### Explaining the code for RWKV v2+ GPT mode

Loading…
Cancel
Save