novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
237 Commits
1 Branch
4 Tags
11 MiB
main
0.01
0.02
2.00
4.00
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'c43a17cfb3'
${ noResults }
Commit Graph

8 Commits (c43a17cfb3968c4d508bd0427b80c666ead1c6e4)

Author SHA1 Message Date
BlinkDL c43a17cfb3 10% faster training 3 years ago
BlinkDL 73b96705d7 + fp32 mode (slow but good for verification) 3 years ago
BlinkDL 6299c087a4 fixed VRAM consumpition 3 years ago
BlinkDL 68c486ad10 supports RWKV-4 pile models 3 years ago
BlinkDL f79137b524 supports megatron bin+idx format 3 years ago
BlinkDL 083f9504c6 + bf16 mode (more stable) 3 years ago
BlinkDL 6667ad18c2 more training tips 3 years ago
BlinkDL 165dfd1b9e RWKV-4 with DeepSpeed & FP16 & Better CUDA Kernel 3 years ago