Commit Graph

Select branches

Hide Pull Requests

main

0.01

0.02

2.00

4.00

Mono Color

• c84e8fd952 bugfix BlinkDL 2022-08-31 10:29:42 +0800
• 73b96705d7 + fp32 mode (slow but good for verification) BlinkDL 2022-08-31 09:19:27 +0800
• 94f618c52a Merge branch 'main' of https://github.com/BlinkDL/RWKV-LM BlinkDL 2022-08-31 07:50:56 +0800
• a1bf15ac40 no message BlinkDL 2022-08-31 07:50:34 +0800
• e05c69452d
  Update README.md PENG Bo 2022-08-31 06:26:24 +0800
• 5f1a473845
  Update README.md PENG Bo 2022-08-31 06:25:12 +0800
• 6299c087a4 fixed VRAM consumpition BlinkDL 2022-08-30 18:23:34 +0800
• cb520e0f15
  Update README.md PENG Bo 2022-08-27 00:06:08 +0800
• a01d915fcc
  Update README.md PENG Bo 2022-08-24 10:42:44 +0800
• 4c2080aadd
  Add files via upload PENG Bo 2022-08-24 10:42:19 +0800
• c1f7a72724 saves some VRAM for 1 GPU training BlinkDL 2022-08-23 01:47:28 +0800
• 69e7cfbf39
  Update README.md PENG Bo 2022-08-21 17:08:07 +0800
• f757518277
  Update README.md PENG Bo 2022-08-21 16:52:16 +0800
• 2bddd576cd
  Update README.md PENG Bo 2022-08-21 06:01:22 +0800
• 1949ed8619
  Update README.md PENG Bo 2022-08-20 04:11:34 +0800
• 68c486ad10 supports RWKV-4 pile models BlinkDL 2022-08-20 04:00:45 +0800
• 61b7c429df no message BlinkDL 2022-07-30 22:59:41 +0800
• 8d4fed7128
  Update README.md PENG Bo 2022-07-30 06:54:12 +0800
• 7cdc8d3164 no message BlinkDL 2022-07-30 04:04:05 +0800
• 13bb641007 no message BlinkDL 2022-07-29 21:37:54 +0800
• f79137b524 supports megatron bin+idx format BlinkDL 2022-07-29 21:32:52 +0800
• aa67870849
  Update README.md PENG Bo 2022-07-28 21:09:00 +0800
• 4c8a1a467b no message BlinkDL 2022-07-28 16:53:45 +0800
• 083f9504c6 + bf16 mode (more stable) BlinkDL 2022-07-28 15:48:05 +0800
• 46eebd98ca
  Add files via upload PENG Bo 2022-07-24 01:18:37 +0800
• c0c4ffc7b4
  Update README.md PENG Bo 2022-07-24 00:25:32 +0800
• 6667ad18c2 more training tips BlinkDL 2022-07-22 17:07:22 +0800
• 5f6e9356a2
  Update README.md PENG Bo 2022-07-21 22:45:00 +0800
• 165dfd1b9e RWKV-4 with DeepSpeed & FP16 & Better CUDA Kernel BlinkDL 2022-07-21 11:31:14 +0800
• dfb75dd89d
  Update README.md PENG Bo 2022-07-19 03:53:07 +0800
• e9488edafd
  Update README.md PENG Bo 2022-07-17 09:49:23 +0800
• 3f158ac736
  Update README.md PENG Bo 2022-07-17 07:00:23 +0800
• ec91ff1857
  Update README.md PENG Bo 2022-07-17 03:20:03 +0800
• 276e322abf
  Update README.md PENG Bo 2022-07-16 06:45:29 +0800
• a4b0759bf6
  Update README.md PENG Bo 2022-07-16 06:44:50 +0800
• 5bd56f1f2d
  Add files via upload PENG Bo 2022-07-16 03:58:33 +0800
• 3f699e6d2f
  Update README.md PENG Bo 2022-07-15 00:27:35 +0800
• f4cd0a5a58
  Update README.md PENG Bo 2022-07-11 03:51:55 +0800
• 0ef922ebfc
  Update README.md PENG Bo 2022-07-11 03:50:23 +0800
• 19005e8067
  Update README.md PENG Bo 2022-07-10 15:02:42 +0800
• 14abfebc94
  Update README.md PENG Bo 2022-07-10 15:01:45 +0800
• 3ef305da6e
  Update README.md PENG Bo 2022-07-10 14:50:21 +0800
• 3de62b92c3
  Update README.md PENG Bo 2022-07-10 01:29:02 +0800
• 456437021f
  Update README.md PENG Bo 2022-07-09 19:09:16 +0800
• b91cca965f
  Add files via upload PENG Bo 2022-07-09 19:06:54 +0800
• 4cb363e5aa
  Update README.md PENG Bo 2022-07-06 14:21:58 +0800
• 8d780208f2 typo fix BlinkDL 2022-07-05 21:53:49 +0800
• 8556d0fd3f no message BlinkDL 2022-07-05 18:58:54 +0800
• b6b5f4628f tips for training, with exponential lr decay BlinkDL 2022-07-05 18:55:35 +0800
• f28be63cd8
  Update README.md PENG Bo 2022-07-05 18:14:38 +0800
• b6403a8aef
  RWKV-3 (test deeper models (n_layer >= 12) to see the advantage) PENG Bo 2022-07-05 18:11:06 +0800
• 1f6461b90b
  Update README.md PENG Bo 2022-07-03 18:17:31 +0800
• 041227cdad
  Update README.md PENG Bo 2022-07-02 01:13:50 +0800
• 940a67ec27
  Update README.md PENG Bo 2022-07-01 17:44:59 +0800
• 0c6ffa710d
  Update README.md PENG Bo 2022-06-30 13:10:21 +0800
• 09132dea52
  Update README.md PENG Bo 2022-06-27 20:42:15 +0800
• 1a49ec4eeb
  Add files via upload PENG Bo 2022-06-27 20:18:31 +0800
• f57d8e3e58
  Add files via upload PENG Bo 2022-06-27 20:15:15 +0800
• 234aa8a5bb
  Update README.md PENG Bo 2022-06-27 12:55:56 +0800
• 803397945b
  Update README.md PENG Bo 2022-06-27 12:54:35 +0800
• f45198b1db
  Add files via upload PENG Bo 2022-06-27 12:54:03 +0800
• 48e5a5326d
  Update README.md PENG Bo 2022-06-27 12:53:29 +0800
• a2de885fdd
  Update README.md PENG Bo 2022-06-27 12:52:17 +0800
• bc85865775
  Update README.md PENG Bo 2022-06-27 12:49:42 +0800
• c4e8057a63
  Add files via upload PENG Bo 2022-06-27 12:49:06 +0800
• c103f0caa3
  Update README.md PENG Bo 2022-06-27 10:37:00 +0800
• 1301d383bb
  Update README.md PENG Bo 2022-06-27 00:58:45 +0800
• 92da17d68f
  Update README.md PENG Bo 2022-06-27 00:54:04 +0800
• 8d63423a56
  Update README.md PENG Bo 2022-06-20 18:04:40 +0800
• 5676b039ad
  Update README.md PENG Bo 2022-06-20 17:57:47 +0800
• 99089254e4
  Update README.md PENG Bo 2022-06-20 17:53:30 +0800
• b54b204074
  Update README.md PENG Bo 2022-06-20 17:52:50 +0800
• 6f7240e693
  Update README.md PENG Bo 2022-06-18 15:56:39 +0800
• 3523a0ab72
  Update README.md PENG Bo 2022-06-18 09:15:37 +0800
• 5bb0c1167f
  Update README.md PENG Bo 2022-06-18 08:49:48 +0800
• bff3b0359d
  Update README.md PENG Bo 2022-06-18 08:49:08 +0800
• 0fc4bdb247
  Add files via upload PENG Bo 2022-06-16 15:31:42 +0800
• f8ed36f6d4
  Add files via upload PENG Bo 2022-06-16 15:28:21 +0800
• a8e71e60af
  Update README.md PENG Bo 2022-06-16 15:27:06 +0800
• aa90f10547
  Update README.md PENG Bo 2022-06-16 11:53:01 +0800
• a862195475
  Add files via upload PENG Bo 2022-06-06 19:48:15 +0800
• 2d6d54d1db
  Add files via upload PENG Bo 2022-05-30 20:31:43 +0800
• 68fcf7e296
  Update README.md PENG Bo 2022-05-30 01:56:10 +0800
• d7b8fc9169
  Add files via upload PENG Bo 2022-05-26 01:07:28 +0800
• 65ae5835d4
  Update README.md PENG Bo 2022-05-26 01:06:49 +0800
• 00fa276018
  Add files via upload PENG Bo 2022-05-26 01:05:44 +0800
• aa8c170cfe
  Add files via upload PENG Bo 2022-05-24 22:27:47 +0800
• f20564a15d
  Update README.md PENG Bo 2022-05-24 16:07:38 +0800
• 53f1baeaad
  Update README.md PENG Bo 2022-05-22 18:25:51 +0800
• 16655d369d
  Update README.md PENG Bo 2022-05-21 02:38:27 +0800
• 1f67abe4e8
  Update README.md PENG Bo 2022-05-20 22:34:16 +0800
• 927aa67e04
  Add files via upload PENG Bo 2022-05-20 22:33:13 +0800
• 812a7d76cf
  Update README.md PENG Bo 2022-05-20 19:21:07 +0800
• a4d3a44e13
  Update README.md PENG Bo 2022-05-20 17:27:56 +0800
• a8a947eda0
  Update README.md PENG Bo 2022-05-19 18:15:39 +0800
• d6ff9a085f
  Update README.md PENG Bo 2022-05-19 17:25:35 +0800
• 9218a1b8a5
  Update README.md PENG Bo 2022-05-19 16:20:00 +0800
• 8e2a779c4c
  Update README.md PENG Bo 2022-05-18 13:06:28 +0800
• af1ecec13d
  Update README.md PENG Bo 2022-05-18 11:54:02 +0800
• 4829bc17fb
  Update README.md PENG Bo 2022-05-18 11:45:20 +0800