Commit Graph

  • c84e8fd952 bugfix BlinkDL 2022-08-31 10:29:42 +0800
  • 73b96705d7 + fp32 mode (slow but good for verification) BlinkDL 2022-08-31 09:19:27 +0800
  • 94f618c52a Merge branch 'main' of https://github.com/BlinkDL/RWKV-LM BlinkDL 2022-08-31 07:50:56 +0800
  • a1bf15ac40 no message BlinkDL 2022-08-31 07:50:34 +0800
  • e05c69452d
    Update README.md PENG Bo 2022-08-31 06:26:24 +0800
  • 5f1a473845
    Update README.md PENG Bo 2022-08-31 06:25:12 +0800
  • 6299c087a4 fixed VRAM consumpition BlinkDL 2022-08-30 18:23:34 +0800
  • cb520e0f15
    Update README.md PENG Bo 2022-08-27 00:06:08 +0800
  • a01d915fcc
    Update README.md PENG Bo 2022-08-24 10:42:44 +0800
  • 4c2080aadd
    Add files via upload PENG Bo 2022-08-24 10:42:19 +0800
  • c1f7a72724 saves some VRAM for 1 GPU training BlinkDL 2022-08-23 01:47:28 +0800
  • 69e7cfbf39
    Update README.md PENG Bo 2022-08-21 17:08:07 +0800
  • f757518277
    Update README.md PENG Bo 2022-08-21 16:52:16 +0800
  • 2bddd576cd
    Update README.md PENG Bo 2022-08-21 06:01:22 +0800
  • 1949ed8619
    Update README.md PENG Bo 2022-08-20 04:11:34 +0800
  • 68c486ad10 supports RWKV-4 pile models BlinkDL 2022-08-20 04:00:45 +0800
  • 61b7c429df no message BlinkDL 2022-07-30 22:59:41 +0800
  • 8d4fed7128
    Update README.md PENG Bo 2022-07-30 06:54:12 +0800
  • 7cdc8d3164 no message BlinkDL 2022-07-30 04:04:05 +0800
  • 13bb641007 no message BlinkDL 2022-07-29 21:37:54 +0800
  • f79137b524 supports megatron bin+idx format BlinkDL 2022-07-29 21:32:52 +0800
  • aa67870849
    Update README.md PENG Bo 2022-07-28 21:09:00 +0800
  • 4c8a1a467b no message BlinkDL 2022-07-28 16:53:45 +0800
  • 083f9504c6 + bf16 mode (more stable) BlinkDL 2022-07-28 15:48:05 +0800
  • 46eebd98ca
    Add files via upload PENG Bo 2022-07-24 01:18:37 +0800
  • c0c4ffc7b4
    Update README.md PENG Bo 2022-07-24 00:25:32 +0800
  • 6667ad18c2 more training tips BlinkDL 2022-07-22 17:07:22 +0800
  • 5f6e9356a2
    Update README.md PENG Bo 2022-07-21 22:45:00 +0800
  • 165dfd1b9e RWKV-4 with DeepSpeed & FP16 & Better CUDA Kernel BlinkDL 2022-07-21 11:31:14 +0800
  • dfb75dd89d
    Update README.md PENG Bo 2022-07-19 03:53:07 +0800
  • e9488edafd
    Update README.md PENG Bo 2022-07-17 09:49:23 +0800
  • 3f158ac736
    Update README.md PENG Bo 2022-07-17 07:00:23 +0800
  • ec91ff1857
    Update README.md PENG Bo 2022-07-17 03:20:03 +0800
  • 276e322abf
    Update README.md PENG Bo 2022-07-16 06:45:29 +0800
  • a4b0759bf6
    Update README.md PENG Bo 2022-07-16 06:44:50 +0800
  • 5bd56f1f2d
    Add files via upload PENG Bo 2022-07-16 03:58:33 +0800
  • 3f699e6d2f
    Update README.md PENG Bo 2022-07-15 00:27:35 +0800
  • f4cd0a5a58
    Update README.md PENG Bo 2022-07-11 03:51:55 +0800
  • 0ef922ebfc
    Update README.md PENG Bo 2022-07-11 03:50:23 +0800
  • 19005e8067
    Update README.md PENG Bo 2022-07-10 15:02:42 +0800
  • 14abfebc94
    Update README.md PENG Bo 2022-07-10 15:01:45 +0800
  • 3ef305da6e
    Update README.md PENG Bo 2022-07-10 14:50:21 +0800
  • 3de62b92c3
    Update README.md PENG Bo 2022-07-10 01:29:02 +0800
  • 456437021f
    Update README.md PENG Bo 2022-07-09 19:09:16 +0800
  • b91cca965f
    Add files via upload PENG Bo 2022-07-09 19:06:54 +0800
  • 4cb363e5aa
    Update README.md PENG Bo 2022-07-06 14:21:58 +0800
  • 8d780208f2 typo fix BlinkDL 2022-07-05 21:53:49 +0800
  • 8556d0fd3f no message BlinkDL 2022-07-05 18:58:54 +0800
  • b6b5f4628f tips for training, with exponential lr decay BlinkDL 2022-07-05 18:55:35 +0800
  • f28be63cd8
    Update README.md PENG Bo 2022-07-05 18:14:38 +0800
  • b6403a8aef
    RWKV-3 (test deeper models (n_layer >= 12) to see the advantage) PENG Bo 2022-07-05 18:11:06 +0800
  • 1f6461b90b
    Update README.md PENG Bo 2022-07-03 18:17:31 +0800
  • 041227cdad
    Update README.md PENG Bo 2022-07-02 01:13:50 +0800
  • 940a67ec27
    Update README.md PENG Bo 2022-07-01 17:44:59 +0800
  • 0c6ffa710d
    Update README.md PENG Bo 2022-06-30 13:10:21 +0800
  • 09132dea52
    Update README.md PENG Bo 2022-06-27 20:42:15 +0800
  • 1a49ec4eeb
    Add files via upload PENG Bo 2022-06-27 20:18:31 +0800
  • f57d8e3e58
    Add files via upload PENG Bo 2022-06-27 20:15:15 +0800
  • 234aa8a5bb
    Update README.md PENG Bo 2022-06-27 12:55:56 +0800
  • 803397945b
    Update README.md PENG Bo 2022-06-27 12:54:35 +0800
  • f45198b1db
    Add files via upload PENG Bo 2022-06-27 12:54:03 +0800
  • 48e5a5326d
    Update README.md PENG Bo 2022-06-27 12:53:29 +0800
  • a2de885fdd
    Update README.md PENG Bo 2022-06-27 12:52:17 +0800
  • bc85865775
    Update README.md PENG Bo 2022-06-27 12:49:42 +0800
  • c4e8057a63
    Add files via upload PENG Bo 2022-06-27 12:49:06 +0800
  • c103f0caa3
    Update README.md PENG Bo 2022-06-27 10:37:00 +0800
  • 1301d383bb
    Update README.md PENG Bo 2022-06-27 00:58:45 +0800
  • 92da17d68f
    Update README.md PENG Bo 2022-06-27 00:54:04 +0800
  • 8d63423a56
    Update README.md PENG Bo 2022-06-20 18:04:40 +0800
  • 5676b039ad
    Update README.md PENG Bo 2022-06-20 17:57:47 +0800
  • 99089254e4
    Update README.md PENG Bo 2022-06-20 17:53:30 +0800
  • b54b204074
    Update README.md PENG Bo 2022-06-20 17:52:50 +0800
  • 6f7240e693
    Update README.md PENG Bo 2022-06-18 15:56:39 +0800
  • 3523a0ab72
    Update README.md PENG Bo 2022-06-18 09:15:37 +0800
  • 5bb0c1167f
    Update README.md PENG Bo 2022-06-18 08:49:48 +0800
  • bff3b0359d
    Update README.md PENG Bo 2022-06-18 08:49:08 +0800
  • 0fc4bdb247
    Add files via upload PENG Bo 2022-06-16 15:31:42 +0800
  • f8ed36f6d4
    Add files via upload PENG Bo 2022-06-16 15:28:21 +0800
  • a8e71e60af
    Update README.md PENG Bo 2022-06-16 15:27:06 +0800
  • aa90f10547
    Update README.md PENG Bo 2022-06-16 11:53:01 +0800
  • a862195475
    Add files via upload PENG Bo 2022-06-06 19:48:15 +0800
  • 2d6d54d1db
    Add files via upload PENG Bo 2022-05-30 20:31:43 +0800
  • 68fcf7e296
    Update README.md PENG Bo 2022-05-30 01:56:10 +0800
  • d7b8fc9169
    Add files via upload PENG Bo 2022-05-26 01:07:28 +0800
  • 65ae5835d4
    Update README.md PENG Bo 2022-05-26 01:06:49 +0800
  • 00fa276018
    Add files via upload PENG Bo 2022-05-26 01:05:44 +0800
  • aa8c170cfe
    Add files via upload PENG Bo 2022-05-24 22:27:47 +0800
  • f20564a15d
    Update README.md PENG Bo 2022-05-24 16:07:38 +0800
  • 53f1baeaad
    Update README.md PENG Bo 2022-05-22 18:25:51 +0800
  • 16655d369d
    Update README.md PENG Bo 2022-05-21 02:38:27 +0800
  • 1f67abe4e8
    Update README.md PENG Bo 2022-05-20 22:34:16 +0800
  • 927aa67e04
    Add files via upload PENG Bo 2022-05-20 22:33:13 +0800
  • 812a7d76cf
    Update README.md PENG Bo 2022-05-20 19:21:07 +0800
  • a4d3a44e13
    Update README.md PENG Bo 2022-05-20 17:27:56 +0800
  • a8a947eda0
    Update README.md PENG Bo 2022-05-19 18:15:39 +0800
  • d6ff9a085f
    Update README.md PENG Bo 2022-05-19 17:25:35 +0800
  • 9218a1b8a5
    Update README.md PENG Bo 2022-05-19 16:20:00 +0800
  • 8e2a779c4c
    Update README.md PENG Bo 2022-05-18 13:06:28 +0800
  • af1ecec13d
    Update README.md PENG Bo 2022-05-18 11:54:02 +0800
  • 4829bc17fb
    Update README.md PENG Bo 2022-05-18 11:45:20 +0800