novarobot
/
RWKV-LM
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • 676a59886a
         Update README.md PENG Bo 2022-05-18 11:43:15 +0800
  • 16761a7f20
         Update README.md PENG Bo 2022-05-17 19:32:35 +0800
  • 29905eedb4
         Update README.md PENG Bo 2022-05-17 04:31:34 +0800
  • bbd6e2223b
         Update README.md PENG Bo 2022-05-17 04:27:17 +0800
  • 2e9fcfc5f3
         Update README.md PENG Bo 2022-05-17 04:22:58 +0800
  • 601ade3e0d
         Update README.md PENG Bo 2022-05-17 02:30:39 +0800
  • 24b30a83c6
         Update README.md PENG Bo 2022-05-17 02:30:16 +0800
  • ece62474d4 Update README.md PENG Bo 2022-05-17 02:25:49 +0800
  • df2fa3fed4
         Update README.md PENG Bo 2022-05-17 02:25:03 +0800
  • 7a47bcd096
         Update README.md PENG Bo 2022-05-17 02:24:24 +0800
  • 1691141765
         Update README.md PENG Bo 2022-05-16 22:59:46 +0800
  • d3b7092249
         Add files via upload PENG Bo 2022-05-16 22:49:10 +0800
  • de8c54dfd4
         Update README.md PENG Bo 2022-05-16 17:02:56 +0800
  • 4bbee4bb1a
         Update README.md PENG Bo 2022-05-16 00:31:29 +0800
  • 15db7d3e14
         Update README.md PENG Bo 2022-05-16 00:31:00 +0800
  • 78169ad5a9
         Update README.md PENG Bo 2022-05-16 00:23:36 +0800
  • f44ad5156e
         Update README.md PENG Bo 2022-05-16 00:22:32 +0800
  • b15642717a
         Update README.md PENG Bo 2022-05-15 23:58:13 +0800
  • e472f9ffbb
         Add files via upload PENG Bo 2022-05-15 23:24:43 +0800
  • 089308fd92
         Update README.md PENG Bo 2022-05-13 05:23:45 +0800
  • b07127f299
         Add files via upload PENG Bo 2022-05-13 04:01:25 +0800
  • 29a21844ab
         Update README.md PENG Bo 2022-05-13 04:00:16 +0800
  • cd19235c00
         Add files via upload PENG Bo 2022-05-11 22:58:38 +0800
  • 89c953b941
         Update README.md PENG Bo 2022-05-11 22:56:52 +0800
  • 9066053fe5
         Update README.md PENG Bo 2022-05-11 07:09:45 +0800
  • c5788dd30f
         Update README.md PENG Bo 2022-05-11 07:08:10 +0800
  • 34c9b6fc0f
         Update README.md PENG Bo 2022-05-11 06:33:41 +0800
  • 9e09fafd59
         Update README.md PENG Bo 2022-05-11 05:12:29 +0800
  • 1e1aacba54
         Update README.md PENG Bo 2022-05-11 05:11:11 +0800
  • caf480fac3
         Add files via upload PENG Bo 2022-05-11 04:04:04 +0800
  • 62d5b5d481
         Update README.md PENG Bo 2022-05-11 03:51:40 +0800
  • c2ad6e9d8d
         Update README.md PENG Bo 2022-05-11 03:48:12 +0800
  • e03c0c9467
         Update README.md PENG Bo 2022-05-11 03:39:47 +0800
  • 64c9015dd1
         Update README.md PENG Bo 2022-05-11 02:38:26 +0800
  • 325ddb76f7
         Add files via upload PENG Bo 2022-05-11 02:29:09 +0800
  • 7212d75e7c
         Update README.md PENG Bo 2022-05-02 02:30:13 +0800
  • 750c5149ab
         Update README.md PENG Bo 2022-04-13 16:26:51 +0800
  • 2bc3912594
         Update README.md PENG Bo 2022-04-13 16:06:12 +0800
  • 31a0f3944c
         Update README.md PENG Bo 2022-04-13 15:58:35 +0800
  • 12fe2002a5
         Update README.md PENG Bo 2022-04-13 14:51:50 +0800
  • 3fbdffb6c6
         Update README.md PENG Bo 2022-04-13 14:39:34 +0800
  • 214ebf9e47
         Add files via upload PENG Bo 2022-04-13 14:38:48 +0800
  • 2971dae91f
         Update README.md PENG Bo 2022-04-13 02:36:15 +0800
  • e65448716d
         Update README.md PENG Bo 2022-04-13 02:33:40 +0800
  • fffbcb6785
         Update README.md PENG Bo 2022-04-13 01:10:44 +0800
  • 2951b2895a
         Update README.md PENG Bo 2022-04-09 17:59:02 +0800
  • e541d93b97
         Update README.md PENG Bo 2022-04-05 07:01:05 +0800
  • 6b1ba8a9bd
         Update README.md PENG Bo 2022-04-05 07:00:04 +0800
  • 619c8add7a
         Update README.md PENG Bo 2022-03-29 03:49:48 +0800
  • 438377af6d
         Add files via upload PENG Bo 2022-03-29 03:49:02 +0800
  • 9cf873ebb2
         Update README.md PENG Bo 2022-03-27 19:13:23 +0800
  • af56c2446d
         Update README.md PENG Bo 2022-03-27 17:40:45 +0800
  • ecaf1f98aa
         Update README.md PENG Bo 2022-03-27 17:23:14 +0800
  • e2f3465fe6
         Update README.md PENG Bo 2022-03-26 23:27:49 +0800
  • f11b97ae48
         Update README.md PENG Bo 2022-03-26 23:26:06 +0800
  • 88e921bf10 +eval code for 27M ppl 1.65 BPC 0.72 enwik8 model 2.00 BlinkDL 2022-03-26 01:14:07 +0800
  • 71538e44a9 refactoring BlinkDL 2022-03-25 22:01:39 +0800
  • 5817d265c3 no message BlinkDL 2022-03-25 21:40:34 +0800
  • 0b6aec3da6 Default parameters for 8G VRAM BlinkDL 2022-03-25 21:17:15 +0800
  • 6aefe59c3d
         Update README.md PENG Bo 2022-03-25 15:37:42 +0800
  • da6f35f276
         Update README.md PENG Bo 2022-03-25 06:13:51 +0800
  • 72a6f28add
         Update README.md PENG Bo 2022-03-25 06:09:15 +0800
  • d8234047e6
         Update README.md PENG Bo 2022-03-25 06:05:42 +0800
  • 5ac82f37be
         Update README.md PENG Bo 2022-03-25 05:46:27 +0800
  • a86ac324de
         Update README.md PENG Bo 2022-03-25 05:45:19 +0800
  • 9ca62d3a1e
         Update README.md PENG Bo 2022-03-25 05:43:35 +0800
  • 4b1df60e94
         Update README.md PENG Bo 2022-03-25 05:41:15 +0800
  • 780bed4e19
         Update README.md PENG Bo 2022-03-25 05:36:20 +0800
  • 5f21ddf20d RWKV v2 RNN is here. Probably the strongest LM as of now. BlinkDL 2022-03-25 03:51:49 +0800
  • 1f189a4034
         Update README.md PENG Bo 2022-03-22 04:55:04 +0800
  • 5ac265691f
         RWKV-v2-RNN introduction PENG Bo 2022-03-22 04:53:07 +0800
  • b4fd1a7209
         Update model.py PENG Bo 2022-03-05 17:29:44 +0800
  • c8a751ed8b
         Update README.md PENG Bo 2022-02-16 18:12:46 +0800
  • 0a0eae447d +headQK (compatible with 2022-02-15 AI-Writer) BlinkDL 2022-02-16 18:02:40 +0800
  • b48aa1d430 no message BlinkDL 2021-11-09 14:34:56 +0800
  • a19be54bf5 no message BlinkDL 2021-10-28 15:24:04 +0800
  • fcd01f8851 no message BlinkDL 2021-10-28 15:16:45 +0800
  • 76e241b71e saves vocab.json, and the model every X epoch BlinkDL 2021-10-28 12:20:31 +0800
  • 689a6a924d
         Update train.py PENG Bo 2021-10-20 11:55:40 +0800
  • 34fa2ec81b
         Update README.md PENG Bo 2021-09-22 20:45:45 +0800
  • 58bdb908f9
         Update README.md PENG Bo 2021-09-22 20:32:41 +0800
  • 3d8d0373b4
         Update README.md PENG Bo 2021-09-22 20:30:56 +0800
  • 710d3e34b7 better init for RWKV BlinkDL 2021-08-28 03:30:54 +0800
  • 619ed00e4b misc improvement 0.02 BlinkDL 2021-08-25 18:49:12 +0800
  • a36fc09fea
         Update README.md PENG Bo 2021-08-23 07:34:03 +0800
  • a91084efa9
         Update README.md PENG Bo 2021-08-20 03:21:16 +0800
  • 3329161ed7 rapid convergence using ZERO initialization BlinkDL 2021-08-20 03:07:23 +0800
  • 7f391c5758 + RWKV tiny-attn and now it's great for ctx 1024 or 2048 BlinkDL 2021-08-19 15:36:21 +0800
  • a9f39c112c
         Update README.md PENG Bo 2021-08-17 23:13:04 +0800
  • 8fd4601dea
         Update README.md PENG Bo 2021-08-17 22:59:57 +0800
  • 9b903db103 Merge branch 'main' of https://github.com/BlinkDL/RWKV-LM into main BlinkDL 2021-08-17 22:55:22 +0800
  • 8aec414db2 no message BlinkDL 2021-08-17 22:53:36 +0800
  • 9e959d0b8a
         Update README.md PENG Bo 2021-08-17 22:46:46 +0800
  • 4ffd8f1b76 + new comparison BlinkDL 2021-08-17 22:44:16 +0800
  • 04852faf04
         Update README.md PENG Bo 2021-08-17 18:08:12 +0800
  • ad627311f4 clean init code BlinkDL 2021-08-17 14:33:33 +0800
  • c675b47705 misc improvements BlinkDL 2021-08-16 20:32:51 +0800
  • ef29f4b9e8 fixed nan loss BlinkDL 2021-08-15 21:16:41 +0800
  • 4fd8716976 improve RWKV time_w initialization BlinkDL 2021-08-15 11:41:51 +0800
  • 1ea53a2f03
         Update README.md PENG Bo 2021-08-14 03:11:08 +0800