Update README.md

3 years ago · 04a564d7d0
parent 5713df51ec
commit 04a564d7d0
1 changed files with 3 additions and 1 deletions
--- a/README.md
+++ b/README.md
@ -212,7 +212,9 @@ out.write(ss + "\n")

 4. Aside from 2d rotation, we can try other Lie groups such as 3d rotation ( SO(3) ). Non-abelian RWKV lol.

-5. RWKV might be great on analog devices (search for Analog Matrix-vector multiplication & Photonic Matrix-vector multiplication). RNN is very hardware-friendly (in-memory processing?). Can be a SNN too (https://github.com/ridgerchu/SpikeGPT). I wonder if it can be optimized for quantum computation.
+5. RWKV might be great on analog devices (search for Analog Matrix-vector multiplication & Photonic Matrix-vector multiplication). The RNN mode is very hardware-friendly (processing-in-memory). Can be a SNN too (https://github.com/ridgerchu/SpikeGPT). I wonder if it can be optimized for quantum computation.
+
+6. Trainable initial hidden state (xx aa bb pp xx).

 ### Vision Tasks