Update README.md

3 years ago · 6b59d8fee1
parent fc047a20b1
commit 6b59d8fee1
1 changed files with 1 additions and 1 deletions
--- a/README.md
+++ b/README.md
@ -192,7 +192,7 @@ out.write(ss + "\n")

 ### Some ideas

-1. Now time decay is like 0.999^T (0.999 is learnable). Change it to something like (0.999^T + 0.1) where 0.1 is learnable too. The 0.1 part will be kept forever.
+1. Now time decay is like 0.999^T (0.999 is learnable). Change it to something like (0.999^T + 0.1) where 0.1 is learnable too. The 0.1 part will be kept forever. Or try A^T + B^T = fast-decay + slow-decay.

 2. Use complex-valued decay (so, rotation instead of decay) in some channels.