From 6b59d8fee1ffe8b4dbfc644c5c0b7b0633d6f08d Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Sat, 25 Feb 2023 23:36:35 +0800 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 98630b1..4704415 100644 --- a/README.md +++ b/README.md @@ -192,7 +192,7 @@ out.write(ss + "\n") ### Some ideas -1. Now time decay is like 0.999^T (0.999 is learnable). Change it to something like (0.999^T + 0.1) where 0.1 is learnable too. The 0.1 part will be kept forever. +1. Now time decay is like 0.999^T (0.999 is learnable). Change it to something like (0.999^T + 0.1) where 0.1 is learnable too. The 0.1 part will be kept forever. Or try A^T + B^T = fast-decay + slow-decay. 2. Use complex-valued decay (so, rotation instead of decay) in some channels.