From df2fa3fed4c47f58fa82e07a609456413962db13 Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Tue, 17 May 2022 02:25:03 +0800 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index aa1633b..0055c68 100644 --- a/README.md +++ b/README.md @@ -112,7 +112,7 @@ Let's say the pile has x chunks (a chunk = ctx_len tokens). pick a prime number p just less than x, and make sure p = 2 (mod 3). -Use (step * step * step) mod p to sample it. +Use (step * step * step) mod p to sample it. Add some bias to step for extra randomness. ## The top-p-x sampling method