Update README.md

main
PENG Bo 4 years ago committed by GitHub
parent 7a47bcd096
commit df2fa3fed4
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -112,7 +112,7 @@ Let's say the pile has x chunks (a chunk = ctx_len tokens).
pick a prime number p just less than x, and make sure p = 2 (mod 3). pick a prime number p just less than x, and make sure p = 2 (mod 3).
Use (step * step * step) mod p to sample it. Use (step * step * step) mod p to sample it. Add some bias to step for extra randomness.
## The top-p-x sampling method ## The top-p-x sampling method

Loading…
Cancel
Save