From 08d0535f813352b5f1f986b8710533e5fc7e8a34 Mon Sep 17 00:00:00 2001 From: randaller Date: Sat, 11 Mar 2023 15:07:04 +0300 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 6d1e8f4..d17795e 100644 --- a/README.md +++ b/README.md @@ -89,6 +89,7 @@ python example-chat.py ./model ./tokenizer/tokenizer.model By default, Meta provided us with top_p sampler only. Again, Shawn added an alternate top_k sampler, which (in my tests) performs pretty well. If you wish to switch to top_k sampler, use the following parameters: ``` +temperature: float = 0.7, top_p: float = 0.0, top_k: int = 40, sampler: str = 'top_k',