diff --git a/README.md b/README.md index 6d1e8f4..d17795e 100644 --- a/README.md +++ b/README.md @@ -89,6 +89,7 @@ python example-chat.py ./model ./tokenizer/tokenizer.model By default, Meta provided us with top_p sampler only. Again, Shawn added an alternate top_k sampler, which (in my tests) performs pretty well. If you wish to switch to top_k sampler, use the following parameters: ``` +temperature: float = 0.7, top_p: float = 0.0, top_k: int = 40, sampler: str = 'top_k',