diff --git a/README.md b/README.md index ae6c8d9..969c18d 100644 --- a/README.md +++ b/README.md @@ -77,3 +77,5 @@ python example-chat.py ./model ./tokenizer/tokenizer.model If you wish to stop generation not by "\n" sign, but by another signature, like "User:" (which is also good idea), or any other, make the following modification in the llama/generator.py: ![image](https://user-images.githubusercontent.com/22396871/224122767-227deda4-a718-4774-a7f9-786c07d379cf.png) + +-5 means to remove last 5 chars from resulting context, which is also the lenght of your stop signature, "User:" in this example.