Update README.md

3 years ago · a1703088e7
parent 1ed4f27932
commit a1703088e7
1 changed files with 2 additions and 0 deletions
--- a/README.md
+++ b/README.md
@ -77,3 +77,5 @@ python example-chat.py ./model ./tokenizer/tokenizer.model
 If you wish to stop generation not by "\n" sign, but by another signature, like "User:" (which is also good idea), or any other, make the following modification in the llama/generator.py:

 ![image](https://user-images.githubusercontent.com/22396871/224122767-227deda4-a718-4774-a7f9-786c07d379cf.png)
+
+-5 means to remove last 5 chars from resulting context, which is also the lenght of your stop signature, "User:" in this example.