From a1703088e7a8467e1a7bbd930489882a2e518c15 Mon Sep 17 00:00:00 2001 From: randaller Date: Thu, 9 Mar 2023 21:38:59 +0300 Subject: [PATCH] Update README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index ae6c8d9..969c18d 100644 --- a/README.md +++ b/README.md @@ -77,3 +77,5 @@ python example-chat.py ./model ./tokenizer/tokenizer.model If you wish to stop generation not by "\n" sign, but by another signature, like "User:" (which is also good idea), or any other, make the following modification in the llama/generator.py: ![image](https://user-images.githubusercontent.com/22396871/224122767-227deda4-a718-4774-a7f9-786c07d379cf.png) + +-5 means to remove last 5 chars from resulting context, which is also the lenght of your stop signature, "User:" in this example.