Update README.md

3 years ago · cb395a25ae
parent 21664b1345
commit cb395a25ae
1 changed files with 10 additions and 0 deletions
--- a/README.md
+++ b/README.md
@ -85,3 +85,13 @@ If you wish to stop generation not by "\n" sign, but by another signature, like
 ### Share the best with community

 Share your best prompts and generations with others here: https://github.com/randaller/llama-chat/issues/7
+
+### Typical generation with prompt (not a chat)
+
+Simply comment those three lines in llama/generation.py to turn it to a generator back.
+
+![image](https://user-images.githubusercontent.com/22396871/224283389-e29de04e-28d1-4ccd-bf6b-81b29828d3eb.png)
+
+```
+python example.py ./model ./tokenizer/tokenizer.model
+```