diff --git a/README.md b/README.md index 8ab9025..611b1cf 100644 --- a/README.md +++ b/README.md @@ -85,3 +85,13 @@ If you wish to stop generation not by "\n" sign, but by another signature, like ### Share the best with community Share your best prompts and generations with others here: https://github.com/randaller/llama-chat/issues/7 + +### Typical generation with prompt (not a chat) + +Simply comment those three lines in llama/generation.py to turn it to a generator back. + +![image](https://user-images.githubusercontent.com/22396871/224283389-e29de04e-28d1-4ccd-bf6b-81b29828d3eb.png) + +``` +python example.py ./model ./tokenizer/tokenizer.model +```