novarobot
/
llama-chat
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
randaller 3 years ago committed by GitHub
parent 1a34868d1c
commit a42915dab2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File

6
README.md
Unescape Escape View File

@ -76,6 +76,12 @@ Place (torrentroot)/tokenizer.model file to the [/tokenizer] folder of this repo
python example-chat.py ./model ./tokenizer/tokenizer.model python example-chat.py ./model ./tokenizer/tokenizer.model
``` ```
### Generation parameters
![image](https://user-images.githubusercontent.com/22396871/224481168-122ef4d1-43b0-4579-8f7e-594936b7bafa.png)
**Temperature** is one of key parameters of generation. You may wish to play with temperature, setting it around 0.7 .. 0.99. The more temperature is, the more model should follow your prompt, the less temperature instruct model to use more imagination.
### Enable multi-line answers ### Enable multi-line answers
If you wish to stop generation not by "\n" sign, but by another signature, like "User:" (which is also good idea), or any other, make the following modification in the llama/generation.py: If you wish to stop generation not by "\n" sign, but by another signature, like "User:" (which is also good idea), or any other, make the following modification in the llama/generation.py:

Write Preview
Loading…
Cancel
Save