novarobot
/
llama-chat
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
randaller 3 years ago committed by GitHub
parent 806d25646e
commit 0cca7abbcf
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File

2
README.md
Unescape Escape View File

@ -19,6 +19,8 @@ One may run with 32 Gb of RAM, but inference will be slow (with the speed of you
I am running this on 12700k/128 Gb RAM/NVIDIA 3070ti 8Gb/fast huge nvme and getting one token from 30B model in a few seconds. I am running this on 12700k/128 Gb RAM/NVIDIA 3070ti 8Gb/fast huge nvme and getting one token from 30B model in a few seconds.
For example, 30B model uses around 70 Gb of RAM.
### Conda Environment Setup Example for Windows 10+ ### Conda Environment Setup Example for Windows 10+
Download and install Anaconda Python https://www.anaconda.com and run Anaconda Prompt Download and install Anaconda Python https://www.anaconda.com and run Anaconda Prompt
``` ```

Write Preview
Loading…
Cancel
Save