novarobot
/
llama-cpu
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
randaller 3 years ago committed by GitHub
parent eaad6d4720
commit f7896c98d5
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File

3
README.md
Unescape Escape View File

@ -3,8 +3,7 @@
This repository is intended as a minimal, hackable and readable example to load [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) ([arXiv](https://arxiv.org/abs/2302.13971v1)) models and run inference by using only CPU. Thus requires no videocard, but 64 (better 128 Gb) of RAM and modern processor is required. This repository is intended as a minimal, hackable and readable example to load [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) ([arXiv](https://arxiv.org/abs/2302.13971v1)) models and run inference by using only CPU. Thus requires no videocard, but 64 (better 128 Gb) of RAM and modern processor is required.
### Conda Environment Setup Example for Windows 10+ ### Conda Environment Setup Example for Windows 10+
Download and install Anaconda Python https://www.anaconda.com Download and install Anaconda Python https://www.anaconda.com and run Anaconda Prompt
Run Anaconda prompt
``` ```
conda create -n llama python=3.10 conda create -n llama python=3.10
conda activate llama conda activate llama

Write Preview
Loading…
Cancel
Save