Update README.md

main
randaller 3 years ago committed by GitHub
parent 6658817c57
commit eaad6d4720
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -2,6 +2,15 @@
This repository is intended as a minimal, hackable and readable example to load [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) ([arXiv](https://arxiv.org/abs/2302.13971v1)) models and run inference by using only CPU. Thus requires no videocard, but 64 (better 128 Gb) of RAM and modern processor is required.
### Conda Environment Setup Example for Windows 10+
Download and install Anaconda Python https://www.anaconda.com
Run Anaconda prompt
```
conda create -n llama python=3.10
conda activate llama
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
```
### Setup
In a conda env with pytorch / cuda available, run
```

Loading…
Cancel
Save