From 0cca7abbcff70d17901ab827da082c25db02c536 Mon Sep 17 00:00:00 2001 From: randaller Date: Thu, 9 Mar 2023 11:30:52 +0300 Subject: [PATCH] Update README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e07637c..05185c2 100644 --- a/README.md +++ b/README.md @@ -19,6 +19,8 @@ One may run with 32 Gb of RAM, but inference will be slow (with the speed of you I am running this on 12700k/128 Gb RAM/NVIDIA 3070ti 8Gb/fast huge nvme and getting one token from 30B model in a few seconds. +For example, 30B model uses around 70 Gb of RAM. + ### Conda Environment Setup Example for Windows 10+ Download and install Anaconda Python https://www.anaconda.com and run Anaconda Prompt ```