From 770ac1aabc67e069c3c3f20a482cc54ddd1faed6 Mon Sep 17 00:00:00 2001 From: randaller Date: Sun, 5 Mar 2023 20:17:19 +0300 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 54aaa16..4c7ca6d 100755 --- a/README.md +++ b/README.md @@ -63,7 +63,7 @@ Running model with single prompt on Windows computer equipped with 12700k, fast | model | RAM usage, fp32 | RAM usage, bf16 | fp32 inference | bf16 inference | | ------------- | ------------- | ------------- | ------------- | ------------- | -| 7B | 44 Gb | 22 Gb | 170 seconds | 850 seconds | +| 7B | 44 Gb, peak 56 Gb | 22 Gb | 170 seconds | 850 seconds | | 13B | 77 Gb, peak 100 Gb | 38 Gb | 340 seconds | | ### RAM usage optimization