novarobot
/
llama-cpu
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
main
randaller 3 years ago committed by GitHub
parent 97bb730aee
commit 2fbc884643
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File

2
README.md
Unescape Escape View File

@ -53,7 +53,7 @@ python example-cpu.py
### Some measurements ### Some measurements
Running the model on Windows computer equipped with 12700k, fast nvme and 128 Gb of RAM. Running model with single prompt on Windows computer equipped with 12700k, fast nvme and 128 Gb of RAM.
| Model | RAM usage fp32 | RAM usage bf16 | fp32 inference | bf16 inference | | Model | RAM usage fp32 | RAM usage bf16 | fp32 inference | bf16 inference |
| ------------- | ------------- | ------------- | ------------- | ------------- | | ------------- | ------------- | ------------- | ------------- | ------------- |

Write Preview
Loading…
Cancel
Save