Update README.md

main
randaller 3 years ago committed by GitHub
parent 1e547045d4
commit 5b29836ca0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -186,7 +186,7 @@ python hf-inference-example.py
To save CPU RAM or GPU VRAM memory, one may wish to enable Bfloat16 processing.
```
# to save memory use bfloat16 on cpu
# to save memory use bfloat16
import torch
torch.set_default_dtype(torch.bfloat16)
```

Loading…
Cancel
Save