Update README.md

main
randaller 3 years ago committed by GitHub
parent 1e547045d4
commit 5b29836ca0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -186,7 +186,7 @@ python hf-inference-example.py
To save CPU RAM or GPU VRAM memory, one may wish to enable Bfloat16 processing. To save CPU RAM or GPU VRAM memory, one may wish to enable Bfloat16 processing.
``` ```
# to save memory use bfloat16 on cpu # to save memory use bfloat16
import torch import torch
torch.set_default_dtype(torch.bfloat16) torch.set_default_dtype(torch.bfloat16)
``` ```

Loading…
Cancel
Save