Update hf-inference-example.py · 0eb2a070ea - llama-chat - Digital Sinus Forgejo GIT server by Novarobot

Update hf-inference-example.py

main

randaller committed by

GitHub

parent ae518062fa

commit 0eb2a070ea

No known key found for this signature in database

GPG Key ID: 4AEE18F83AFDEB23

1 changed files with 1 additions and 1 deletions

										
											2

hf-inference-example.py

										Unescape
										Escape
									
											View File
										
					@ -1,7 +1,7 @@

					import llamahf

					import llamahf

					import os

					import os

					# # to save memory use bfloat16 on cpu

					# # to save memory use bfloat16

					# import torch

					# import torch

					# torch.set_default_dtype(torch.bfloat16)

					# torch.set_default_dtype(torch.bfloat16)

Loading…

Cancel

Save