Update example-cpu.py · 164d3e4b36 - llama-cpu - Digital Sinus Forgejo GIT server by Novarobot

Update example-cpu.py

main

randaller committed by

GitHub

parent 7266efc685

commit 164d3e4b36

No known key found for this signature in database

GPG Key ID: 4AEE18F83AFDEB23

1 changed files with 1 additions and 0 deletions

										
											1

example-cpu.py

										Unescape
										Escape
									
											View File
										
					@ -53,6 +53,7 @@ def main(

					        max_batch_size: int = 32,

					        max_batch_size: int = 32,

					):

					):

					    # torch.manual_seed(1)

					    # torch.manual_seed(1)

					    # torch.set_default_dtype(torch.bfloat16)

					    generator = load(ckpt_dir, tokenizer_path, max_seq_len, max_batch_size)

					    generator = load(ckpt_dir, tokenizer_path, max_seq_len, max_batch_size)

Loading…

Cancel

Save