mirror of https://github.com/novarobot/llama.cpp
master
model-linking-policy-doc
jed/load-progress
jed/spm
patch-win-utf8
feat-input-prefix
q4_1_more_accel_kahan
q4_1_more_accel_loopsplit
q4_1_more_accel
tcp_server
llama-patch-enable-fma-msvc
mmap
dev
master-01a297b
master-074bea2
master-084e2f0
master-0b366e7
master-0f1b21c
master-22213a1
master-2456837
master-2e17dfd
master-2e664f1
master-305ba6f
master-368d0c8
master-3cd8dde
master-4122dff
master-483bab2
master-4870e45
master-50fae10
master-56e659a
master-5c19c70
master-69c9229
master-70f01cb
master-8cf9f34
master-928480e
master-9794052
master-9e17072
master-a140219
master-a791a68
master-ad072fc
master-ad5fd5b
master-ae44e23
master-c494ed5
master-d3f202d
master-d5850c5
master-d7def1a
master-da5303c
master-e4412b4
master-e6c9e09
master-ea10d3d
master-f5a77a6
master-f7dc43b
${ noResults }
1 Commits (a18c19259a3cb9dec332d613e8f15704f678a468)
| Author | SHA1 | Message | Date |
|---|---|---|---|
|
|
7392f1cd2c
|
Improved quantize script (#222)
* Improved quantize script I improved the quantize script by adding error handling and allowing to select many models for quantization at once in the command line. I also converted it to Python for generalization as well as extensibility. * Fixes and improvements based on Matt's observations Fixed and improved many things in the script based on the reviews made by @mattsta. The parallelization suggestion is still to be revised, but code for it was still added (commented). * Small fixes to the previous commit * Corrected to use the original glob pattern The original Bash script uses a glob pattern to match files that have endings such as ...bin.0, ...bin.1, etc. That has been translated correctly to Python now. * Added support for Windows and updated README to use this script New code to set the name of the quantize script binary depending on the platform has been added (quantize.exe if working on Windows) and the README.md file has been updated to use this script instead of the Bash one. * Fixed a typo and removed shell=True in the subprocess.run call Fixed a typo regarding the new filenames of the quantized models and removed the shell=True parameter in the subprocess.run call as it was conflicting with the list of parameters. * Corrected previous commit * Small tweak: changed the name of the program in argparse This was making the automatic help message to be suggesting the program's usage as being literally "$ Quantization Script [arguments]". It should now be something like "$ python3 quantize.py [arguments]". |
3 years ago |