4 Commits (master-074bea2)

Author	SHA1	Message	Date
Mack Straight	074bea2eb1	sentencepiece bpe compatible tokenizer (#252) ... * potential out of bounds read * fix quantize * style * Update convert-pth-to-ggml.py * mild cleanup * don't need the space-prefixing here rn since main.cpp already does it * new file magic + version header field * readme notice * missing newlines Co-authored-by: slaren <2141330+slaren@users.noreply.github.com>	3 years ago
Sebastián A	eb062bb012	Windows fixes (#31) ... * Apply fixes suggested to build on windows Issue: https://github.com/ggerganov/llama.cpp/issues/22 * Remove unsupported VLAs * MSVC: Remove features that are only available on MSVC C++20. * Fix zero initialization of the other fields. * Change the use of vector for stack allocations.	3 years ago
Georgi Gerganov	a9e58529ea	Fix un-initialized FP16 tables on x86 (#15, #2)	3 years ago
Georgi Gerganov	26c0846629	Initial release	3 years ago