Commit Graph

4 Commits (jed/load-progress)

Author SHA1 Message Date
Jed Fox 1f9592baf3
Renames 3 years ago
Jed Fox ab02a2441c
Move llama_progress_handler into llama_context_params 3 years ago
Jed Fox e47924fd4b
File load progress reporting 3 years ago
Georgi Gerganov f5a77a629b
Introduce C-style API (#370)
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
3 years ago