Commit Graph

3 Commits (ab02a2441cc4c133dd77174f07d4af541f176f05)

Author SHA1 Message Date
Jed Fox ab02a2441c
Move llama_progress_handler into llama_context_params 3 years ago
Jed Fox e47924fd4b
File load progress reporting 3 years ago
Georgi Gerganov f5a77a629b
Introduce C-style API (#370)
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
3 years ago