novarobot
/
llama.cpp
mirror of https://github.com/novarobot/llama.cpp
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
173 Commits
13 Branches
39 Tags
892 KiB
master
model-linking-policy-doc
jed/load-progress
jed/spm
patch-win-utf8
feat-input-prefix
q4_1_more_accel_kahan
q4_1_more_accel_loopsplit
q4_1_more_accel
tcp_server
llama-patch-enable-fma-msvc
mmap
dev
master-01a297b
master-074bea2
master-084e2f0
master-0b366e7
master-0f1b21c
master-22213a1
master-2456837
master-2e17dfd
master-2e664f1
master-305ba6f
master-368d0c8
master-3cd8dde
master-4122dff
master-483bab2
master-4870e45
master-50fae10
master-56e659a
master-5c19c70
master-69c9229
master-70f01cb
master-8cf9f34
master-928480e
master-9794052
master-9e17072
master-a140219
master-a791a68
master-ad072fc
master-ad5fd5b
master-ae44e23
master-c494ed5
master-d3f202d
master-d5850c5
master-d7def1a
master-da5303c
master-e4412b4
master-e6c9e09
master-ea10d3d
master-f5a77a6
master-f7dc43b
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '4870e455b3'
${ noResults }
Commit Graph

5 Commits (4870e455b3653f7d7769fa5772b2c90ffad088df)

Author SHA1 Message Date
Georgi Gerganov 4870e455b3
Fix memory allocation issues and seg faults 3 years ago
Georgi Gerganov 483bab2e3d
Avoid the transposed X branch in the Z = X * Y matrix multiplication (#439) 
Should make results reproducible for different number of threads and batch sizes
 3 years ago
Yusuf Kağan Hanoğlu d5850c53ca
Add missing header for memcpy (#386) 
fixed: memcpy is not defined
 3 years ago
Georgi Gerganov 928480ef5b
Init llama_context_params properly from CLI (#370) 3 years ago
Georgi Gerganov f5a77a629b
Introduce C-style API (#370) 
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
 3 years ago