novarobot
/
rllama
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11 Commits
3 Branches
0 Tags
1.4 MiB
k4bit
master
broken-opencl-code
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '846759b277'
${ noResults }
Commit Graph

2 Commits (846759b2776f69b576522604c4f5067e682804fd)

Author SHA1 Message Date
Mikko Juola 846759b277 Optimize conversions to and from f16<->32. 
x86 cannot do f16 operations natively, but it does have an instruction
to convert them to f32. I optimized those to use SIMD instructions.
 3 years ago
Mikko Juola 3b8f904f13 First commit. LLaMA works now. It is not pretty but it does generate text from prompts. Yay. 3 years ago