From 99da6ed71a145981e8176d438193ba6ad97d293a Mon Sep 17 00:00:00 2001 From: Mikko Juola Date: Mon, 13 Mar 2023 17:44:03 -0700 Subject: [PATCH] Update README.md benchmarks for new attention OpenCL thing. --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index b630620..d2231ca 100644 --- a/README.md +++ b/README.md @@ -98,4 +98,11 @@ LLaMA-7B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: 567ms / token LLaMA-7B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 956ms / token LLaMA-13B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: 987ms / token LLaMA-13B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 1706ms / token + +# commit 35b0c372a87192761e17beb421699ea5ad4ac1ce (13 March 2023) +# I moved some attention stuff to OpenCL too. +LLaMA-7B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: 283ms / token +LLaMA-7B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 679ms / token +LLaMA-13B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: +LLaMA-13B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 1226ms / token ```