From 6e456e64f371be9ee714ec1ab05249de8d4ec709 Mon Sep 17 00:00:00 2001 From: Mikko Juola Date: Mon, 13 Mar 2023 17:17:09 -0700 Subject: [PATCH] Add new benchmarks now that this is partially OpenCLified. --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index 3fb5c09..b630620 100644 --- a/README.md +++ b/README.md @@ -91,4 +91,11 @@ cargo run --release -- # commit c9c861d199bd2d87d7e883e3087661c1e287f6c4 (13 March 2023) LLaMA-7B: AMD Ryzen 3950X: 1058ms / token LLaMA-13B: AMD Ryzen 3950X: 2005ms / token + +# commit 63d27dba9091823f8ba11a270ab5790d6f597311 (13 March 2023) +# This one has one part of the transformer moved to GPU as a type of smoke test +LLaMA-7B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: 567ms / token +LLaMA-7B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 956ms / token +LLaMA-13B: AMD Ryzen 3950X + OpenCL GTX 3090 Ti: 987ms / token +LLaMA-13B: AMD Ryzen 3950X + OpenCL Ryzen 3950X: 1706ms / token ```