extern/whisper.cpp
1
0
Fork 1
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-08-10 06:58:00 +02:00
Code Issues Packages Projects Releases Wiki Activity

ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (llama/7433)

Browse Source 
* Add SVE support for q4_0_q8_0 q8_0_q8_0

* remove ifdef
This commit is contained in:
Masaya, Kato
2024-05-25 17:42:31 +09:00
committed by Georgi Gerganov
parent 8cd7a3df37
commit 37ed71c964
4 changed files with 79 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
ggml-impl.h
View File

@ -144,6 +144,10 @@ extern "C" {
#endif
#endif
#if defined(__ARM_FEATURE_SVE)
#include <arm_sve.h>
#endif
// 16-bit float
// on Arm, we use __fp16
// on x86, we use uint16_t