ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-06-17 14:28:07 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

ggml : reading the runtime sve config of the cpu (llama/8709)

Browse Source 
* ggml : reading the runtime sve config of the cpu

* change to one time init to prevent performance drop

* prefix variable to avoid possible conflicts

* revert xxhash fix and add brackets

---------

Co-authored-by: domke <673751-domke@users.noreply.gitlab.com>
This commit is contained in:
jdomke
2024-08-04 01:34:41 +09:00
committed by Georgi Gerganov
parent 6cb38c3673
commit a902fb4ab2
5 changed files with 30 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
ggml/src/ggml-quants.h
View File

@ -127,6 +127,10 @@ void iq2xs_free_impl(enum ggml_type type);
void iq3xs_init_impl(int grid_size);
void iq3xs_free_impl(int grid_size);
#if defined(__ARM_FEATURE_SVE)
extern int ggml_sve_cnt_b;
#endif
#ifdef __cplusplus
}
#endif