ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-04-27 22:39:52 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,488 Commits 54 Branches 38 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
Georgi Gerganov
503a786c9a
bench : update numbers [no ci] (#2993) 2025-04-02 16:27:36 +03:00
Georgi Gerganov
7094ea5e75
whisper : use flash attention (#2152) 
* whisper : use flash attention in the encoder

* whisper : add kv_pad

* whisper : remove extra backend instance (huh?)

* whisper : use FA for cross-attention

* whisper : use FA for self-attention

* whisper : simplify encoder FA

* whisper : add flash_attn runtime parameter

* scripts : add bench log

* scripts : add M1 Pro bench log
 2024-05-15 09:38:19 +03:00