ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-06-15 13:28:08 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
f41fdad200a8e82c20b34fbbef45aac67e88ec5a
whisper.cpp/ggml/src/ggml-cuda/template-instances
History
Johannes Gäßler 8c4f30497a CUDA: MMQ code deduplication + iquant support (llama/8495) 
* CUDA: MMQ code deduplication + iquant support

* 1 less parallel job for CI build
2024-08-08 22:48:46 +03:00
..
fattn-vec-f16-instance-hs64-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs64-f16-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs64-f16-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs64-f16-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs64-f16-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs64-f16-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-f16-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q4_1-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q5_1-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs128-q8_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f16-instance-hs256-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs64-f16-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-f16-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q4_1-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q5_1-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs128-q8_0-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-vec-f32-instance-hs256-f16-f16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-wmma-f16-instance-kqfloat-cpb16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-wmma-f16-instance-kqfloat-cpb32.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-wmma-f16-instance-kqhalf-cpb8.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-wmma-f16-instance-kqhalf-cpb16.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
fattn-wmma-f16-instance-kqhalf-cpb32.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
generate_cu_files.py
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq1_s.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq2_s.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq2_xs.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq2_xxs.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq3_s.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq3_xxs.cu
CUDA: MMQ code deduplication + iquant support (llama/8495)
2024-08-08 22:48:46 +03:00
mmq-instance-iq4_nl.cu
CUDA: MMQ support for iq4_nl, iq4_xs (llama/8278)
2024-07-08 14:53:55 +03:00
mmq-instance-iq4_xs.cu
CUDA: MMQ support for iq4_nl, iq4_xs (llama/8278)
2024-07-08 14:53:55 +03:00
mmq-instance-q2_k.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q3_k.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q4_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q4_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q4_k.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q5_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q5_1.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q5_k.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q6_k.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00
mmq-instance-q8_0.cu
whisper : reorganize source code + improve CMake (#2256)
2024-06-26 19:34:09 +03:00