ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-12-22 22:12:21 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
1,200 Commits 50 Branches 34 Tags 95 MiB
9fab28135c
Commit Graph

100 Commits

Author SHA1 Message Date
Georgi Gerganov
794b162a46
whisper : add integer quantization support (#540) 
* whisper : add integer quantization support

* examples : add common-ggml + prepare to add "quantize" tool

* whisper : quantization tool ready

* whisper : fix F32 support

* whisper : try to fix shared lib linkage

* wasm : update quantized models to Q5

* bench.wasm : remove "medium" button

* bench.wasm : fix custom model button

* ggml : add Q5_0 and Q5_1 WASM SIMD

* wasm : add quantized models to all WASM examples

* wasm : bump DB version number to 2

* talk-llama : update example to latest llama.cpp

* node : increase test timeout to 10s

* readme : add information for model quantization

* wasm : add links to other examples
 2023-04-30 18:51:57 +03:00
Georgi Gerganov
5fd1bdd7fc
whisper : add GPU support via cuBLAS (#834) 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
 2023-04-30 12:14:33 +03:00
Georgi Gerganov
3efb81dec6
build : add WHISPER_COREML_ALLOW_FALLBACK to make / CMake (#812) 2023-04-29 10:55:24 +03:00
Georgi Gerganov
c23588cc4b
release : v1.3.0 2023-04-15 17:30:44 +03:00
Georgi Gerganov
5e47e223bd
whisper : add Core ML support (#566) 
* coreml : use Core ML encoder inference

* coreml : simlpify whisper_encode + log messages

* whisper : resolve rebase conflicts

* coreml : add scripts for CoreML model generation

* bench-all : recognize COREML flag
 2023-04-15 13:21:27 +03:00
LittleLoli
61128870b8
cmake : add msvc compiler args /utf-8 fix error C3688 (#721) 
* force msvc compiler use utf-8 encode

* only enable on msvc
 2023-04-14 19:36:38 +03:00
Andrew Huynh
fc49c44426
cmake : add a flag to disable F16C (#628) 2023-03-22 22:30:40 +02:00
Georgi Gerganov
ad1389003d
release : v1.2.1 2023-02-28 22:29:12 +02:00
Avik Sengupta
113fcec513
cmake : install whisper.h header (#485) 
Including the header file in the install bundle helps projects that ship binaries.
 2023-02-11 09:13:32 +02:00
Qianhe Chen
ab1916fc59
ci : add node addon test and optimize compilation configuration (#468) 
* addon: implement node addon call whisper through cpp

* addon: modify the license to MIT

* addon: remove iostream

* addon: rename dir

* addon: fix typo

* addon: configure cmake to build when cmake-js is used

* ci: add addon.node test ci

* addon: remove build WHISPER_BUILD_TESTS

* addon: update build command

* addon: add test

* addon: add test file

* addon: adapt to compile on Windows

* addon: fix typo

* addon: reuse jfk.wav

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* addon: reuse jfk.wav

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-02-05 15:02:08 +02:00
Georgi Gerganov
b2083c5d02
release : v1.2.0 2023-02-04 09:49:49 +02:00
Georgi Gerganov
2c3f50a021
release : v1.1.1 2023-01-23 20:23:44 +02:00
Georgi Gerganov
8738427dd6
cmake : bump version to 1.1.0 2023-01-15 14:33:13 +02:00
Georgi Gerganov
44efbf7ff1
cmake : add -Wno-unused-function + update whisper.js 2023-01-07 20:18:34 +02:00
m.bell
41e05c6b1b
cmake : support AVX2 in Windows better (#381) 2023-01-06 19:36:33 +02:00
Georgi Gerganov
fa379cb22a
Revert "tmp" 
This reverts commit 1652965529.
 2023-01-06 19:33:09 +02:00
David Thorpe
322f4e6c4e
go : bindings updated so they can be used in third party packages. (#379) 
* Updated bindings so they can be used in third pary packages.

* Updated makefiles to set FMA flag on optionally, for xeon E5 on Darwin
 2023-01-06 19:32:28 +02:00
Georgi Gerganov
1652965529
tmp 2023-01-06 19:32:12 +02:00
Georgi Gerganov
6042c7a3be
cmake : change min required version to 3.0 (#351) 
We increase the min version only when want to use particular
functionality that is available in the newer version
 2023-01-06 19:25:28 +02:00
Georgi Gerganov
4a214d2f07
cmake : add CMAKE_RUNTIME_OUTPUT_DIRECTORY 
Currently needed by the wasm examples
 2023-01-05 21:40:59 +02:00
Andy Maloney
84c6b42e65
cmake : update to 3.19 (#351) 
- update from 3.0 (from 2014) to 3.19 (from 2020)
- move some global setting onto the targets (through a cmake include)
 2023-01-05 21:22:48 +02:00
Avik Sengupta
a091581eb3
cmake : add runtime destination install (#345) 
needed for mingw32 build to successfully install the dlls in the correct location
 2022-12-31 09:48:00 +02:00
Andy Maloney
76b6211f9b
cmake : add headers to target (#298) 
This will show the header files in IDEs.
 2022-12-22 16:34:47 +02:00
Georgi Gerganov
99da1e5cc8
cmake : enable and fix -Wall -Wextra -Wpedantic C++ warnings 2022-12-19 20:45:08 +02:00
Georgi Gerganov
1d716d6e34
release : v1.0.4 2022-12-17 19:52:42 +02:00
Georgi Gerganov
930c693989
release : v1.0.3 
Fixed whisper.spm tests
 2022-12-12 20:36:52 +02:00
Georgi Gerganov
9e3e6f253a
release : v1.0.2 2022-12-12 20:29:30 +02:00
Georgi Gerganov
f309f97df6
Node.js package (#260) 
* npm : preparing infra for node package

* npm : package infra ready

* npm : initial version ready

* npm : change name to whisper.cpp

whisper.js is taken
 2022-12-12 20:17:27 +02:00
Georgi Gerganov
37a93d2459
cmake : require c++11 instead of c++20 2022-12-11 20:04:05 +02:00
Tamotsu Takahashi
2f596f5b33 Find libopenblas.dll.a on windows 
"lib" is needed for windows.

With this change, you can build whisper.cpp with OpenBLAS's prebuilt DLL.
1. extract a zip from https://github.com/xianyi/OpenBLAS/releases
2. copy the headers in (openblas)/include to the root directory of whisper.cpp
3. invoke cmake with -DCMAKE_LIBRARY_PATH=(openblas)\lib -DWHISPER_SUPPORT_OPENBLAS=ON
4. copy (openblas)/bin/libopenblas.dll to the same directory of whisper.dll after msbuild

https://github.com/ggerganov/whisper.cpp/issues/89#issuecomment-1324391258
 2022-11-23 08:26:45 +02:00
Chidi Williams
a728be9cdb
Add WHISPER_NO_AVX and WHISPER_NO_AVX2 to CMakeLists (#136) 
* Check for AVX and AVX2 on Darwin

* Add AVX options to CMakeLists
 2022-11-11 18:10:01 +02:00
boolemancer
0bfe728b84 Fix the Windows pthread_create shim 
The current implementation doesn't actually set the out parameter,
and it returns 0 on failure instead of on success.
 2022-11-08 15:02:32 +02:00
Georgi Gerganov
4c66b6a828
cmake : add submodule whisper.spm 2022-11-07 20:50:24 +02:00
Georgi Gerganov
a2eeb941f6
cmake : fix passing GGML_PERF compile option 2022-11-03 20:19:06 +02:00
Georgi Gerganov
234f414652
ref #5 : update CMake for Windows build 
- __AVX2__ should already be defined due to /arch:AVX2
- _CRT_SECURE_NO_WARNINGS should be defined both for shared and static lib
 2022-10-29 19:41:50 +03:00
Georgi Gerganov
fbd513b813 Add OpenBLAS support 
Supported via CMake - just add:

cmake .. -DWHISPER_SUPPORT_OPENBLAS=ON

On Ubuntu, you have to install the library like this:

apt install libopenblas-dev

Unfortunately, I don't observe any benefit compared to the
original AVX2 + FP16 implementation. Maybe I'm missing something
 2022-10-27 18:31:49 +03:00
Mikhail Grigorev
9820234f13 Fixed compile definitions and link libraries for MSVC 2022-10-27 17:20:49 +03:00
Georgi Gerganov
c6710efde2 refactoring : move main + stream in examples + other stuff 2022-10-25 20:53:48 +03:00
Georgi Gerganov
6b45e37b2b Update README.md and finalize the whisper.wasm example 2022-10-22 18:54:01 +03:00
Georgi Gerganov
db460b78ff wip : WASM 128-bit SIMD support 2022-10-22 18:54:01 +03:00
Georgi Gerganov
e905c6f827 wip : initial WASM port 
Works but it is very slow because no SIMD is used.
For example, jfk.wav is processed in ~23 seconds using "tiny.en" model
 2022-10-22 18:54:01 +03:00
Georgi Gerganov
8d15a1c635
ci : fix and re-enable tests (2nd try) 2022-10-21 15:57:20 +03:00
Georgi Gerganov
692aa0784f
Revert "ci : fix and re-enable tests" 
This reverts commit 80aefc9514.
 2022-10-21 15:36:19 +03:00
Georgi Gerganov
80aefc9514
ci : fix and re-enable tests 2022-10-21 15:27:30 +03:00
Georgi Gerganov
66b3169d39
ci : disable tests temporarily 2022-10-19 08:37:18 +03:00
Georgi Gerganov
632660abb9
CMake support for Accelerate framework 2022-10-18 18:51:59 +03:00
Borislav Stanimirov
0b45d25151 Building with MSVC 2022-10-11 21:40:46 +03:00
Georgi Gerganov
29b041f79b Cleanup CMakeLists.txt 2022-10-08 09:02:41 +03:00
Georgi Gerganov
4a732b2879 cmake : fixes 2022-10-08 09:02:41 +03:00
Georgi Gerganov
877c058179 Add CMake support 2022-10-08 09:02:41 +03:00