ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-12-19 04:37:51 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity
1,940 Commits 50 Branches 33 Tags 94 MiB
6aa1d7b892
Commit Graph

170 Commits

Author SHA1 Message Date
布客飞龙
6780c98e19
readme : update CMake build commands (#1231) 
* Update README.md

* Update README.md: `vcpkg install opencl clblast`

* readme : update build commands

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-09-05 13:53:34 +03:00
Fangjun Kuang
aad2dad38a
whisper : minor fixes (#1154) 2023-08-27 19:02:00 +03:00
Ryan Metcalfe
1fa360fc6e
readme : add OpenVINO support details (#1112) 2023-07-25 19:07:59 +03:00
Martin Warnaar
176d7e4e7b
readme : better wording (#1064) 2023-07-04 15:30:31 +03:00
Georgi Gerganov
70e6fcd78b
readme : add tinydiarize instructions (#1058) 2023-07-04 09:51:22 +03:00
GiviMAD
bc2dcf85fe
readme : add java alternative binding (#1029) 
Signed-off-by: Miguel Álvarez <miguelwork92@gmail.com>
 2023-06-25 14:46:07 +03:00
Larry Battle
a7f822ef59
readme : corrected syntax for markdown link (#995) 2023-06-25 13:46:44 +03:00
0xsourcecode
4e16a8fb63
readme : highlight OpenBLAS support (#956) 
* highlight openblas support

* Update README.md
 2023-05-24 11:23:51 +03:00
Nicholas Albion
bc89f285d8
bindings : add java bindings (#931) 
* WIP - java bindings

* updated README

* failed attempt at JNI

* fullTranscribe() test passes

* tested on Ubuntu 20

* link to Java bindings
 2023-05-20 18:25:02 +03:00
Georgi Gerganov
a5defbc1b9
release : v1.4.2 2023-05-14 19:06:45 +03:00
Jhen-Jie Hong
16564f554f
readme : improve Core ML model conversion guidance (#915) 2023-05-14 18:11:08 +03:00
Clifford Heath
9931d66400
readme : add instructions on converting to GGML + "--no-config" to wget (#874) 2023-05-08 20:58:36 +03:00
Vulcan
919e58b96a
readme : partial OpenCL GPU support via CLBlast (#863) 
* ggml : CLBlast support as in llama.cpp

Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.

Usage:
WHISPER_CLBLAST=1 make

* CMake/Makefile : CLBlast support as in llama.cpp

Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.

Usage:
```
Makefile:
cd whisper.cpp
WHISPER_CLBLAST=1 make

CMake:
cd whisper.cpp ; mkdir build ; cd build
cmake -DWHISPER_CLBLAST=ON  ..
make
```

* Update README.md

Added OpenCL Build Instructions

* Instruction: Partial OpenCL GPU support via CLBlast

Added build instructions and examples for Make and CMake to support OpenCL enabled GPUs.
 2023-05-03 19:24:43 +03:00
Georgi Gerganov
9c61f5f585
release : v1.4.1 2023-04-30 22:57:42 +03:00
Georgi Gerganov
fa8dbdc888
release : v1.4.0 2023-04-30 19:23:37 +03:00
Georgi Gerganov
794b162a46
whisper : add integer quantization support (#540) 
* whisper : add integer quantization support

* examples : add common-ggml + prepare to add "quantize" tool

* whisper : quantization tool ready

* whisper : fix F32 support

* whisper : try to fix shared lib linkage

* wasm : update quantized models to Q5

* bench.wasm : remove "medium" button

* bench.wasm : fix custom model button

* ggml : add Q5_0 and Q5_1 WASM SIMD

* wasm : add quantized models to all WASM examples

* wasm : bump DB version number to 2

* talk-llama : update example to latest llama.cpp

* node : increase test timeout to 10s

* readme : add information for model quantization

* wasm : add links to other examples
 2023-04-30 18:51:57 +03:00
Georgi Gerganov
5fd1bdd7fc
whisper : add GPU support via cuBLAS (#834) 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
 2023-04-30 12:14:33 +03:00
Georgi Gerganov
4d89ee2e59
readme : add logo 2023-04-28 22:41:29 +03:00
Georgi Gerganov
c23588cc4b
release : v1.3.0 2023-04-15 17:30:44 +03:00
Georgi Gerganov
355da83690
readme : fix link 2023-04-15 13:30:36 +03:00
Georgi Gerganov
3e5c49e59a
readme : add usage instructions for Core ML 2023-04-15 13:30:07 +03:00
Aaron Taylor
1c5edc3cb3
readme : add SwiftWhisper to listed bindings (#755) 2023-04-14 20:24:00 +03:00
Alex Evgrashin
674a8e579b
readme : add unity bindings (#733) 2023-04-14 19:59:44 +03:00
Sam
b73a4638ac
readme : make the quick start instructions clearer. (#716) 
Users wanting to make use of this implementation of the whisper model with no prior knowledge of C/C++ may download the Whisper model but fail to use of the "make" command as specified given that they forgot or didn't know they needed to clone the repository first. Hope this modification clears things up.
 2023-04-14 19:33:06 +03:00
bocytko
ccb47e7e10
readme : add shell command example for --print-colors (#710) 
The section of the readme file explaining `--print-colors` includes only a screenshot with directories that are inconsistent with other examples. This commit adds an example shell command, consistent with the remaining examples.
 2023-04-14 19:25:23 +03:00
Zigfrid Zvezdin
859ffc994e
misc : typo (#688) 2023-03-30 07:51:33 +03:00
Georgi Gerganov
82637b8e9f
readme : add talk-llama example to the table 2023-03-27 21:02:35 +03:00
jwijffels
aec01bb337
Include link to R wrapper in README (#626) 2023-03-22 22:28:22 +02:00
Jhen-Jie Hong
a5e60c019d
readme : add react-native bindings (#619) 2023-03-22 21:39:02 +02:00
Georgi Gerganov
1beff6f66d
models : change HF hosting from dataset to model 2023-03-22 20:44:56 +02:00
Georgi Gerganov
fa9d43181f
readme : add bench-wts.sh demo 2023-03-06 21:06:27 +02:00
Georgi Gerganov
ad1389003d
release : v1.2.1 2023-02-28 22:29:12 +02:00
Aaron Pham
d176160f6f
readme : add pybind11 bindings (#538) 2023-02-27 21:02:11 +02:00
Georgi Gerganov
ca21f7ab16
readme : add cython bindings (#9) 2023-02-24 08:46:06 +02:00
Georgi Gerganov
2407ae8ef0
readme : add Ruby discussion + update .NET discussion 2023-02-15 19:51:54 +02:00
Georgi Gerganov
9764782bd9
readme : add another .NET repo (#303) 2023-02-14 20:04:03 +02:00
Georgi Gerganov
3b010f9bed
readme : add .NET repo (#303) 2023-02-11 17:35:33 +02:00
Georgi Gerganov
b2083c5d02
release : v1.2.0 2023-02-04 09:49:49 +02:00
Georgi Gerganov
f3ee4a9673
whisper : reduce memory usage during inference (#431) 
* ggml : add "scratch" buffer support

* ggml : support for scratch ring-buffer

* ggml : bug fix in ggml_repeat()

* ggml : error on scratch buffer overflow

* whisper : use scratch buffers during inference (base model only)

* whisper : update memory usage for all models

* whisper : fix encoder memory usage

* whisper : use whisper_context functions instead of macros

* whisper : fix FF + remove it from README

* ggml : reuse ggml_new_i32

* ggml : refactor the scratch buffer storage

* whisper : reorder scratch buffers in the decoder

* main : add option to disable temp fallback

* Update README.md
 2023-02-04 09:45:52 +02:00
Georgi Gerganov
2c3f50a021
release : v1.1.1 2023-01-23 20:23:44 +02:00
Georgi Gerganov
874bde887e
Update README.md 2023-01-16 18:47:31 +02:00
Georgi Gerganov
8738427dd6
cmake : bump version to 1.1.0 2023-01-15 14:33:13 +02:00
Georgi Gerganov
0b85e8c401
Update README.md 2023-01-15 11:36:20 +02:00
Georgi Gerganov
8de452c18b
Improve decoding (#291) 
* whisper : prepare infra for new decoding strategies

* whisper : apply logit filters and compute logprobs

* whisper : add whisper_get_logits()

* whisper : separate self and cross attention memory

Initial step needed for supporting parallel decoders

* whisper : move probs_id buffer to whisper_context

* whisper : refactor kv cache into separate struct

* whisper : move self-attention kv cache to whisper_decoder

* whisper : wip decoding parameters + strategies

* whisper : wip decoding parameters + strategies (part 2)

* whisper : wip decoding parameters + strategies (part 3)

* whisper : wip decoding parameters + strategies (part 4)

* whisper : fix prompt_past update to not include prompt_init

* whisper : temperature + best_of support

* whisper : support for compression_ration_threshold

We actually use entropy, but it is similar

* command : fix example to use logits instead of obsolete probs

* whisper : handle empty sequence ranking

* whisper : add WHISPER_DEBUG + diagnostic prints + new main args

* whisper : minor fixes

* whisper : add beam-search support

* whisper : bug fix when there no previous context

* whisper : add comments

* stream : disable temperature fallback

For real-time processing, we always want a single decoder running at T=0

* whisper.swiftui : update example - fix paths + add empty folders
 2023-01-15 11:29:57 +02:00
Ian Bicking
5e9f33596f
readme : clarify main and stream usage (#391) 
Give an example of ./main that uses a sample file that's already there, and make the stream example clarify you need `make stream`
 2023-01-08 20:18:41 +02:00
Thomas Fitzsimmons
1944e7c33e whisper : document POWER VSX support 2023-01-05 23:53:00 +02:00
Georgi Gerganov
1480a5f1af
Update README.md 
Add SwiftUI example links
 2022-12-23 11:02:46 +02:00
Georgi Gerganov
4c1fe0c813
Update README.md 
Add bindings links / discussions
 2022-12-22 18:22:58 +02:00
Georgi Gerganov
afe2db0fe2
Add Roadmap 2022-12-16 23:41:57 +02:00
Georgi Gerganov
ea19ed33f1
Update README.md (#46) 
Add references to the new Android app
 2022-12-16 19:28:51 +02:00
Georgi Gerganov
c37c2443c1
Update README.md (#56) 2022-12-16 18:01:05 +02:00
Georgi Gerganov
812ae3ffbd
Update README.md 2022-12-12 20:20:51 +02:00
Georgi Gerganov
fcf515de60
bench.wasm : same as "bench" but runs in the browser (#89) 2022-12-11 11:09:10 +02:00
Georgi Gerganov
3b1aacbe6d talk : talk with AI in the terminal 2022-12-10 16:51:58 +02:00
Georgi Gerganov
3996ecc156
Update README.md 2022-12-07 05:15:46 +02:00
Georgi Gerganov
9fe7306f4b
models : add the new "large" model release by OpenAI 
The old "large" model is now renamed "large-v1".
If you have been using it, make sure to rename it and download the new
"large" model for best results.
 2022-12-06 18:48:57 +02:00
Georgi Gerganov
6fd5358dd0
Update README.md 2022-11-27 11:30:32 +02:00
Georgi Gerganov
67e819baf4
minor : remove "examples/" prefix from the README 2022-11-26 13:07:54 +02:00
Georgi Gerganov
a425365b82
yt-wsp.sh : script to easily transcribe VODs 
Thanks to @DaniruKun
ref: https://gist.github.com/DaniruKun/96f763ec1a037cc92fe1a059b643b818

Usage:

  cd whisper.cpp
  make

  ./examples/yt-wsp.sh <video-url>
 2022-11-26 12:54:42 +02:00
Georgi Gerganov
e0e864d9ca
Update README.md 2022-11-26 11:56:55 +02:00
Georgi Gerganov
68ecadbbc9
command.wasm : add voice assistant example for the Web (#171) 
Same as the command-line tool "command", but runs in the browser

Also, added helper script "extra/deploy-wasm.sh" and fixed some timing
constants for the WASM examples.
 2022-11-26 11:40:06 +02:00
Georgi Gerganov
1246dd023e
command : add demonstration video 2022-11-25 20:23:58 +02:00
Georgi Gerganov
bc88eb13c6
examples : add "command" tool (#171) 2022-11-25 19:36:57 +02:00
Georgi Gerganov
b8ce25dec1
refactoring : more readable code 2022-11-25 19:28:04 +02:00
Georgi Gerganov
2c0501b38a
Update README.md 2022-11-24 20:06:51 +02:00
Georgi Gerganov
35cd29ce1f
ggml : fix cross-compile Linux -> Window with mingw (#168) 2022-11-23 22:28:41 +02:00
Georgi Gerganov
a156a358ca
Revert "update README.md" 
This reverts commit 6a84147113.
 2022-11-23 22:16:50 +02:00
katsu560
6a84147113 update README.md 2022-11-23 22:16:33 +02:00
Georgi Gerganov
363a2dadec
Update README.md 2022-11-23 09:53:55 +02:00
Georgi Gerganov
623a486056
Update README.md 2022-11-23 09:52:36 +02:00
Georgi Gerganov
2e311a2917
Update README.md 2022-11-21 18:52:20 +02:00
Georgi Gerganov
864a78a8d0
models : change default hosting to Hugging Face 
My Linode is running out of monthly bandwidth due to the big interest in
the project
 2022-11-15 19:47:06 +02:00
Georgi Gerganov
8fdfb0ba92
Update README.md 2022-11-06 21:04:21 +02:00
Georgi Gerganov
a09e9123ca
Update README.md 2022-11-05 08:44:41 +02:00
Georgi Gerganov
0e689f83d8
Update README.md 2022-11-02 22:03:27 +02:00
Georgi Gerganov
d5afebd37c
whisper : token-level timestamp refactoring (#49, #120) 
This turned out pretty good overall. The algorithm has been moved from
main.cpp to whisper.cpp and can be reused for all subtitles types. This
means that now you can specify the maximum length of the generated
lines. Simply provide the "-ml" argument specifying the max length in
number of characters
 2022-11-02 21:45:54 +02:00
Georgi Gerganov
4b1c32e8ea
Update README.md 2022-11-02 18:33:29 +02:00
Georgi Gerganov
b5dde365e9
extra : compute SHA of all models files 2022-11-02 18:31:55 +02:00
Georgi Gerganov
e46bc56e71
Update README.md 2022-11-01 22:47:58 +02:00
Georgi Gerganov
b0f2aa0ea6
Update README.md 2022-10-30 17:10:46 +02:00
Georgi Gerganov
2c281d190b
Update README.md 2022-10-28 22:09:40 +03:00
Georgi Gerganov
9ccafa8792 Update README.md 2022-10-25 20:53:48 +03:00
Georgi Gerganov
89d8ee3ee5 Update README.md 2022-10-25 20:53:48 +03:00
Georgi Gerganov
c6710efde2 refactoring : move main + stream in examples + other stuff 2022-10-25 20:53:48 +03:00
Georgi Gerganov
728676927f
Update README.md 2022-10-24 18:26:21 +03:00
Georgi Gerganov
181b762de8
Update README.md 2022-10-23 12:47:51 +03:00
Georgi Gerganov
4196856c7b
Update README.md 2022-10-23 10:24:36 +03:00
Georgi Gerganov
705198f063
Update README.md 2022-10-23 10:12:10 +03:00
Georgi Gerganov
3e69a6071d
Update README.md 2022-10-23 08:04:33 +03:00
Georgi Gerganov
f3dae90c31 Update README.md 2022-10-22 21:17:21 +03:00
Georgi Gerganov
8c1d970088
Update README.md 2022-10-22 19:00:25 +03:00
Georgi Gerganov
6b45e37b2b Update README.md and finalize the whisper.wasm example 2022-10-22 18:54:01 +03:00
Georgi Gerganov
5698b51718
Update README.md 2022-10-20 17:52:59 +03:00
Georgi Gerganov
3fe3898ebb
Update README.md 2022-10-20 17:43:56 +03:00
Georgi Gerganov
81c185576c
Update README.md 2022-10-20 17:39:31 +03:00
Georgi Gerganov
1969ee4bc7
Update README.md 2022-10-18 22:20:35 +03:00
Georgi Gerganov
72d967bce4 Use Accelerate framework on Apple silicon 
Huge performance improvement in the Encode (almost x2 on MacBook M1 Pro)

Also various extra optimizations:

- Multi-threaded NORM operator
- Faster GELU via F16 cast
 2022-10-18 00:12:51 +03:00
Georgi Gerganov
36945162fa
Update README.md (ref #50) 2022-10-15 09:40:08 +03:00
Georgi Gerganov
b2f1600aa3
Update README.md 2022-10-12 21:25:42 +03:00
Topping1
1348796a93
Update README.md (#43) 
* Update README.md

Updated README.md to list new features, such as subtitle file support (VTT and SRT)

* Update README.md

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2022-10-12 07:32:14 +03:00