176d7e4e7b
readme : better wording ( #1064 )
2023-07-04 15:30:31 +03:00
70e6fcd78b
readme : add tinydiarize instructions ( #1058 )
2023-07-04 09:51:22 +03:00
bc2dcf85fe
readme : add java alternative binding ( #1029 )
...
Signed-off-by: Miguel Álvarez <miguelwork92@gmail.com >
2023-06-25 14:46:07 +03:00
a7f822ef59
readme : corrected syntax for markdown link ( #995 )
2023-06-25 13:46:44 +03:00
4e16a8fb63
readme : highlight OpenBLAS support ( #956 )
...
* highlight openblas support
* Update README.md
2023-05-24 11:23:51 +03:00
bc89f285d8
bindings : add java bindings ( #931 )
...
* WIP - java bindings
* updated README
* failed attempt at JNI
* fullTranscribe() test passes
* tested on Ubuntu 20
* link to Java bindings
2023-05-20 18:25:02 +03:00
a5defbc1b9
release : v1.4.2
2023-05-14 19:06:45 +03:00
16564f554f
readme : improve Core ML model conversion guidance ( #915 )
2023-05-14 18:11:08 +03:00
9931d66400
readme : add instructions on converting to GGML + "--no-config" to wget ( #874 )
2023-05-08 20:58:36 +03:00
919e58b96a
readme : partial OpenCL GPU support via CLBlast ( #863 )
...
* ggml : CLBlast support as in llama.cpp
Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.
Usage:
WHISPER_CLBLAST=1 make
* CMake/Makefile : CLBlast support as in llama.cpp
Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.
Usage:
```
Makefile:
cd whisper.cpp
WHISPER_CLBLAST=1 make
CMake:
cd whisper.cpp ; mkdir build ; cd build
cmake -DWHISPER_CLBLAST=ON ..
make
```
* Update README.md
Added OpenCL Build Instructions
* Instruction: Partial OpenCL GPU support via CLBlast
Added build instructions and examples for Make and CMake to support OpenCL enabled GPUs.
2023-05-03 19:24:43 +03:00
9c61f5f585
release : v1.4.1
2023-04-30 22:57:42 +03:00
fa8dbdc888
release : v1.4.0
2023-04-30 19:23:37 +03:00
794b162a46
whisper : add integer quantization support ( #540 )
...
* whisper : add integer quantization support
* examples : add common-ggml + prepare to add "quantize" tool
* whisper : quantization tool ready
* whisper : fix F32 support
* whisper : try to fix shared lib linkage
* wasm : update quantized models to Q5
* bench.wasm : remove "medium" button
* bench.wasm : fix custom model button
* ggml : add Q5_0 and Q5_1 WASM SIMD
* wasm : add quantized models to all WASM examples
* wasm : bump DB version number to 2
* talk-llama : update example to latest llama.cpp
* node : increase test timeout to 10s
* readme : add information for model quantization
* wasm : add links to other examples
2023-04-30 18:51:57 +03:00
5fd1bdd7fc
whisper : add GPU support via cuBLAS ( #834 )
...
* make : add WHISPER_CUBLAS
* make : fix CUBLAS build
* whisper : disable Flash Attention + adjust memory buffers
* whisper : remove old commented code
* readme : add cuBLAS instructions
* cmake : add WHISPER_CUBLAS option
* gitignore : ignore build-cublas
2023-04-30 12:14:33 +03:00
4d89ee2e59
readme : add logo
2023-04-28 22:41:29 +03:00
c23588cc4b
release : v1.3.0
2023-04-15 17:30:44 +03:00
355da83690
readme : fix link
2023-04-15 13:30:36 +03:00
3e5c49e59a
readme : add usage instructions for Core ML
2023-04-15 13:30:07 +03:00
1c5edc3cb3
readme : add SwiftWhisper to listed bindings ( #755 )
2023-04-14 20:24:00 +03:00
674a8e579b
readme : add unity bindings ( #733 )
2023-04-14 19:59:44 +03:00
b73a4638ac
readme : make the quick start instructions clearer. ( #716 )
...
Users wanting to make use of this implementation of the whisper model with no prior knowledge of C/C++ may download the Whisper model but fail to use of the "make" command as specified given that they forgot or didn't know they needed to clone the repository first. Hope this modification clears things up.
2023-04-14 19:33:06 +03:00
ccb47e7e10
readme : add shell command example for --print-colors ( #710 )
...
The section of the readme file explaining `--print-colors` includes only a screenshot with directories that are inconsistent with other examples. This commit adds an example shell command, consistent with the remaining examples.
2023-04-14 19:25:23 +03:00
859ffc994e
misc : typo ( #688 )
2023-03-30 07:51:33 +03:00
82637b8e9f
readme : add talk-llama example to the table
2023-03-27 21:02:35 +03:00
aec01bb337
Include link to R wrapper in README ( #626 )
2023-03-22 22:28:22 +02:00
a5e60c019d
readme : add react-native bindings ( #619 )
2023-03-22 21:39:02 +02:00
1beff6f66d
models : change HF hosting from dataset to model
2023-03-22 20:44:56 +02:00
fa9d43181f
readme : add bench-wts.sh demo
2023-03-06 21:06:27 +02:00
ad1389003d
release : v1.2.1
2023-02-28 22:29:12 +02:00
d176160f6f
readme : add pybind11 bindings ( #538 )
2023-02-27 21:02:11 +02:00
ca21f7ab16
readme : add cython bindings ( #9 )
2023-02-24 08:46:06 +02:00
2407ae8ef0
readme : add Ruby discussion + update .NET discussion
2023-02-15 19:51:54 +02:00
9764782bd9
readme : add another .NET repo ( #303 )
2023-02-14 20:04:03 +02:00
3b010f9bed
readme : add .NET repo ( #303 )
2023-02-11 17:35:33 +02:00
b2083c5d02
release : v1.2.0
2023-02-04 09:49:49 +02:00
f3ee4a9673
whisper : reduce memory usage during inference ( #431 )
...
* ggml : add "scratch" buffer support
* ggml : support for scratch ring-buffer
* ggml : bug fix in ggml_repeat()
* ggml : error on scratch buffer overflow
* whisper : use scratch buffers during inference (base model only)
* whisper : update memory usage for all models
* whisper : fix encoder memory usage
* whisper : use whisper_context functions instead of macros
* whisper : fix FF + remove it from README
* ggml : reuse ggml_new_i32
* ggml : refactor the scratch buffer storage
* whisper : reorder scratch buffers in the decoder
* main : add option to disable temp fallback
* Update README.md
2023-02-04 09:45:52 +02:00
2c3f50a021
release : v1.1.1
2023-01-23 20:23:44 +02:00
874bde887e
Update README.md
2023-01-16 18:47:31 +02:00
8738427dd6
cmake : bump version to 1.1.0
2023-01-15 14:33:13 +02:00
0b85e8c401
Update README.md
2023-01-15 11:36:20 +02:00
8de452c18b
Improve decoding ( #291 )
...
* whisper : prepare infra for new decoding strategies
* whisper : apply logit filters and compute logprobs
* whisper : add whisper_get_logits()
* whisper : separate self and cross attention memory
Initial step needed for supporting parallel decoders
* whisper : move probs_id buffer to whisper_context
* whisper : refactor kv cache into separate struct
* whisper : move self-attention kv cache to whisper_decoder
* whisper : wip decoding parameters + strategies
* whisper : wip decoding parameters + strategies (part 2)
* whisper : wip decoding parameters + strategies (part 3)
* whisper : wip decoding parameters + strategies (part 4)
* whisper : fix prompt_past update to not include prompt_init
* whisper : temperature + best_of support
* whisper : support for compression_ration_threshold
We actually use entropy, but it is similar
* command : fix example to use logits instead of obsolete probs
* whisper : handle empty sequence ranking
* whisper : add WHISPER_DEBUG + diagnostic prints + new main args
* whisper : minor fixes
* whisper : add beam-search support
* whisper : bug fix when there no previous context
* whisper : add comments
* stream : disable temperature fallback
For real-time processing, we always want a single decoder running at T=0
* whisper.swiftui : update example - fix paths + add empty folders
2023-01-15 11:29:57 +02:00
5e9f33596f
readme : clarify main and stream usage ( #391 )
...
Give an example of ./main that uses a sample file that's already there, and make the stream example clarify you need `make stream`
2023-01-08 20:18:41 +02:00
1944e7c33e
whisper : document POWER VSX support
2023-01-05 23:53:00 +02:00
1480a5f1af
Update README.md
...
Add SwiftUI example links
2022-12-23 11:02:46 +02:00
4c1fe0c813
Update README.md
...
Add bindings links / discussions
2022-12-22 18:22:58 +02:00
afe2db0fe2
Add Roadmap
2022-12-16 23:41:57 +02:00
ea19ed33f1
Update README.md ( #46 )
...
Add references to the new Android app
2022-12-16 19:28:51 +02:00
c37c2443c1
Update README.md ( #56 )
2022-12-16 18:01:05 +02:00
812ae3ffbd
Update README.md
2022-12-12 20:20:51 +02:00
fcf515de60
bench.wasm : same as "bench" but runs in the browser ( #89 )
2022-12-11 11:09:10 +02:00
