ulatekh c8eeb93a6a

whisper : suppress tokens with a regex (#1997) ...

* Allow a regular expression to describe tokens to suppress.

Example: --suppress-tokens-re "[,\.]|[ ]?[0-9]+" will suppress commas, periods, and numeric tokens.

Technique inspired by https://github.com/openai/whisper/discussions/1041

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* Blind change to fix Java test.

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-04-09 18:27:28 +03:00

..

addon.node

examples : clean up common code (#1871)

2024-02-19 10:50:15 +02:00

bench

examples : fix typo in bench.cpp (#1933)

2024-03-06 22:21:44 +00:00

bench.wasm

whisper : add support for large v3 (#1444)

2023-11-07 15:30:18 +02:00

command

whisper : suppress tokens with a regex (#1997)

2024-04-09 18:27:28 +03:00

command.wasm

whisper : add context param to disable gpu (#1293)

2023-11-06 11:04:24 +02:00

lsp

examples : clean up common code (#1871)

2024-02-19 10:50:15 +02:00

main

whisper : suppress tokens with a regex (#1997)

2024-04-09 18:27:28 +03:00

python

examples : add python example for transcription (#1744)

2024-01-13 19:37:18 +02:00

quantize

quantize : fix load vocab crash when len is 128 (#1160)

2023-08-06 11:04:42 +03:00

server

examples : rename --audio-context to --audio-ctx per help text (#1953)

2024-03-18 17:53:33 +02:00

stream

readme : add Fedora dependencies (#1970)

2024-03-20 18:42:11 +02:00

stream.wasm

stream.wasm : fix invalid memory access when no segments (#1902)

2024-02-26 10:12:35 +02:00

sycl

whisper : add SYCL support (#1863)

2024-02-23 09:22:24 +02:00

talk

readme : add Fedora dependencies (#1970)

2024-03-20 18:42:11 +02:00

talk-llama

talk-llama : sync llama.cpp

2024-04-07 16:21:08 +03:00

talk.wasm

examples : clean up common code (#1871)

2024-02-19 10:50:15 +02:00

wchess

cmake : create solution folders (#2004)

2024-04-09 18:23:33 +03:00

whisper.android

ggml : 32-bit arm compat (#1891)

2024-02-22 18:31:40 +02:00

whisper.android.java

whisper.android.java : fix returns in JNI (#1929)

2024-03-05 15:59:26 +02:00

whisper.nvim

examples : vim plugin and LSP server (#1144)

2023-08-27 21:35:06 +03:00

whisper.objc

docs : make model options / model install methods clearer (#1806)

2024-01-26 17:39:54 +02:00

whisper.swiftui

whisper.swiftui : add .gitignore

2024-01-04 15:00:27 +02:00

whisper.wasm

whisper : add context param to disable gpu (#1293)

2023-11-06 11:04:24 +02:00

CMakeLists.txt

cmake : create solution folders (#2004)

2024-04-09 18:23:33 +03:00

common-ggml.cpp

sync : ggml (#2001)

2024-03-27 18:55:10 +02:00

common-ggml.h

whisper : add integer quantization support (#540)

2023-04-30 18:51:57 +03:00

common-sdl.cpp

sdl : fix audio callback (#1523)

2023-11-20 13:16:38 +02:00

common-sdl.h

sdl : fix audio callback (#1523)

2023-11-20 13:16:38 +02:00

common.cpp

talk, talk-llama : pass text_to_speak as a file (#1865)

2024-02-24 09:24:47 +02:00

common.h

talk, talk-llama : pass text_to_speak as a file (#1865)

2024-02-24 09:24:47 +02:00

dr_wav.h

refactoring : move main + stream in examples + other stuff

2022-10-25 20:53:48 +03:00

generate-karaoke.sh

minor : add comment for using "generate_karaoke.sh"

2022-11-26 10:22:42 +02:00

grammar-parser.cpp

whisper : add grammar-based sampling (#1229)

2023-11-13 10:51:34 +02:00

grammar-parser.h

whisper : add grammar-based sampling (#1229)

2023-11-13 10:51:34 +02:00

helpers.js

wchess : whisper assisted chess (#1595)

2023-12-14 15:58:26 +02:00

json.hpp

examples : clean up common code (#1871)

2024-02-19 10:50:15 +02:00

livestream.sh

whisper : make large version explicit + fix data size units (#1493)

2023-11-15 19:42:25 +02:00

twitch.sh

whisper : make large version explicit + fix data size units (#1493)

2023-11-15 19:42:25 +02:00

yt-wsp.sh

yt-wsp.sh : print help on empty args

2023-02-18 09:42:31 +02:00