ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-12-24 22:56:42 +00:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Georgi Gerganov 2022-10-20 17:39:31 +03:00 committed by GitHub
parent 744bd47685
commit 81c185576c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 10 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
README.md
View File

@ -252,9 +252,18 @@ the framwork utilizes the special-purpose AMX coprocessor available in modern Ap
## Limitations ## Limitations
- Very basic greedy sampling scheme - always pick up the top token. You can implement your own strategy
- Inference only - Inference only
- No GPU support - No GPU support
- Very basic greedy sampling scheme - always pick up the token with highest probability.
This should be similar to the [GreedyDecoder](https://github.com/openai/whisper/blob/main/whisper/decoding.py#L249-L274)
from the original python implementation, so in order to make a fair comparison between the 2 implementations, make sure
to run the python code with the following parameters:
```
whisper --best_of 1 --beam_size 1 ...
```
In the future, `whisper.cpp` will support more sampling strategies.
## Memory usage ## Memory usage