ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-12-20 21:23:06 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

whisper : zero-out the KV cache upon clear (#2445)

Browse Source
This commit is contained in:
Georgi Gerganov 2024-10-05 15:22:17 +03:00
parent 6e40108a59
commit 847f94fdeb
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/whisper.cpp
View File

@ -1046,6 +1046,8 @@ static void whisper_kv_cache_clear(struct whisper_kv_cache & cache) {
cache.cells[i].seq_id.clear();
}
cache.head = 0;
ggml_backend_buffer_clear(cache.buffer, 0);
}
static void whisper_kv_cache_seq_rm(