ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-06-17 22:38:07 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

talk-llama : llama.cpp

Browse Source
This commit is contained in:
Georgi Gerganov
2024-01-14 11:06:28 +02:00
parent d08445c9ad
commit 2a5874441d
2 changed files with 132 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/talk-llama/llama.h
View File

@ -249,6 +249,7 @@ extern "C" {
bool quantize_output_tensor; // quantize output.weight
bool only_copy; // only copy tensors - ftype, allow_requantize and quantize_output_tensor are ignored
bool pure; // disable k-quant mixtures and quantize all tensors to the same type
void * imatrix; // pointer to importance matrix data
} llama_model_quantize_params;
// grammar types