2034 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Georgi Gerganov	8a9ad7844d	release : v1.7.4 v1.7.4	2025-01-06 15:13:48 +02:00
Georgi Gerganov	eb874b3a3c	ci : cont	2025-01-06 10:46:10 +02:00
Georgi Gerganov	eb78e3a3f1	ci : fix ubuntu runner names	2025-01-06 09:29:10 +02:00
Yusuf Redžić	ece3ff88f6	cli : fix segfault on missing argument (#2700)	2025-01-04 10:47:41 +02:00
Georgi Gerganov	9366544991	ci : fix arm builds	2025-01-04 10:45:01 +02:00
Georgi Gerganov	95583942ed	sync : ggml ... ggml-ci	2025-01-04 10:45:01 +02:00
Georgi Gerganov	2e93cb6a2f	ggml : do not install metal source when embed library (ggml/1054)	2025-01-04 10:45:01 +02:00
Georgi Gerganov	de5cd60d1c	metal : avoid uint (llama/11019)	2025-01-04 10:45:01 +02:00
Srihari-mcw	3fcba3e58b	ggml : fixes for AVXVNNI instruction set with MSVC and Clang (llama/11027) ... * Fixes for clang AVX VNNI * enable AVX VNNI and alder lake build for MSVC * Apply suggestions from code review --------- Co-authored-by: slaren <slarengh@gmail.com>	2025-01-04 10:45:01 +02:00
Jeff Bolz	cea5f1c52f	vulkan: optimize mul_mat for small values of N (llama/10991) ... Make the mul_mat_vec shaders support N>1 (as a spec constant, NUM_COLS) where the batch_strides are overloaded to hold the row strides. Put the loads from the B matrix in the innermost loop because it should cache better. Share some code for reducing the result values to memory in mul_mat_vec_base.	2025-01-04 10:45:01 +02:00
Jeff Bolz	2112462db4	vulkan: im2col and matmul optimizations for stable diffusion (llama/10942) ... * tests: Add im2col perf tests * vulkan: optimize im2col, more elements per thread * vulkan: increase small tile size for NV_coopmat2 * vulkan: change im2col to 512 elements per workgroup	2025-01-04 10:45:01 +02:00
Jeff Bolz	fc84ecd445	vulkan: Use push constant offset to handle misaligned descriptors (llama/10987)	2025-01-04 10:45:01 +02:00
Eve	8de1e99907	vulkan: multi-row k quants (llama/10846) ... * multi row k quant shaders! * better row selection * more row choices * readjust row selection * rm_kq=2 by default	2025-01-04 10:45:01 +02:00
Peter	499af9294a	examples, ggml : fix GCC compiler warnings (llama/10983) ... Warning types fixed (observed under MSYS2 GCC 14.2.0): * format '%ld' expects argument of type 'long int', but argument has type 'size_t' * llama.cpp/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp:81:46: warning: missing initializer for member '_STARTUPINFOA::lpDesktop' [-Wmissing-field-initializers] (emitted for all struct field except first)	2025-01-04 10:45:01 +02:00
Djip007	bcf937c216	ggml : more perfo with llamafile tinyblas on x86_64 (llama/10714) ... * more perfo with llamafile tinyblas on x86_64. - add bf16 suport - change dispache strategie (thanks: https://github.com/ikawrakow/ik_llama.cpp/pull/71 ) - reduce memory bandwidth simple tinyblas dispache and more cache freindly * tinyblas dynamic dispaching * sgemm: add M blocs. * - git 2.47 use short id of len 9. - show-progress is not part of GNU Wget2 * remove not stable test	2025-01-04 10:45:01 +02:00
Diego Devesa	b8d90953d7	ggml : use wstring for backend search paths (llama/10960) ... ggml-ci	2025-01-04 10:45:01 +02:00
Diego Devesa	60a422147b	ggml : fix arm enabled features check (llama/10961)	2025-01-04 10:45:01 +02:00
Diego Devesa	3387415bad	ggml : fix const usage in SSE path (llama/10962)	2025-01-04 10:45:01 +02:00
yuri@FreeBSD	536ca3ec89	ggml : fix run-time on FreeBSD in get_executable_path() (llama/10948)	2025-01-04 10:45:01 +02:00
Jeff Bolz	a4bb983190	vulkan: build fixes for 32b (llama/10927) ... * vulkan: build fixes for 32b Should fix #10923 * vulkan: initialize some buffer/offset variables	2025-01-04 10:45:01 +02:00
Jeff Bolz	39c205f555	vulkan: optimize coopmat2 dequant functions (llama/10855) ... Change the code to do 16b loads when possible and extract the appropriate component late, so the code is effectively decoding a pair of elements and then selecting one. This can allow more commoning to happen in the compiler when neighboring elements are loaded.	2025-01-04 10:45:01 +02:00
Adrien Gallouët	6d502f33dc	ggml-cpu: replace NEON asm with intrinsics in ggml_gemv_q4_0_4x8_q8_0() (llama/10874) ... * ggml-cpu: replace NEON asm with intrinsics in ggml_gemv_q4_0_4x8_q8_0() Signed-off-by: Adrien Gallouët <angt@huggingface.co> * ggml-cpu: format code Signed-off-by: Adrien Gallouët <angt@huggingface.co> --------- Signed-off-by: Adrien Gallouët <angt@huggingface.co>	2025-01-04 10:45:01 +02:00
Akarshan Biswas	5ea27d089d	SYCL: Migrate away from deprecated ggml_tensor->backend (llama/10840) ... * Migrate to tensor->buffer for checking backend buffer type: 1 * SYCL: common.cpp try to migrate away from tensor->backend * SYCL: fix assertions and add proper comments * SYCL: remove extra space * SYCL: Add back static to ggml_backend_buffer_is_sycl_split function * SYCL: Add pragma directive to suppress warning spam * SYCL: Integrate debug logs with GGML_LOG and other fixes * Revert "SYCL: Integrate debug logs with GGML_LOG and other fixes" This reverts commit 2607b7de0f0d2f4f1f690226f86fa861aa39cb97. Let's keep the current SYCL specific logging mechanism for now * SYCL: Use GGML_SYCL_DEBUG after reverting * SYCL: reg_get_proc_address func, update to the current func signature * SYCL: Refactor SYCL buffer checks in ggml_sycl_cpy_tensor_2d	2025-01-04 10:45:01 +02:00
Diego Devesa	1462d92588	ggml : add test for SVE and disable when it fails (llama/10906)	2025-01-04 10:45:01 +02:00
Adrien Gallouët	7ba1a41f47	ggml: fix arm build with gcc (llama/10895) ... Signed-off-by: Adrien Gallouët <angt@huggingface.co>	2025-01-04 10:45:01 +02:00
Diego Devesa	5ea088636f	ggml : fix arm build (llama/10890) ... * ggml: GGML_NATIVE uses -mcpu=native on ARM Signed-off-by: Adrien Gallouët <angt@huggingface.co> * ggml: Show detected features with GGML_NATIVE Signed-off-by: Adrien Gallouët <angt@huggingface.co> * remove msvc support, add GGML_CPU_ARM_ARCH option * disable llamafile in android example * march -> mcpu, skip adding feature macros ggml-ci --------- Signed-off-by: Adrien Gallouët <angt@huggingface.co> Co-authored-by: Adrien Gallouët <angt@huggingface.co>	2025-01-04 10:45:01 +02:00
Georgi Gerganov	f32ddb3b1c	tts : add OuteTTS support (llama/10784) ... * server : add "tokens" output ggml-ci * server : output embeddings for all tokens when pooling = none ggml-ci * server : be explicit about the pooling type in the tests ggml-ci * server : do not normalize embeddings when there is no pooling ggml-ci * llama : add OuteTTS support (wip) * wip * extract features * first conv * group norm * resnet conv * resnet * attn * pos net * layer norm * convnext * head * hann window * fix n_embd + remove llama.cpp hacks * compute hann window * fft * spectrum processing * clean-up * tts : receive input text and generate codes * clip : fix new conv name * tts : minor fix * tts : add header + minor fixes ggml-ci * tts : add matchematical constant ggml-ci * tts : fix sampling + cut initial noise * tts : fixes * tts : update default samplers ggml-ci * tts : text pre-processing * tts : outetts-voc -> wavtokenizer-dec * tts : remove hardcoded constants ggml-ci * tts : fix tensor shapes * llama : refactor wavtokenizer tensors ggml-ci * cont ggml-ci * cont [no ci] * llama : update WavTokenizer to non-causal attn * llama : handle no-vocab detokenization * tts : add Python example for OuteTTS (wip) * tts : extend python example to generate spectrogram ggml-ci * server : fix rebase artifacts * tts : enable "return_tokens" in Python example ggml-ci * tts : minor fixes * common : support HF download for vocoder	2025-01-04 10:45:01 +02:00
Johannes Gäßler	79b75ece03	tests: add tests for GGUF (llama/10830)	2025-01-04 10:45:01 +02:00
Daniel Bevenius	6348d73e55	ggml : improve inputs log sched_print_assignments (ggml/1053) ... This commit attempts to improve the log message for the inputs of the splits in the sched_print_assignments function. The motivation for this change is that currently even if there are no inputs a colon is displayed at the end of the line, which can make it a little confusing when reading the output as it could be interpreted as the line below are inputs when they are in fact nodes. With this change the colon will only be printed if there actually are inputs.	2025-01-04 10:45:01 +02:00
Samuel Durante	fb36a1538a	readme : fix real-time audio input example build instructions (#2692)	2025-01-02 12:05:38 +02:00
Alter	c81b8b910b	objc : rename ggml-cpu-aarch64.c to .cpp (#2687)	2025-01-02 12:05:09 +02:00
Konosuke Sakai	85b60f31d0	docs : replace Core ML with OpenVINO (#2686)	2025-01-02 12:03:02 +02:00
Georgi Gerganov	227b5ffa36	make : fix "main" -> "whisper-cli"	2024-12-31 11:46:17 +02:00
Nikolaj Olsson	36a64a253f	ci : re-enable Windows cublas build (#2676) ... * Enable Windows cublas build * Re-add v12 cuda	2024-12-31 11:11:42 +02:00
KITAITI Makoto	c84b83c370	ruby : Fix of C++ header guard name, model URI support, type signature and more (#2683) ... * Add test to make Whisper::Context.new accept URI string * Add test to make Whisper::Context.new accept URI * Make Whisper::Context.new accept URI string and URI * Update README Revert "Fix argument of rb_undefine_finalizer" * Fix typos * Add type signature file * Assign literarl to const variable * Load Whisper::Model::URI from Init_whisper * Simplify .gitignore * Don't load whisper.so from whisper/model/uri.rb * Use each_with_object instead of each * Add Development section to README * Rename header guard to conform to C++ naming convention	2024-12-30 14:26:35 +02:00
Georgi Gerganov	5136fd92c2	examples : handle "main.exe" deprecation	2024-12-30 13:00:18 +02:00
Andreas Lubbe	7d55637f0b	cli : add --suppress_nst support (#2664)	2024-12-24 09:30:07 +02:00
Andreas Lubbe	0994506054	cli : add no_speech_thold (#2663)	2024-12-24 09:29:19 +02:00
Georgi Gerganov	53c9a3a984	cmake : remove hardcoded install rpath v1.7.4-pre-1	2024-12-23 21:22:10 +02:00
Georgi Gerganov	ed09075ca0	server : fix help print	2024-12-22 15:32:05 +02:00
KITAITI Makoto	f07a81aa9f	ruby : bug fix on callbacks and no_speech_prob (#2656) ... * Don't generate documentation on test * Move .startup to TestBase class * Extract new_segment_callback as a function * Extract progress_callback as a function * Extract abort_callback as a function * Extract register_callbacks as a function * Call callbacks in Whiser::Context#full and #full_parallel * Fix README * Care about the cases content-size is nil and TTY is not available * Add tests for no_speech_prob * Add Whisper::Context#full_get_segment_no_speech_prob and Whisper::Segment#no_speech_prob	2024-12-21 21:52:06 +02:00
Sacha Arbonel	4183517076	server : add no-speech threshold parameter and functionality (#2654)	2024-12-21 17:00:08 +02:00
Georgi Gerganov	f4668169a0	whisper : rename suppress_non_speech_tokens to suppress_nst (#2653)	2024-12-21 12:54:35 +02:00
Sacha Arbonel	944ce49439	server : add option to suppress non-speech tokens (#2649) ... * The parameter will suppress non-speech tokens like [LAUGH], [SIGH], etc. from the output when enabled. * add to whisper_params_parse * add missing param	2024-12-21 12:05:05 +02:00
Georgi Gerganov	2e59dced12	whisper : rename binaries + fix install (#2648) ... * whisper : rename binaries + fix install * cont : try to fix ci * cont : fix emscripten builds v1.7.4-pre-0	2024-12-21 09:43:49 +02:00
Georgi Gerganov	e4e05981d6	ruby : update gem version to v1.3.1	2024-12-20 11:53:27 +02:00
Georgi Gerganov	3de9deead5	release : v1.7.3 v1.7.3	2024-12-18 18:12:40 +02:00
Georgi Gerganov	47f989f9b3	ci : msys enable SDL2 build (#2635)	2024-12-18 12:52:41 +02:00
KITAITI Makoto	acc4e13dee	ruby : sync ggml (#2643)	2024-12-18 12:52:16 +02:00
Georgi Gerganov	ba6c2a8fd9	android : try to fix build	2024-12-18 12:52:16 +02:00