ExternalVendorCode/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-12-22 05:57:48 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity
7f85e1d7fd
whisper.cpp/ggml-cuda
History
Carolinabanana 526332873b
llama : add Command R Plus support (llama/6491) 
* Add Command R Plus GGUF

* Add Command R Plus GGUF

* Loading works up to LayerNorm2D

* Export new tensors in 1D so they are not quantized.

* Fix embedding layer based on Noeda's example

* Whitespace

* Add line

* Fix unexpected tokens on MPS. Re-add F16 fix. ((Noeda)

* dranger003: Fix block index overflow in CUDA dequantizing.

* Reverted blocked multiplication code as it still has issues and could affect other Llama arches

* export norms as f32

* fix overflow issues during quant and other cleanup

* Type convention

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* dranger003: Fix more int overflow during quant.

---------

Co-authored-by: S <seast@Ss-Mac-Studio.local>
Co-authored-by: S <s@example.com>
Co-authored-by: slaren <slarengh@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2024-04-09 20:26:18 +03:00
..
acc.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
acc.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
alibi.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
alibi.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
arange.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
arange.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
argsort.cu ggml : mul_mat_id use the same tensor for all the experts (llama/6387) 2024-04-07 16:15:57 +03:00
argsort.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
binbcast.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
binbcast.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
clamp.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
clamp.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
common.cuh llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
concat.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
concat.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
convert.cu llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
convert.cuh llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
cpy.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
cpy.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
dequantize.cuh llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
diagmask.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
diagmask.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
dmmv.cu llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
dmmv.cuh sync : llama.cpp (skip) 2024-04-07 16:15:57 +03:00
getrows.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
getrows.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
im2col.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
im2col.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
mmq.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
mmq.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
mmvq.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
mmvq.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
norm.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
norm.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
pad.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
pad.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
pool2d.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
pool2d.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
quantize.cu llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
quantize.cuh llama : add Command R Plus support (llama/6491) 2024-04-09 20:26:18 +03:00
rope.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
rope.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
scale.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
scale.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
softmax.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
softmax.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
sumrows.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
sumrows.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
tsembd.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
tsembd.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
unary.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
unary.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
upscale.cu sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
upscale.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00
vecdotq.cuh sync : ggml (#2001) 2024-03-27 18:55:10 +02:00