Georgi Gerganov d0b8335789 metal : optimize FA kernels (llama/10171) ...

* ggml : add ggml_flash_attn_ext_get_prec

* metal : use F16 precision in FA kernels

ggml-ci

* metal : minor clean-up

* metal : compile-guard bf16 FA kernels

ggml-ci

* build : remove obsolete compile flag [no ci]

* metal : prevent int overflows [no ci]

* cuda : disable BF16 FA

ggml-ci

* metal : fix BF16 requirement for FA kernels

ggml-ci

* make : clean-up [no ci]

2024-11-15 15:21:04 +02:00

..

ggml-alloc.h

ggml : fix typo in example usage ggml_gallocr_new (ggml/984)

2024-10-05 15:23:51 +03:00

ggml-amx.h

ggml : add AMX backend (llama/8998)

2024-11-01 10:19:05 +02:00

ggml-backend.h

ggml : move CPU backend to a separate file (llama/10144)

2024-11-15 15:21:04 +02:00

ggml-blas.h

ggml : add backend registry / device interfaces to BLAS backend (llama/9752)

2024-11-01 10:19:05 +02:00

ggml-cann.h

Adapt to dynamically loadable backends mechanism (llama/9970)

2024-11-01 10:19:05 +02:00

ggml-cpp.h

llama : use smart pointers for ggml resources (llama/10117)

2024-11-15 15:21:04 +02:00

ggml-cpu.h

ggml : move CPU backend to a separate file (llama/10144)

2024-11-15 15:21:04 +02:00

ggml-cuda.h

llama : refactor model loader with backend registry (llama/10026)

2024-11-15 15:21:04 +02:00

ggml-kompute.h

kompute: add backend registry / device interfaces (llama/10045)

2024-11-15 15:21:04 +02:00

ggml-metal.h

ggml : add metal backend registry / device (llama/9713)

2024-11-01 10:19:05 +02:00

ggml-rpc.h

rpc : add backend registry / device interfaces (llama/9812)

2024-11-01 10:19:05 +02:00

ggml-sycl.h

Add SYCL Backend registry, device and Event Interfaces (llama/9705)

2024-11-01 10:19:05 +02:00

ggml-vulkan.h

vulkan : add backend registry / device interfaces (llama/9721)

2024-11-01 10:19:05 +02:00

ggml.h

metal : optimize FA kernels (llama/10171)

2024-11-15 15:21:04 +02:00