Max Krasnyansky 08e8414f27 threads: improve ggml_barrier scaling with large number of threads (llama/9598) ...

Make sure n_barrier and n_barrier_passed do not share the cache line to avoid cache line bouncing.
This optimization shows performance improvements even for n_threads <= 8 cases.

Resurect TSAN (Thread Sanitizer) check so that we can avoid doing expensive read-modify-write
in the normal case and just use thread-fence as originally intended.

2024-09-24 19:45:08 +03:00

..

cmake

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

include

examples : adapt to ggml.h changes (ggml/0)

2024-09-24 19:45:08 +03:00

src

threads: improve ggml_barrier scaling with large number of threads (llama/9598)

2024-09-24 19:45:08 +03:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

cmake : do not hide GGML options + rename option (llama/9465)

2024-09-24 19:45:08 +03:00

ggml_vk_generate_shaders.py

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00