Markus Tavenrath 488a966c07 Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (llama/8943) ... * Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. - Allocation overhead for the temporary std::vectors was easily detectable with a sampling profiler and simple to remove. - ggml_vk_sync_buffer introduce a full pipeline sync which has a significant cost on the GPU side, sometimes larger than the actual kernel execution. Adding only barriers for shader read/writes and transfers seems to be sufficient looking at the code which either launches compute kernels or copies tensors. * Fix small typo --------- Co-authored-by: 0cc4m <picard12@live.de>		2024-08-28 13:22:20 +03:00
..
cmake	whisper : reorganize source code + improve CMake (#2256)	2024-06-26 19:34:09 +03:00
include	feat: ref. cross entropy, add CUDA, fix grad test (ggml/929)	2024-08-28 13:22:20 +03:00
src	Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (llama/8943)	2024-08-28 13:22:20 +03:00
.gitignore	whisper : reorganize source code + improve CMake (#2256)	2024-06-26 19:34:09 +03:00
CMakeLists.txt	cann: update cmake (llama/8765)	2024-08-08 22:48:46 +03:00
ggml_vk_generate_shaders.py	whisper : reorganize source code + improve CMake (#2256)	2024-06-26 19:34:09 +03:00