extern/whisper.cpp
1
0
Fork 1
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-08-12 16:38:07 +02:00
Code Issues Packages Projects Releases Wiki Activity

Update Vulkan RoPE implementation (llama/7818)

Browse Source 
* Update Vulkan RoPE implementation

* Return nullptr on alloc_buffer when allocation fails, instead of throwing an exception

Minor fixes

* Fix segfault when running out of VRAM

Co-authored-by: slaren <slarengh@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>
This commit is contained in:
0cc4m
2024-06-11 21:20:29 +02:00
committed by Georgi Gerganov
parent a99e213a82
commit f100b3b523
2 changed files with 35 additions and 60 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ggml-alloc.c
View File

@ -886,7 +886,7 @@ static bool alloc_tensor_range(struct ggml_context * ctx,
fprintf(stderr, "%s: failed to allocate %s buffer of size %zu\n", __func__, ggml_backend_buft_name(buft), size);
#endif
for (size_t i = 0; i < *n_buffers; i++) {
ggml_backend_buffer_free(*buffers[i]);
ggml_backend_buffer_free((*buffers)[i]);
}
free(*buffers);
return false;