Jeroen Mostert 86506b0c5c Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629) ...

The check gating the use of `__builtin_amdgc_sdot4` specifically checks for gfx1030. This causes a severe perf regression for anything gfx103? that's not gfx1030 and not using `HSA_OVERRIDE_GFX_VERSION` (if you've built ROCm to support it). We already have a generic RDNA2 define, let's use it.

2024-08-08 22:48:46 +03:00

..

template-instances

CUDA: MMQ code deduplication + iquant support (llama/8495)

2024-08-08 22:48:46 +03:00

acc.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

acc.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

arange.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

arange.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

argsort.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

argsort.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

binbcast.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

binbcast.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

clamp.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

clamp.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

common.cuh

Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629)

2024-08-08 22:48:46 +03:00

concat.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

concat.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

conv-transpose-1d.cu

feat: cuda implementation for ggml_conv_transpose_1d (ggml/854)

2024-07-08 14:53:55 +03:00

conv-transpose-1d.cuh

feat: cuda implementation for ggml_conv_transpose_1d (ggml/854)

2024-07-08 14:53:55 +03:00

convert.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

convert.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

cpy.cu

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (llama/8258)

2024-07-08 14:53:55 +03:00

cpy.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

dequantize.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

diagmask.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

diagmask.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

dmmv.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

dmmv.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-common.cuh

CUDA: MMQ support for iq4_nl, iq4_xs (llama/8278)

2024-07-08 14:53:55 +03:00

fattn-tile-f16.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-tile-f16.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-tile-f32.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-tile-f32.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-vec-f16.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-vec-f32.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn-wmma-f16.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

fattn.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

getrows.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

getrows.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

im2col.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

im2col.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

mma.cuh

CUDA: optimize and refactor MMQ (llama/8416)

2024-08-08 22:48:46 +03:00

mmq.cu

CUDA: MMQ code deduplication + iquant support (llama/8495)

2024-08-08 22:48:46 +03:00

mmq.cuh

CUDA: MMQ code deduplication + iquant support (llama/8495)

2024-08-08 22:48:46 +03:00

mmvq.cu

CUDA: refactor and optimize IQ MMVQ (llama/8215)

2024-07-08 14:53:55 +03:00

mmvq.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

norm.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

norm.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

pad.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

pad.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

pool2d.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

pool2d.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

quantize.cu

CUDA: optimize and refactor MMQ (llama/8416)

2024-08-08 22:48:46 +03:00

quantize.cuh

CUDA: optimize and refactor MMQ (llama/8416)

2024-08-08 22:48:46 +03:00

rope.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

rope.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

scale.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

scale.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

softmax.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

softmax.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

sumrows.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

sumrows.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

tsembd.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

tsembd.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

unary.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

unary.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

upscale.cu

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

upscale.cuh

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

vecdotq.cuh

CUDA: MMQ code deduplication + iquant support (llama/8495)

2024-08-08 22:48:46 +03:00