Georgi Gerganov f3ee4a9673 whisper : reduce memory usage during inference (#431) ... * ggml : add "scratch" buffer support * ggml : support for scratch ring-buffer * ggml : bug fix in ggml_repeat() * ggml : error on scratch buffer overflow * whisper : use scratch buffers during inference (base model only) * whisper : update memory usage for all models * whisper : fix encoder memory usage * whisper : use whisper_context functions instead of macros * whisper : fix FF + remove it from README * ggml : reuse ggml_new_i32 * ggml : refactor the scratch buffer storage * whisper : reorder scratch buffers in the decoder * main : add option to disable temp fallback * Update README.md		2023-02-04 09:45:52 +02:00
..
go	go : support "auto" as an option when set language (#462)	2023-02-04 09:09:27 +02:00
ios@9653b42eb4	release : v1.1.1	2023-01-23 20:23:44 +02:00
javascript	whisper : reduce memory usage during inference (#431)	2023-02-04 09:45:52 +02:00
CMakeLists.txt	Node.js package (#260)	2022-12-12 20:17:27 +02:00