Georgi Gerganov f3ee4a9673 whisper : reduce memory usage during inference (#431) ...

* ggml : add "scratch" buffer support

* ggml : support for scratch ring-buffer

* ggml : bug fix in ggml_repeat()

* ggml : error on scratch buffer overflow

* whisper : use scratch buffers during inference (base model only)

* whisper : update memory usage for all models

* whisper : fix encoder memory usage

* whisper : use whisper_context functions instead of macros

* whisper : fix FF + remove it from README

* ggml : reuse ggml_new_i32

* ggml : refactor the scratch buffer storage

* whisper : reorder scratch buffers in the decoder

* main : add option to disable temp fallback

* Update README.md

2023-02-04 09:45:52 +02:00

..

addon.node

addon.node : using whisper as a Node.js addon (#443)

2023-02-04 09:10:25 +02:00

bench

bench : fix Windows linkage by moving ggml benches in whisper lib ..

2023-01-18 21:19:50 +02:00

bench.wasm

bench.wasm : print system info

2023-01-15 11:34:03 +02:00

command

Improve decoding (#291)

2023-01-15 11:29:57 +02:00

command.wasm

whisper : add loader class to allow loading from buffer and others (#353)

2023-01-08 13:03:33 +02:00

main

whisper : reduce memory usage during inference (#431)

2023-02-04 09:45:52 +02:00

stream

stream : fix handling of --step == --length (#416)

2023-01-18 21:22:52 +02:00

stream.wasm

Improve decoding (#291)

2023-01-15 11:29:57 +02:00

talk

whisper : add loader class to allow loading from buffer and others (#353)

2023-01-08 13:03:33 +02:00

talk.wasm

whisper : add loader class to allow loading from buffer and others (#353)

2023-01-08 13:03:33 +02:00

whisper.android

whisper.android : add support for loading directly from asset in C (#415)

2023-01-16 21:57:35 +02:00

whisper.nvim

Update README.md

2022-11-04 22:26:08 +02:00

whisper.objc

whisper : add loader class to allow loading from buffer and others (#353)

2023-01-08 13:03:33 +02:00

whisper.swiftui

Update README.md

2023-01-15 14:08:12 +02:00

whisper.wasm

whisper.wasm : add labels for easier radio selection (#435)

2023-01-23 20:49:00 +02:00

CMakeLists.txt

addon.node : using whisper as a Node.js addon (#443)

2023-02-04 09:10:25 +02:00

dr_wav.h

refactoring : move main + stream in examples + other stuff

2022-10-25 20:53:48 +03:00

generate-karaoke.sh

minor : add comment for using "generate_karaoke.sh"

2022-11-26 10:22:42 +02:00

helpers.js

wasm : fix typo in helper.js (#459)

2023-02-04 08:49:15 +02:00

livestream.sh

livestream.sh : run main with model arg instead of default (#453)

2023-01-27 01:13:31 +02:00

twitch.sh

twitch.sh : various fixes and polishing

2022-12-08 19:20:04 +02:00

yt-wsp.sh

yt-wsp.sh : improve usage instructions

2022-12-07 22:12:08 +02:00