mirror of https://github.com/ggerganov/whisper.cpp.git synced 2024-11-07 16:44:13 +01:00

History

Georgi Gerganov 4a0deb8b1e talk-llama : add new example + sync ggml from llama.cpp (#664 ) * talk-llama : talk with LLaMA AI * talk.llama : disable EOS token * talk-llama : add README instructions * ggml : fix build in debug		2023-03-27 21:00:32 +03:00
..
.gitignore	talk : talk with AI in the terminal	2022-12-10 16:51:58 +02:00
CMakeLists.txt	examples : refactor in order to reuse code and reduce duplication (#482 )	2023-02-15 19:28:10 +02:00
gpt-2.cpp	examples : fix memory leak on failure to load gpt2 model (#323 )	2022-12-23 20:19:07 +02:00
gpt-2.h	talk : talk with AI in the terminal	2022-12-10 16:51:58 +02:00
README.md	models : change HF hosting from dataset to model	2023-03-22 20:44:56 +02:00
speak.sh	talk-llama : add new example + sync ggml from llama.cpp (#664 )	2023-03-27 21:00:32 +03:00
talk.cpp	examples : refactor in order to reuse code and reduce duplication (#482 )	2023-02-15 19:28:10 +02:00

README.md

talk

Talk with an Artificial Intelligence in your terminal

Demo Talk

Web version: examples/talk.wasm

Building

The talk tool depends on SDL2 library to capture audio from the microphone. You can build it like this:

# Install SDL2 on Linux
sudo apt-get install libsdl2-dev

# Install SDL2 on Mac OS
brew install sdl2

# Build the "talk" executable
make talk

# Run it
./talk -p Santa

GPT-2

To run this, you will need a ggml GPT-2 model: instructions

Alternatively, you can simply download the smallest ggml GPT-2 117M model (240 MB) like this:

wget --quiet --show-progress -O models/ggml-gpt-2-117M.bin https://huggingface.co/ggerganov/ggml/raw/main/ggml-model-gpt-2-117M.bin

TTS

For best experience, this example needs a TTS tool to convert the generated text responses to voice. You can use any TTS engine that you would like - simply edit the speak.sh script to your needs. By default, it is configured to use espeak, but you can use whatever you wish.