extern/whisper.cpp
1
0
Fork 1
mirror of https://github.com/ggerganov/whisper.cpp.git synced 2025-06-30 06:20:07 +02:00
Code Issues Packages Projects Releases Wiki Activity

talk.wasm : polishing + adding many AI personalities

Browse Source
This commit is contained in:
Georgi Gerganov
2022-11-22 20:10:20 +02:00
parent 385236d1d3
commit 9aea96f774
4 changed files with 383 additions and 48 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
examples/talk.wasm/README.md
View File

@ -31,6 +31,15 @@ In order to run this demo efficiently, you need to have the following:
- Speak phrases that are no longer than 10 seconds - this is the audio context of the AI
- The web-page uses about 1.4GB of RAM
Notice that this demo is using the smallest GPT-2 model, so the generated text responses are not always very good.
Also, the prompting strategy can likely be improved to achieve better results.
The demo is quite computationally heavy - it's not usual to run these transformer models in a browser. Typically, they
run on powerful GPU hardware. So for better experience, you do need to have a powerful computer.
Probably in the near future, mobile browsers will start to support the WASM SIMD capabilities and this will allow
to run the demo on your phone or tablet. But for now it seems to be not supported (at least on iPhone).
## Feedback
If you have any comments or ideas for improvement, please drop a comment in the following discussion: