Merge pull request #31 from thorstenMueller/prep-thorsten-22.05
Merge new README (preparation for new TTS model release)
357
README.md
@ -1,132 +1,55 @@
|
|||||||
![Thorsten - Open German Voice Dataset](./img/ThorstenVoice_Logo_Small.png "Thorsten - Open German Voice Dataset")
|
- [Project motivation](#motivation-for-thorsten-voice-project-speaking_head-speech_balloon)
|
||||||
|
|
||||||
- [Introduction to "Thorsten-Voice" :speaking_head: :speech_balloon: :sloth:](#introduction-to-thorsten-voice-speaking_head-speech_balloon-sloth)
|
- [Personal note](#some-personal-words-before-using-thorsten-voice)
|
||||||
|
|
||||||
- [A personal note](#please-read-some-personal-words-before-using-dataset--tts-models)
|
- [**Thorsten** Voice Datasets](#voice-datasets)
|
||||||
|
- [Thorsten-21.02-neutral](#thorsten-2102-neutral)
|
||||||
|
- [Thorsten-21.06-emotional](#thorsten-2106-emotional)
|
||||||
|
- [Thorsten-22.05-neutral](#thorsten-2205-neutral)
|
||||||
|
|
||||||
- [Voice "Thorsten" (neutral)](#dataset-thorsten-neutral)
|
- [**Thorsten** TTS-Models](#tts-models)
|
||||||
- [Samples of my neutral voice](#samples-of-my-neutral-voice)
|
- [Thorsten-21.04-Tacotron2-DCA](#thorsten-2104-tacotron2-dca)
|
||||||
- [Dataset information :microphone:](#dataset-information-microphone)
|
- [Thorsten-22.05-VITS](#thorsten-2205-vits)
|
||||||
- [Dataset evolution / changelog](#dataset-evolution)
|
- [Thorsten-22.05-Tacotron2-DDC](#thorsten-2205-tacotron2-ddc)
|
||||||
- [Download information](#neutral-dataset-download-information)
|
- [Other models](#other-models)
|
||||||
|
|
||||||
- [Voice "Thorsten" (emotional)](#dataset-Thorsten-emotional)
|
|
||||||
- [Emotional dataset information and samples :microphone:](#emotional-dataset-information-and-samples-microphone)
|
|
||||||
- [Emotional dataset download information](#emotional-dataset-download-information)
|
|
||||||
|
|
||||||
- [Pretrained TTS models](#pretrained-tts-models)
|
|
||||||
- [Quick setup voice synthesizing with Coqui models](#quick-steps-for-synthesizing-voice)
|
|
||||||
- [Pre-trained Silero-models](#silero)
|
|
||||||
- [ZDisket TensorVox](#ZDisket)
|
|
||||||
|
|
||||||
- [Public talks](#public-talks)
|
- [Public talks](#public-talks)
|
||||||
|
|
||||||
- [Feel free to file an issue if you ...](#feel-free-to-file-an-issue-if-you-)
|
- [My Youtube channel](#youtube-channel)
|
||||||
- [Recommended projects / communities](#recommended-projects)
|
|
||||||
- [Special thanks](#special-thanks)
|
- [Special Thanks](#thanks-section)
|
||||||
- [Additional links](#additional-links)
|
|
||||||
|
|
||||||
|
|
||||||
# Introduction to "Thorsten-Voice" :speaking_head: :speech_balloon: :sloth:
|
# Motivation for Thorsten-Voice project :speaking_head: :speech_balloon:
|
||||||
## **A free to use, offline working, high quality german TTS voice should be available for every project without any license struggling.**
|
A **free** to use, **offline** working, **high quality** **german** **TTS** voice should be available for every project without any license struggling.
|
||||||
|
|
||||||
|
|
||||||
[![CC-0 license](https://img.shields.io/badge/License-CC--0-blue.svg)](https://creativecommons.org/licenses/by-nd/4.0)
|
|
||||||
![Maintaner](https://img.shields.io/badge/maintainer-Thorsten_Mueller-blue)
|
|
||||||
<a href="https://twitter.com/intent/follow?screen_name=ThorstenVoice">
|
|
||||||
<img src="https://img.shields.io/twitter/follow/ThorstenVoice?style=social&logo=twitter"
|
|
||||||
alt="follow on Twitter"></a>
|
|
||||||
[![Open Source](https://badges.frapsoft.com/os/v1/open-source.svg?v=103)](https://opensource.org/)
|
[![Open Source](https://badges.frapsoft.com/os/v1/open-source.svg?v=103)](https://opensource.org/)
|
||||||
[![Audio comparison page](https://img.shields.io/badge/Audio_samples-TTS_comparison-92a0c0)](https://thorstenmueller.github.io/deep-learning-german-tts/audio_compare)
|
<a href="https://twitter.com/intent/follow?screen_name=ThorstenVoice"><img src="https://img.shields.io/twitter/follow/ThorstenVoice?style=social&logo=twitter" alt="follow on Twitter"></a>
|
||||||
|
![YouTube Channel Subscribers](https://img.shields.io/youtube/channel/subscribers/UCjqqTVVBTsxpm0iOhQ1fp9g?style=social)
|
||||||
|
![Project website](https://img.shields.io/badge/Project_website-www.Thorsten--Voice.de-92a0c0)
|
||||||
|
|
||||||
My datasets are listed on Zenodo with following DOIs:
|
# Some personal words before using **Thorsten-Voice**
|
||||||
|
> I contribute my voice as a person believing in a world where all people are equal. No matter of gender, sexual orientation, religion, skin color and geocoordinates of birth location. A global world where everybody is warmly welcome on any place on this planet and open and free knowledge and education is available to everyone. :earth_africa: (*Thorsten Müller*)
|
||||||
|
|
||||||
|
Please keep in mind, that **i am no professional voice talent**. I'm just a normal guy sharing his voice with the world.
|
||||||
|
|
||||||
|
# Voice-Datasets
|
||||||
|
Voice datasets are listed on Zenodo:
|
||||||
| Dataset | DOI Link |
|
| Dataset | DOI Link |
|
||||||
| --------------- | ------- |
|
| --------------- | ------- |
|
||||||
| Thorsten (neutral) | [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525342.svg)](https://doi.org/10.5281/zenodo.5525342) |
|
| Thorsten-21.02-neutral | [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525342.svg)](https://doi.org/10.5281/zenodo.5525342) |
|
||||||
| Thorsten (emotional) | [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525023.svg)](https://doi.org/10.5281/zenodo.5525023) |
|
| Thorsten-21.06-emotional | [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525023.svg)](https://doi.org/10.5281/zenodo.5525023) |
|
||||||
|
| Thorsten-21.05-neutral | soon to come |
|
||||||
|
|
||||||
Speaking tech devices and voice based smart assistants are very popular ourdays. But for providing nice sounding TTS lot of projects depend on big tech cloud services for synthezing voice. While quality is quite good, there remain critical aspects like **privacy concerns** and **missing offline availablitiy**.
|
## Thorsten-21.02-neutral
|
||||||
|
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525342.svg)](https://doi.org/10.5281/zenodo.5525342)
|
||||||
:arrow_right: http://www.Thorsten-Voice.de
|
|
||||||
|
|
||||||
:arrow_right: https://OpenVoice-Tech.net
|
|
||||||
|
|
||||||
## True, but what is this all about
|
|
||||||
> I want to (*hopefully*) fill that german TTS gap and make the most personal contribution i can give.<br>
|
|
||||||
**I contribute my personal voice!** :green_heart:
|
|
||||||
|
|
||||||
## This contribution is split into three parts:
|
|
||||||
* "Thorsten" **neutral** dataset
|
|
||||||
* "Thorsten" **emotional** dataset
|
|
||||||
* Pretrained TTS models based on "Thorsten" dataset
|
|
||||||
|
|
||||||
# Please read some personal words before using dataset / TTS models
|
|
||||||
> I contribute my voice as a person believing in a world where all people are equal. No matter of gender, sexual orientation, religion, skin color and geocoordinates of birth location. A global world where everybody is warmly welcome on any place on this planet and open and free knowledge and education is available to everyone. :earth_africa:
|
|
||||||
|
|
||||||
**So hopefully my voice is used in this manner to make this world a better place for all of us :smiley:.**
|
|
||||||
|
|
||||||
**tl;dr** Please don't use for evil!
|
|
||||||
|
|
||||||
# Datasets
|
|
||||||
|
|
||||||
|
|
||||||
> For both datasets please keep in mind, that **i am no professional voice talent**. I'm just a normal guy sharing his voice with you.
|
|
||||||
|
|
||||||
## Dataset "Thorsten" neutral [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525342.svg)](https://doi.org/10.5281/zenodo.5525342)
|
|
||||||
|
|
||||||
### NEW RECORDING-IN-PROGRESS SNEAK PREVIEW OOPS PREHEAR :speaking_head: :construction: :microphone:
|
|
||||||
I am currently recording a new neutral dataset on a new corpus. This time with BETTER MICROPHONE, BETTER ROOM SITUATION, MORE NATURAL SPEECH FLOW right from the beginning. I've just recorded 8.000 recordings (much recording work remaining) but i share this dataset with you. Any feedback on quality, understandability or naturalness is highly appreciated and i can adjust my recording voice on furher recordings.
|
|
||||||
> https://drive.google.com/file/d/1Pqdwrv63OnPnp5TVJt1PmrcBTIEx6Zko/view?usp=sharing
|
|
||||||
|
|
||||||
### Samples of my neutral voice
|
|
||||||
To get an impression what my voice sounds to decide if it fits to your project i published some sample recordings, so no need to download complete dataset first.
|
|
||||||
|
|
||||||
* [Das Teilen eines Benutzerkontos ist strengstens untersagt.](./samples/original_recording/recorded_sample_01.wav )
|
|
||||||
* [Der Prophet spricht stets in Gleichnissen.](./samples/original_recording/recorded_sample_02.wav )
|
|
||||||
* [Bitte schmeißt euren Müll nicht einfach in die Walachei.](./samples/original_recording/recorded_sample_03.wav )
|
|
||||||
* [So etwas würde mir nie in den Sinn kommen.](./samples/original_recording/recorded_sample_04.wav )
|
|
||||||
* [Sie klettert auf einen Stein und nimmt eine Denkerpose ein.](./samples/original_recording/recorded_sample_05.wav )
|
|
||||||
* [Jede gute Küchenwaage hat eine Tara-Funktion.](./samples/original_recording/recorded_sample_06.wav )
|
|
||||||
* [Jeden Gedanken kannst du hier loswerden.](./samples/original_recording/recorded_sample_07.wav )
|
|
||||||
|
|
||||||
### Dataset information :microphone:
|
|
||||||
|
|
||||||
* ljspeech-1.1 structure
|
|
||||||
* 22.668 recorded phrases (wav files)
|
|
||||||
* more than 23 hours of pure audio
|
|
||||||
* samplerate 22.050Hz
|
|
||||||
* mono
|
|
||||||
* normalized to -24dB
|
|
||||||
* phrase length (min/avg/max): 2 / 52 / 180 chars
|
|
||||||
* no silence at beginning/ending
|
|
||||||
* avg spoken chars per second: 14
|
|
||||||
* sentences with question mark: 2.780
|
|
||||||
* sentences with exclamation mark: 1.840
|
|
||||||
|
|
||||||
![text length vs. mean audio duration](./img/thorsten-de---datasetAnalysis1.png)
|
|
||||||
![text length vs. median audio duration](./img/thorsten-de---datasetAnalysis2.png)
|
|
||||||
![text length vs. STD](./img/thorsten-de---datasetAnalysis3.png)
|
|
||||||
![text length vs. number instances](./img/thorsten-de---datasetAnalysis4.png)
|
|
||||||
![signal noise ratio](./img/thorsten-de---datasetAnalysis5.png)
|
|
||||||
![bokeh](./img/thorsten-de---datasetAnalysis6.png)
|
|
||||||
|
|
||||||
### Dataset evolution
|
|
||||||
As described in the pdf document ([evolution of thorsten dataset](./EvolutionOfThorstenDataset.pdf)) this dataset consists of three recording phases.
|
|
||||||
|
|
||||||
* **phase1**: Recorded with a cheap usb microphone
|
|
||||||
* **phase2**: Recorded with a good microphone
|
|
||||||
* **phase3**: Recorded with same good microphone but longer phrases (> 100 chars)
|
|
||||||
|
|
||||||
If you wanna use just a dataset subset (phase1 and/or phase2 and/or phase3) you can see which files belong to which recording phase in [recording quality](./RecordingQuality.csv) csv file.
|
|
||||||
|
|
||||||
|
|
||||||
### Neutral dataset download information
|
|
||||||
> Download: https://zenodo.org/record/5525342 (*2,7GB*)
|
|
||||||
|
|
||||||
```
|
```
|
||||||
@dataset{muller_thorsten_2021_5525342,
|
@dataset{muller_thorsten_2021_5525342,
|
||||||
author = {Müller, Thorsten and
|
author = {Müller, Thorsten and
|
||||||
Kreutz, Dominik},
|
Kreutz, Dominik},
|
||||||
title = {Thorsten - Open German Voice (Neutral) Dataset},
|
title = {Thorsten-Voice - "Thorsten-21.02-neutral" Dataset},
|
||||||
month = feb,
|
month = feb,
|
||||||
year = 2021,
|
year = 2021,
|
||||||
note = {{Please use it to make the world a better place for
|
note = {{Please use it to make the world a better place for
|
||||||
@ -135,44 +58,45 @@ If you wanna use just a dataset subset (phase1 and/or phase2 and/or phase3) you
|
|||||||
version = {3.0},
|
version = {3.0},
|
||||||
doi = {10.5281/zenodo.5525342},
|
doi = {10.5281/zenodo.5525342},
|
||||||
url = {https://doi.org/10.5281/zenodo.5525342}
|
url = {https://doi.org/10.5281/zenodo.5525342}
|
||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
## Dataset "Thorsten" emotional [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525023.svg)](https://doi.org/10.5281/zenodo.5525023)
|
> :speaking_head: **Listen to some audio recordings from this dataset [here](https://drive.google.com/drive/folders/1KVjGXG2ij002XRHb3fgFK4j0OEq1FsWm?usp=sharing).**
|
||||||
|
|
||||||
### Emotional dataset information and samples :microphone:
|
### Dataset summary
|
||||||
> All emotional recordings where recorded by myself and i tried to feel and pronounce that emotion even if the phrase context does not match that emotion. Example: I pronounced the sleepy recordings in the tone i have shortly before falling asleep.
|
* Recorded by Thorsten Müller
|
||||||
|
* Optimized by Dominik Kreutz
|
||||||
|
* LJSpeech file and directory structure
|
||||||
|
* 22.668 recorded phrases (*wav files*)
|
||||||
|
* More than 23 hours of pure audio
|
||||||
|
* Samplerate 22.050Hz
|
||||||
|
* Mono
|
||||||
|
* Normalized to -24dB
|
||||||
|
* Phrase length (min/avg/max): 2 / 52 / 180 chars
|
||||||
|
* No silence at beginning/ending
|
||||||
|
* Avg spoken chars per second: 14
|
||||||
|
* Sentences with question mark: 2.780
|
||||||
|
* Sentences with exclamation mark: 1.840
|
||||||
|
|
||||||
* 300 sentences * 8 emotions = 2.400 recordings
|
### Dataset evolution
|
||||||
* recorded by Thorsten Müller (optimized by Dominik Kreutz)
|
As described in the PDF document ([evolution of thorsten dataset](./EvolutionOfThorstenDataset.pdf)) this dataset consists of three recording phases.
|
||||||
* mono
|
|
||||||
* samplerate 22.050Hz
|
|
||||||
* normalized to -24dB
|
|
||||||
* no silence at beginning/ending
|
|
||||||
* sentence length: 59 - 148 chars
|
|
||||||
|
|
||||||
*Btw. i mentioned, that i'm no professional voice talent, did i?*
|
* **Phase 1**: Recorded with a cheap usb microphone (*low quality*)
|
||||||
> "Mist, wieder nichts geschafft."
|
* **Phase 2**: Recorded with a good microphone (*good quality*)
|
||||||
|
* **Phase 3**: Recorded with same good microphone but longer phrases (> 100 chars) (*good quality*)
|
||||||
|
|
||||||
| Emotion | Minutes | Sample |
|
If you want to use a dataset subset you can see which files belong to which recording phase in [recording quality](./RecordingQuality.csv) csv file.
|
||||||
|-----------|---------| --------- |
|
|
||||||
| Neutral :slightly_smiling_face: | 19 min. | [neutral sample](./samples/emotional_recording/neutral.wav) |
|
|
||||||
| Disgusted :nauseated_face: | 23 min. | [disgusted sample](./samples/emotional_recording/disgusted.wav) |
|
|
||||||
| Angry :angry: | 20 min. | [angry sample](./samples/emotional_recording/angry.wav) |
|
|
||||||
| Amused :grinning: | 18 min. | [amused sample](./samples/emotional_recording/amused.wav) |
|
|
||||||
| Surprised :astonished: | 18 min. | [surprised sample](./samples/emotional_recording/surprised.wav) |
|
|
||||||
| Sleepy :pensive: | 30 min. | [sleepy sample](./samples/emotional_recording/sleepy.wav) |
|
|
||||||
| Drunk (*i was "not" drunk while recording!*) :dizzy_face: | 25 min. | [drunk sample](./samples/emotional_recording/drunk.wav) |
|
|
||||||
| Whispering 🤫 | 22 min. | [whispering sample](./samples/emotional_recording/whisper.wav) |
|
|
||||||
|
|
||||||
### Emotional dataset download information
|
|
||||||
> Download: https://zenodo.org/record/5525023 (*size 350MB*)
|
## Thorsten-21.06-emotional
|
||||||
|
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5525023.svg)](https://doi.org/10.5281/zenodo.5525023)
|
||||||
|
|
||||||
```
|
```
|
||||||
@dataset{muller_thorsten_2021_5525023,
|
@dataset{muller_thorsten_2021_5525023,
|
||||||
author = {Müller, Thorsten and
|
author = {Müller, Thorsten and
|
||||||
Kreutz, Dominik},
|
Kreutz, Dominik},
|
||||||
title = {Thorsten - Open German Voice (Emotional) Dataset},
|
title = {{Thorsten-Voice - "Thorsten-21.06-emotional"
|
||||||
|
Dataset}},
|
||||||
month = jun,
|
month = jun,
|
||||||
year = 2021,
|
year = 2021,
|
||||||
note = {{Please use it to make the world a better place for
|
note = {{Please use it to make the world a better place for
|
||||||
@ -184,100 +108,107 @@ If you wanna use just a dataset subset (phase1 and/or phase2 and/or phase3) you
|
|||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
# Pretrained TTS models
|
All emotional recordings where recorded by myself and i tried to feel and pronounce that emotion even if the phrase context does not match that emotion. Example: I pronounced the sleepy recordings in the tone i have shortly before falling asleep.
|
||||||
If you trained a model on "Thorsten" dataset please file an issue with some information on it. Sharing a trained model is highly appreciated.
|
|
||||||
|
|
||||||
My personal training sessions are based on TTS repo code (originally initiated by Mozilla) and now maintained through https://www.coqui.ai (:frog:)
|
### Samples
|
||||||
## Coqui models
|
Listen to the phrase "**Mist, wieder nichts geschafft.**" in following emotions.
|
||||||
|
|
||||||
### Quick steps for synthesizing voice
|
* :slightly_smiling_face: [Neutral](./samples/thorsten-21.06-emotional/neutral.wav)
|
||||||
For all "Thorsten" coqui models i recommend setting up a virtual environment (*venv*).
|
* :nauseated_face: [Disgusted](./samples/thorsten-21.06-emotional/disgusted.wav)
|
||||||
> Python 3.6 - 3.9 required
|
* :angry: [Angry](./samples/thorsten-21.06-emotional/angry.wav)
|
||||||
* mkdir ThorstenVoice
|
* :grinning: [Amused](./samples/thorsten-21.06-emotional/amused.wav)
|
||||||
* cd ThorstenVoice
|
* :astonished: [Surprised](./samples/thorsten-21.06-emotional/surprised.wav)
|
||||||
* python3 -m venv .
|
* :pensive: [Sleepy](./samples/thorsten-21.06-emotional/sleepy.wav)
|
||||||
* source ./bin/activate
|
* :dizzy_face: [Drunk](./samples/thorsten-21.06-emotional/drunk.wav)
|
||||||
* pip install -U pip TTS
|
* 🤫 [Whispering](./samples/thorsten-21.06-emotional/whisper.wav)
|
||||||
|
### Dataset summary
|
||||||
|
* Recorded by Thorsten Müller
|
||||||
|
* Optimized by Dominik Kreutz
|
||||||
|
* 300 sentences * 8 emotions = 2.400 recordings
|
||||||
|
* Mono
|
||||||
|
* Samplerate 22.050Hz
|
||||||
|
* Normalized to -24dB
|
||||||
|
* No silence at beginning/ending
|
||||||
|
* Sentence length: 59 - 148 chars
|
||||||
|
|
||||||
|
|
||||||
|
## Thorsten-22.05-neutral
|
||||||
|
> :speaking_head: **Listen to some audio recordings from this dataset [here](https://drive.google.com/drive/folders/1dxoSo8Ktmh-5E0rSVqkq_Jm1r4sFnwJM?usp=sharing).**
|
||||||
|
|
||||||
|
Soon to come
|
||||||
|
|
||||||
|
# TTS Models
|
||||||
|
|
||||||
|
## Thorsten-21.04-Tacotron2-DCA
|
||||||
|
This [TTS-model](https://drive.google.com/drive/folders/1m4RuffbvdOmQWnmy_Hmw0cZ_q0hj2o8B?usp=sharing) has been trained on [**Thorsten-21.02-neutral**](#thorsten-2102-neutral) dataset. The recommended trained Fullband-MelGAN Vocoder can be downloaded [here](https://drive.google.com/drive/folders/1hsfaconm4Yd9wPVyOtrXjWQs4ZAPoouY?usp=sharing).
|
||||||
|
|
||||||
|
Run the model:
|
||||||
|
* pip install TTS==0.5.0
|
||||||
* tts-server --model_name tts_models/de/thorsten/tacotron2-DCA
|
* tts-server --model_name tts_models/de/thorsten/tacotron2-DCA
|
||||||
* Open web-browser on http://localhost:5002
|
|
||||||
|
|
||||||
Details: https://github.com/coqui-ai/TTS/releases/tag/v0.0.11 or https://github.com/coqui-ai/TTS/releases/tag/v0.1.3
|
|
||||||
|
|
||||||
![Coqui web interface ](./img/CoquiWebThorstenVoice.png)
|
## Thorsten-22.05-VITS
|
||||||
|
Trained on dataset **Thorsten-22.05-neutral**.
|
||||||
|
> TODO
|
||||||
|
|
||||||
Instead of web frontend you can call it by cli.
|
## Thorsten-22.05-Tacotron2-DDC
|
||||||
> curl http://localhost:5002/api/tts?text=TEXT --output test.wav
|
Trained on dataset [**Thorsten-22.05-neutral**](#thorsten-2205-neutral).
|
||||||
### Download Coqui trained checkpoints / config
|
> :speaking_head: **Listen to synthesized samples [here](https://drive.google.com/drive/folders/1cZlLYkLWKtF0cZQ74Pef8fJ8fiG1G7du?usp=sharing).**
|
||||||
| Model name | Coqui Repo branch / commit | Release date | Google Drive Download Link |
|
|
||||||
|----------------------------------|---------------------------------------------------|----------------------|--------------------------------------------------------------------------------------|
|
|
||||||
| Thorsten Tacotron2 DCA | master / 0ee3eeefb553678d56c49534f3972a426a254649 | 2021-04-02 | [Google Drive Thorsten Taco2 DCA](https://drive.google.com/drive/folders/1m4RuffbvdOmQWnmy_Hmw0cZ_q0hj2o8B?usp=sharing) |
|
|
||||||
| Thorsten Vocoder WaveGrad | master / 0ee3eeefb553678d56c49534f3972a426a254649 | 2021-04-02 | [Google Drive Thorsten Vocoder WaveGrad](https://drive.google.com/drive/folders/1uOWpYH3yoDv5_3Dn_aDbAprEmyk1tDw5?usp=sharing) |
|
|
||||||
| Thorsten Vocoder Fullband-MelGAN | master / 0ee3eeefb553678d56c49534f3972a426a254649 | 2021-07-26 | [Google Drive Thorsten Vocoder Fullband-MelGAN](https://drive.google.com/drive/folders/1hsfaconm4Yd9wPVyOtrXjWQs4ZAPoouY?usp=sharing) or [Coqui v0.1.3 model download](https://github.com/coqui-ai/TTS/releases/tag/v0.1.3) |
|
|
||||||
| Thorsten Vocoder HifiGAN | | planned | planned |
|
|
||||||
| Thorsten Vocoder WaveRNN | | planned | planned |
|
|
||||||
|
|
||||||
## Silero
|
Soon to come.
|
||||||
|
|
||||||
You can use a free A-GPL licensed models trained on this dataset via the [silero-models](https://github.com/snakers4/silero-models) project. The full list of models including their older version is available via this [yaml file](https://github.com/snakers4/silero-models/blob/master/models.yml).
|
|
||||||
|
|
||||||
| Speaker | Gender | Language | Examples | Colab |
|
## Other models
|
||||||
| -------------- | ------ | -------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
### Silero
|
||||||
| thorsten_8khz | m | de | [8000](https://drive.google.com/drive/folders/1mpQCK5E_IqhcSurnYuGePJiJWL4ZL08z?usp=sharing) / [16000](https://drive.google.com/drive/folders/1tR6w4kgRS2JJ1TWZhwoFuU04Xkgo6YAs?usp=sharing) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/snakers4/silero-models/blob/master/examples_tts.ipynb) |
|
|
||||||
| thorsten_16khz | m | de | [8000](https://drive.google.com/drive/folders/1mpQCK5E_IqhcSurnYuGePJiJWL4ZL08z?usp=sharing) / [16000](https://drive.google.com/drive/folders/1tR6w4kgRS2JJ1TWZhwoFuU04Xkgo6YAs?usp=sharing) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/snakers4/silero-models/blob/master/examples_tts.ipynb) |
|
You can use a free A-GPL licensed models trained on **Thorsten-21.02-neutral** dataset via the [silero-models](https://github.com/snakers4/silero-models/blob/master/models.yml) project.
|
||||||
|
|
||||||
|
* [Thorsten 16kHz](https://drive.google.com/drive/folders/1tR6w4kgRS2JJ1TWZhwoFuU04Xkgo6YAs?usp=sharing)
|
||||||
|
* [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/snakers4/silero-models/blob/master/examples_tts.ipynb)
|
||||||
|
|
||||||
|
### ZDisket
|
||||||
|
[ZDisket](https://github.com/ZDisket/TensorVox) made a tool called TensorVox for setting up an TTS environment on Windows and included a german TTS model trained by [monatis](https://github.com/monatis/german-tts). Thanks for sharing that :thumbsup:. See it in action on [Youtube](https://youtu.be/tY6_xZnkv-A).
|
||||||
|
|
||||||
## ZDisket
|
|
||||||
[ZDisket](https://github.com/ZDisket/) made a tool called [TensorVox](https://github.com/ZDisket/TensorVox) for setting up an TTS environment on Windows easily and included the german TTS model trained by [monatis](https://github.com/monatis/german-tts). Thanks for sharing that :thumbsup:. You can find more details on how to set up [here](https://github.com/ZDisket/TensorVox) or see it live in action on [Youtube](https://youtu.be/tY6_xZnkv-A).
|
|
||||||
# Public talks
|
# Public talks
|
||||||
> I really want to bring the topic "OpenVoice" to a bigger public attention, so i am happy to be invited as a speaker on that.
|
I really want to bring the topic "**Open Voice For An Open Future**" to a bigger public attention.
|
||||||
|
|
||||||
|
* I've been part of a Linux User Group podcast about Mycroft AI and talked on my TTS efforts on that in (*May 2021*).
|
||||||
|
* I was invited by [Yusuf](https://github.com/monatis/) from Turkish tensorflow community to talk on "How to make machines speak with your own voice". This talk has been streamed live on Youtube and is available [here](https://www.youtube.com/watch?v=m-Uwb-Bg144&t=2303s). If you're interested on the showed slides, feel free to download my presentation [here](https://docs.google.com/presentation/d/1ynnw0ilKV3WwMSJHytrN3GXRiFr8x3r0DUimBm1y0LI/edit?usp=sharing) (*June 2021*)
|
||||||
|
)
|
||||||
|
* I've been invited as speaker on VoiceLunch language & linguistics on 03.01.2022. [Here are my slides](https://docs.google.com/presentation/d/1Gi6BmYHs7g4ZgdAiIKGBnBwZDCvJOD9DJxQOGlgds1o/edit?usp=sharing) (*January 2022*).
|
||||||
|
|
||||||
|
# Youtube channel
|
||||||
|
In summer 2021 i've started to share my lessons learned and experiences on open voice tech, in special **TTS** on my little [Youtube channel](https://www.youtube.com/c/ThorstenMueller). If you check out and like my videos i'd happy to welcome you as subscriber and member of my little Youtube community.
|
||||||
|
|
||||||
* I have been part of a Linux User Group podcast about Mycroft AI and talked on my TTS efforts on that in May 2021. I'll publish a link to that talk when it's released to the public.
|
|
||||||
* In addition to that i was invited by [Yusuf](https://github.com/monatis/) from Turkish tensorflow community to talk on "How to make machines speak with your own voice" on june 2nd, 2021. This talk has been streamed live on Youtube and is available [here](https://www.youtube.com/watch?v=m-Uwb-Bg144&t=2303s). If you're interested on the showed slides, feel free to download my presentation [here](https://docs.google.com/presentation/d/1ynnw0ilKV3WwMSJHytrN3GXRiFr8x3r0DUimBm1y0LI/edit?usp=sharing)
|
|
||||||
* Whenever i've something about open voice in mind what i like to share my thoughts on i post a video on [Youtube](https://www.youtube.com/c/ThorstenMueller).
|
|
||||||
* I've been invited as speaker on VoiceLunch language & linguistics on 03.01.2022. [Here are my slides](https://docs.google.com/presentation/d/1Gi6BmYHs7g4ZgdAiIKGBnBwZDCvJOD9DJxQOGlgds1o/edit?usp=sharing).
|
|
||||||
|
|
||||||
# Feel free to file an issue if you ...
|
# Feel free to file an issue if you ...
|
||||||
* have improvements on dataset
|
* Use my TTS voice in your project(s)
|
||||||
* use my TTS voice in your project(s)
|
* Want to share your trained "Thorsten" model
|
||||||
* want to share your trained "Thorsten" model
|
* Get to know about any abuse usage of my voice
|
||||||
* get to know about any abuse usage of my voice
|
|
||||||
|
|
||||||
# Recommended projects
|
# Thanks section
|
||||||
* https://mycroft.ai/ (*for building an opensource privacy friendly voice assistant*)
|
## Cool projects
|
||||||
* https://www.mozilla.org (*for initiating voice projects for STT and TTS*)
|
* https://commonvoice.mozilla.org/
|
||||||
* https://coqui.ai/ (*for keeping voice projects running*)
|
* https://coqui.ai/
|
||||||
* https://github.com/coqui-ai/TTS
|
* https://mycroft.ai/
|
||||||
* https://github.com/TensorSpeech/TensorFlowTTS
|
* https://github.com/rhasspy/
|
||||||
* https://github.com/rhasspy/de_larynx-thorsten
|
|
||||||
|
|
||||||
# Special thanks
|
## Cool people
|
||||||
I want to thank all open source communities for providing great projects.
|
* [El-Tocino](https://github.com/el-tocino/)
|
||||||
|
* [Eren Gölge](https://github.com/erogol/)
|
||||||
Just to name some nice guys who joined me on this TTS roadtrip:
|
* [Gras64](https://github.com/gras64/)
|
||||||
|
* [Kris Gesling](https://github.com/krisgesling/)
|
||||||
* eltocino (https://github.com/el-tocino/)
|
* [Nmstoker](https://github.com/nmstoker)
|
||||||
* erogol (https://github.com/erogol/)
|
* [Othiele](https://discourse.mozilla.org/u/othiele/summary)
|
||||||
* gras64 (https://github.com/gras64/)
|
* [Repodiac](https://github.com/repodiac)
|
||||||
* krisgesling (https://github.com/krisgesling/)
|
* [SanjaESC](https://github.com/SanjaESC)
|
||||||
* nmstoker (https://github.com/nmstoker)
|
* [Synesthesiam](https://github.com/synesthesiam/)
|
||||||
* othiele (https://discourse.mozilla.org/u/othiele/summary)
|
|
||||||
* repodiac (https://github.com/repodiac)
|
|
||||||
* SanjaESC (https://github.com/SanjaESC)
|
|
||||||
|
|
||||||
|
## Even more special people
|
||||||
Additionally, a really nice thanks for my dear colleague, Sebastian Kraus, for supporting me with audio recording equipment and for being the creative mastermind behind the logo design.
|
Additionally, a really nice thanks for my dear colleague, Sebastian Kraus, for supporting me with audio recording equipment and for being the creative mastermind behind the logo design.
|
||||||
|
|
||||||
And last but not least i want to say a huge thank you to a special guy who supported me on this journey right from the beginning. Not just with nice words, but with his time, audio optimization knowhow and finally his gpu computing power.
|
And last but not least i want to say a **huge, huge thank you** to a special guy who supported me on this journey as a partner right from the beginning. Not just with nice words, but with his time, audio optimization knowhow and finally GPU power.
|
||||||
|
|
||||||
Without his amazing support this dataset (in it's current way) would not exists.
|
**Thank you so much, dear **Dominik** ([@domcross](https://github.com/domcross/)) for being my partner on this journey.**
|
||||||
|
|
||||||
Thank you Dominik (@domcross / https://github.com/domcross/)
|
Thorsten (*Twitter: @ThorstenVoice*)
|
||||||
|
|
||||||
# Additional links
|
|
||||||
* https://medium.com/@thorsten_Mueller/why-ive-chosen-to-donate-my-german-voice-for-mankind-177beeb91675
|
|
||||||
* https://discourse.mozilla.org/t/contributing-my-german-voice-for-tts/48150
|
|
||||||
* https://community.mycroft.ai/
|
|
||||||
* https://github.com/MycroftAI/mimic-recording-studio
|
|
||||||
|
|
||||||
We'll hear us in future :speaking_head:
|
|
||||||
|
|
||||||
Thorsten
|
|
||||||
(https://twitter.com/ThorstenVoice)
|
|
||||||
|
Before Width: | Height: | Size: 126 KiB |
Before Width: | Height: | Size: 640 KiB |
Before Width: | Height: | Size: 148 KiB |
Before Width: | Height: | Size: 352 KiB |
Before Width: | Height: | Size: 8.2 KiB |
Before Width: | Height: | Size: 8.5 KiB |
Before Width: | Height: | Size: 11 KiB |
Before Width: | Height: | Size: 9.6 KiB |
Before Width: | Height: | Size: 3.9 KiB |
Before Width: | Height: | Size: 31 KiB |