Es spricht Deutsch | Tortoise TTS Speaking German Demo Clip | Model Download Link in Description

Channel:
Canada NanoNomad
Subscribers:
2,340
Published on ● Video Link: https://www.youtube.com/watch?v=AvK5jnOizm4


Duration: 1:36
879 views
15

A short demo clip of a German fine-tuned Tortoise TTS model speaking using @ThorstenMueller 's voice dataset

I may post a guide on how it was done, but the process is essentially the same as I went over in past videos.

Thorsten-Voice dataset:
https://github.com/thorstenMueller/Thorsten-Voice

Tortoise model checkpoints and tokenizer here: https://huggingface.co/AOLCDROM/Tortoise-TTS-de

Requires the tokenizer used in training, and code changes to disable text cleaners. At minimum, change english_cleaners to basic_cleaners.

Code changes:
modules\tortoise-tts\tortoise\utils\tokenizer.py
Change Line 201: txt = english_cleaners(txt) and replace it
with txt = basic_cleaners(txt)

modules\tortoise-tts\build\lib\tortoise\utils\tokenizer.py
Change Line 201: txt = english_cleaners(txt) and replace it
with txt = basic_cleaners(txt)

\modules\dlas\dlas\data\audio\paired_voice_audio_dataset.py
Line 133: return text_to_sequence(txt, ['english_cleaners'])
and replace it with: return text_to_sequence(txt, ['basic_cleaners'])

modules\dlas\dlas\data\audio\voice_tokenizer.py
Line 14: from dlas.models.audio.tts.tacotron2.text.cleaners import
english_cleaners
to: from dlas.models.audio.tts.tacotron2.text.cleaners import
english_cleaners, basic_cleaners
Line 85: txt = english_cleaners(txt) to txt =
basic_cleaners(txt)
Line 134: word = english_cleaners(word) to basic_cleaners(word)

Copy and paste German text into the tokenizer tester on the utilities
tab, and you should see it tokenized with all of the special
characters, and no [UNK].

Past Videos:
Tortoise TTS Text Cleaners
https://youtu.be/upNCCaWxxEA

Tortoise TTS Fine-Tuning
https://youtu.be/P3BbCG0hTwU



Other Videos By NanoNomad


2024-04-17Replacing Faulty Asus Phoenix RTX 3060 GPU Cooler - It's Easy
2024-03-21Bark TTS, Seamless Translation, RVC, Music Generation and More with the TTS Generation WebUI
2024-02-14Train Better Stable Diffusion Models | Prep Datasets Using this Free "Magic" Image Tool
2024-02-12Emulate a Sound Blaster in real MS-DOS on Modern Hardware | Retro Gaming on "Current" PCs
2024-01-28How to Play Hundreds of Point-and-Click Adventures on iOS for FREE with ScummVM with NO SIDELOADING
2024-01-18Training LoRAs and GLoRAs for Stable Diffusion 1.5 and XL Using the New Prodigy Optimizer
2024-01-03Nick Rekieta - Role Model (Voice Parody. It's silly. It's a joke.)
2023-11-19Automated Image Captioning with LLMs - Recognize Anything, BLIP-2, and Kosmos-2
2023-10-27Fine-Tuning Mistral 7B using QLoRA and PEFT on Unstructured Scraped Text Data | Making it Evil?
2023-09-20Exploring XTTS v1 and Tools to make Better Audio Datasets (the lazy way)
2023-09-01Es spricht Deutsch | Tortoise TTS Speaking German Demo Clip | Model Download Link in Description
2023-08-18AI Null reads Alice's Adventures in Wonderland by Lewis Carroll | Full Audiobook
2023-08-11Remove Background Music and Enhance Speech with Free AI Tools | Avoid ContentID
2023-08-06AI Null Reads Alice's Adventures in Wonderland by Lewis Carroll, Chapters 1 and 2 | joshcore
2023-07-30Are Text Cleaners Making Your TTS Models Sound Bad? | TTS Model Training Tips
2023-07-08.:Demo:. Tortoise TTS Expressive Speech narrating Norman Arkawy's 1955 Sci-Fi short "Selling Point"
2023-07-03.::Demo::. 4 Voice Multispeaker Tortoise TTS English Fine-Tuned Model Test :: Great Dictator Speech
2023-07-01Creepy Message about a 2003 Pandemic in China on found IBM PS/1 Pentium 66mhz PC
2023-06-28Now for Download: YourTTS (English, French, German, Spanish) Multilingual Model with 60+ Voices
2023-06-27Demo: YourTTS speaking in native French; A sampling of trained-in Voices
2023-06-27Demo: YourTTS speaking in native Spanish; A sampling of trained-in Voices


Tags:
tortoise tts
german tts
ai speech
text to speech
ai voice
voice cloning