Tortoise TTS Fine Tuning Wrap-Up

Channel:
Canada NanoNomad
Subscribers:
2,810
Published on ● Video Link: https://www.youtube.com/watch?v=P3BbCG0hTwU


Duration: 9:22
1,673 views
26

A quick video summarizing some of my experiences fine tuning Tortoise TTS over the past few weeks. I'm also trying to learn my way around Premiere a little better, so playing with some silly visual things.

Fine Tuning Tortoise TTS for Faster Generation
https://www.youtube.com/watch?v=Fzah3eJabOY&feature=youtu.be

Fine Tuning in Other European Languages w/ Custom Tokenizer
https://www.youtube.com/watch?v=o7QRbMvFPzs

Fine tuning Tortoise TTS using the AI Voice Cloning WebUI
WebUI Github https://git.ecker.tech/mrq/ai-voice-cloning

Download one of my fine-tuned Tortoise TTS models here:
Base model here: https://huggingface.co/AOLCDROM/Tortoise-TTS-MSFT-VCTK-4V-En
Requires custom tokenizer file, pt-t.json (put in ./models/tokenizers, switch tokenizer in settings menu)

See comments here re: multispeaker training issues:
https://www.youtube.com/watch?v=o7QRbMvFPzs&lc=UgyOF0mO3Xfn0zqAr4p4AaABAg

https://git.ecker.tech/mrq/ai-voice-cloning/issues/237



Other Videos By NanoNomad


2023-06-28Now for Download: YourTTS (English, French, German, Spanish) Multilingual Model with 60+ Voices
2023-06-27Demo: YourTTS speaking in native French; A sampling of trained-in Voices
2023-06-27Demo: YourTTS speaking in native Spanish; A sampling of trained-in Voices
2023-06-27Demo: YourTTS speaking in native German; A sampling of trained-in Voices
2023-06-27Demo: YourTTS speaking Norman Arkawy's 1955 Sci-Fi Story 'Selling Point'. Info in description.
2023-06-14Running 13B and 30B LLMs at Home with KoboldCPP, AutoGPTQ, LLaMA.CPP/GGML
2023-06-08Demo and Download: YourTTS Multi-accent, English/Spanish Multi-Voice Model 600k Checkpoint
2023-06-05DEMO: YourTTS - One Voice, Many Accents. A single speaker can generate multiple accents.
2023-06-04Revisiting YourTTS - Details about Training, Datasets, and experiences Voice Cloning with Coqui TTS
2023-06-03DEMO: YourTTS Multi-speaker VCTK Irish-accented Dataset after 275k Steps trained using Coqui TTS
2023-05-22Tortoise TTS Fine Tuning Wrap-Up
2023-05-16Tortoise TTS DEMO: G-Man performs Gilbert and Sullivan's 'The Major-General's Song'
2023-05-15Train Tortoise TTS in English, Spanish, French, Italian, Portuguese, German, and more? Maybe?
2023-05-10DEMO: Testing French-Speaking Tortoise TTS
2023-05-10DEMO: Testing German-Speaking Tortoise TTS
2023-05-08DEMO: Testing Spanish Speaking Tortoise TTS
2023-05-07DEMO: Testing Tortoise TTS Speaking in Portuguese
2023-05-04Make Using Tortoise TTS Faster with Fine-Tuned Models
2023-05-01AI Voice Swap and Lip Sync using Wav2Lip-HQ-Updated
2023-04-22Voice Cloning with Tortoise TTS and Model Training Using the AI Voice Cloning WebUI
2023-04-07Locally Hosted Chatbots with RWKV through ChatRWKV and the Text-Generation-WebUI | 14B Model on 3GB!


Tags:
Tortoise TTS
Voice Cloning
AI Voice
Artificial Intelligence
Machine Learning
TTS
text to speech