Make Using Tortoise TTS Faster with Fine-Tuned Models

Channel:
Canada NanoNomad
Subscribers:
2,860
Published on ● Video Link: https://www.youtube.com/watch?v=Fzah3eJabOY


Duration: 11:18
5,906 views
102

I've been fine tuning a bunch of Tortoise TTS voices, and found that after a model is trained to a voice, you can lower the sample rate and adjust generation parameters to get equivalent or better sounding output than even the Ultra Fast preset.
Experimental fine tuning in other European languages: https://youtu.be/o7QRbMvFPzs

Timestamps:
Talking about samples: https://youtu.be/Fzah3eJabOY?t=152
Fine-Tuning: https://youtu.be/Fzah3eJabOY?t=333
Generating: https://youtu.be/Fzah3eJabOY?t=523

Tortoise TTS video: https://youtu.be/snz-VzgGgmA
AI Lip Sync video: https://youtu.be/fJOeaAKo09o

DeepFilter: https://github.com/Rikorose/DeepFilterNet
MakeMKV: https://www.makemkv.com/
Ultimate Vocal Remover (demucs and other models for Windows): https://github.com/Anjok07/ultimatevocalremovergui
WaveShop (fast .wav editor for Windows): https://waveshop.sourceforge.net/

Download one of my fine-tuned Tortoise TTS models here:
Base model here: https://huggingface.co/AOLCDROM/Tortoise-TTS-MSFT-VCTK-4V-En
Requires custom tokenizer file, pt-t.json (put in ./models/tokenizers, switch tokenizer in settings menu)



Other Videos By NanoNomad


2023-06-05DEMO: YourTTS - One Voice, Many Accents. A single speaker can generate multiple accents.
2023-06-04Revisiting YourTTS - Details about Training, Datasets, and experiences Voice Cloning with Coqui TTS
2023-06-03DEMO: YourTTS Multi-speaker VCTK Irish-accented Dataset after 275k Steps trained using Coqui TTS
2023-05-22Tortoise TTS Fine Tuning Wrap-Up
2023-05-16Tortoise TTS DEMO: G-Man performs Gilbert and Sullivan's 'The Major-General's Song'
2023-05-15Train Tortoise TTS in English, Spanish, French, Italian, Portuguese, German, and more? Maybe?
2023-05-10DEMO: Testing French-Speaking Tortoise TTS
2023-05-10DEMO: Testing German-Speaking Tortoise TTS
2023-05-08DEMO: Testing Spanish Speaking Tortoise TTS
2023-05-07DEMO: Testing Tortoise TTS Speaking in Portuguese
2023-05-04Make Using Tortoise TTS Faster with Fine-Tuned Models
2023-05-01AI Voice Swap and Lip Sync using Wav2Lip-HQ-Updated
2023-04-22Voice Cloning with Tortoise TTS and Model Training Using the AI Voice Cloning WebUI
2023-04-07Locally Hosted Chatbots with RWKV through ChatRWKV and the Text-Generation-WebUI | 14B Model on 3GB!
2023-03-29Create Datasets for Voice Model Training on Google Colab | Updated Tools for Coqui TTS Training
2023-03-22Train a VITS Speech Model using Coqui TTS | Updated Script and Audio Processing Tools
2023-03-15Training or Fine Tuning a Hindi Language VITS TTS Voice Model with Coqui TTS on Google Colab
2023-03-05Install and Configure Retroarch for PS Vita with Thumbnails, Overlays and Shaders
2023-03-03Fallout 1 on the PS Vita is the Best Way to Play
2023-02-24Train or Fine Tune VITS on (theoretically) Any Language | Train Multi-Speaker Model | Train YourTTS
2023-02-12Even more Voice Cloning | Train a Multi-Speaker VITS model using Google Colab and a Custom Dataset


Tags:
TTS
Tortoise TTS
text to speech
AI
voice cloning