Training or Fine Tuning a Hindi Language VITS TTS Voice Model with Coqui TTS on Google Colab

Channel:
Canada NanoNomad
Subscribers:
2,970
Published on ● Video Link: https://www.youtube.com/watch?v=jE-lKBKfxJw


Duration: 11:23
2,269 views
37

I received a few questions about training a Hindi language VITS model. I couldn't answer them well enough, since I hadn't done it, so this is my attempt. If you have a decent quality dataset, and double check the character set, you should be able to make it work. However, if you have the ability, it is probably best to run Coqui at home. Colab is VERY slow for file transfers, and this will slow down your dataset loading time, and eat into your computing credits very quickly.

Colab Notebook:
https://colab.research.google.com/drive/1lKsO-_5TJE8q_Ot1-t5380hobxNL_SWa?usp=sharing

Other voice videos:
https://www.youtube.com/playlist?list=PLn3gJVMORUsTiGp5Jc37XID9jS9SHKUV1

https://www.openslr.org/103/
Multilingual and code-switching ASR Challenge Dataset - sub-task1
Hindi_train.tar.gz [4.4G]

https://commonvoice.mozilla.org/en/datasets
Select Hindi
Common Voice Corpus 12.0



Other Videos By NanoNomad


2023-05-10DEMO: Testing French-Speaking Tortoise TTS
2023-05-10DEMO: Testing German-Speaking Tortoise TTS
2023-05-08DEMO: Testing Spanish Speaking Tortoise TTS
2023-05-07DEMO: Testing Tortoise TTS Speaking in Portuguese
2023-05-04Make Using Tortoise TTS Faster with Fine-Tuned Models
2023-05-01AI Voice Swap and Lip Sync using Wav2Lip-HQ-Updated
2023-04-22Voice Cloning with Tortoise TTS and Model Training Using the AI Voice Cloning WebUI
2023-04-07Locally Hosted Chatbots with RWKV through ChatRWKV and the Text-Generation-WebUI | 14B Model on 3GB!
2023-03-29Create Datasets for Voice Model Training on Google Colab | Updated Tools for Coqui TTS Training
2023-03-22Train a VITS Speech Model using Coqui TTS | Updated Script and Audio Processing Tools
2023-03-15Training or Fine Tuning a Hindi Language VITS TTS Voice Model with Coqui TTS on Google Colab
2023-03-05Install and Configure Retroarch for PS Vita with Thumbnails, Overlays and Shaders
2023-03-03Fallout 1 on the PS Vita is the Best Way to Play
2023-02-24Train or Fine Tune VITS on (theoretically) Any Language | Train Multi-Speaker Model | Train YourTTS
2023-02-12Even more Voice Cloning | Train a Multi-Speaker VITS model using Google Colab and a Custom Dataset
2023-02-04Updated | Near-Automated Voice Cloning | Whisper STT + Coqui TTS | Fine Tune a VITS Model on Colab
2023-01-30YourTTS Training Discussion | Experiences, Multistage Training, Demos, Prior Training Preservation
2023-01-27Updated | Fine-Tuning YourTTS with Automated STT Datasets on Google Colab for AI Voice Cloning
2023-01-13Fine-Tune YourTTS with Near-Automated Datasets on Google Colab for AI Voice Cloning
2022-12-22Near-Automated Voice Cloning | Whisper STT + Coqui TTS | Fine Tune a VITS Model on Colab or Linux
2022-12-09Dreambooth and Fine Tuning for Stable Diffusion 1.5 and 2 with this Versatile Script


Tags:
voice cloning
tts
hindi
coqui
machine learning