Text-To-Skyrim: Stendarr's Crunchy Soup [Twitch TTS Mod]

Channel:
Subscribers:
257,000
Published on ● Video Link: https://www.youtube.com/watch?v=VDqrAHKB64I



Duration: 0:00
32,279 views
2,645


Participate and watch LIVE: https://twitch.tv/blurbs
ALL EPISODES:    • Text-To-Skyrim  
VODS:    / @blurbsvods  

Discord: https://discord.gg/zrSnf4JvKw
TikTok: https://www.tiktok.com/@blurbstv
Twitter: https://twitter.com/Blurbstv
Instagram: https://www.instagram.com/blurbsttv/

HOW THIS WAS MADE:

So many people asked if this mod will be available publicly, and honestly I'm not sure. It's not a single "mod", but rather multiple programs running in tandem for it to function properly. Additionally, the code is not only spaghetti, but specific to my information. I will however give as many resources as I can for those of you wanting to attempt this.

This works using a mod I created in Skyrim that sends and receives instructions to a node JS server running locally on my machine.
The server reads Twitch chat, and when told by Skyrim dialogue is needed, reaches out to ElevenLabs to generate .wav files. Using this audio, the program listed below is run to generate .lip files needed for lip movement.
After creating a dummy Topic with placeholder voice lines in the Creation Kit, the server hotswaps the new audio/lip files over the existing ones, giving the illusion of a complex dialogue system.
Enjoy the memes!

Sources:
I used SkyrimPlatform to code the plugin in Typescript (personal preference) https://www.nexusmods.com/skyrimspecialedition/mods/54909
Program to generate .lip files: https://github.com/Haurrus/FaceFXWrapper
Plugin to inject subtitles into Skyrim: https://github.com/swwu/Mantella-Subtitles-Plugin-NG
Script extender: https://github.com/skyrim-platform/po3-papyrus-extender
How to convert buffer to .wav blob (gotta do further steps to actually write that to disk however): https://stackoverflow.com/questions/29584420/how-to-manipulate-the-contents-of-an-audio-tag-and-create-derivative-audio-tags







Other Statistics

The Elder Scrolls V: Skyrim Statistics For Blurbs

There are 18,632,698 views in 111 videos for The Elder Scrolls V: Skyrim. About 4 hours worth of The Elder Scrolls V: Skyrim videos were uploaded to his channel, or 1.25% of the total watchable video on Blurbs's YouTube channel.