Unreal Engine 5 - Ultimate Voice AI Tutorial - Masterclass from scratch
707Because there has been excessive demand for a tutorial, there it is now.
Explaining how to use a microphone for communication with an NPC/AI and get an voice response using ChatGPT and Elevenlabs TTS from scratch!
Project Files downloadable for Patrons:
https://9sj9.short.gy/UE5AI
Plugins need to be installed for UE5.1
____________________________________
https://www.unrealengine.com/marketplace/en-US/product/varest-plugin
https://www.unrealengine.com/marketplace/en-US/product/runtime-audio-importer
https://www.unrealengine.com/marketplace/en-US/product/runtime-speech-recognizer
Websites:
https://openai.com/
API: https://platform.openai.com/docs/api-reference/chat/create
https://beta.elevenlabs.io/
API: https://docs.elevenlabs.io/api-reference/text-to-speech-stream
Voice IDs:
Name Voice ID
Rachel 21m00Tcm4TlvDq8ikWAM
Domi AZnzlk1XvdvUeBnXmlld
Bella EXAVITQu4vr4xnSDxMaL
Antoni ErXwobaYiN019PkySvjV
Elli MF3mGyEYCl7XYWbV9V6O
Josh TxGEqnHWrfWFTfGW9XjX
Arnold VR6AewLTigWG4xSOukaG
Adam pNInz6obpgDQGcFmaJgB
Sam yoZ06aMxZJJ28mfd3POQ
Don't forget to like, comment, and subscribe for more exciting showcases.
https://discord.gg/94tfRKDG9w
_______________________________________
Want to support me?
https://www.patreon.com/marvelmaster
or
https://www.paypal.me/marvelmasteryt
All donation money flows into better software, equipement, assest and cloud space.
_______________________________________
Time stamps:
0:00 Introduction
1:39 Requirements and limitations
4:51 Setting up the project
6:21 Speech recognition
16:07 ChatGPT communication
34:46 Fixing ChatGPT bugs
37:47 Make ChatGPT remember
44:36 Elevenlabs TTS
1:04:44 TTS Bug fixing
1:12:00 Outro