Unreal Engine 5 - Ultimate Voice AI Tutorial - Masterclass from scratch

Channel:
Germany Marvel Master
Subscribers:
15,000
Published on ● Video Link: https://www.youtube.com/watch?v=xBs-nXzXwoM


Category:
Tutorial
Duration: 1:13:03
13,982 views
474

Because there has been excessive demand for a tutorial, there it is now.
Explaining how to use a microphone for communication with an NPC/AI and get an voice response using ChatGPT and Elevenlabs TTS from scratch!

Project Files downloadable for Patrons:
https://9sj9.short.gy/UE5AI

Plugins need to be installed for UE5.1
____________________________________
https://www.unrealengine.com/marketplace/en-US/product/varest-plugin
https://www.unrealengine.com/marketplace/en-US/product/runtime-audio-importer
https://www.unrealengine.com/marketplace/en-US/product/runtime-speech-recognizer

Websites:
https://openai.com/
API: https://platform.openai.com/docs/api-reference/chat/create
https://beta.elevenlabs.io/
API: https://docs.elevenlabs.io/api-reference/text-to-speech-stream

Voice IDs:
Name Voice ID
Rachel 21m00Tcm4TlvDq8ikWAM
Domi AZnzlk1XvdvUeBnXmlld
Bella EXAVITQu4vr4xnSDxMaL
Antoni ErXwobaYiN019PkySvjV
Elli MF3mGyEYCl7XYWbV9V6O
Josh TxGEqnHWrfWFTfGW9XjX
Arnold VR6AewLTigWG4xSOukaG
Adam pNInz6obpgDQGcFmaJgB
Sam yoZ06aMxZJJ28mfd3POQ


Don't forget to like, comment, and subscribe for more exciting showcases.

https://discord.gg/94tfRKDG9w

_______________________________________
Want to support me?

https://www.patreon.com/marvelmaster
or
https://www.paypal.me/marvelmasteryt

All donation money flows into better software, equipement, assest and cloud space.
_______________________________________

Time stamps:
0:00 Introduction
1:39 Requirements and limitations
4:51 Setting up the project
6:21 Speech recognition
16:07 ChatGPT communication
34:46 Fixing ChatGPT bugs
37:47 Make ChatGPT remember
44:36 Elevenlabs TTS
1:04:44 TTS Bug fixing
1:12:00 Outro



Other Videos By Marvel Master


2023-06-02Unreal Engine 5 - Ultimate Voice AI Tutorial - Masterclass from scratch
2023-05-16Unreal Engine ChatGPT talking assistant.
2023-05-14Unreal Engine 5 + ChatGPT + Elevenlabs Voice = Ultimate AI Assistant
2022-10-19Unreal Engine 5 Zibra Liquids is fun #shorts
2022-10-19Unreal Engine 5 - New Liquid System by Zibra AI realtime - free version
2022-06-22Unreal Engine 5 - Auto Folder Setup Plugin Showcase
2022-06-10Elon Musk is a MetaHuman
2022-06-10Elon Musk is a MetaHuman
2022-06-08Neo fighting the Matrix Unreal Engine 5
2022-06-07Unreal Engine 5 - Matrix Neo Game Demo Download - UE5 + DLSS
2022-05-13Exploring Fluid Flux for Unreal Engine and trying some Ragdoll Trickshots
2022-04-10UE5 Lumen Tweaked + DLSS = better Performance 60FPS in Big City Matrix Sample
2022-04-09Unreal Engine 5 - Matrix Neo mod Gameplay Big City Flying - UE5
2022-02-06Unreal Engine Auto Material Setup - also works with Substance Painter
2021-12-07Zelda Ocarina of Time remastered - Master Sword Scabbard Modeling Blender Timelapse - Free download
2021-11-29Zelda Ocarina of Time remastered - Slingshot Modeling Timelapse - Free model download
2021-08-17The Legend of Zelda Ocarina of Time CGI Commercial 4k 60fps - AI Upscale and Frameinterpolation
2021-08-12Ever heard of RTX? - Nvidia, Unreal Engine and the Shape of light
2021-07-29Free Character Creator - Ready Player Me for Unreal Engine Unity and VR
2021-07-09UE4 - Where does that Print String come from? Tutorial lost print string solution Unreal Engine
2021-06-22UE4 Cutting Grass Tutorial - Unreal Engine 4 how to cut grass


Tags:
UE5
AI
Unreal Engine
NPC
ChatGPT
Tutorial
next gen
future tech
education
masterclass
ultimate
from scratch
integration