The Future of AI in Videogames - UE5 AI NPC Realtime localy with Ollama

Channel:

Marvel Master (Marvelmaster)

Subscribers:

15,200

Published on May 17, 2025 4:00:50 AM ● Video Link: https://www.youtube.com/watch?v=cyqR3ckP49o

Duration: 0:00

2,726 views

100

Believe it or not but you can download this demo and try on your own...
This showcases that you can run a local ai in Unreal Engine 5 and use it ingame as an generic NPC. The conversation here is not scripted...I am just reacting to what the AI says.
The Demo uses Ollama as AI Server and LLama3.2-vision as model.
I use as c++ and libcurl to commuicate with the Ollama server.
All code was written by chatgpt and Deepseek AI ... lol

Download link:
https://drive.google.com/drive/folders/1n362U-2zCpiaTR45RRP2flA166SdKCet?usp=sharing

For the metahuman interaction i used some plugins by Georgy Dev:
Runtime Speech Recognizer
https://www.fab.com/listings/00ffc308-d7f9-4142-ac4c-4aeaa75ab54b
Runtimer Text to speech
https://www.fab.com/listings/0dab646f-73b4-46d9-bb7e-8e6c12bdd808
Runtime Metahuman Lip Sync
https://www.fab.com/listings/b514294e-e78b-4b8b-ad21-78ce51dc7e8c

PC Specs:
RTX3090 Founders Edition
AMD 7950x3D
64GB Ram

Frame Model by
toya_mimura (https://sketchfab.com/toya_mimura)