Making a Facial Motion Capture Helmet for Live Face in Iclone

Making a Facial Motion Capture Helmet for Live Face in Iclone

Channel:
Subscribers:
5,370
Published on ● Video Link: https://www.youtube.com/watch?v=sS4V5ex1mdA



Duration: 4:25
5,967 views
169


We're using Live Face through Iclone 7. In this complicated hard to understand video I take you through my failure.
I initially made a helmet cam with a light weight aluminum arm, and it wasn't sturdy enough to avoid rotating under the weight of the iPhone X camera.
So I got GoPro accessories to attach to the helmet, but they didn't quite attach.
and then I realized that I had been assuming the Live Face would read the rotation of the actors neck, and translate that on to the animated model by reading cues in the background behind the actor. This is because when I unboxed the ROKOKO I missed the headband and sensor attachments (they were hidden in a pouch at the back)
So, that's ok, I'll just read the rotation of the neck by having a fixed static cam for Live Face. If I lose any facial data when an actor turns their head a lot to the side, I'll just go back and lay in a pass where we're only collecting face data and ignoring neck. Basically I'll just do it in 2 passes.

Now that would work! It's annoying, but it would work!

Once I found the head sensor and headband in the Rokoko though, I pivoted back to the original head cam design, attached the more solid GoPro equipment adapted to hold a cell phone, added some counter weights to the back of the helmet. and boom. Helmet mounted facial mocap is complete.

However! In an upcoming video I'll show you we mostly use a static face cam and we do body mocap and facial mocap separately so we can keep the work much cleaner and make sure the body mocap performer has a lot more freedom.

#CharacterCreator #HeadshotCC #iClone #IndieDev #UE4 #FacialMocap

Game Dev Gear -
CHARACTERS - http://iclone.reallusion.com/
MOCAP - https://www.rokoko.com/en/products/smartsuit-pro
ENGINE - UE4

MUSIC - https://shadowshogunbeats.bandcamp.com/
DISCORD - http://discord.gg/tDSP8jp
SUBSCRIBE - https://goo.gl/EqQarf
TWITTER - https://twitter.com/lampsblack




Other Videos By Hermit


2020-05-07Who am I??
2020-04-29Tutorial: Integrate a Character Creator 3 model with Advanced Locomotion System v4
2020-04-08How sexy is too sexy for video games - Making of Sasha 3
2020-03-02Making a Facial Motion Capture Helmet for Live Face in Iclone
2020-02-26Character Creator and Blender comparison
2019-10-30Rokoko Smartsuit Pro Unboxing
2018-10-04HOW TO BUILD YOUR OWN VOCAL BOOTH | One Minute Voice Tip
2018-10-03HAT IN TIME - Devs Praise Carol-Anne's work
2018-09-06IN THE BOOTH | The Ballad Singer | Behind the Scenes
2018-04-06POKEMONTAS (Jigglypuff Sings Disney) The Colors of Ho-Oh | Colors of the Wind Parody
2017-10-04DRINKING MILK vs. EATING A GREEN APPLE (What does it do to your voice?) - One Minute Voice Tip
2017-09-20HARDEST TONGUE TWISTER IN THE WORLD - BEST VOCAL WARMUP EVER - One Minute Voice Tip
2017-09-19HOW TO MAKE YOUR VOICE DEEP - One Minute Voice Tip
2017-09-13BEST VOCAL WARM UP EVER - One Minute Voice Tip
2017-09-06WHO BURPS THE BEST - RICK & MORTY BAD IMPRESSIONS - ("professional" voice actors)
2017-09-06RICK AND MORTY BAD IMPRESSIONS - ("professional" voice actors)
2017-08-02OVERWATCH BAD IMPRESSIONS - Professional Voice Actors do Impressions of Overwatch Characters
2017-07-15A Dank Tale - EP 1 - It's Dangerous To Go Alone
2017-05-13INFERNO DRUNK - Mega Man X8 Let's Play #8 - Lucas Gilbertson signs up for AA
2017-05-08Mega Man X Fan Fic # 2 | Melissa Johnson | Lucas Gilbertson | Carol-Anne Day
2017-04-24The Death of Ash and Pikachu (I'll Always Choose You Pikachu) A Pokemon Tragedy - SAD FEELS



Tags:
reallusion
iclone
rokoko
facial mocap
mocap
motion capture
facial motion capture
how to make a mocap helmet
live face