NeosVR Advanced Facial Animation Showcase
28Q/A (aka FAQ but I haven't actually been asked these)
Q: How did you do this?
A: I used blender for creating all of the shape keys, and I'm using Rezillo Ryker's Sizeable Furs HUD for the gesture system, which comes with the ability to assign shape keys to either buttons or trackpad axes, as well as triggers, allowing for partial shape key blends, and multiple gesture sets, pre-set facial expressions are on both trackpads and buttons, while facial control is trackpad or trigger only, I also have the ears moving based on said facial expressions, as for the breathing & microexpressions, those are handled by both the SF breathing function, and some custom logiX for randomly applying them, including lip biting and subtle mouth/cheek movements, eye dilation & blinking are handled by the eye manager component natively and as such would be handled by eye tracking if I had it.
Q: What would this look like with eye tracking?
A: Very simular, except my eye movement would look more realistic.
Q: What VR headset are you using for this?
A: Vive pro, not the vive pro eye, I might upgrade to it eventually though, I'm also using the Valve Index Controllers.
Q: Can this be done in VRChat?
A: No, atleast not as fluidly, the idle functions like breathing and eye dilation can be done (albeit not as easily), but the complex gesture control sadly can't, as you can't split gestures between controllers, and there are only 7 that can be done, also in neos's case I was at times combining what would be 5 seperate gestures, including partial blends, also I had a HUD that was used for swapping between gesture sets, TLDR: it's not possible.
Q: How easy is it to use?
A: Honestly I use it without even thinking about it in conversation, if I were to get facial tracking I doubt many people would really notice and would probably think I was just using this system, eye tracking however would possibly have people noticing.
Q: How many people actually notice this system?
A: I've had a lot of people comment on it pretty quickly when I give them the squint, I even managed to fool people into believing I had a vive pro eye, until I told them otherwise.
Q: What other things do you have on your avatar?
A: I did modify the eye manager some to make blinking more natural, as well as allowing double blinks within milliseconds of eachother, I also modified the IK to line up my body whenever I'm not using full body tracking, and it works pretty well most of the time.
Other Videos By Groxxy
Other Statistics
NeosVR Statistics For Groxxy
Currently, Groxxy has 21,985 views for NeosVR across 23 videos. His channel uploaded 3 hours worth of NeosVR videos, roughly 7.97% of the content that Groxxy has uploaded to YouTube.