I Coded VTubing Software the DUMB Way

Subscribers:
102,000
Published on ● Video Link: https://www.youtube.com/watch?v=2mwK5H4xsuI



Duration: 8:19
20,291 views
1,278


I mapped my face to an avatar using face-api.js, node.js, python, and pygame (face-api.js uses tensorflow). There was a bit of math involved and I ended up writing my own 3D rendering system from the ground up!

I released most of the code used for this project here:
https://github.com/DaFluffyPotato/face-tracker-pyjs

My Projects:
https://dafluffypotato.com/projects

Discord:
https://discord.gg/9Qt2GxF

Patreon:
https://www.patreon.com/dafluffypotato

Potato Tier Patrons:
Keill
NingNangNongy
eivl

Timestamps:
0:00 - what
0:11 - why
1:36 - choosing the software
2:13 - exposing the data
3:20 - interpreting the data
5:26 - rendering the avatar

The streamer shown at 1:12 is Tim Beaudet:
https://www.twitch.tv/timbeaudet

#python #pygame #nodejs







Tags:
DaFluffyPotato
vtube
vtuber
programming
computer science
python
nodejs
pygame
face-api.js
faceapi
javascript
java script
machine learning
neural networks
tensorflow