I Coded VTubing Software the DUMB Way
I mapped my face to an avatar using face-api.js, node.js, python, and pygame (face-api.js uses tensorflow). There was a bit of math involved and I ended up writing my own 3D rendering system from the ground up!
I released most of the code used for this project here:
https://github.com/DaFluffyPotato/face-tracker-pyjs
My Projects:
https://dafluffypotato.com/projects
Discord:
https://discord.gg/9Qt2GxF
Patreon:
https://www.patreon.com/dafluffypotato
Potato Tier Patrons:
Keill
NingNangNongy
eivl
Timestamps:
0:00 - what
0:11 - why
1:36 - choosing the software
2:13 - exposing the data
3:20 - interpreting the data
5:26 - rendering the avatar
The streamer shown at 1:12 is Tim Beaudet:
https://www.twitch.tv/timbeaudet
#python #pygame #nodejs
Other Videos By DaFluffyPotato
2021-09-29 | I simulated 40K blades of realtime grass with Python |
2021-08-21 | How to ACTUALLY get into Gamedev |
2021-07-31 | Pygame's Performance - What You Need to Know |
2021-07-05 | Kite vs. Tabnine: An Autocomplete Software Comparison |
2021-06-17 | Pygame Performance Stress Test |
2021-06-15 | Why I'm STILL Glad I Didn't Use a Game Engine |
2021-05-25 | Python Webdev #4 - CSS |
2021-05-13 | Python Webdev #3 - HTML |
2021-04-24 | i make fast gaem |
2021-04-08 | 3D Terrain Generation in Python/Pygame - Demo/Explanation |
2021-03-16 | I Coded VTubing Software the DUMB Way |
2021-03-09 | Controller Input - Pygame Tutorial |
2021-03-03 | The Story Behind My 16 Hour Game |
2021-02-18 | hello |
2021-02-17 | I mapped my face to a cube. (python/pygame/node.js/face-api.js) |
2021-02-10 | Python Webdev #2 - Cookies and Arguments (Flask) |
2021-02-03 | Python Webdev #1 - Flask |
2021-01-26 | Learning Gamedev and Why I'm Glad I Didn't Start with Unity |
2021-01-11 | My Inexperienced Development Podcast Segment |
2021-01-01 | 2020 Pygame Projects |
2020-12-30 | Isometric Rendering - Pygame Tutorial |