Turning My Body Into a Controller with Machine Learning, ml5.js, and p5.js

Channel:
United States Steve's Makerspace
Subscribers:
6,610
Published on ● Video Link: https://www.youtube.com/watch?v=96sWFP9CCkQ


Duration: 9:42
1,396 views
39

In this video we look at some applications from the ml5.js site (and also my own drawing program) and it's use in p5.js (Javascript) using machine learning pre-trained models to track body movements - hand, face, and full body tracking. You might use this to move an object around the screen using any body part. Or train the computer to recognize that a certain pose means something. We look at PoseNet, Handpose, Facemesh, and KNNClassifier PoseNet, as well as Dan Shiffman's PoseNet YMCA example. ml5.js is built around TensorFlow.js.

My drawing program code:
https://editor.p5js.org/StevesMakerspace/sketches/VCFXH2lOh

All about ml5.js:
https://ml5js.org/

Dan Shiffman's Coding Train video usine PoseNet:
https://www.youtube.com/watch?v=FYgYyq-xqAw

Join my Discord: https://discord.gg/FSW6zzU

Follow me on Twitter: https://twitter.com/SteveMakerspace

Music:
Funk Down (Sting) by MK2 (theme)
Come and Get It! by Dan Lebowitz
Blues Infusion by Quincas Moreira
Dewey, Cheedham, and Howe by John Deley and the 41 Players
Hold on a Second by John Deley and the 41 Players



Other Videos By Steve's Makerspace


2021-11-19I Made a Restaurant for Animals - Creativerse #3
2021-11-17Quest to Tame a Chizzard - Creativerse #2
2021-11-14Starting a New Survival Series! - Creativerse #1
2021-09-20My Watercolor Painting App and Self-Painting App in p5.js - generative art - use in your browser
2021-09-18Scrap Mechanic DevBlog 22: Underground Mining Pics, new NPC's, Signs, Custom Wedges, and More
2021-09-13Playing with Perlin Noise in p5.js - generative art with lots of options, plus wave convections
2021-09-05I Made Scrap Mechanic Art with Deep Dream Generator Style Transfer
2021-08-28My Mondrian-Style Art Maker in p5.js - Generative Art Fun with lots of options
2021-08-25Deeper Dive into Deep Dream Generator Style Transfer
2021-08-22Amazing Computer-Generated Art - Guide to Deep Dream Generator - How To
2021-08-15Turning My Body Into a Controller with Machine Learning, ml5.js, and p5.js
2021-08-08Helping an AI Make Art with ArtBreeder - It's Really Good!
2021-07-25Sand Art in p5.js - Sandpiles Fractal Images
2021-07-19Programming an Amazing Art-Making Machine in p5.js generative art
2021-07-19Mind-Blowing Art-Making Program I Made in p5.js generative art
2021-07-11My New Coding Adventures in p5.js
2021-06-26New Tool from Dr. Pixel - Live Video inside Scrap Mechanic
2021-06-05New Channel and Update on Steve's Makerspace
2021-05-30Launching Wocs and Bots The Easy Way
2021-05-09Awesome Community Creations in Scrap Mechanic
2021-04-10The Bard's Quest: Skyrim #4


Tags:
Tensorflow.js
tensorflow
machine learning
neural network
p5.js
ml5.js
posenet
facemesh
handpose
KNNClassifier
coding train
dan shiffman
javascript machine learning
p5.js machine learning
processing machine learning
pre-trained model