Coding Challenge #153: Interactive Drawing with Machine Learning Model (SketchRNN)

Coding Challenge #153: Interactive Drawing with Machine Learning Model (SketchRNN)

Channel:
United States The Coding Train
Subscribers:
1,740,000
Published on ● Video Link: https://www.youtube.com/watch?v=ZCXkvwLxBrA


Duration: 32:48
44,645 views
1,045

This challenge uses the pre-trained SketchRNN machine learning model (available with the ml5.js library) to create a p5.js sketch that finishes a person's drawing. Code: https://thecodingtrain.com/challenges/153-interactive-drawing-with-sketchrnn

πŸ•ΉοΈ p5.js Web Editor Sketch: https://editor.p5js.org/codingtrain/sketches/hcumr-aua

πŸŽ₯ Previous video: https://youtu.be/nSYw9GrakjY?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH
πŸŽ₯ Next video: https://youtu.be/trKjYdBASyQ?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH
πŸŽ₯ All videos: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH

References:
πŸ’» ml5.js: https://ml5js.org/
πŸ’» Draw Together with a Neural Network - Magenta TensorFlow: https://magenta.tensorflow.org/assets/sketch_rnn_demo/index.html
πŸ—„ Ramer-Douglas-Peucker Algorithm on Wikipedia: https://en.wikipedia.org/wiki/Ramer%E2%80%93Douglas%E2%80%93Peucker_algorithm
πŸ““ A Neural Representation of Sketch Drawings: https://arxiv.org/abs/1704.03477
πŸ’» Quick, Draw!: https://quickdraw.withgoogle.com/#
πŸ’» Recurrent Neural Networks & LSTMs: https://ayearofai.com/rohan-lenny-3-recurrent-neural-networks-10300100899b

Live Stream Archive:
πŸ”΄ Coding Train Live 186: https://youtu.be/GMaKcRkiNoM?t=4054s

Related Coding Challenges:
πŸš‚ #128 SketchRNN Snowflakes with ml5.js: https://youtu.be/pdaNttb7Mr8
πŸš‚ #152 RDP Algorithm: https://youtu.be/nSYw9GrakjY

Timestamps:
0:00 Introduction
0:30 Magenta website
2:11 Recurrent Neural Networks
2:43 Magenta blog post
3:18 ml5 sketchRNN reference
3:51 Let's Code!
4:25 The model
4:55 SketchRNN.generate()
5:55 Sequential data
6:24 The states
7:50 When do you draw?
10:48 Deal with the pen state
14:28 seedPath
16:14 See the user drawing
17:35 Tell the model about user seed strokes
18:54 RDP algorithm
20:40 Add rdp.js
25:07 Redraw simplified line
28:10 Other models

Editing by Mathieu Blanchette
Animations by Jason Heglund
Music from Epidemic Sound

πŸš‚ Website: http://thecodingtrain.com/
πŸ‘Ύ Share Your Creation! https://thecodingtrain.com/guides/passenger-showcase-guide
🚩 Suggest Topics: https://github.com/CodingTrain/Suggestion-Box
πŸ’‘ GitHub: https://github.com/CodingTrain
πŸ’¬ Discord: https://thecodingtrain.com/discord
πŸ’– Membership: http://youtube.com/thecodingtrain/join
πŸ›’ Store: https://standard.tv/codingtrain
πŸ–‹οΈ Twitter: https://twitter.com/thecodingtrain
πŸ“Έ Instagram: https://www.instagram.com/the.coding.train/

πŸŽ₯ Coding Challenges: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6ZiZxtDDRCi6uhfTH4FilpH
πŸŽ₯ Intro to Programming: https://www.youtube.com/playlist?list=PLRqwX-V7Uu6Zy51Q-x9tMWIv9cueOFTFA

πŸ”— p5.js: https://p5js.org
πŸ”— p5.js Web Editor: https://editor.p5js.org/
πŸ”— Processing: https://processing.org

πŸ“„ Code of Conduct: https://github.com/CodingTrain/Code-of-Conduct

This description was auto-generated. If you see a problem, please open an issue: https://github.com/CodingTrain/thecodingtrain.com/issues/new

#sketchrnn #machinelearning #quickdraw #ml5js #p5js



Other Videos By The Coding Train


2019-12-05ml5: Save Neural Network Trained Model
2019-12-05ml5.js: Save Neural Network Training Data
2019-11-27Coding Train Live 188: Tic Tac Toe AI with Minimax
2019-11-22ml5.js: Train Your Own Neural Network
2019-11-18D3.js Cont'd with Shirley Wu
2019-11-15Introduction to D3.js with Shirley Wu
2019-11-11Teachable Machine 3: Sound Classifiication
2019-11-09Coding Train Live 188: ml5.neuralNetwork
2019-11-08Teachable Machine 2: Snake Game
2019-11-07Teachable Machine 1: Image Classification
2019-10-31Coding Challenge #153: Interactive Drawing with Machine Learning Model (SketchRNN)
2019-10-27Coding the Collatz Conjecture
2019-10-25Coding Train Live 187: Fractal #TeamTrees with Physics
2019-10-23Coding Challenge #152: RDP Line Simplification Algorithm
2019-10-18Coding Train Live 186: Interactive Drawing with SketchRNN
2019-10-11Coding the Maurer Rose
2019-10-11Coding Train Live 185: RDP Algorithm
2019-10-08Coding Train Live 184: uNet and BodyPix with ml5.js
2019-10-03Coding Challenge #151: Ukulele Tuner with Machine Learning Pitch Detection Model
2019-09-27Coding Train Live 183: Brooklyn Studio, ml5.js Pitch Detection
2019-08-22Coding Challenge #150: AI Rainbows with Runway and p5.js


Tags:
machine learning
sketchRNN
AI drawing
javascript
tensorflow.js
magenta.js
tensorflow
p5.js
p5
javascript machine learning
recurrent neural networks
RNN