Using a bot to navigate a website (Web scraping)

Channel:

Double D

Subscribers:

9,300

Published on May 29, 2022 4:00:10 PM ● Video Link: https://www.youtube.com/watch?v=NiIZ156wAP0

Duration: 10:30

4,048 views

61

In this video you will learn:
- what is web scraping
- how to use a bot to navigate a website
- how to retrieve any data from any website - for example, get Google's autocomplete suggestions in your NodeJS API
- advantages & disadvantages of web scraping

Full code example:
https://github.com/DoubleDebug/google-autocomplete-api

Learn more about Puppeteer:
https://www.npmjs.com/package/puppeteer

Timestamps:
0:00 What is web scraping?
1:33 Puppeteer setup
3:08 What we want the bot to do
4:16 Navigating the website
5:43 Let's test it
6:02 Filtering results
7:36 Use cases
8:43 Disadvantages
10:00 Outro

#javascript #nodejs
_________________________________________________________
Social media:
● Facebook: https://www.facebook.com/YoutubeDoubleD
● Twitter: https://twitter.com/YoutubeDoubleD
● Twitch: http://twitch.tv/NotDoubleD