C# Coding - Making a web crawler (maybe commentary)

Channel:
Subscribers:
105
Published on ● Video Link: https://www.youtube.com/watch?v=DDe21Wur9K4



Duration: 1:50:28
2,953 views
8


Sharing a screen while coding.(maybe) Some commentary, just watch and learn (eventually) ...

Check 15:30 - 16:30 and see GUI settings and action to understand most of the idea and automation.
It's multiclient network server with clients.
Persistent storage is MySQL.
Exports XML specific data structure to most web services (SOAP, PUT).
Import XML config file (wordpress compatible), for specific domain and elements of interest.
Advanced JS capabilities for each element.
HTTPS.
Cookies.
SImulates human interaction for low bot detection.
Easy-to-understand point-and-click interface for fast automation.
HTML 5, CSS 3, JS.

One of my better projects.

Edit*: 9.10.2016 - it's completed by now, fully working.
If you are interested by any way mail me:
bunak [at] mail . bg
(remove all spaces and replace [at] with @)







Tags:
c#
coding
programming
web crawler
site scraper
web automation
chromium
site automation
bot
web bot
web clicker
web testing
selenium alike