Decision Trees and Boosting, XGBoost | Two Minute Papers #55

Channel:
Hungary Two Minute Papers
Subscribers:
1,550,000
Published on ● Video Link: https://www.youtube.com/watch?v=0Xc9LIb_HTw


Duration: 3:37
96,188 views
1,514

A decision tree is a great tool to help making good decisions from a huge bunch of data. In this episode, we talk about boosting, a technique to combine a lot of weak decision trees into a strong learning algorithm.

Please note that gradient boosting is a broad concept and this is only one possible application of it!

__________________________________

Our Patreon page is available here:
https://www.patreon.com/TwoMinutePapers
If you don't want to spend a dime or you can't afford it, it's completely okay, I'm very happy to have you around! And please, stay with us and let's continue our journey of science together!

The paper "Experiments with a new boosting algorithm" is available here:
http://www.public.asu.edu/~jye02/CLASSES/Fall-2005/PAPERS/boosting-icml.pdf

Another great introduction to tree boosting:
http://homes.cs.washington.edu/~tqchen/pdf/BoostedTree.pdf

WE WOULD LIKE TO THANK OUR GENEROUS SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE:
Sunil Kim, Vinay S.

The thumbnail image background was created by John Voo (CC BY 2.0), content-aware filling has been applied - https://flic.kr/p/BLphju
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePap...
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/



Other Videos By Two Minute Papers


2016-05-08Deep Learning and Cancer Research | Two Minute Papers #64
2016-05-04Face2Face: Real-Time Facial Reenactment
2016-05-01Training Deep Neural Networks With Dropout | Two Minute Papers #62
2016-04-28Narrow Band Liquid Simulations | Two Minute Papers #61
2016-04-24No Such Thing As Artificial Intelligence | Two Minute Papers #60
2016-04-1410 Even Cooler Deep Learning Applications | Two Minute Papers #59
2016-04-10The Dunning-Kruger Effect | Two Minute Papers #58
2016-04-04From Doodles To Paintings With Deep Learning | Two Minute Papers #57
2016-03-30Overfitting and Regularization For Deep Learning | Two Minute Papers #56
2016-03-27How The Witness Teaches Scientific Thinking
2016-03-24Decision Trees and Boosting, XGBoost | Two Minute Papers #55
2016-03-203D Depth From a Single Photograph | Two Minute Papers #54
2016-03-15How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53
2016-03-1310 More Cool Deep Learning Applications | Two Minute Papers #52
2016-03-065000 Fellow Scholars Special! | Two Minute Papers
2016-03-02Awesome Research For Everyone! - Two Minute Papers Channel Trailer
2016-03-02How To Get Started With Machine Learning? | Two Minute Papers #51
2016-02-28Interactive Photo Recoloring | Two Minute Papers #50
2016-02-24Deep Learning Program Learns to Paint | Two Minute Papers #49
2016-02-21Artistic Manipulation of Caustics | Two Minute Papers #48
2016-02-18Should You Take the Stairs at Work? (For Weight Loss) | Two Minute Papers #47


Tags:
two minute papers
Experiments with a new boosting algorithm
xgboost
tree boosting
python xgboost
kaggle xgboost
decision trees
boosted trees
xgboost decision tree
machine learning decision tree
what is a decision tree
what is boosting
what is xgboost
decision tree boosting
gradient boosting
extreme gradient boosting
kaggle decision tree
kaggle random forest
random forest
random forest xgboost
kaggle boosting
kaggle
boosting