Creating an SVM from scratch - Practical Machine Learning Tutorial with Python p.25

Channel:
United States sentdex
Subscribers:
1,410,000
Published on ● Video Link: https://www.youtube.com/watch?v=AbVtcUBlBok


Category:
Tutorial
Duration: 10:16
108,285 views
900

Welcome to the 25th part of our machine learning tutorial series and the next part in our Support Vector Machine section. In this tutorial, we're going to begin setting up or own SVM from scratch.

Before we dive in, however, I will draw your attention to a few other options for solving this constraint optimization problem:

First, the topic of constraint optimization is massive, and there is quite a bit of material on the subject. Even just our subsection: Convex Optimization, is massive. A starting place might be: https://web.stanford.edu/~boyd/cvxbook/bv_cvxbook.pdf. For a starting place for constraint optimization in general, you could also check out http://www.mit.edu/~dimitrib/Constrained-Opt.pdf

Within the realm of Python specifically, the CVXOPT package has various convex optimization methods available, one of which is the quadratic programming problem we have (found @ cvxopt.solvers.qp).

Also, even more specifically there is libsvm's Python interface, or the libsvm package in general. We are opting to not make use of any of these, as the optimization problem for the Support Vector Machine IS basically the entire SVM problem.

Now, to begin our SVM in Python.

https://pythonprogramming.net
https://twitter.com/sentdex
https://www.facebook.com/pythonprogramming.net/
https://plus.google.com/+sentdex



Other Videos By sentdex


2016-06-10Handling Non-Numeric Data - Practical Machine Learning Tutorial with Python p.35
2016-06-07Clustering Introduction - Practical Machine Learning Tutorial with Python p.34
2016-06-02SVM Parameters - Practical Machine Learning Tutorial with Python p.33
2016-06-01Soft Margin SVM and Kernels with CVXOPT - Practical Machine Learning Tutorial with Python p.32
2016-05-31Soft Margin SVM - Practical Machine Learning Tutorial with Python p.31
2016-05-30Why Kernels - Practical Machine Learning Tutorial with Python p.30
2016-05-29Kernels Introduction - Practical Machine Learning Tutorial with Python p.29
2016-05-28Completing SVM from Scratch - Practical Machine Learning Tutorial with Python p.28
2016-05-26SVM Optimization - Practical Machine Learning Tutorial with Python p.27
2016-05-24SVM Training - Practical Machine Learning Tutorial with Python p.26
2016-05-23Creating an SVM from scratch - Practical Machine Learning Tutorial with Python p.25
2016-05-21Support Vector Machine Optimization - Practical Machine Learning Tutorial with Python p.24
2016-05-19Support Vector Machine Fundamentals - Practical Machine Learning Tutorial with Python p.23
2016-05-17Support Vector Assertion - Practical Machine Learning Tutorial with Python p.22
2016-05-16Understanding Vectors - Practical Machine Learning Tutorial with Python p.21
2016-05-13Support Vector Machine Intro and Application - Practical Machine Learning Tutorial with Python p.20
2016-05-11Final thoughts on K Nearest Neighbors - Practical Machine Learning Tutorial with Python p.19
2016-05-09Applying our K Nearest Neighbors Algorithm - Practical Machine Learning Tutorial with Python p.18
2016-05-06Writing our own K Nearest Neighbors in Code - Practical Machine Learning Tutorial with Python p.17
2016-05-05Creating Our K Nearest Neighbors Algorithm - Practical Machine Learning with Python p.16
2016-05-03Euclidean Distance - Practical Machine Learning Tutorial with Python p.15


Tags:
support vector machine
svm
machine learning
python
classification
artificial intelligence
tutorial