Visualizing hyperparameters with a robot arm

Channel:
Subscribers:
9,890
Published on ● Video Link: https://www.youtube.com/watch?v=_Me2qhX9jNo



Duration: 1:35
156 views
5


Using Gradient Descent to solve the Inverse Kinematics for a robot arm lets us visualize the impact that hyperparameters have on the optimization.

Too high a learning rate and we start thrashing. Too low and we converge too fast. Too much momentum and we circle the target if we approach too quickly. Just the right amount of momentum more than doubles how fast we converge at the optimal solution.