paulmoon008308

The core of all AI/deep learning is ultimately optimization. Of course, optimization theory is not only needed in AI/deep learning. Computer vision, robotics & control systems, financial engineering & quant, data science, signal processing... Probably no matter which field you study, optimization theory is one of the topics you will inevitably encounter when you go deeper. This lecture systematically covers everything from basic mathematical theory to in-depth content. I believe it is by far the best optimization theory lecture offered in Korea.

jhim21

Optimization Theory Bible

입문

초급

중급이상

optimization-problem

Introduction to the Optimization Theory Bible

Differentiation of Multivariable Functions

Convex function

Optimization Theory 1: Unconstrained Optimization

Gradient Descent Search Method and Deep Neural Network's Backpropagation Algorithm

Newton's Method

Optimization Theory 2: Constrained Optimization