Backpropagation, the engine that runs deep learning, is the part that needs to be learned most deeply in the basic deep learning course.
This lecture covers the principles of training neural networks through backpropagation more intensively than any other lecture .
To understand backpropagation, you need to understand the Jacobian matrix, but the Jacobian matrix used in mathematics is insufficient in expressing backpropagation in deep learning.
Therefore, in this lecture, we will explain backpropagation in deep learning by extending the Jacobian matrix covered in mathematics .
What you learn
In this lecture, we will start from the basics of differentiation.
Through differentiation of multivariable functions
Deals with differentiation of vector functions
Learn the extended Jacobian to explain backpropagation in deep learning.
Backpropagation Practice
In this lecture, we will train a simple model using backpropagation, which we learned theoretically.
Observe the results of the learned model in an easy way and analyze the principles of learning.
Inflearn's course content is available under the Creative Commons Attribution-NonCommercial-NoDerivatives license.
Recommended for these people
Who is this course right for?
People who lack mathematical ability to study deep learning
Those who want to lay a solid foundation for deep learning
If you want to fully understand the principle of backpropagation
L4DL Curriculum Participants
Need to know before starting?
[L4DL Lecture] Operations of Deep Learning Networks
I have taken many lectures, but in my experience, this is the best lecture on deep learning mathematics. If you want to solidify your basics, you should definitely take this lecture.
I highly recommend this to those who want to learn deep learning and approach deep learning mathematically. Most of the existing lectures on deep learning are about simple module usage and programming code usage, but I think this type of study has its limitations. I think this is a lecture that can develop solid skills for studying artificial intelligence by directly understanding and implementing a simple ann model mathematically.