강의

멘토링

커뮤니티

AI Technology

/

Deep Learning & Machine Learning

Shin Kyung-sik's Deep Learning - Gradient Descent

This is a course that intensively covers gradient descent, the most fundamental learning algorithm in deep learning.

(5.0) 3 reviews

36 learners

Level Basic

Course period Unlimited

  • asdfghjkl13551941
Deep Learning(DL)
Deep Learning(DL)
gradient-descent
gradient-descent
optimization-problem
optimization-problem
PyTorch
PyTorch
python3
python3
Deep Learning(DL)
Deep Learning(DL)
gradient-descent
gradient-descent
optimization-problem
optimization-problem
PyTorch
PyTorch
python3
python3

What you will gain after the course

  • Principles of the Gradient Descent Algorithm

  • Implementing Gradient Descent from Scratch

  • Mathematical Foundations Related to Gradient Descent

  • Deep Learning Implementation Fundamentals

  • Gradient Descent Using PyTorch's Autograd

NOTICE

This course is part of the AI-specialized curriculum All about AI.

The Core Principle of Deep Learning Model Training! Gradient Descent


This course is designed to perfectly understand the operating principles of the gradient descent algorithm that trains all deep learning models.

Perfect Theoretical Understanding of Gradient Descent!

In this lecture, we will ① understand the working mechanism of Gradient descent mathematically, ② implement it directly in code, and ③ visualize the computational process to achieve a complete mathematical understanding of its operating principles.

Additionally, we will experiment and analyze gradient descent in various situations to build the fundamentals needed to become a deep learning expert.

Step-by-step hands-on implementation of Gradient Descent!

In this lecture, we implement gradient descent by gradually increasing the difficulty level step by step. Through this, you can not only gain a more complete understanding of how gradient descent works, but also build the foundational skills for writing more professional deep learning code in the future.

Practical Advanced Learning of Gradient Descent!

This course covers not only simple gradient descent but also practical gradient descent content for training actual deep learning models. We cover gradient descent for multivariate functions and learn about the biased learning that occurs in this process. Through this, you can understand the causes of many problems that arise when training actual deep learning models.

How to use torch.optim.SGD!

In this lecture, you will learn not only how to implement gradient descent directly, but also how to use PyTorch's SGD class. Through this, you will build the fundamentals of training deep learning models with gradient descent.

Recommended for
these people

Who is this course right for?

  • Those who want to properly learn deep learning

  • Those who want to build a solid foundation in deep learning basics

Need to know before starting?

  • Fundamentals of Differentiation (Refer to Gradients and PyTorch's Autograd lecture)

Hello
This is

3,491

Learners

160

Reviews

85

Answers

4.9

Rating

16

Courses

Lecture History

  • [Like Lion] Intermediate/Advanced AI Course

  • [National Institute of Meteorological Sciences] 2022, 2023, 2025 Meteorological AI Boost Camp

  • [Samsung Electro-Mechanics] Advanced Software Course for New Employees

  • [Korea Institute of Human Resources Development in Science and Technology] Long-term Mentoring for Strengthening R&D Implementation Capabilities

  • [Korea Institute of Human Resources Development in Science and Technology] E-learning content production for R&D professional courses

  • [Korea Institute of Human Resources Development in Science and Technology] Research Data Visualization Course for Postdoctoral Researchers

  • [Wonkwang University] Wonkwang University AI Collective Training and AI Short/Long-term Courses

  • [National Information Society Agency] SW Education for Women Professionals

  • [SK m&service] Data-Driven Decision Making

  • [Korea IT Business Promotion Association] ICT COG Academy

  • [Seoul Metropolitan Office of Education] Training in New Technology Fields

  • [KT] KT AI Competency Enhancement Course

  • [K-ICT] Data Safe Zone Analysis Camp

  • [Gyeonggi-do Business & Science Accelerator] Vision AI for Beginners

  • [Gyeonggi Business & Science Accelerator] Introduction to Data Analysis with Python

  • [Seoul National University of Science and Technology] Advanced AI Utilization Training

  • [Seoul National University] AI Utilization Capacity Building Training

  • [HD Korea Shipbuilding & Offshore Engineering] AIC AI Research Position Competency Assessment Development

  • [Multicampus] Mastering Core Machine Learning Algorithms: From Principles to Implementation

  • [Fast Campus] A Mathematical Approach to Deep Learning

  • [패스트캠퍼스] Machine Learning and Data Analysis A-Z: All-in-One Master Class

  • [Fast Campus] Byte Degree Lv.2 Deep Learning Essentials

  • [Fast Campus] Deep Learning & AI Super Gap

  • [Fast Campus] Computer Science Super Gap VER.2

    Analysis A-Z [Fast Campus] Byte Degree Lv.2 Deep Learning Essentials [Fast Campus] Deep Learning AI Super Gap [Fast Campus] Computer Science Super Gap VER.2

Curriculum

All

43 lectures ∙ (8hr 53min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

3 reviews

5.0

3 reviews

  • vjeong71170433님의 프로필 이미지
    vjeong71170433

    Reviews 14

    Average Rating 3.9

    5

    30% enrolled

    • galoistheory6041님의 프로필 이미지
      galoistheory6041

      Reviews 38

      Average Rating 5.0

      5

      30% enrolled

      • keyivy20120586님의 프로필 이미지
        keyivy20120586

        Reviews 4

        Average Rating 5.0

        5

        32% enrolled

        $7.70

        asdfghjkl13551941's other courses

        Check out other courses by the instructor!

        Similar courses

        Explore other courses in the same field!