inflearn logo

How Does GPT Generate Sentences? | LLM·ViT Lecture ATT Free Release

How does GPT predict the next word and continue writing a sentence? We’re releasing Part 1 of the GPT section of ATT: After The Transformer for free. Understand how language models generate sentences through intuitive explanations, and build a foundation for studying GPT in greater depth.

(5.0) 3 reviews

59 learners

Level Basic

Course period Unlimited

gpt
gpt
Deep Learning(DL)
Deep Learning(DL)
gpt
gpt
Deep Learning(DL)
Deep Learning(DL)
Thumbnail

What you will gain after the course

  • Understanding the basic principle by which GPT generates sentences by predicting the next token

  • Explaining the language model’s sentence generation process from the model’s perspective

Recommended for
these people

Who is this course right for?

  • People who have tried using GPT but are curious about how sentences are generated

  • Those who want to continue learning about GPT and language models after learning about Transformers

Need to know before starting?

  • Fundamental Concepts of Artificial Neural Networks and Deep Learning Training

  • It would be good to understand the basic structures of attention, self-attention, and transformers.

Hello
This is hyukppen

195

Learners

5

Reviews

4.8

Rating

4

Courses

Hello. I’m Hyeokpenheim, a deep learning instructor with a Ph.D. from the KAIST School of Electrical Engineering. After working as a principal researcher at Samsung Electronics and as an adjunct lecturer at the School of Medicine at Sungkyunkwan University, I currently run Hyeokpenheim Academy. I am the author of *Easy! Deep Learning*, an introductory book on deep learning, and have 11 years of teaching experience, having taught approximately 3,000 students in total. I specialize in deep learning theory and PyTorch practice, covering CNNs, transformers, LLMs and vision models, diffusion, and more.

Rather than simply memorizing model architectures or equations, I explain why each idea emerged and how it works. Starting with intuitive analogies, I clarify the meaning of the equations and connect them to code, with the goal of helping learners explain what they have learned in their own words and build a foundation for reading papers in depth.

On the YouTube channel “Hyukpenheim,” we offer lectures ranging from basic mathematics and Python to advanced deep learning topics, as well as providing on-site lectures and training for schools, companies, and organizations.

More

Curriculum

All

3 lectures ∙ (35min)

Published: 
Last updated: 

Reviews

All

3 reviews

5.0

3 reviews

  • chungwoopark1091님의 프로필 이미지
    chungwoopark1091

    Reviews 9

    ∙

    Average Rating 5.0

    5

    100% enrolled

    • human2642622님의 프로필 이미지
      human2642622

      Reviews 104

      ∙

      Average Rating 5.0

      5

      100% enrolled

      • kwkim379303님의 프로필 이미지
        kwkim379303

        Reviews 3

        ∙

        Average Rating 5.0

        5

        100% enrolled

        hyukppen's other courses

        Check out other courses by the instructor!

        Similar courses

        Explore other courses in the same field!

        Free