inflearn logo

How Does GPT Generate Sentences? | LLM·ViT Lecture ATT Free Release

How does GPT predict the next word and continue writing a sentence? We’re releasing Part 1 of the GPT section of ATT: After The Transformer for free. Understand how language models generate sentences through intuitive explanations, and build a foundation for studying GPT in greater depth.

14 learners are taking this course

Level Basic

Course period Unlimited

gpt
gpt
Deep Learning(DL)
Deep Learning(DL)
gpt
gpt
Deep Learning(DL)
Deep Learning(DL)
Thumbnail

What you will gain after the course

  • Understanding the basic principle by which GPT generates sentences by predicting the next token

  • Explaining the language model’s sentence generation process from the model’s perspective

Recommended for
these people

Who is this course right for?

  • People who have tried using GPT but are curious about how sentences are generated

  • Those who want to continue learning about GPT and language models after learning about Transformers

Need to know before starting?

  • Fundamental Concepts of Artificial Neural Networks and Deep Learning Training

  • It would be good to understand the basic structures of attention, self-attention, and transformers.

Hello
This is hyukppen

Hello. I’m Hyeokpenheim, a deep learning instructor with a Ph.D. from the KAIST School of Electrical Engineering. After working as a principal researcher at Samsung Electronics and as an adjunct lecturer at the School of Medicine at Sungkyunkwan University, I currently run Hyeokpenheim Academy. I am the author of *Easy! Deep Learning*, an introductory book on deep learning, and have 11 years of teaching experience, having taught approximately 3,000 students in total. I specialize in deep learning theory and PyTorch practice, covering CNNs, transformers, LLMs and vision models, diffusion, and more.

Rather than simply memorizing model architectures or equations, I explain why each idea emerged and how it works. Starting with intuitive analogies, I clarify the meaning of the equations and connect them to code, with the goal of helping learners explain what they have learned in their own words and build a foundation for reading papers in depth.

On the YouTube channel “Hyukpenheim,” we offer lectures ranging from basic mathematics and Python to advanced deep learning topics, as well as providing on-site lectures and training for schools, companies, and organizations.

More

Curriculum

All

3 lectures ∙ (35min)

Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

hyukppen's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

Free