I was a bit scared to watch because I wasn't prepared for the math, but it was great that you just picked out the summary for me!
5.0
Park Ju Yeong
38% enrolled
I now understand automatic differentiation, which I previously only knew abstractly!
5.0
HuaZ
38% enrolled
This is very helpful for understanding.
What you will gain after the course
History and Theory of Language Models
Early language modeling techniques such as BoW and word embeddings
The Structure of Recurrent Neural Networks (RNNs) and Training Language Models Using RNNs
Core components of a transformer (self-attention, multilayer perceptron, rotary position embedding, key-value caching)
Fine-Tuning Large Language Models and Various Token Sampling Strategies
Parameter-efficient fine-tuning methods: LoRA and prompt engineering
Discount announcement
<Hands-On Machine Learning with Scikit-Learn and PyTorch> Full Book Completion Challenge (https://inf.run/5SDwX) Register now and receive a 50% discount coupon for this course!
Book Introduction
Less complex theory, with only the essential core!
The Most Concise Guide to Learning Language Modeling
As a follow-up to Andriy Burkov’s bestseller *The Hundred-Page Machine Learning Book*, this book provides a concise yet thorough treatment of language modeling, starting with its fundamentals and extending to the latest large language models (LLMs). Through this book, readers can systematically learn the mathematical foundations of modern machine learning and neural networks, count-based methods implemented in Python, RNN-based language models, transformers built from scratch with PyTorch, and hands-on LLM practices, including instruction fine-tuning and prompt engineering.
Built around executable Python code and a Google Colab environment, this hands-on book enables anyone to expand their understanding by following along step by step. It explains how language models evolved from simple n-gram statistics into a core technology of today’s AI, starting with count-based methods and progressing to the latest Transformer architectures, while covering both their principles and implementation. Each chapter builds progressively on the material before it, with clear explanations, illustrations, and exercises that make even complex concepts easy to understand.
Review Quotes
“This book clears up conceptual confusion about how machine learning actually works. It is a gem that captures machine learning with clarity.” - Vint Cerf (Internet pioneer and Turing Award recipient)
“It is an excellent starting point for those taking their first steps in language modeling and seeking to advance toward the cutting edge.” - Tomas Mikolov (developer of word2vec and FastText)
“Andrej paints a journey from the fundamentals of linear algebra to implementing transformers in over a hundred beautiful brushstrokes.” - Florian Douetteau (co-founder and CEO of Dataiku)
“One of the most comprehensive yet concise guides to gaining a deep understanding of how LLMs work internally.” - Jerry Liu (Co-founder and CEO of LlamaIndex)
“He has an almost supernatural talent for distilling the vast concepts of AI into bite-sized pieces that make readers feel, ‘Now I get it!’” - Jorge Torres (CEO of MindsDB)
Although I majored in mechanical engineering, I have worked continuously reading and writing code since graduating. I am a Google AI/Cloud GDE. I run the TensorFlow blog (tensorflow.blog) and explore the fascinating boundary between software and science by writing and translating books about machine learning and deep learning.
I have written 『Deep Learning You Study by Building It Yourself』 (Hanbit Media, 2025), 『Self-Study Machine Learning + Deep Learning (Revised Edition)』 (Hanbit Media, 2025), 『Self-Study Data Analysis with Python』 (Hanbit Media, 2023), 『The Art of Conversing with ChatGPT』 (Hanbit Media, 2023), and 『Do it! Introduction to Deep Learning』 (Aegis Publishing, 2019).
『Hands-On Machine Learning with Scikit-Learn and PyTorch』(Hanbit Media, 2026), 『Deep Learning from the Keras Creator (3rd Edition)』(Gilbut, 2026),『LLM Fine-Tuning, Fast and Focused!』(Insight, 2026), 『LLM & AI with PyTorch』(Hanbit Media, 2026), 『Large Language Models, Fast and Focused!』(Insight, 2025), 『Machine Learning, Fast and Focused!』(Insight, 2025), 『Learn LLMs by Building from Scratch』(Gilbut, 2025), 『Hands-On LLM』(Hanbit Media, 2025), 『Machine Learning Q & AI』(Gilbut, 2025), 『Mathematics for Developers』(Hanbit Media, 2024), 『Practical ML Problem Solving with Python』(Hanbit Media, 2024), 『Machine Learning Textbook: PyTorch Edition』(Gilbut, 2023), 『Stephen Wolfram's ChatGPT Course』(Hanbit Media, 2023), 『Hands-On Machine Learning, 3rd Edition』(Hanbit Media, 2023), 『Generative Deep Learning by Building, 2nd Edition』(Hanbit Media, 2023), 『Python That Awakens Your Coding Brain』(Hanbit Media, 2023), 『Natural Language Processing with Transformers』(Hanbit Media, 2022), 『Deep Learning from the Keras Creator, 2nd Edition』(Gilbut, 2022), 『Machine Learning&Deep Learning for Developers』(Hanbit Media, 2022), 『Gradient Boosting with XGBoost and Scikit-Learn』(Hanbit Media, 2022), 『Learn Deep Learning with the Google Brain Team with TensorFlow.js』(Gilbut, 2022), and 『Machine Learning with Python Machine Learning Libraries (2nd Revised Edition)』(Hanbit Media, 2022), among several dozen books translated into Korean.