aboutexo046263

This is a course covering the GitHub notebooks and bonus content from <Build a Large Language Model from Scratch> (Gilbut, 2025). GitHub: https://github.com/rickiepark/llm-from-scratch/
<Build a Large Language Model from Scratch> is the Korean translation of the bestseller <Build a Large Language Model (from Scratch)> (Manning, 2024) by Sebastian Raschka. This book provides a way to learn and utilize the operating principles of large language models by building a complete model starting from scratch with OpenAI's GPT-2 model.

haesunpark

<Building LLMs from Scratch> GitHub + Bonus Content Commentary

실습 중심

사전훈련

미세튜닝

대규모언어모델

입문

초급

중급이상

파이토치

PyTorch

gpt-2

transformer

대규모 언어 모델

파인튜닝(미세조정)

Fine-Tuning

0 Course Introduction

Chapter 1 Understanding Large Language Models

Chapter 2 Handling Text Data

Chapter 3: Implementing Attention Mechanisms

Chapter 4 Implementing GPT Models from Scratch

Chapter 5 Pre-training Using Unlabeled Data

Chapter 6 Fine-tuning for Classification

Chapter 7 Fine-tuning to Follow Instructions