arachnephobi0028

From Multi-Head Attention to the Original Transformer model, BERT, the Encoder-Decoder based MarianMT translation model, and even Vision Transformer, you'll learn Transformer inside and out by implementing them directly in code.

dooleyz3525

Learning Transformer Through Implementation

이론과 실습 한 번에

이론 실습 모두

transformer

바닥부터구현

입문

초급

중급이상

Deep Learning(DL)

파이토치

PyTorch

encoder-decoder

bert

Course Introduction and Lab Environment Setup

Prerequisite Knowledge for Transformer - Understanding NLP Foundations and RNNs

Transformer Overview and Multi-Head Self-Attention Implementation

Transformer Encoder Implementation

Transformer Decoder Implementation

Handling Hugging Face Datasets

Handling Hugging Face Tokenizer and DataCollator

BERT Model Implementation, Training, and Inference

Implementation of the MarianMT Encoder-Decoder Translation Model

Training and Inference of the Implemented MarianMT Model

Vision Transformer (ViT) Implementation