wj08286955

It explains the fundamental principles of large language models like ChatGPT, focusing on theory.

arigaram

Understanding the Fundamental Principles of Large Language Models (LLMs)

llm성능평가및튜닝

chatGPT

chatgpt

생성형AI

생성형ai

입문

초급

중급이상

자연어처리(Natural Language Processing)

챗지피티

ChatGPT

대규모 언어 모델

[Basic] Understanding Generative AI

[Advanced] Understanding Generative AI (Advanced)

[Practice] 'Understanding Generative AI' Practice Session

[Basic] In-depth Understanding of Language Model Principles

[Practice] 'In-depth Understanding of Language Model Principles' Practice

[Basic] Autoregressive Model vs. Self-Attention Model

[Advanced] Deep Dive into 'Autoregressive Models vs. Self-Attention Models'

[Practice] 'Autoregressive Model vs. Self-Attention Model' Practice

[Advanced] Transformer Architecture

[Hands-on] 'Transformer Architecture' Practice --> Input and Representation

[Practice] 'Transformer Architecture' Practice --> Understanding and Implementing Attention --> Theory of Scaled Dot Product Attention

[Practice] 'Transformer Architecture' Practice --> Understanding and Implementing Attention --> Implementation of Scaled Dot Product Attention

[Practice] 'Transformer Architecture' Practice --> Understanding and Implementing Attention --> Implementation of Multi-Head Attention

[Practice] 'Transformer Architecture' Practice --> Transformer Block Components

(Posting in progress) [Hands-on] 'Transformer Architecture' Practice --> Transformer Full Architecture

(Scheduled) [Hands-on] 'Transformer Architecture' Practice --> Pre-trained Models and Applications

[Advanced] Comparison of Open-Source LLMs and Closed-Source LLMs

[Practice] 'Comparison of Open-Source LLM and Closed-Source LLM' Practice

[Basic] Understanding Basic Concepts Related to LLM Training

[Advanced] Deep Dive into 'Understanding Basic Concepts of LLM Training'

(Published) [Basic] A Taste of Tokenization Implementation for LLMs

[Advanced] Mastering Tokenization for LLMs --> Beginner's Guide

[Advanced] Mastering Tokenization for LLMs --> Intermediate Level

[Advanced] Mastering Tokenization for LLMs --> Advanced Edition

[Basic] Understanding the Entire LLM Production Process - (1) Building a Foundation Model

(Posting in progress) [Basic] Understanding the Entire Process of LLM Creation - (2) Follow-up Tasks

(Scheduled) [Basic] Understanding the Entire LLM Production Process - (3) Enhancement and Maintenance During Operation (LLM-Ops)

[Advanced] Understanding the Entire LLM Production Process - (1) Project Planning

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (2) Data Collection

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (3) Data Cleaning

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (4) Dataset Management

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (5) Tokenization

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (6) Pre-Training

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (7) Fine-Tuning

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (8) Reinforcement Learning for Alignment

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (9) Performance Evaluation

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (10) Safety Verification

(Scheduled) [Advanced] Understanding the Entire Process of LLM Creation - (11) Deployment

(Scheduled) [Advanced] Understanding the Entire Process of LLM Production - (12) Operations

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' - (1) Comprehensive Summary of the Hands-on Process

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (2) Environment Preparation

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (3) Data Preparation

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Practice - (4) Tokenizer

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (5) Model Implementation

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (6) Training

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (7) Fine-tuning

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (8) Inference

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (9) Evaluation

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (10) Safety

(Scheduled) [Hands-on] 'Understanding the Entire LLM Production Process' Workshop - (11) Deployment

[Basic] LLM Training Process Details

(Scheduled) [Advanced] 'LLM Training Process Details' Advanced Course

[Hands-on] 'LLM Training Process Details' Practice

[Basic] LLM Evaluation Methods

(Scheduled) [Advanced] Deep Dive into 'LLM Evaluation Methods'

[Practice] 'LLM Evaluation Methods' Practice

[Basic] LLM Lightweighting

(Scheduled) [Advanced] 'LLM Weight Reduction' Deep Dive

(Scheduled) [Hands-on] 'LLM Weight Reduction' Practice

(Scheduled) [Advanced] Ethical Considerations of LLM and Responsible AI

(Scheduled) [Hands-on] 'Ethical Considerations of LLM and Responsible AI' Workshop

(Scheduled) [Advanced] LLM Application and Deployment Strategy

(Scheduled) [Hands-on] 'LLM Application and Deployment Strategy' Practice Session

[Advanced] Current State of Latest LLM Technology

(Scheduled) [Hands-on] 'Latest LLM Technology Trends' Hands-on Session

(Scheduled) [Advanced] Latest LLM Research Trends and Future Outlook

(Scheduled) [Hands-on] 'Latest LLM Research Trends and Future Outlook' Hands-on Session

(Scheduled) [Advanced] Practical Application of Generative AI

(Scheduled) [Hands-on] 'Practical Application of Generative AI' Workshop

(Tentative) [Advanced] Guide to Small-scale Practice and Project-Based Learning Methods

(Scheduled) [Hands-on] 'Guide to Small-scale Practice and Project-Based Learning Methods' Workshop