Inflearn brand logo image
Inflearn brand logo image
Inflearn brand logo image
AI Development

/

Natural Language Processing

History and Development of LLMs

Describes in detail the various language models developed from the inception of Natural Language Processing technology to the process leading up to the latest LLM models.

8 learners are taking this course

  • arigaram
NLP
RNN
self-attention
transformer
LLM

What you will learn!

  • Language Model Development and Principles of Each Model

  • Origin of NLP

  • Structure and Principle of Transformers

  • RNN, LSTM Structure and Principles

  • Principles of Attention Mechanism

🔍 What you will learn in this course

This lecture focuses on the history and development of large language models (LLMs) , covering recent technological trends and innovative approaches. The lecture is organized into four main sections, each systematically introducing key developments in language models, from their origins to the latest technologies .


Section 1: Origins and Early Development of Language Models

This section covers the fundamental concepts and early research in language modeling. We examine how language processing technologies have evolved and the early limitations and challenges they faced.


Section 2: Language Model Development Before Transformers

We analyze language models that existed before the advent of Transformer models. Specifically, we'll understand how models like RNNs and LSTMs were utilized in natural language processing (NLP) and their limitations.


Section 3: The Transformer Revolution and the Era of Large-Scale Language Models

This article explains how the groundbreaking advancements in transformer models have revolutionized the field of NLP. It focuses on the emergence of large-scale language models like GPT and BERT, as well as their practical applications.


Section 4: Modern LLM Models and Technological Advancements

This section covers cutting-edge LLM technologies , particularly multimodal processing , model lightweighting , device-based execution (LLM-on-Device), and cutting-edge techniques such as reinforcement learning and agentic workflow . We present the evolution of cutting-edge LLMs and their industrial applications.


🔍 Example screen

As shown in the example screen below, various diagrams are used throughout the lecture to explain LLM-related concepts in detail. Specifically, diagrams related to NLP, RNN, self-attention, transformers, and LLM are used for explanation.

Screen example 1 explained in Lesson 3

Screen example 2 explained in Lesson 3

Screen example 3 explained in Lesson 3

Notes before taking the course


Practice environment

  • Because this is a theory-oriented course, no separate practical training environment is required.

Learning Materials

  • The lecture notes are attached in PDF file format.

Player Knowledge and Precautions

  • A background in natural language processing, artificial intelligence, deep learning, and reinforcement learning will help you understand the content better.

Recommended for
these people

Who is this course right for?

  • For those interested in LLM's origin, evolution, and tech trends.

  • Those who want to know about the artificial neural network structure underlying LLMs

  • Those wishing to gain theoretical knowledge for direct LLM development.

Hello
This is

333

Learners

16

Reviews

1

Answers

4.8

Rating

17

Courses

IT가 취미이자 직업인 사람입니다.

다양한 저술, 번역, 자문, 개발, 강의 경력이 있습니다.

Curriculum

All

11 lectures ∙ (5hr 23min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

$17.60

arigaram's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!