inflearn logo

[Chuseok Special] Building Embeddings and a Mini GPT from Scratch with a Silicon Valley Developer

If you’ve found it difficult to explain what’s happening under the hood while using AI and embeddings, this course may be the answer. Drawing on the experience of a practicing AI developer in Silicon Valley, it helps you understand the principles of AI through code by implementing everything from embeddings and Word2Vec to automatic differentiation and transformers yourself.

38 learners are taking this course

Level Basic

Course period Unlimited

Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent
Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent

What you will gain after the course

  • You can directly perform text preprocessing and construct training data using Python.

  • By implementing the principles of embeddings and Word2Vec, you can explain how words and sentences are represented as vectors.

  • By implementing automatic differentiation and gradient descent, you can understand how models learn and improve their performance.

  • You can implement a Transformer and a mini GPT from scratch to examine the next-token prediction process.

  • You can create a simple AI agent that answers questions by combining embedding search with a mini GPT.

  • You can diagnose and improve the model’s prediction errors and learning issues through step-by-step missions and experiments.

Recommended for
these people

Who is this course right for?

  • A developer who wants to understand how AI works internally through code, based on Python

  • Those who want to directly examine the generation process and limitations while using ChatGPT and AI Agents

  • Those who use embeddings and vector search but find it difficult to explain how the results are generated

  • For those who want to go beyond using AI libraries and implement Word2Vec, automatic differentiation, and transformers themselves.

  • Those who want to complete their own mini GPT or AI Agent through step-by-step missions and hands-on projects

  • Those who want to analyze and improve the causes of a model’s strange answers and performance degradation themselves

Need to know before starting?

  • It would be good to know Python.

Hello
This is Hong

Inflearn Verified

Career Verified

10,139

Learners

625

Reviews

169

Answers

4.8

Rating

34

Courses

I started studying development after becoming interested in it while idling at home, and I am currently responsible for platform server development in Pangyo. I am continuing my activities as a knowledge sharer because I want to provide you with the methods I used to study, as well as the various problems and solutions you may encounter in practice.

 

These lectures are not created solely through my own knowledge. There are others who collaborate on every lecture.

 

[Instructor Career]

[Former] Blockchain developer related to Sandbox IP

[Former] Metaverse Backend Developer

[Current] A server developer becoming a veteran in Pangyo

 

[Interview History]

[Other Inquiries]

[Official Site]

More

Curriculum

All

32 lectures ∙ (8hr 39min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

Limited time deal

$1,090,575.00

69%

$135.30