inflearn logo

[Chuseok Special] A Silicon Valley Developer Explains Embeddings and Mini GPT

If you’ve found it difficult to explain what’s happening under the hood while using AI and embeddings, this course may be the answer. Drawing on the experience of a practicing AI developer in Silicon Valley, it helps you understand the principles of AI through code by implementing everything from embeddings and Word2Vec to automatic differentiation and transformers yourself.

56 learners are taking this course

Level Basic

Course period Unlimited

Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent
Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent

Reviews from Early Learners

5.0

5.0

두쫀쫀쿠

100% enrolled

Of all the courses I’ve taken on Inflearn, this was by far my favorite, and I learned an incredible amount. I think this may be the first course I’ve seen where you actually train a real model and then make it perform tasks based on what it learned. In practice, I’ve only been using things like Claude or Codex because they work well, without really thinking much about what was under the hood. Seeing this content made me realize that I had truly been a frog in a well. I thought it would be great if others could refer to this, so I’ll briefly summarize what the course covers!! 1. You explain what embeddings are. Without understanding this concept, it’s difficult to follow anything that comes afterward. 2. You start by covering the fundamental concepts of what’s needed to implement a model, and then we build the model together through hands-on practice, with about 90% of the course being practical. 3. We also train the model on data, and you explain concepts such as transformers and blocks—things you wouldn’t really know unless you had actually worked on development. 4. You also share realistic, highly useful tips from time to time. These were incredibly valuable. It really felt like an exceptionally skilled senior mentor was teaching me development while sharing lessons from real-world experience. Overall, actually building and training a real model broadened my perspective so much... Once again, thank you for providing such an informative course. Content at this level was truly impressive and memorable in my development career. You saved a person...!!

What you will gain after the course

  • You can directly perform text preprocessing and construct training data using Python.

  • By implementing the principles of embeddings and Word2Vec, you can explain how words and sentences are represented as vectors.

  • By implementing automatic differentiation and gradient descent, you can understand how models learn and improve their performance.

  • You can implement a Transformer and a mini GPT from scratch to examine the next-token prediction process.

  • You can create a simple AI agent that answers questions by combining embedding search with a mini GPT.

  • You can diagnose and improve the model’s prediction errors and learning issues through step-by-step missions and experiments.

Recommended for
these people

Who is this course right for?

  • A developer who wants to understand how AI works internally through code, based on Python

  • Those who want to directly examine the generation process and limitations while using ChatGPT and AI Agents

  • Those who use embeddings and vector search but find it difficult to explain how the results are generated

  • For those who want to go beyond using AI libraries and implement Word2Vec, automatic differentiation, and transformers themselves.

  • Those who want to complete their own mini GPT or AI Agent through step-by-step missions and hands-on projects

  • Those who want to analyze and improve the causes of a model’s strange answers and performance degradation themselves

Need to know before starting?

  • It would be good to know Python.

Hello
This is Hong

Inflearn Verified

Career Verified

10,198

Learners

628

Reviews

169

Answers

4.8

Rating

34

Courses

I started studying development after becoming interested in it while idling at home, and I am currently responsible for platform server development in Pangyo. I am continuing my activities as a knowledge sharer because I want to provide you with the methods I used to study, as well as the various problems and solutions you may encounter in practice.

 

These lectures are not created solely through my own knowledge. There are others who collaborate on every lecture.

 

[Instructor Career]

[Former] Blockchain developer related to Sandbox IP

[Former] Metaverse Backend Developer

[Current] A server developer becoming a veteran in Pangyo

 

[Interview History]

[Other Inquiries]

[Official Site]

More

Curriculum

All

32 lectures ∙ (8hr 39min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

Limited time deal

$40.70

69%

$135.30