강의

챌린지

멘토링

로드맵

커뮤니티

Embeddings and Mini GPT Explained by a Silicon Valley Developer

If you’ve found it difficult to explain what’s happening under the hood while using AI and embeddings, this course may be the answer. Drawing on the experience of a practicing AI developer in Silicon Valley, it helps you understand the principles of AI through code by implementing everything from embeddings and Word2Vec to automatic differentiation and transformers yourself.

(5.0) 14 reviews

662 learners

Level Basic

Course period Unlimited

Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent
Python
Python
Business Productivity
Business Productivity
AI
AI
ChatGPT
ChatGPT
AI Agent
AI Agent

Reviews from Early Learners

5.0

5.0

강평이

88% enrolled

This is the best course for truly understanding the underlying principles beyond simply using APIs. Even though I had been using LLM and embedding APIs, I had always wanted to understand exactly what mathematical and structural principles were at work under the hood. Starting with text preprocessing, this course guides you through implementing Word2Vec, automatic differentiation, the Transformer architecture, and even a mini GPT directly from scratch in code, helping you fully grasp how AI works. Even complex and difficult concepts are explained clearly and intuitively, allowing me to stay engaged and complete the course. I highly recommend it to anyone who wants to understand the fundamental principles underlying models rather than merely using libraries.

5.0

02년생 개발자

81% enrolled

Honestly, the material isn’t easy. If anything, it’s difficult. But I really enjoyed it. 1. Since the material is difficult, high-quality resources are provided, and everything is explained in detail. 2. Because the material is difficult, it covers things that aren’t easy to learn elsewhere, including content that can only be learned through this course. 3. It doesn’t just deal with theory; we work through the code together and proceed by taking actual measurements. Since all the materials and videos needed to create an environment where you can study and put in the effort are provided through this course, if you have the motivation to study on your own, I don’t think you’ll find better content than this.

5.0

seha incheon

100% enrolled

It was a very valuable course that covered everything from the embedding process, starting with the basic concepts, to training and running an actual model. I’m really glad I had the opportunity to watch a course like this. I wonder if Inflearn offers any other courses like this?? Most courses seem to focus only on using Codex or Claude Code, but I don’t think there are many that delve into the internal, core technical aspects like this one.

What you will gain after the course

  • You can directly perform text preprocessing and construct training data using Python.

  • By implementing the principles of embeddings and Word2Vec, you can explain how words and sentences are represented as vectors.

  • By implementing automatic differentiation and gradient descent, you can understand how models learn and improve their performance.

  • You can implement a Transformer and a mini GPT from scratch to examine the next-token prediction process.

  • You can create a simple AI agent that answers questions by combining embedding search with a mini GPT.

  • You can diagnose and improve the model’s prediction errors and learning issues through step-by-step missions and experiments.

Recommended for
these people

Who is this course right for?

  • A developer who wants to understand how AI works internally through code, based on Python

  • Those who want to directly examine the generation process and limitations while using ChatGPT and AI Agents

  • Those who use embeddings and vector search but find it difficult to explain how the results are generated

  • For those who want to go beyond using AI libraries and implement Word2Vec, automatic differentiation, and transformers themselves.

  • Those who want to complete their own mini GPT or AI Agent through step-by-step missions and hands-on projects

  • Those who want to analyze and improve the causes of a model’s strange answers and performance degradation themselves

Need to know before starting?

  • It would be good to know Python.

Hello
This is Hong

Inflearn Verified

Career Verified

13,173

Learners

675

Reviews

183

Answers

4.8

Rating

34

Courses

I started studying development after becoming interested in it while idling around at home, and I am currently responsible for platform server development in Pangyo. I continue sharing my knowledge because I want to provide you with the methods I used to study, as well as various issues you may encounter in practice and their solutions.

 

The courses are not created solely from my own knowledge. Every course is made possible with the help of others.

 

[Knowledge Sharer Experience]

[Former] Blockchain developer specializing in Sandbox IP

[Former] Metaverse backend developer

[Current] A server developer stagnating in Pangyo

 

[Interview History]

[Other Inquiries]

[Official Website and Social Media]

More

Curriculum

All

32 lectures ∙ (8hr 39min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

14 reviews

5.0

14 reviews

  • gjsu540607534님의 프로필 이미지
    gjsu540607534

    Reviews 16

    ∙

    Average Rating 5.0

    5

    81% enrolled

    Honestly, the material isn’t easy. If anything, it’s difficult. But I really enjoyed it. 1. Since the material is difficult, high-quality resources are provided, and everything is explained in detail. 2. Because the material is difficult, it covers things that aren’t easy to learn elsewhere, including content that can only be learned through this course. 3. It doesn’t just deal with theory; we work through the code together and proceed by taking actual measurements. Since all the materials and videos needed to create an environment where you can study and put in the effort are provided through this course, if you have the motivation to study on your own, I don’t think you’ll find better content than this.

    • jhong
      Instructor

      Hello, developer born in 2002. Thank you for leaving such a kind review!! As you mentioned, the material probably wasn’t easy. However, because it’s genuinely difficult, I put a lot of effort into explaining it as clearly as possible and preparing plenty of resources. I chose a topic that I believe you absolutely won’t regret exploring. Rather than simply thinking, “I tried using Claude Code,” I hope you can broaden your perspective to think, “Since I learned Claude Code this way, it might be good to use it like this, right??” Thank you!

  • achoi68339754님의 프로필 이미지
    achoi68339754

    Reviews 4

    ∙

    Average Rating 5.0

    Edited

    5

    100% enrolled

    Of all the courses I’ve taken on Inflearn, this was by far my favorite, and I learned an incredible amount. I think this may be the first course I’ve seen where you actually train a real model and then make it perform tasks based on what it learned. In practice, I’ve only been using things like Claude or Codex because they work well, without really thinking much about what was under the hood. Seeing this content made me realize that I had truly been a frog in a well. I thought it would be great if others could refer to this, so I’ll briefly summarize what the course covers!! 1. You explain what embeddings are. Without understanding this concept, it’s difficult to follow anything that comes afterward. 2. You start by covering the fundamental concepts of what’s needed to implement a model, and then we build the model together through hands-on practice, with about 90% of the course being practical. 3. We also train the model on data, and you explain concepts such as transformers and blocks—things you wouldn’t really know unless you had actually worked on development. 4. You also share realistic, highly useful tips from time to time. These were incredibly valuable. It really felt like an exceptionally skilled senior mentor was teaching me development while sharing lessons from real-world experience. Overall, actually building and training a real model broadened my perspective so much... Once again, thank you for providing such an informative course. Content at this level was truly impressive and memorable in my development career. You saved a person...!!

    • jhong
      Instructor

      Hello, thank you so much for leaving such a great review!! This topic is admittedly quite deep, so I gave it a lot of thought, but I believe it’s a subject where you can actually learn a great deal once you understand it. I expected the content might not be easy. Since there’s so much you can learn from it, I hope you’ll continue to show it lots of interest!! Thank you!

  • kasju72796603님의 프로필 이미지
    kasju72796603

    Reviews 3

    ∙

    Average Rating 5.0

    5

    72% enrolled

    I can really see why this is a course.. More than the topic of using an AI Agent, I was incredibly curious about how it’s structured internally. And the materials are so comprehensive as well. It really shows how passionate the instructor is about this topic.

    • jhong
      Instructor

      Hello Hyunwoo, thank you so much for leaving a review!! I truly mean it!! Haha. I worked really hard to prepare this, so I hope you’ll get a lot out of it!! Have a great day!

  • kask814587762님의 프로필 이미지
    kask814587762

    Reviews 8

    ∙

    Average Rating 5.0

    5

    81% enrolled

    It was incredibly helpful how you explained the difficult content as simply as possible and provided examples.

    • jhong
      Instructor

      The more difficult the topic, the more thoroughly we should explain it, haha. Thank you for leaving such a kind review!!

  • jukascrow6433님의 프로필 이미지
    jukascrow6433

    Reviews 13

    ∙

    Average Rating 5.0

    5

    81% enrolled

    The material isn’t easy. So it took me quite a while to understand and complete the course, but it’s truly worthwhile. If you aspire to become an AI developer, I think this is a course everyone should take at least once. I mentioned earlier that it’s difficult, but that also means there’s a lot of material. So if you have the determination to study, I don’t think there’s any other topic where you can learn this much. Thank you for the great content!

    • jhong
      Instructor

      This is something I deeply relate to. “If you have the will to study” is the guiding principle I hold most strongly as I create lectures and share my knowledge with you. Studying itself is something you have to do on your own. But I want to be your support and mentor throughout that process—and help guide you in the right direction as well!! I hope you’ll learn a lot through this course. Thank you!

Hong's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!