Getting Started with Custom LLM Creation – An Introduction to LoRA & QLoRA Fine-tuning

"Your first step to creating a customized LLM with LoRA-based lightweight fine-tuning!" This is an introductory hands-on course designed so that even those new to LLMs can easily follow along. We minimize complex theory and guide you step-by-step through the entire process: loading the model → applying data → training → comparing results. In a short time, you'll directly experience the workflow of cutting-edge lightweight fine-tuning techniques like LoRA and QLoRA, and gain an intuitive understanding of "how LLM fine-tuning works." Even without extensive resources, experience the satisfaction of creating an LLM specialized for your domain!

(4.4) 54 reviews

421 learners

Level Beginner

Course period Unlimited

Deep Learning(DL)
Deep Learning(DL)
NLP
NLP
AI
AI
LLM
LLM
Fine-Tuning
Fine-Tuning
Deep Learning(DL)
Deep Learning(DL)
NLP
NLP
AI
AI
LLM
LLM
Fine-Tuning
Fine-Tuning

Reviews from Early Learners

4.4

5.0

몽상가

32% enrolled

You explain things in a way that makes the concepts easy to grasp, haha.

5.0

컴공과

64% enrolled

It was great to be able to quickly experience both the theory and practice of fine-tuning. The lecture materials and practice resources were organized so neatly, which was very helpful.

5.0

Jang Jaehoon

18% enrolled

Thank you for the great lecture!

What you will gain after the course

  • You can easily understand what fine-tuning is and why LoRA and QLoRA are necessary.

  • You will experience the process of running prepared code, directly loading a small language model (sLLM), and training it.

  • Learn the process of creating a customized LLM tailored to your field without requiring extensive resources or complex theory.

Large Language Models (LLM), LLM Fine-tuning, Where Should I Start?

"LLM Fine-tuning, Where Should I Start?"

This course is designed for beginners to quickly learn the concept and overall flow of fine-tuning and practice it hands-on.

We've boldly reduced complex math and advanced theory, so you can experience step-by-step from loading the model → training → comparing results, and physically feel "Ah, this is how fine-tuning works."

Best of all, it consists of a total of 22 lectures, approximately 1 hour long, short and concise, so even those encountering it for the first time can follow along without burden.

👉 For reference, while dataset construction methods and advanced usage of Huggingface/Unsloth go beyond the scope of this course, they will be covered in future advanced courses. Therefore, this course focuses on helping beginners gain a sense of achievement while understanding the overall picture.

Features of This Course

📌Complete Mastery of the Latest Lightweight Fine-tuning Techniques

We explain the latest techniques such as LoRA, QLoRA, and PEFT step by step from the basics.

📌Hands-on Practice with Various Models

We'll apply techniques hands-on to everything from classic models like GPT-2 and BERT to the latest models including OPT-350M and Llama 3.1.

📌Includes performance comparison analysis

You'll directly compare the performance of Full Fine-tuning and LoRA methods to understand the differences.

📌Beginner-friendly structure

We provide a step-by-step learning flow so that even beginners can easily follow along.

📌Hands-on Practice-Focused Course

Develop a sense for LLM fine-tuning through hands-on practice using Hugging Face and PyTorch.

📌LLM Fine-tuning at a Glance

Without unnecessary extras, containing only the essentials, you can grasp the entire flow in about 1 hour.

This course is recommended for

Junior developers who have used ChatGPT but want to tune it directly with their own data

AI beginner developers who want to understand LLMs through hands-on practice

Those who want to grasp the big picture of LLM fine-tuning in a short time
Those who are curious about cutting-edge techniques like LoRA·QLoRA, but find difficult theories overwhelming. Those who want an easy first step before moving on to advanced courses

LLM beginners who have heard of LoRA and QLoRA but don't know what they are
You can naturally learn the concept of lightweight fine-tuning through hands-on practice without complex theory.

After completing this course

  • You can understand the structure and concept of LoRA and apply it directly to various models.

  • You will gain the complete workflow and hands-on experience to build an LLM specialized for your field.

  • You'll be able to directly compare fine-tuning results and develop the insight to independently select appropriate strategies.

  • You will be able to get a sense of developing an LLM based on your own domain knowledge.


Here's what you'll learn.

Understanding the Basic Concepts of Fine-tuning

  • You'll learn the principles of fine-tuning to optimize pre-trained LLMs for your domain.


Understanding LoRA & QLoRA Architecture

  • Understand the core principles of lightweight fine-tuning easily, without complex theory.


Full vs. LoRA Performance Comparison

  • Experience the performance differences between fine-tuning methods through hands-on experiments.


How to Use Huggingface + PyTorch

  • Learn the essential frameworks needed for actual LLM fine-tuning.

Who created this course

Hello, I'm Lee Jin-gyu, CEO of Happy AI,
passionate about generative AI and LLM fine-tuning practice.người nhiệt huyết với thực tiễn AI tạo sinh và Fine-tuning LLM.

I majored in Natural Language Processing and LLM at an AI graduate school, and since then
have carried out over 200 AI·RAG projects with Samsung Electronics, Seoul National University, Korea Electric Power Corporation, and others,
accumulating practical experience in Private LLM construction, fine-tuning, multimodal RAG, and more.

Recently, I have been conducting numerous
hands-on lectures on LangChain, RAG, and Agent LLM for various companies and public institutions.

This course is designed
❝ so that even beginners can follow along with LoRA-based fine-tuning without complex theory ❞
based on extensive practical experience, structured as a hands-on approach to learning by directly working with models.


📌 Key Career Summary

  • 2024~ CEO of HappyAI (Operating a Generative AI & RAG specialized company)

  • Completed PhD coursework in AI Graduate School (Major in LLM & Natural Language Processing)

  • Public News AI Columnist (serializing on LLM, bias issues, etc.)

  • Over 200 LLM·RAG projects of practical experience


📚 Lecture and Activity Examples

  • KT – LLM-based Agent LLM Development Lecture

  • Samsung SDS – LangChain & RAG Hands-on Training

  • Seoul Digital Foundation – LLM Theory and RAG Chatbot Development

In addition, conducted LLM and big data lectures at numerous companies


🔗 Related Links

Notes Before Taking the Course

Practice Environment

  • All practice code is provided based on Google Colab


  • Reference documents and organized notes will be provided through links.

Learning Materials

  • We'll provide it through a Notion link!

Prerequisites and Important Notes

  • Basic Python syntax


  • Basic AI and LLM knowledge (it would be good if you know the fundamentals of LLM theory)

  • You can take the course with just a Chrome browser and a Google account

Recommended for
these people

Who is this course right for?

  • LLM beginners who have heard of LLMs like ChatGPT but have never done fine-tuning themselves

  • Beginner developers and researchers who want to learn the basic workflow by directly running the latest techniques such as LoRA and QLoRA

  • For those who want to get hands-on experience by running and lightly fine-tuning sLLMs (small language models) to understand the workflow

Need to know before starting?

  • Python basic syntax (variables, functions, conditional statements, etc.)

  • Basic Deep Learning Concepts (fundamental understanding of models, training, loss functions, etc.)

  • Experience with PyTorch or Colab would be helpful

Hello
This is HappyAI

5,487

Learners

329

Reviews

53

Answers

4.5

Rating

12

Courses

Lee JinKyu | Lee JinKyu

Ph.D. in AI Engineering · Adjunct Professor in the Department of AI Software · CEO of Happy AI

Hello.
I am Lee JinKyu, and I research, develop, and teach AI, focusing on natural language processing (NLP) and large language models (LLMs).

I earned a Ph.D. in Engineering specializing in Artificial Intelligence and have conducted research primarily in natural language processing and LLMs.

I am currently an adjunct professor in the Department of AI Software, teaching AI-related courses such as natural language processing and computer vision, and I run HappyAI, a generative AI company.

After working as a natural language processing and big data analysis researcher at a government-funded research institute, and then as a developer at an AI-specialized company, I currently carry out AI projects and training for businesses and public institutions.

At various companies and institutions, including Samsung SDS, KT, Hyundai Wia, and the Seoul Digital Foundation, I have conducted training and projects related to generative AI, LLMs, RAG, AI agents, and fine-tuning.

Additionally, I have conducted natural language processing and text mining research on various types of unstructured data, including documents, surveys, reviews, news media, policy, and academic data, and have experience with research and analysis projects across fields such as healthcare, policy, the environment, law, economics, and education.


Key Career History

  • Adjunct Professor in the Department of AI Software

    • Natural Language Processing

    • Computer Vision

    • Generative AI

    • Data Mining

  • Ph.D. in Engineering (Artificial Intelligence)

     

    • Large Language Model (LLM) and Agent Research

  • CEO of Happy AI

    • Generative AI, LLM, RAG, and AI Agent R&D and education

  • Researcher at a government-funded research institute

    • Natural Language Processing · Big Data Analytics

  • Developer at an AI and Big Data Specialist Company

  • AI Columnist

    • Articles on generative AI, LLMs, RAG, and AI technologies


Key Areas of Expertise

  • Generative AI and large language models (LLMs)

  • RAG · Private LLM

  • AI Agent · Agentic AI

  • AI applications based on LangChain and LangGraph

  • LLM fine-tuning based on LoRA·QLoRA

  • Natural Language Processing (NLP) · Text Mining

  • AI-based data analysis and work automation


Training for Major Companies and Institutions

  • Samsung SDS – LangChain·RAG-based LLM programming

  • KT – LLM/sLLM application development

  • Seoul Digital Foundation – LLM theory and RAG chatbot development

  • Hyundai Wia – Generative AI·AX training

  • Seoul National University of Science and Technology – Python-based text analysis

  • Kyonggi University – Python Using ChatGPT

  • Dankook University – Big Data Expert Program


Key AI Projects

  • Private LLM-based RAG document search and chatbot development

  • Development of Private LLM solutions in an internal network environment

  • LLM Fine-Tuning and Instruction Tuning

  • AI Agent-based business process design

  • Natural language processing and text mining–based research and analysis

  • AI analysis of survey, review, media, policy, and academic data


Research and Publications

  • Conducted domestic and international academic research on natural language processing and LLMs

  • Research on measuring and mitigating LLM bias

  • Numerous papers in the fields of NLP and text mining

  • Experience in AI-related patents and software research and development

  • Book: “Stock Data Analysis with ChatGPT”


What I Consider Most Important in My Lectures

AI technology is changing rapidly, but if you understand the core principles, you can learn new technologies much faster.

In the lectures, rather than simply following features or code,

“what it is → why it is needed → how it works → where it is used in practice”

I consider it most important to explain things clearly so that you can understand them.

Rather than explaining complex AI technologies in a difficult way,
I will explain them so that even beginners can understand the overall structure and apply them to real-world work and projects.


Inquiries about lectures and projects

Email
leejinkyu0612@naver.com

Homepage
https://happyaidata.kr

YouTube
https://www.youtube.com/@HappyAI_0612

GitHub
https://github.com/leejin-kyu

Kmong Prime Expert

 

Detailed profile
https://bit.ly/jinkyu-profile

More

Curriculum

All

22 lectures ∙ (1hr 9min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

54 reviews

4.4

54 reviews

  • yariyari3186님의 프로필 이미지
    yariyari3186

    Reviews 1

    Average Rating 5.0

    5

    32% enrolled

    It builds a solid foundation of the basic concepts.

    • doyoung님의 프로필 이미지
      doyoung

      Reviews 7

      Average Rating 5.0

      5

      32% enrolled

      You explain things in a way that makes the concepts easy to grasp, haha.

      • leckar12311219님의 프로필 이미지
        leckar12311219

        Reviews 23

        Average Rating 5.0

        5

        100% enrolled

        It was really great to be able to get an overall grasp of fine-tuning!

        • justindev님의 프로필 이미지
          justindev

          Reviews 10

          Average Rating 4.9

          5

          64% enrolled

          It was great to be able to quickly experience both the theory and practice of fine-tuning. The lecture materials and practice resources were organized so neatly, which was very helpful.

          • jjhgwx님의 프로필 이미지
            jjhgwx

            Reviews 1,145

            Average Rating 4.9

            5

            18% enrolled

            Thank you for the great lecture!

            HappyAI's other courses

            Check out other courses by the instructor!

            Similar courses

            Explore other courses in the same field!