강의

멘토링

커뮤니티

AI Development

/

AI Agent Development

Made in RAG(Local LLM QA System) With Docker + ollama + R2R

In just 2 hours of hands-on practice, we build a local LLM with RAG-based QA system using the Docker + ollama + R2R framework. (Internal/in-house QA systems, personal portfolios, AI-powered work capabilities, and even commercial services are possible.)

(5.0) 1 reviews

19 learners

  • kojeomstudio
실습 중심
Docker
AI
wsl
LLM

What you will learn!

  • You will learn how to operate an LLM locally.

  • Implementing the fabled AI Q&A system locally.

  • Build an AI Q&A system based on specific domain knowledge.

  • You will learn how to build a Docker-based AI system.

  • You will learn how to utilize AI open source projects.

  • An in-house/internal local (or generative AI API) LLM-based RAG system will be implemented.

  • One step closer to realizing AI systems that felt distant.

  • I learn about 'ollama', the ultimate LLM open framework.

I want to create an LLM-based QA system... How do I build it?

AI technology development that feels endlessly difficult!

1) We invite you to the world of AI with a local LLM QA system using Docker, ollama, and R2R framework!

2) From AI infrastructure technology to practical open-source project applications with light, quick steps!

3) You can build On-premise infrastructure without security concerns for internal/in-house use!

Features of this course

📌 After taking the course, build an in-house Local and commercial LLM-based RAG system that can be used immediately in practice!

📌 You can develop a sense for open source projects related to artificial intelligence (AI).

📌 You will gain opportunities to develop and utilize AI technology that may have seemed distant before.

📌 You will experience infrastructure and operating system concepts such as Docker and WSL that are necessary for artificial intelligence (AI) technology infrastructure.

I recommend this for people like this

I want to try utilizing AI and artificial intelligence technology within the company.

Programmers who want to try AI utilization that they hear about everywhere but don't know where to start!

I want to add AI experience to my programmer portfolio too~
Programmers and job seekers who are secretly worried because they've never used any related technologies even once in the AI era!

I'm curious about AI-related open source projects!
A developer curious about how to use related open source projects in the AI era!

After taking the course

  • Before you know it, you'll find yourself taking a step forward in utilizing AI technology.

  • You will make a name for yourself as a developer who built an AI system within the company.

  • You'll find yourself surprised, thinking "AI development was this close to me all along!?"

  • You will gain a deeper understanding of the concepts of artificial intelligence and AI.

  • You will learn the concepts and usage methods necessary for infrastructure such as WSL and Docker.

  • You will learn about AI Q&A systems through LLM-based RAG systems.

You'll learn content like this.

Convenient embedding work through R2R dashboard

Conveniently work on domain knowledge embedding required for QA systems.

Build an LLM-based QA system that feels so distant!

Experience an LLM QA system built on ollama, docker, and wsl!

The person who created this course

  • Currently a genuine programmer at major game company N.

  • A person with great interest in systems/programming/game development/DevOps/subculture/drawing.

  • A person with a firm belief that AI and subculture will change the world.


  • A person who believes that the true seeds of growth lie in mistakes and failures.

Pre-enrollment Reference Information

Practice Environment

  • The course is conducted based on Windows 10.

  • You will be using a Linux kernel-based virtual machine provided by Windows. (WSL)

  • You will install and use the Docker system on WSL.


Based on the lecture content, for R2R, it would be good to proceed with the included version (3.6.0).

However, assuming that the R2R framework continues to be improved, proceeding with the latest version shouldn't cause major issues. (You should consider that some commands or settings may change.)

For version 3.6.0, please refer to the Release Tags in the official R2R GitHub repository or use the link separately archived by the author.

github

docker hub : docker pull kojeomstudio/r2r:3.6.0

  • You can directly pull version 3.6.0. (Image created by the author)


p.s. For R2R-dashboard, since there are few changes, you can use the latest version.

Learning Materials

Recommended for
these people

Who is this course right for?

  • Programmer wanting to try implementing an AI system

  • Aspiring programmer looking to build an AI system portfolio

  • Programmer who wants to build an in-house, specific domain-based AI Q&A system

  • Person looking to run LLM locally.

  • Programmer wanting to ride the AI wave

  • Developers aspiring to build Docker-based AI systems

  • AI open-source project novice

  • Programmer eager to apply AI open-source projects in practice

Need to know before starting?

  • Docker

  • Basic Concepts of LLM

  • Desire and will to enhance AI proficiency

  • AI system infra build interest

  • Interest in open source projects

Hello
This is

1,000

Learners

29

Reviews

4.8

Rating

5

Courses

 

 

장송의 프리렌 그림.jpg.webp

 

※ 현재 대기업 게임 N사에서 프로그래머로 살고 있습니다.

※ 시스템/게임 개발/프로그래밍/데브옵스/드로잉/서브컬처/AI에 관심이 많습니다.

※ 서브컬처와 AI가 세상을 바꿀 수 있다고 믿고 있습니다.

※ 깃허브 >> https://github.com/kojeomstudio

※ 도커 허브 >>https://hub.docker.com/repositories/kojeomstudio

 

Curriculum

All

7 lectures ∙ (1hr 47min)

Published: 
Last updated: 

Reviews

All

1 reviews

5.0

1 reviews

  • 류하경님의 프로필 이미지
    류하경

    Reviews 2

    Average Rating 5.0

    5

    100% enrolled

    $59.40

    kojeomstudio's other courses

    Check out other courses by the instructor!

    Similar courses

    Explore other courses in the same field!