inflearn logo

Practical LLM Service Development for Spring Developers

This is a practical course on building a RAG-based document search system using the OpenAI API and Spring AI in a Spring Boot environment. You will learn the entire process of developing an AI assistant step by step, from the concepts of Prompt Engineering, Vector Stores, and Embeddings to rapid prototyping with Dify, MCP tool integration, multimodality, and guardrails. You can learn practical application strategies by comparing direct implementation with the use of no-code tools. 🆕 [Update] Section 4 now includes a supplementary lecture (1 hour) on TypeSafe’s Jev decision-making model, covering how to design an agent’s decision-making logic in greater depth.

(5.0) 5 reviews

769 learners

Level Basic

Course period Unlimited

openai
openai
vector-database
vector-database
prompt engineering
prompt engineering
RAG
RAG
Spring AI
Spring AI
openai
openai
vector-database
vector-database
prompt engineering
prompt engineering
RAG
RAG
Spring AI
Spring AI

What you will gain after the course

  • Practical Experience Implementing ChatClient, Structured Outputs, and Streaming Responses with Spring AI

  • The ability to build a vector store–based RAG pipeline from design to chunking strategy.

  • Experience completing production-grade LLM services, from MCP tool integration and multimodal processing to applying guardrails.

  • How to Configure a Dify Knowledge–Based AI Assistant and Integrate It with Spring Boot

Complete LLM services with Spring, from RAG to production and Jev decision-making models

This course aims to equip Spring Boot developers with the capability to develop LLM services that they can use right away in real-world projects. Starting with the basics of using ChatClient in Spring AI, structured output, and streaming response implementation, the course progressively covers building RAG pipelines (vector store integration, chunking strategies, and search quality improvements), integrating external tools with MCP, processing multimodal inputs such as images, Dify integration, and applying guardrails for service stability. Finally, you will complete a practical, service-ready deliverable through a mini-project that integrates everything you have learned.

  • Internal document/knowledge search: Convert internal documents, manuals, and wikis into a searchable chatbot using a RAG pipeline

  • Commerce/Retail AI integrations: Configure backend functions such as order lookup and product recommendations so that the LLM can call them directly through MCP-based tool integration (incorporating patterns used in an actual large-scale retail MCP commerce integration project)

  • Financial/Enterprise AI Services: Designing AI service architectures for the financial sector, where response reliability and stability are critical, by applying guardrails

  • Multimodal document processing: Services that analyze documents containing images (such as contracts and reports) simultaneously

Features of This Course

📌 Hands-on practice with executable Spring Boot example projects, going beyond theoretical explanations

📌 We share the real-world problems you may encounter when building a RAG pipeline (such as chunking strategies and degraded search quality) and the process of solving them as-is.

📌 Reflects the latest ecosystem trends from a practical perspective, including MCP, multimodality, and Dify integration

📌Experience the structure of a complete service—not just individual features—through a mini project :)

Recommended for those who...

I want to level up through LLM development.
For those with Spring backend experience who feel unsure where to start with LLM services

I'm interested in building RAG services.
Those who only know RAG as a concept and want to understand how it works by implementing it themselves

I'm interested in the Spring AI development course.
Professionals who need to build internal document search, chatbots, and AI assistant features using Spring.

After completing the course,

  • You will be able to design and implement your own LLM services using the core components of the Spring AI ecosystem. You will develop the ability to turn ideas into service architectures by combining ChatClient, vector stores, MCP, and guardrails.

  • You will be able to independently diagnose and improve issues that arise in RAG pipelines. You will develop practical debugging skills to identify and fix the causes of poor search quality by examining chunking strategies, prompts, and vector search parameters individually.

  • You will be able to personally lead the process of transforming internal documents and manuals into a searchable chatbot. You will reach a level where you can design RAG-based knowledge retrieval systems from start to finish, from requirements analysis through implementation.

  • You will be able to design integration workflows that use MCP to let LLMs directly call backend functions (retrieval, recommendations, processing, etc.). You will be able to independently map out architectures that connect existing APIs, such as commerce and internal systems, to LLM workflows.

  • You will be able to lead the initial architecture of AI services that require guardrails and reliability standards (such as finance and internal regulatory compliance). Rather than focusing on a "working demo," you will be able to participate in design discussions based on the standards of a "service you can trust and use."

You’ll learn the following.

1. Spring AI Core Fundamentals

  • The basic structure and invocation methods of ChatClient, and how to configure prompt templates

  • How to safely map LLM responses to Java objects using structured output (Structured Output)

  • Streaming Response Implementation — Backend design for supporting a chat-style UI where answers are displayed in real time

2. Tool and Multimodal Extensions

  • Integrate MCP (Model Context Protocol) so that the LLM can directly call external tools (backend functions such as retrieval, processing, and recommendations).

  • A service architecture that processes multimodal inputs, such as images, together (including examples of analyzing mixed documents and images, such as contracts and reports)

  • How to combine no-code workflows with a Spring backend through integration with Dify

  • [Supplementary Lecture] Designing Agent Decision-Making Logic with the TypeSafe Jev Decision Model


3. Building a RAG Pipeline

  • Designing the Architecture for Vector Store Integration and Embedding Storage/Retrieval

  • Comparison of document chunking strategies (token-based vs. paragraph-based) and selection criteria by situation — An introduction to a case where search quality actually deteriorated and the strategy was changed

  • How to diagnose and improve causes of degraded search quality (such as damaged semantic units and the inclusion of low-relevance chunks)


4. Service Stabilization and Real-World Projects

  • How to filter out incorrect responses and potentially exploitable inputs by applying guardrails

  • Reliability design standards required in domains where trustworthiness is critical, such as the financial sector

  • Conduct a mini project that integrates all the elements learned so far (ChatClient, RAG, MCP, multimodality, and guardrails) into one.

The person who created this course

I believe that “Knowledge in your head is not knowledge.” With this in mind, I strive to package the small amount of experience and knowledge I have and explain it in a way that is easier to understand. I believe this course will be easier to understand for those who are interested in the fields of LLMs and AI based on Java and Spring Framework technologies.

  • With 26 years of experience in teaching, consulting, and development, I conduct lectures designed to help participants understand practical experience and know-how.

  • My current work as an architect and engineer: I directly design and develop GraphRAG-based knowledge graph systems and enterprise AI platforms.

    • 2023 ~ Present: CEO of NJOne Company Co., Ltd.


    • Formerly) Adjunct Professor, Department of Information Security, Graduate School of International Information, Dongguk University

    • Former) JP Morgan Chase AMJ Tech consultant (Japan)

    • Formerly) Samsung SDS CMS Business Division, Lead Engineer

  • Financial-sector AI/LLM project execution: By repeatedly carrying out AI- and LLM-related projects in the financial sector, I gained practical experience designing and implementing LLM services in the financial domain, where reliability and stability are especially important.

  • Years of teaching MSA, cloud-native technologies, and AI: I teach courses in Spring Boot, Spring Cloud, MSA, Kafka, Blockchain, Machine Learning, Deep Learning, and DevOps.

  • Corporate training and curriculum design: I have designed curricula for and personally taught numerous corporate and bootcamp courses, including cloud, MSA, security, and AI programs. My guiding principle is to incorporate hands-on project experience into my lectures rather than stopping at theory.


Do you have any questions?

Q. Can I take this course even if I know nothing about AI or machine learning?

A. Yes, it is. This course covers LLM service development from a Spring developer’s perspective, explaining AI-related concepts as they become necessary.

Q. Does the hands-on practice incur any costs?

A. Using LLM APIs may incur costs, and we also provide guidance on how to practice using local models such as Ollama. The total cost of taking the course may vary depending on how many times you run the exercises, but approximately $1~$2 in API fees may be incurred. The course uses models provided by OpenAI.

Q. Can I follow along even if I’m new to RAG and MCP?

A. Yes, the course is structured step by step, from explaining the concepts to hands-on practice, so even beginners can follow along without difficulty.

Q. Can I apply what I learn to a real-world service after completing the course?

A. The mini-project in the latter part of the course reflects the structure of a real-world service, so you can apply it directly to in-house projects or personal services.

Q. Is the course updated regularly?

A. Yes. For example, Section 4 now includes an additional one-hour supplementary lecture covering TypeSafe’s Jev decision-making model.

Things to Note Before Enrolling

Practice Environment

  • The course is explained using macOS (based on Sequoia 15.7.4), but those using Windows can also follow along easily.

  • In this course, the hands-on exercises are conducted using IntelliJ IDEA and Postman based on OpenJDK 21+.

  • We use Maven or Gradle as the build tool.

  • Docker Desktop must be installed to run a Docker container for the PGVector exercises.

  • We use Postman to test the implemented APIs and directly call them to verify streaming responses and other features.

Learning Materials

  • PDF slide materials provided for each section

  • A runnable Spring Boot example project is provided (the GitHub repo is made public in the course materials).

Prerequisites and Notes

  • Basic experience using Spring Boot required (understanding of REST APIs)

  • No prior knowledge of AI/LLMs is required

  • An LLM API key (or an environment for running a local model) may be required for the exercises (details will be explained in the hands-on examples).

Recommended for
these people

Who is this course right for?

  • A backend developer with Spring Boot experience but no prior experience developing LLM/AI services

  • Developers who want to apply RAG, vector search, and more to real-world projects—not just at a tutorial level

  • An AI service planner who wants to understand RAG and LLM technologies through hands-on practice

  • Practitioners who need to directly implement in-house AI features (chatbots, document search, recommendations, etc.) using Spring.

Need to know before starting?

  • Understanding Spring Boot Basics and REST API Concepts

  • Understanding of Java programming fundamentals and object-oriented concepts

  • Basic understanding of HTTP communication and JSON data processing

Hello
This is Dowon Lee

Inflearn Verified

32,111

Learners

1,786

Reviews

1,392

Answers

4.8

Rating

10

Courses

I am an IT engineer. There was a time when I wondered which word I should choose for the occupation field: "office worker?", "developer?", or "instructor?" Then I came to think that “IT engineer” was the job title that suited me best, so I have continued to write "IT engineer" in the occupation field.

A profession represents the work you do, and I believe that work should be enjoyable and useful. Although no one can live by doing exactly the work they want, I am someone who likes the work I do and wants to do it well. Having worked as a developer, instructor, and consultant, I am constantly struggling to keep up with newly released and ever-changing IT technologies. Even so, I am one of those people who wants to encounter, share, and use them even a little earlier than others.

The field I have recently become interested in is online education consulting. The technologies I am interested in include Cloud Native Architecture, Blockchain, Machine Learning, Kafka, and Kuberbetes. I actually teach courses on these technologies and apply them in my work as well. However, since they are such vast topics, I am still continuously studying them.

They say that what you keep in your head is not true knowledge. I intend to share my knowledge and experience in various ways. And I will continue to be an IT engineer who takes on new challenges in new fields and with new technologies.

 

 

  • Current) CEO of NJ One Company

  • Current) Adjunct Professor, Department of Information Security, Graduate School of International Information, Dongguk University

  • Former) JP Morgan Chase AMJ Tech consultant (Japan)

  • Former) Samsung SDS CMS Business Division Lead Engineer

 

 

More

Curriculum

All

132 lectures ∙ (21hr 6min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

5 reviews

5.0

5 reviews

  • 93backend님의 프로필 이미지
    93backend

    Reviews 5

    ∙

    Average Rating 5.0

    5

    24% enrolled

    The course content is very good. It was great to be able to learn not only about Spring AI but also about AI-related concepts themselves. However, while listening to the lectures, I could continuously hear a strange high-frequency noise. I hope this can be improved next time.

    • kenneth
      Instructor

      Hello, this is Lee Do-won. Thank you for taking the course and sharing your valuable feedback. I’m glad to hear that it helped you understand not only Spring AI but also AI-related concepts. I apologize for the inconvenience caused by the high-frequency noise you mentioned. I do my best to minimize noise during recording, but some lecture files may contain unwanted noise. If you could let me know the title of the lecture or the section where you hear the noise, I’ll check the video and review whether the audio quality can be improved. I’ll also pay closer attention to the issue you mentioned when recording future lectures. Thank you.

  • godmin9548님의 프로필 이미지
    godmin9548

    Reviews 2

    ∙

    Average Rating 5.0

    5

    30% enrolled

    • oinl17775637님의 프로필 이미지
      oinl17775637

      Reviews 3

      ∙

      Average Rating 5.0

      5

      30% enrolled

      • dglee2585407님의 프로필 이미지
        dglee2585407

        Reviews 14

        ∙

        Average Rating 5.0

        5

        100% enrolled

        • blossommind0637님의 프로필 이미지
          blossommind0637

          Reviews 2

          ∙

          Average Rating 5.0

          5

          61% enrolled

          Dowon Lee's other courses

          Check out other courses by the instructor!

          Similar courses

          Explore other courses in the same field!

          25% off for new members

          $40.60

          25%

          $50.60