์ฑ„๋„ํ†ก ์•„์ด์ฝ˜

Spring AI Multi-LLM & Orchestrated Multi-Agent ์‹œ์Šคํ…œ

๋ณธ ๊ณผ์ •์€ Spring AIยทSpring Boot๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ GPT, Gemini, LLaMA(๋กœ์ปฌ) ๋ฅผ ์ „๋žต์ ์œผ๋กœ ์กฐํ•ฉํ•ด Multi-LLM ์•„ํ‚คํ…์ฒ˜์™€ ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ ์ค‘์‹ฌ Agent ์‹œ์Šคํ…œ(Main/Sub, Tool, Task Runtime, Agent Registry) ์„ ์„ค๊ณ„ยท๊ตฌํ˜„ํ•˜๋Š” ๊ณ ๊ธ‰ ๊ณผ์ •์ž…๋‹ˆ๋‹ค. ๋‹จ์ผ LLM ํ˜ธ์ถœ์„ ๋„˜์–ด Agentic Workflow Pattern(Chain, Parallel, Routing, Orchestratorโ€“Workers, Evaluatorโ€“Optimizer) ๊ณผ Multi-Agent ๊ตฌ์กฐ๋ฅผ ์ ์šฉํ•˜๊ณ , ToolยทToolRegistry๋กœ RAGยท์™ธ๋ถ€ API/DB ๋“ฑ ์‹คํ–‰ ๋ ˆ์ด์–ด๋ฅผ ๋ถ„๋ฆฌํ•˜๋ฉฐ, DAG ์—”์ง„ยทYAML ์„ ์–ธ์  ์›Œํฌํ”Œ๋กœยท๋กœ๋”ฉ ์งํ›„ ๊ฒ€์ฆ(Validated DSL) ์œผ๋กœ ํ™•์žฅ ๊ฐ€๋Šฅํ•˜๊ณ  ์•ˆ์ •์ ์ด๋ฉฐ, ํ’ˆ์งˆ์ด ์ง€์† ๊ฐœ์„ ๋˜๋Š” AI ์‹œ์Šคํ…œ์„ ๊ตฌํ˜„ํ•˜๋Š” ํ๋ฆ„์„ ๋‹ค๋ฃน๋‹ˆ๋‹ค. ๋˜ํ•œ Circuit Breaker, Reactive Stream, Redis ๋ชจ๋‹ˆํ„ฐ๋ง, ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ, ๋ฐ˜๋ณต ํ‰๊ฐ€ ๋ฃจํ”„๊นŒ์ง€ ํฌํ•จํ•˜๋ฉฐ, Thymeleaf(SSR) ์‹ค์Šต์— ReactยทREST๋กœ ํ”„๋ก ํŠธ/๋ฐฑ์„ ๋‚˜๋ˆ„๊ณ  MCP๋กœ ํˆดยท์—์ด์ „ํŠธ ๋Ÿฐํƒ€์ž„์„ ํ‘œ์ค€ ํ”„๋กœํ† ์ฝœ๋กœ ์—ฐ๋™ํ•˜๋Š” ํ™•์žฅ์„ ๋”ํ•ด ์‹ค์ œ ์šด์˜ ํ™˜๊ฒฝ ์ˆ˜์ค€์˜ AI ์•„ํ‚คํ…์ฒ˜ ์„ค๊ณ„ ์—ญ๋Ÿ‰์„ ๊ฐ–์ถ”๋„๋ก ํ•ฉ๋‹ˆ๋‹ค. ์ตœ์ข… ๋ชฉํ‘œ๋Š” ๋‹จ์ผ API ์—ฐ๋™ยทํ”„๋กฌํ”„ํŠธ ์ˆ˜์ค€์— ๋จธ๋ฌด๋Š” ๋‹จ์ˆœํ•œ AI ์ด์šฉ์ž๊ฐ€ ์•„๋‹ˆ๋ผ, Multi-LLMยท์—์ด์ „ํŠธยท์›Œํฌํ”Œ๋กœยท์„ ์–ธยท๊ฒ€์ฆ์„ ํ•˜๋‚˜์˜ ์‹คํ–‰ ์•„ํ‚คํ…์ฒ˜๋กœ ์„ค๋ช…ยท์ ˆ์ถฉํ•  ์ˆ˜ ์žˆ๋Š”, AI ์‹œ์Šคํ…œ์„ ์„ค๊ณ„ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐœ๋ฐœ์ž๋กœ ์„ฑ์žฅํ•˜๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค.

(4.8) ์ˆ˜๊ฐ•ํ‰ 5๊ฐœ

์ˆ˜๊ฐ•์ƒ 78๋ช…

๋‚œ์ด๋„ ์ดˆ๊ธ‰

์ˆ˜๊ฐ•๊ธฐํ•œ ๋ฌด์ œํ•œ

์‹ค์Šต ์ค‘์‹ฌ
์‹ค์Šต ์ค‘์‹ฌ
AI ํ™œ์šฉ๋ฒ•
AI ํ™œ์šฉ๋ฒ•
springai
springai
AI ์ฝ”๋”ฉ
AI ์ฝ”๋”ฉ
์‹ค์Šต ์ค‘์‹ฌ
์‹ค์Šต ์ค‘์‹ฌ
AI ํ™œ์šฉ๋ฒ•
AI ํ™œ์šฉ๋ฒ•
springai
springai
AI ์ฝ”๋”ฉ
AI ์ฝ”๋”ฉ

์ƒˆ์†Œ์‹

3 ๊ฐœ

  • ์ด์ง„๋งŒ(tootoo)๋‹˜์˜ ํ”„๋กœํ•„ ์ด๋ฏธ์ง€

    ์•ˆ๋…•ํ•˜์‹ญ๋‹ˆ๊นŒ ์ด์ง„๋งŒ ์ž…๋‹ˆ๋‹ค.

    Spring AI Multi-LLM ์•„ํ‚คํ…์ฒ˜์™€

    Orchestration ์ค‘์‹ฌ Multi Agent ์‹œ์Šคํ…œ

    https://inf.run/mYtWS

    ๊ณผ์ •์— ๋Œ€ํ•œ ์—…๊ทธ๋ ˆ์ด๋“œ ์†Œ์‹ ์ „ํ•ด ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

    ๋งŽ์€ ๊ด€์‹ฌ ๋ถ€ํƒ ํ•ฉ๋‹ˆ๋‹ค.

     

    ์ด๋ฒˆ์— Spring AI๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ GPT, Gemini, LLaMA(๋กœ์ปฌ) ๋ฅผ ์ „๋žต์ ์œผ๋กœ ์กฐํ•ฉํ•˜๋Š” Multi-LLM ์•„ํ‚คํ…์ฒ˜์™€, Main/SubยทToolยทTask๋กœ ์ด์–ด์ง€๋Š” Orchestrated Multi-Agent ์‹œ์Šคํ…œ์„ ์„ค๊ณ„ยท๊ตฌํ˜„ํ•˜๋Š” ๊ณ ๊ธ‰ ๊ณผ์ •์„ ์•ˆ๋‚ด๋“œ๋ฆฝ๋‹ˆ๋‹ค.

    ์ด ๊ณผ์ •์—์„œ ๋‹ค๋ฃจ๋Š” ํ•ต์‹ฌ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.

    • ๋‹จ์ผ LLM ํ˜ธ์ถœ์ด ์•„๋‹ˆ๋ผ Agentic Workflow(Chain, Parallel, Routing, Orchestratorโ€“Workers, Evaluatorโ€“Optimizer)๋กœ ํ™•์žฅยท์•ˆ์ •ยท์ง€์† ํ’ˆ์งˆ ๊ฐœ์„ 

    • Multi-LLM ๋ผ์šฐํŒ…ยทFallbackยท๋ณด์•ˆ ๋ถ„๊ธฐ๋กœ ์šด์˜ยท๊ทœ์ œ๋ฅผ ์ „์ œ์— ๋‘” ๋ชจ๋ธ ์„ ํƒยท์ „ํ™˜

    • ๋ฉ€ํ‹ฐ ์—์ด์ „ํŠธ ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ โ€” Agent Registry, Tool/RAG ์‹คํ–‰ ๋ถ„๋ฆฌ, Task Runtime๊ณผ HTTPยทSSEยทRedis๋กœ ์ง„ํ–‰ยท์ƒํƒœ๊นŒ์ง€ ์—ฎ๊ธฐ

    • DAG ์›Œํฌํ”Œ๋กœ ์—”์ง„๊ณผ YAML ์„ ์–ธ์  DSL, ๋กœ๋”ฉ ์งํ›„ ๊ฒ€์ฆ(Validated DSL) ์œผ๋กœ ๊ทธ๋ž˜ํ”„ ์‹คํ–‰๊ณผ ์‹ ๋ขฐ๋ฅผ ํ•œ ํ๋ฆ„์œผ๋กœ

    • ์„ ํƒ ํ™•์žฅ: ReactยทREST, MCP๋กœ UI/API ๋ถ„๋ฆฌยทํ‘œ์ค€ ํˆด ์—ฐ๋™

    • Circuit Breaker, Reactive Stream, Redis ๋ชจ๋‹ˆํ„ฐ๋ง, ๋ณ‘๋ ฌ, ๋ฐ˜๋ณต ํ‰๊ฐ€ ๋“ฑ Production์— ๊ฐ€๊นŒ์šด ์„ค๊ณ„ ๊ด€์ 

    ์ด๋Ÿฐ ๋ถ„๊ป˜ ์ถ”์ฒœ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

    • API๋งŒ ๋ถ™์—ฌ ๋ณธ ์ˆ˜์ค€์„ ๋„˜์–ด, ์—์ด์ „ํŠธยท์›Œํฌํ”Œ๋กœยท์šด์˜๊นŒ์ง€ ์„ค๊ณ„ํ•˜๊ณ  ์‹ถ์€ ๋ฐฑ์—”๋“œยทํ’€์Šคํƒ ๊ฐœ๋ฐœ์ž

    • ๋ณตํ•ฉ ์งˆ์˜ยท์ž๋™ํ™” ํŒŒ์ดํ”„๋ผ์ธ์„ ๊ตฌ์กฐํ™”ํ•ด ํŒ€์— ์„ค๋ช…ํ•ด์•ผ ํ•˜๋Š” ์•„ํ‚คํ…์ฒ˜ยท๋ฆฌ๋“œ ์—ญํ• ์„ ์ค€๋น„ํ•˜๋Š” ๋ถ„

    ์ˆ˜๊ฐ• ํ›„์—๋Š” โ€œํ”„๋กฌํ”„ํŠธ ํ•œ ๋ฐฉโ€์ด ์•„๋‹ˆ๋ผ Multi-LLMยท์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ยทToolยทTaskยทDAGยท์„ ์–ธยท๊ฒ€์ฆ์„ ํ•˜๋‚˜์˜ ์‹คํ–‰ ์•„ํ‚คํ…์ฒ˜๋กœ ๋งํ•˜๊ณ  ๋ฌธ์„œํ™”ํ•  ์ˆ˜ ์žˆ๋Š” AI ์‹œ์Šคํ…œ ์„ค๊ณ„ ๊ด€์ ์„ ํ™•์‹คํžˆ ๊ฐ€์ ธ๊ฐ€์‹ค ์ˆ˜ ์žˆ๋„๋ก ๊ตฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค.

     

    ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค.

     

    ๋ณธ ๊ณผ์ •์—์„œ ๋ฐฐ์šฐ๋Š” ์‹œ์Šคํ…œ์œผ๋กœ ์•„๋ž˜์™€ ๊ฐ™์€ ๋ณตํ•ฉ ์—…๋ฌดยท์˜์‚ฌ๊ฒฐ์ •์„ ์ฒ˜๋ฆฌ ํ•˜๋Š” ์‹œ์Šคํ…œ์„ ๊ตฌ์ถ• ํ•˜๋Š” ๊ฒƒ์ด

    ๋ณธ ๊ณผ์ •์˜ ๋ชฉ์ ์ž…๋‹ˆ๋‹ค.

    image.png

     

    ๋ณธ๊ณผ์ •์˜ ์ปค๋ฆฌํ˜๋Ÿผ์€ ์•„๋ž˜์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค.

    1โƒฃ SpringBoot์—์„œ Spring AI ๊ฐœ๋ฐœ ํ™˜๊ฒฝ ๋ฐ Multi LLM ํ™˜๊ฒฝ ๊ตฌ์ถ•

    2โƒฃChapter 1. Multi-LLM Architecture(๋‹ค์ค‘ ๋ชจ๋ธ ๊ณผ AI ์•„ํ‚คํ…์ฒ˜ ์„ค๊ณ„)

    3โƒฃChapter 2. Agentic Workflow Patterns(5๊ฐ€์ง€ Agent Workflow ํŒจํ„ด)

    4โƒฃChapter 3. Orchestrated Multi-Agent Patterns(ํŒŒ์ดํ”„๋ผ์ธ์œผ๋กœ ๊ตฌํ˜„)

    5โƒฃChapter 4. Multi-Agent Architecture (Main Agent & SubAgent ๋ถ„๋ฆฌ ์ „๋žต)

    6โƒฃChapter 5. Tool-Orchestrated Multi-Agent(Tool ๊ธฐ๋ฐ˜ ์‹คํ–‰ ๋ ˆ์ด์–ด ๋ถ„๋ฆฌ)

    7โƒฃChapter 6. Task-Orchestrated Multi-Agent(TaskTool Agent Runtime)

    8โƒฃChapter 7. DAG-Orchestrated Multi-Agent(DAG๊ธฐ๋ฐ˜ AI Workflow ์„ค๊ณ„)

    9โƒฃChapter 8. Declarative Agent Workflow with YAML(YAML ๊ธฐ๋ฐ˜ DAG)

    ๐Ÿ”ŸChapter 9. Validated Agent Workflow DSL(DSL ๊ฒ€์ฆ ๊ธฐ๋ฐ˜ DAG)

    ๐Ÿ…ฐAppendix A. React Front-End & REST API Server Integration

    ๐Ÿ…ฑ Appendix B. MCP Integration(MCP๋กœ Toolยท์—์ด์ „ํŠธ ๋Ÿฐํƒ€์ž„ ์—ฐ๋™)

     

    ๋ณธ๊ณผ์ •์˜ ์‹œ์Šคํ…œ ๊ตฌ์„ฑ์€ ์•„๋ž˜์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค.

    image.png

     

     

    0
  • ์•ˆ๋…•ํ•˜์‹ญ๋‹ˆ๊นŒ ์ง€์‹ ๊ณต์œ ์ž ์ด์ง„๋งŒ(tootoo) ์ž…๋‹ˆ๋‹ค.

     

    Spring AI Multi-LLM ์•„ํ‚คํ…์ฒ˜์™€ Orchestration ์ค‘์‹ฌ Agent ์‹œ์Šคํ…œ

    https://inf.run/mYtWS

    ๊ณผ์ •์— ๋Œ€ํ•œ ์—…๊ทธ๋ ˆ์ด๋“œ ์†Œ์‹ ์ „ํ•ด ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

    4์›” ์ค‘์ˆœ ๊ฒฝ ์—…๊ทธ๋ ˆ์ด๋“œ ์˜ˆ์ •์ด๋ฉฐ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๊ตฌ์„ฑ์œผ๋กœ ์˜คํ”ˆ ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.

    ํ˜„์žฌ ๊ตฌ๋งค ํ•˜์‹  ๋ถ„๋“ค์€ Chapter3๊นŒ์ง€ ๋ณด์‹œ๊ณ  ์ดํ›„ Chapter 4๋ถ€ํ„ฐ ๋ณด์‹œ๋ฉด ๋  ๊ฑฐ ๊ฐ™์Šต๋‹ˆ๋‹ค.

    4์›” ์ค‘์ˆœ๋ถ€ํ„ฐ๋Š” ๋ณธ ๊ณผ์ •์˜ ๊ฐ€๊ฒฉ์ด ์†Œํญ ์ƒ์Šน ํ•  ์˜ˆ์ •์ด๋‹ˆ ๋ฏธ๋ฆฌ ๊ตฌ๋งค ํ•˜์‹œ๋Š” ๊ฒƒ๋„ ์ข‹์„ ๊ฑฐ ๊ฐ™์Šต๋‹ˆ๋‹ค.

    ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค.

     

    ์ „์ฒด์ ์ธ ๊ต์•ˆ ๋ถ€๋ถ„์ด ์ˆ˜์ • ๋˜์—ˆ์œผ๋ฉฐ Chapter1 ~ Chapter 3 ๊นŒ์ง€๋Š” Pattern ์„ ์ฃผ๋กœ ๊ณต๋ถ€ ํ–ˆ๋‹ค๋ฉด

    Chapter4 ~ Chapter 8 ๊นŒ์ง€๋Š” ์‹ค๋ฌด ์ค‘์‹ฌ์˜ Multi-Agent ๋ฅผ ๋งŒ๋“œ๋Š” ๊ณผ์ •์œผ๋กœ ๊ตฌ์„ฑ ํ•˜์˜€์Šต๋‹ˆ๋‹ค.

     

    Chapter 1. Multi-LLM Architecture(๋‹ค์ค‘ ๋ชจ๋ธ ์ „๋žต๊ณผ ์—”ํ„ฐํ”„๋ผ์ด์ฆˆ AI ์•„ํ‚คํ…์ฒ˜ ์„ค๊ณ„)

    Chapter 2. Agentic Workflow Patterns(์‹ค๋ฌด์—์„œ ์‚ฌ์šฉํ•˜๋Š” 5๊ฐ€์ง€ Agent Workflow ํŒจํ„ด)

    Chapter 3. Orchestrated Multi-Agent Patterns(Multi-Agent ๊ตฌ์กฐ๋ฅผ ์‹ค์ œ ์„œ๋น„์Šค ํŒŒ์ดํ”„๋ผ์ธ์œผ๋กœ ๊ตฌํ˜„ํ•˜๊ธฐ)

    Chapter 4. Multi-Agent Architecture (SubAgent ๋ถ„๋ฆฌ ์ „๋žต๊ณผ Agent Registry ๋‚ด๋ถ€ ๊ตฌ์กฐ)

    Chapter 5. Tool-Orchestrated Multi-Agent(Tool์„ ์ด์šฉํ•œ ์‹คํ–‰ ๋ ˆ์ด์–ด ๋ถ„๋ฆฌ ์•„ํ‚คํ…์ฒ˜)

    Chapter 6. Task-Orchestrated Multi-Agent(TaskTool ๊ธฐ๋ฐ˜ Agent Runtime ์„ค๊ณ„)

    Chapter 7. DAG-Orchestrated Multi-Agent(์—”ํ„ฐํ”„๋ผ์ด์ฆˆ๊ธ‰ DAG ๊ธฐ๋ฐ˜ AI Workflow ์„ค๊ณ„)

    Chapter 8. Declarative Agent Workflow with YAML(YAML ๊ธฐ๋ฐ˜ DAG ์ •์˜์™€ ์‹คํ–‰ ์—”์ง„ ๋ถ„๋ฆฌ)

    0
  • ์•ˆ๋…•ํ•˜์‹ญ๋‹ˆ๊นŒ ์ง€์‹ ๊ณต์œ ์ž ์ด์ง„๋งŒ ์ž…๋‹ˆ๋‹ค.

    Spring AI - Part2๋ฅผ ์˜คํ”ˆ ํ–ˆ์Šต๋‹ˆ๋‹ค.

     

    Spring AI -Part1์—์„œ๋Š” ์ฃผ๋กœ LLM ์—ฐ๋™๊ณผ ๋”๋ถˆ์–ด RAG, Multimodality API, Tool / Function Calling ๋ฐ MCP(Model Context Protocol) ํ™œ์šฉ์— ๋Œ€ํ•ด์„œ ์ง„ํ–‰ ํ–ˆ์Šต๋‹ˆ๋‹ค.

     

    Spring AI - Part2์—์„œ๋Š” ์ฃผ๋กœ Multi-LLM ๊ธฐ๋ฐ˜ AI ์•„ํ‚คํ…์ฒ˜ ์„ค๊ณ„, Agentic Workflow ํŒจํ„ด, Orchestrated Multi-Agent ์‹œ์Šคํ…œ ๊ตฌํ˜„์ด ์ฃผ์š” ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค.

     

    Spring AI Multi-LLM ์•„ํ‚คํ…์ฒ˜์™€ Orchestration ์ค‘์‹ฌ Agent ์‹œ์Šคํ…œ

    https://inf.run/mYtWS

     

    ๋งŽ์€ ๊ด€์‹ฌ ๋ถ€ํƒ ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

     

    ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค.

     

     

     

    0

์ง€์‹๊ณต์œ ์ž์˜ ๊นœ์งํ• ์ธ ์ค‘ (7์ผ ๋‚จ์Œ)

โ‚ฉ28,880

24%

โ‚ฉ38,500