inflearn logo

LLM APIs, All in One Go — Prompts, Structured Outputs, and Tool Calling

I sent the same request twice and got different answers. Which one can I use in my program? We’ll walk through actual API call logs on screen, step by step, examining the structure of requests and responses, structured outputs, streaming, tool calls, errors and retries, and costs. Instead of treating the mere arrival of text as success, we’ll establish criteria for accepting or holding a response based on its status, format, evidence, and cost.

2 learners are taking this course

Level Basic

Course period Unlimited

Python
Python
gemini
gemini
prompt engineering
prompt engineering
LLM
LLM
openAI API
openAI API
Python
Python
gemini
gemini
prompt engineering
prompt engineering
LLM
LLM
openAI API
openAI API

What you will gain after the course

  • You can parse the response into its body, completion status, and usage, and identify responses that haven’t finished or are waiting for a tool to run—even if the HTTP status is 200.

  • You can find the conversation history and requirements in the request and check the token usage and output limit to identify missing information and fix the cause of a truncated response.

  • You can set up completion, format, and source-text comparison checks in sequence for structured output, distinguishing answers to save from those to hold, along with the reasons.

  • This lets the app manage stream completion events and the call_id round trip for tool calls, while distinguishing model requests from the app’s execution permissions.

  • You can use error bodies, limit headers, usage, and official pricing to decide when to retry or stop, estimate cost and latency per task, and retest with the same inputs after making changes.

Recommended for
these people

Who is this course right for?

  • For those who can use functions and conditionals but are trying to connect an LLM API to their program for the first time.

  • For anyone who needs a clear standard for deciding which response to use in a feature, since answers to the same question vary slightly each time.

  • People who have used chat services but have never looked directly at raw API requests, response structures, tokens, or costs.

  • For those who want to know where each one stops and what to check before adding structured output, streaming, tool calls, and retries.

Need to know before starting?

  • You only need to be able to read variables, functions, arrays, objects, and conditionals in one programming language. The code shown on screen is mostly short Python snippets.

  • HTTP requests and responses, JSON, and API key authentication are explained when they first come up.

  • You don’t need any experience with machine learning math or model training, or to have taken other courses. The calculations only involve basic arithmetic with tokens and costs.

Hello
This is haeyeomiso

Career Verified

718

Learners

23

Reviews

41

Answers

4.7

Rating

20

Courses

Nice to meet you!

I am Haeyeo, someone who explores the infinite possibilities of AI and computer science and wishes to share that journey with all of you.

During my undergraduate years, my passion for my major was so intense that I was nicknamed a 'Computer Science Addict.' I graduated at the top of my class with a major GPA of over 4.4. I then earned my Master's degree in AI from Seoul National University and further deepened my expertise through a doctoral program.

However, as I felt as much of a fascination for solving real-world problems with AI as I did for theoretical exploration, I took a break from my doctoral studies to gain valuable hands-on experience by working on AI-based LLM and video analysis projects at a startup.

Currently, I am working as an LLM project developer and PM at one of the top three conglomerates in Korea, contributing to creating positive changes that AI technology will bring to our lives. I will generously share with you the challenges I faced, the problem-solving processes I went through, and the vivid know-how I gained in the field. I will be your reliable guide on this journey into the exciting world of AI.

Inquiries and Proposals: haeyeo.open@gmail.com

More

Curriculum

All

30 lectures ∙ (4hr 41min)

Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

haeyeomiso's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

Limited time deal

$17.60

58%

$42.90