inflearn logo

LLM Evaluation and Safety in Practice for Silicon Valley AI Engineers

Build a hands-on evaluation framework for measuring and managing the quality and safety of production LLM systems. Analyze real execution logs from a virtual shopping chatbot, and build the entire evaluation pipeline yourself—from failure case classification and LLM-as-a-Judge validation to Safety Eval and CI regression testing.

1 learners are taking this course

Level Intermediate

Course period Unlimited

CI/CD
CI/CD
nullsafe
nullsafe
LLM
LLM
RAG
RAG
CI/CD
CI/CD
nullsafe
nullsafe
LLM
LLM
RAG
RAG

What you will gain after the course

  • Analysis of failure cases, creation of an evaluation dataset, and development of a Python grader and LLM judge.

  • Implement a tool-call validation and safety evaluation (Agent Eval · Safety Eval) system.

  • Operational reliability checks, CI-integrated regression testing, and release report preparation

Recommended for
these people

Who is this course right for?

  • Backend or AI engineers who have built chatbot or RAG features using an LLM API

  • A developer who needs to quantitatively explain quality changes before deployment

  • A tech lead who designs evaluation criteria and testing strategies

Need to know before starting?

  • Experience calling LLM APIs using Python

  • Experience developing chatbots or RAG systems

  • Understanding of basic software testing concepts

Hello
This is codebridge

Inflearn Verified

Career Verified

2,207

Learners

227

Reviews

37

Answers

4.7

Rating

18

Courses

I share the experience and insights I’ve gained firsthand by taking on challenges in Silicon Valley.

Experience

- Currently pursuing a master’s degree in AI at a graduate school in Silicon Valley, USA

- Currently a researcher at the AI & Data Systems Lab

- Former software R&D engineer at H Group (6+ years)

- Contributor to open-source projects such as AWS and Qualcomm

- Completed numerous AI coding and agent-based software development projects

- Operates 'Codebridge,' educational content on AI and software development.

 

[Eng]

Based on my existing experience and experience, I'm sharing know-how and tips I want to share while following world trends. Thank you for your cooperation!

Experience

Developer at a major IT corporation in South Korea (6y +)

Bachelor's degree in Computer Engineering

More

Curriculum

All

21 lectures ∙ (3hr 51min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

Not enough reviews.
Please write a valuable review that helps everyone!

codebridge's other courses

Check out other courses by the instructor!

Similar courses

Explore other courses in the same field!

Limited time deal

$6,826.00

29%

$59.40