강의

N
챌린지

멘토링

N
클립

로드맵

BEST
Business & Marketing

/

Project & Product Management

The Complete Guide to AB Testing

As the popularity and interest in AB Testing explodes, we will introduce Korea's first AB Testing lecture right now!

(4.8) 18 reviews

271 learners

  • 거친코딩
abtest
수학
통계
데이터분석
AB test
Statistics

Reviews from Early Learners

What you will learn!

  • A/B Testing Core Principles and Concepts

  • Essential Statistical Concepts for A/B Testing

  • A/B Test Mock Case Study

Isn't this your concern ?


🥲 I know A/B testing is important, but I don't know why I should do it or how to set it up .

🫠 If you are trying to get a job as a PO or DA, A/B testing experience is preferred , but there is no way to get the experience .


The biggest key point of this lecture! 🗝️

01. Make it as similar as possible to the actual work environment.
Indirectly experience A/B testing

02. Actual A/B test mock case
From design to final analysis

I recommend this to these people 💪

Design an A/B Test
POs that require decision-making

Analyze the results of A/B testing
DA that derives insights

A/B Testing indirectly
Job seekers or college students seeking experience

Learn things like this 📚

#1.
A/B Testing Core Fundamentals

We'll introduce the concepts and basic core principles you need to know before starting A/B testing, and share examples of excellent companies that are actually using A/B testing.

  • What is A/B Testing?
  • A/B Testing Corporate Case Studies
  • A/B Testing Basic Core Principles

#2.
Essential Statistics Concepts

We've collected only the essential statistical concepts needed for A/B testing.

  • Sample and Population, Sampling Method, P-Value, Confidence Interval
  • Chi-Square Test, Hypothesis Test, Type 1 & 2 Error

#3.
A/B Test Experiment Plan

We'll explain in detail how to write an experiment plan for actually running an A/B test.

  • How to Write an A/B Test Experiment Plan
  • Determining group size (minimum sample size)

#4.
Introducing Example Domains

To demonstrate a mock A/B Test case, we'll introduce a randomly created example app.

  • Introducing A/B Test Example Domains

#5.
A/B Test Experiment Topics 1 and 2

We will introduce two mock A/B test cases and explain everything from writing the experiment plan to deriving analysis results.

  • Create a 1-Pager
  • Interpretation of results

#6.
A/B Testing Precautions

I'll explain the things you must keep in mind when conducting A/B testing experiments.

  • Peeping problem
  • Confounding Factor
  • Primacy effect and novelty effect
  • Follow-up monitoring of completed A/B tests

Notes before taking the class *️⃣

  • Learning materials
    • We will provide PDFs of lectures from 1 to 7.
    • We will provide the Excel file used in lectures 6 and 7.
  • Player Knowledge and Precautions
    • Unauthorized distribution of lectures and learning materials is prohibited.
    • Questions and answers will be accepted freely.

Introducing the Knowledge Sharer ✒️

Recommended for
these people

Who is this course right for?

  • PO & DA involved in on-site A/B testing

  • Job seekers & college students who want to work in a field that requires A/B Testing

Need to know before starting?

  • doesn't exist

Hello
This is

6,795

Learners

103

Reviews

101

Answers

4.8

Rating

3

Courses

🙌 소개

안녕하세요. 거칠지만 정말 유익한 데이터 분석가 "거친코딩" 입니다.

  • 고려대학교 통계학과 (졸업)

  • 고려대학교 대학원 빅데이터융합학과 (재학)

  • QS 세계대학평가 평가위원

  • 고려대학교 SW 중심대학 인공지능 심화 수료

  • 고려대학교 KUCC(컴퓨터 동아리) 세션장

  • 고려대학교 학과 5회 수석, 1회 전체 수석

  • 빅데이터분석기사 자격증

  • 빅데이터분석 준전문가(adsp) 자격증

  • 빅데이터 분석 및 개발 블로그 운영

  • 인공지능 강의 유튜브 운영

 

저는 현재 "네카 중 한 곳"에서 파이썬 및 시각화툴(Tableau)를 활용하여 데이터 수집, 가공, 분석, 예측, 시각화, 업무 자동화를 하고 있습니다.

 

⭐️ 멘토링

  • 데이터 분석 직무를 꿈꾸는 학생들을 위한 효율적 공부법

  • 데이터 분석 현업에 있는 주니어 분석가를 위한 상담

  • 현업에서 IT직군이 아니지만, IT 기술을 활용하여 본인 업무에 적용하고 싶은 분

 

🌈 멘토링 진행 방식

  • zoom을 통한 비대면 방식 진행

  • 준비물 : 컴퓨터, 카메라, 이어폰

  • 미리 준비한 질문 사항 혹은 현 상황에 따라 멘토링 진행

 

🐯 마무리 글

  • 모든 일에는 시작이 가장 중요합니다. 뜨거운 열정으로 이루고자 하는 것을 꼭 이뤄냅시다!..

 

📨 메일문의

rough_coding@naver.com

Curriculum

All

25 lectures ∙ (2hr 47min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

18 reviews

4.8

18 reviews

  • sdyk03479010님의 프로필 이미지
    sdyk03479010

    Reviews 1

    ∙

    Average Rating 5.0

    5

    96% enrolled

    • seongminlee02083729님의 프로필 이미지
      seongminlee02083729

      Reviews 6

      ∙

      Average Rating 5.0

      5

      92% enrolled

      Please, please make an intermediate course too!

      • sjad1324989님의 프로필 이미지
        sjad1324989

        Reviews 1

        ∙

        Average Rating 5.0

        5

        100% enrolled

        Thank you for the informative lecture~!!

        • gkstoa06002932님의 프로필 이미지
          gkstoa06002932

          Reviews 3

          ∙

          Average Rating 5.0

          5

          32% enrolled

          I'm a job seeker and I listened to the AB lectures well. Good.

          • hodtkqwlf124563님의 프로필 이미지
            hodtkqwlf124563

            Reviews 2

            ∙

            Average Rating 5.0

            5

            16% enrolled

            I work as a PO at a small startup, and I felt a strong need for AB Testing, so I took the course. Thanks to the instructor, I was able to understand it very well.

            Limited time deal ends in 5 days

            $29.70

            22%

            $38.50

            거친코딩's other courses

            Check out other courses by the instructor!

            Machine learning starting from Python's basic libraries강의 썸네일

            Machine learning starting from Python's basic libraries

            거친코딩

            For those who are new to machine learning, we will provide a clear understanding of the direction of study and basic concepts.

            초급

            초급

            Machine Learning(ML), Pandas, Matplotlib

            Machine learning starting from Python's basic libraries강의 썸네일

            Machine learning starting from Python's basic libraries

            거친코딩

            (UPDATED) Personalized Recommendation System Using Python | Recommendation Algorithm | Recommendation Artificial Intelligence강의 썸네일

            (UPDATED) Personalized Recommendation System Using Python | Recommendation Algorithm | Recommendation Artificial Intelligence

            거친코딩

            By understanding the working principles of various recommendation algorithms, you can create your own personalized recommendation algorithm!

            초급

            초급

            Recommendation System, Deep Learning(DL)

            (UPDATED) Personalized Recommendation System Using Python | Recommendation Algorithm | Recommendation Artificial Intelligence강의 썸네일

            (UPDATED) Personalized Recommendation System Using Python | Recommendation Algorithm | Recommendation Artificial Intelligence

            거친코딩

            Similar courses

            Explore other courses in the same field!

            Data Literacy for PMs (Product Data Analysis)강의 썸네일

            Data Literacy for PMs (Product Data Analysis)

            kyleschool

            This is a course for PMs who want to utilize data. This course covers the entire process of utilizing data in the PM role, including the flow of work from day 1 of a job change through the start and end of a project. It is an introductory data course that covers data-driven thinking, logical thinking, metric definition, log design, experiment design, creating a data culture, and more, to help you develop critical thinking skills. Although created as a course for PMs, it is structured with content that data analysts would also find beneficial (in fact, many analysts have taken the course). In addition, many people in marketing, design, and business planning roles are also taking the course.

            초급

            초급

            Data literacy, metric hierarchy, AB test

            Data Literacy for PMs (Product Data Analysis)강의 썸네일

            Data Literacy for PMs (Product Data Analysis)

            kyleschool

            Successful Companies' Marketing A/B Testing Secrets - Conversion Rate, Revenue Growth, and Cost Efficiency Know-How강의 썸네일

            Successful Companies' Marketing A/B Testing Secrets - Conversion Rate, Revenue Growth, and Cost Efficiency Know-How

            daejung

            Experimentation and A/B testing are essential skills in CRM marketing and growth marketing practice. Both PMs and POs must repeatedly conduct experiments and A/B tests in growth marketing and CRM marketing campaigns to maximize performance and efficiency. In fact, when PM and PO roles establish CRM marketing strategies based on experimentation and A/B testing, they can simultaneously achieve data-driven growth marketing performance and cost efficiency.

            입문

            입문

            Marketing Theory, Growth Hacking, CRM Marketing

            Successful Companies' Marketing A/B Testing Secrets - Conversion Rate, Revenue Growth, and Cost Efficiency Know-How강의 썸네일

            Successful Companies' Marketing A/B Testing Secrets - Conversion Rate, Revenue Growth, and Cost Efficiency Know-How

            daejung

            Growth Hacking, GTM, AB Test for PM, Designer, Marketer, All in One강의 썸네일

            Growth Hacking, GTM, AB Test for PM, Designer, Marketer, All in One

            comento

            Data-driven growth hacking needed for PM, marketers, designers, operations managers, and sales positions. This one video will give you a complete understanding of the basics.

            입문

            입문

            Growth Hacking, Google Tag Manager, AB test

            Growth Hacking, GTM, AB Test for PM, Designer, Marketer, All in One강의 썸네일

            Growth Hacking, GTM, AB Test for PM, Designer, Marketer, All in One

            comento

            Coding-free AI data analysis using Orange - Lv.4 Classification machine learning analysis강의 썸네일

            Coding-free AI data analysis using Orange - Lv.4 Classification machine learning analysis

            Masocampus

            Don't be afraid of coding or data analysis anymore! Develop your data analysis skills without coding with Orange.

            초급

            초급

            AI, Orange3, logistic-regression

            Coding-free AI data analysis using Orange - Lv.4 Classification machine learning analysis강의 썸네일

            Coding-free AI data analysis using Orange - Lv.4 Classification machine learning analysis

            Masocampus

            Data Knows the Answer! Data-Driven Decision Making DDDM강의 썸네일

            Data Knows the Answer! Data-Driven Decision Making DDDM

            skmns

            Data-driven decision-making can minimize errors caused by subjective judgment and intuition, and will serve as an important basis for predicting various risks in advance and establishing various strategies.

            초급

            초급

            Data literacy, Big Data, Statistics

            Data Knows the Answer! Data-Driven Decision Making DDDM강의 썸네일

            Data Knows the Answer! Data-Driven Decision Making DDDM

            skmns

            Basic Statistics with Excel강의 썸네일

            Basic Statistics with Excel

            statisticsplaybook

            Statistics learned in school, was it too hard to understand? No matter how much you listened to the explanation, statistics were confusing, but we will help you understand them. If you implement them one by one by hand using Excel, you will understand statistical concepts that you didn't understand! A new experience that makes boring statistics fun! We will give you a gift. :)

            초급

            초급

            Excel, Statistics

            Basic Statistics with Excel강의 썸네일

            Basic Statistics with Excel

            statisticsplaybook

            [Big Data Learning Center] (Free) 63rd and 64th Open House - Effect Size and Power Analysis / Extension and Evolution of Linear Regression강의 썸네일

            [Big Data Learning Center] (Free) 63rd and 64th Open House - Effect Size and Power Analysis / Extension and Evolution of Linear Regression

            dataai

            The 63rd Open House explains the concept of effect size and SPSS's effect size output. It also covers the concept of sample size and power and SPSS's power analysis method. The 64th Open House learns in detail about the extension and evolution of linear regression.

            초급

            초급

            Statistics, spss

            [Big Data Learning Center] (Free) 63rd and 64th Open House - Effect Size and Power Analysis / Extension and Evolution of Linear Regression강의 썸네일

            [Big Data Learning Center] (Free) 63rd and 64th Open House - Effect Size and Power Analysis / Extension and Evolution of Linear Regression

            dataai

            ADsP Essential강의 썸네일

            ADsP Essential

            루비네코딩

            ADsP Certification All-In-One Course! Ultra-Short Term Completion! Reflecting 2025 August 46th Exam! (Continuous Updates!)

            입문

            입문

            Machine Learning(ML), Statistics, Big Data

            ADsP Essential강의 썸네일

            ADsP Essential

            루비네코딩

            ADsP Crash강의 썸네일

            ADsP Crash

            루비네코딩

            ADsP Summary + Past Exam Solutions. Reflects August 2025 46th Exam! (Continuously Updated!)

            입문

            입문

            Machine Learning(ML), Statistics, Big Data

            ADsP Crash강의 썸네일

            ADsP Crash

            루비네코딩

            Python and Statistics for Data Science Beginners강의 썸네일

            Python and Statistics for Data Science Beginners

            pnuswedu

            Let's develop specialized skills in programming skills, algorithm skills, and statistical analysis skills!

            입문

            입문

            Python, Algorithm, Statistics

            Python and Statistics for Data Science Beginners강의 썸네일

            Python and Statistics for Data Science Beginners

            pnuswedu