강의

멘토링

커뮤니티

Game Dev

/

Game Programming

Complete Guide to Unity Machine Learning Agents (Basics)

Through this course, students will learn various reinforcement learning theories and implement them themselves, as well as create a reinforcement learning environment to test the reinforcement learning algorithm implemented using Unity Machine Learning Agents.

(4.2) 24 reviews

503 learners

내공을 쌓아요
한국에 이런 강의가?
Reinforcement Learning(RL)
Machine Learning(ML)
Unity
Unity ML-Agents

Reviews from Early Learners

What you will gain after the course

  • Unity Development

  • Unity Machine Learning Agent

  • Creating a reinforcement learning environment

  • Reinforcement learning theory

  • Implementing reinforcement learning code

Implementation of reinforcement learning environment,
Easy and convenient with Unity!

reinforcement learning environment ,
How should I prepare it?

Since AlphaGo's groundbreaking performance in 2016, interest in reinforcement learning , known to have been applied to AlphaGo, has grown significantly, and the enthusiasm remains strong. The key components of reinforcement learning are the reinforcement learning algorithm and the reinforcement learning environment, as shown below. These two components exchange information, including actions, states, and rewards, allowing the reinforcement learning algorithm to learn.

Since AlphaGo, reinforcement learning algorithms have made significant progress. In response, a variety of reinforcement learning environments have been released, including OpenAI GYM, Mujoco, Atari, GTA5, and Malmo. Most of these environments are game-based. While reinforcement learning is clearly an ideal algorithm for games, there has been a recent surge in attempts to apply it beyond games to diverse fields, including recommendation, robotics, drones, energy, and finance.

However, reinforcement learning environments for these diverse fields are still lacking. In particular, it's extremely difficult to expect an environment that precisely meets developers' specific requirements to be released. Even if you have a robot environment with a specific sensor configuration and joint structure that you want to apply reinforcement learning to, it may be impossible to even begin research without a publicly available reinforcement learning environment for that field.

If you use an environment that has already been created,
There are these drawbacks:

About the environment
Sujeong
difficulty

For each environment
How to use this
difference

necessary
The environment
There may not be any

But in September 2017, Unity, one of the world's largest game engine companies, released a tool called Unity Machine-Learning Agent that could solve this problem.


With Unity ML-Agents
Implementing reinforcement learning environment!

What if we use Unity Machine Learning Agents ?

In this lecture, you will learn how to implement various reinforcement learning environments using this Unity Machine Learning Agent, as well as the theory and code implementation of reinforcement learning algorithms applicable to those environments.

Information before taking the class!

This course's content is identical to the book "Reinforcement Learning with PyTorch and Unity ML-Agents." Please be aware of this before attending.

Reinforcement Learning with PyTorch and Unity ML-Agents - Yes24

Mastering Unity Machine Learning Agents - Basics

The entire "Complete Mastery of Unity Machine Learning Agents" course will be divided into two sections: Basics and Applications. This lecture will cover the Basics section. The specific content covered in the Basics section is as follows:

  • Reinforcement Learning Basics and Theory
  • Unity Installation and Basic Usage
  • Unity Machine Learning Agents Installation, Component Description, and Usage (mlagents-learn, Python API)
  • Environment Creation
    • GridWorld, Drone, KartRacing
  • Learning reinforcement learning algorithm theory and implementing code
    • DQN, A2C, DDPG, Behavioral Cloning

The code for the environment we will create and the algorithms we will learn in this lecture is all included on GitHub .
The images below are the reinforcement learning environments you will implement in this lecture and the results of learning using the reinforcement learning algorithm you will implement.

Creating a Gridworld Environment

Creating a drone environment

Creating a kart racing environment


Frequently Asked Questions
Check it out.

Q. I have never used Unity before. Can I still take the course?

Even beginners to Unity will find this course easy to follow, starting with installation and moving through the process of creating a simple environment. While it doesn't cover Unity in detail, after taking the course, you'll be able to create environments using assets from the Asset Store or by creating a simple environment yourself, creating a reinforcement learning environment.

Q. Do I need to be familiar with reinforcement learning to use machine learning agents?

Machine learning agents are tools that fundamentally support reinforcement learning, so a basic understanding of reinforcement learning concepts is essential for easier use. However, Unity Machine Learning Agents also provides a variety of reinforcement learning algorithms, allowing agents to learn within a reinforcement learning environment. This functionality allows you to easily use machine learning agents even without in-depth knowledge of reinforcement learning.

Q. Do I need a deep understanding of deep learning or extensive implementation experience to take this course?

If you've already implemented a model to classify MNIST data using PyTorch, you should be able to take this course without much difficulty. Even those with experience using TensorFlow 2.x should be able to take this course without difficulty if they just learn the basics of PyTorch.

Recommended for
these people

Who is this course right for?

  • Developers interested in developing reinforcement learning environments

  • Students and researchers interested in the theory and implementation of reinforcement learning.

Need to know before starting?

  • Experience with Python and PyTorch

  • Basic Deep Learning Theory (ANN, CNN)

Hello
This is

618

Learners

29

Reviews

102

Answers

4.3

Rating

2

Courses

Curriculum

All

38 lectures ∙ (7hr 18min)

Course Materials:

Lecture resources
Published: 
Last updated: 

Reviews

All

24 reviews

4.2

24 reviews

  • pnltoen님의 프로필 이미지
    pnltoen

    Reviews 1

    Average Rating 5.0

    5

    100% enrolled

    A simple review by a non-major, liberal arts student "A lecture that provides a broad perspective and knowledge for beginners, and reinforcement learning and Unity tips for others" I bought the book before, but I came running when I heard that there was a video lecture...! This lecture is really full of information, such as creating a Unity environment, reinforcement learning theory, and practice. Even looking at it broadly, it is really rare to find a lecture that explains two fields in detail (actually, there aren't any...ㅠ). In addition, it is really diverse in detail, from simple reinforcement learning theory to practice and Unity environment building tips. In particular, it was really fun to do a simulation with Unity rather than just text, and I thought a lot about how I could create a machine learning agent....! If you are considering purchasing, I strongly recommend purchasing it!!

    • uce032113674님의 프로필 이미지
      uce032113674

      Reviews 1

      Average Rating 5.0

      5

      100% enrolled

      I really enjoyed the lecture!! It was really the best lecture for beginners in reinforcement learning. I will study hard on my own until you come back for the advanced/applied part next time. Thank you.

      • 씨네포프21님의 프로필 이미지
        씨네포프21

        Reviews 10

        Average Rating 5.0

        5

        100% enrolled

        This is a really great lecture!!

        • xrart018052님의 프로필 이미지
          xrart018052

          Reviews 1

          Average Rating 5.0

          5

          100% enrolled

          The lecture video is really good! Even if you don't have any specialized knowledge in reinforcement learning, you can understand it well. It's hard to find Korean explanation materials for Unity ML-Agent, but this one lecture is good because you can do all the basic design. I'm looking forward to not only the basics but also the intermediate and advanced levels. ㅎㅎ

          • talentedwoo0898님의 프로필 이미지
            talentedwoo0898

            Reviews 1

            Average Rating 5.0

            5

            100% enrolled

            I was able to gain a general understanding of how to implement reinforcement learning by configuring a learning environment in Unity. There are still errors in executing scripts in Unity, but I think it will get better in the future. It was very helpful, and I am looking forward to the application part.

            • kyushik
              Instructor

              Hello! Thank you so much for leaving a great review! What kind of errors are you getting in your Unity script? Please post them in the question box and I will answer as soon as possible! :)

          Limited time deal ends in 00:58:02

          $39.60

          23%

          $51.70

          kyushik's other courses

          Check out other courses by the instructor!

          Similar courses

          Explore other courses in the same field!