🙆🏻♀ Beyond Q-learning and Deep Q-learning to RND🙆🏻♂
🗒 Course Introduction
The reinforcement learning boom started with AlphaGo. Did you know that reinforcement learning was an algorithm that existed long before AlphaGo?

Reinforcement learning is generally known as a field with a high barrier to entry. While the emergence of AlphaGo sparked interest, the complex nature of the subject makes it challenging to learn. For those who have been eager to learn reinforcement learning but have been hesitant to even begin, this course summarizes the key points. From Q-learning to DQN, and beyond DQN, this course explores the sparse reward problem, a key challenge in reinforcement learning, and various ideas for solving it. This course will provide a comprehensive overview of reinforcement learning in a short period of time.
🌈 What on earth is reinforcement learning?
We will explain step-by-step, using examples, what reinforcement learning is, what elements it contains, and how learning progresses.

🌈 Q-learning that you can solve by hand
Explaining it in words alone isn't enough. Let's try solving Q-learning problems ourselves to truly grasp the concepts of reinforcement learning.

🌈 DQN, the foundation of deep reinforcement learning
This book summarizes the core concepts of Deep Reinforcement Learning, from Deep Q-network (DQN) to various DQN variants including PerDQN, actorcritic, and Self-Imitation learning.

🌈 Sparse reward problem, the main problem of reinforcement learning
We will discuss the sparse reward problem, which is a major problem in reinforcement learning, and discuss various techniques to solve it.
We mainly talk about 'curiosity' or 'prediction error' and introduce several algorithms that utilize them.
(SIL, Random Network Distillation, etc.)

🌈 Implementing DQN/ActorCritic/SIL/RND directly in R
Unless you implement it yourself with code, you only know half of it, right? Let's write reinforcement learning algorithms for the most important models in R and examine the results together.
And let's also see if RND for Exploration really works.

🙋🏻♂️ Expected questions related to the lecture
Q. Do you have any player knowledge?
A. It would be good to have a basic understanding of machine learning and NN.
Q. Don't you do any practical training with Python?
A. Currently, I have uploaded the lecture by implementing the practical code in R, and I plan to upload the practical code in Python in the future. (I will upload it in addition to this lecture, rather than opening it as another lecture.)