Deep Reinforcement Learning: A Brief Survey

Глубокое обучение с подкреплением: краткий обзор
Miles Brundage, Marc Peter Deisenroth, Kai Arulkumaran, Anil A. Bharath
2017-11-01

asynchronous advantage actor-criticdeep Q-network (DQN)deep reinforcement learningtrust region policy optimization (TRPO)visual reinforcement learning
Deep reinforcement learning (DRL) is poised to revolutionize the field of artificial intelligence (AI) and represents a step toward building autonomous systems with a higher-level understanding of the visual world. Currently, deep learning is enabling reinforcement learning (RL) to scale to problems that were previously intractable, such as learning to play video games directly from pixels. DRL algorithms are also applied to robotics, allowing control policies for robots to be learned directly from camera inputs in the real world. In this survey, we begin with an introduction to the general field of RL, then progress to the main streams of value-based and policy-based methods. Our survey will cover central algorithms in deep RL, including the deep Q-network (DQN), trust region policy optimization (TRPO), and asynchronous advantage actor critic. In parallel, we highlight the unique advantages of deep neural networks, focusing on visual understanding via RL. To conclude, we describe several current areas of research within the field.
1
DRL algorithms are being applied to robotics, allowing control policies to be learned directly from real-world camera inputs.
2
Deep neural networks provide unique advantages in visual understanding when combined with RL, supporting higher-level perception for autonomous systems.
3
Deep reinforcement learning (DRL) enables reinforcement learning to scale to previously intractable problems, such as learning to play video games directly from pixels.
4
The paper identifies and describes several current research areas within deep reinforcement learning as directions for future work.
5
The survey organizes DRL into main streams: value-based methods and policy-based methods, and covers central algorithms including DQN, TRPO, and A3C.

Deep reinforcement learning (DRL) as a research area and set of algorithms

Core algorithms, methods, and capabilities of DRL—including value-based and policy-based approaches (e.g., DQN, TRPO, A3C), their use of deep neural networks for visual understanding, scaling RL to high-dimensional inputs, and applications such as game playing and robotic control

Publication Details
Publication Date
2017-11-01
Journal
Publisher
ISSN
Cited by
4452
Access Type
Author Information
Authors
Miles Brundage
Marc Peter Deisenroth
Kai Arulkumaran
Anil A. Bharath
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%