Deep Reinforcement Learning: A Brief Survey
Глубокое обучение с подкреплением: краткий обзор
2017-11-01
SCID: 54.1/x57yw7uu
Discuss with AI
asynchronous advantage actor-criticdeep Q-network (DQN)deep reinforcement learningtrust region policy optimization (TRPO)visual reinforcement learning
Figures from the paper
Abstract (AI)
Deep reinforcement learning (DRL) is poised to revolutionize the field of artificial intelligence (AI) and represents a step toward building autonomous systems with a higher-level understanding of the visual world. Currently, deep learning is enabling reinforcement learning (RL) to scale to problems that were previously intractable, such as learning to play video games directly from pixels. DRL algorithms are also applied to robotics, allowing control policies for robots to be learned directly from camera inputs in the real world. In this survey, we begin with an introduction to the general field of RL, then progress to the main streams of value-based and policy-based methods. Our survey will cover central algorithms in deep RL, including the deep Q-network (DQN), trust region policy optimization (TRPO), and asynchronous advantage actor critic. In parallel, we highlight the unique advantages of deep neural networks, focusing on visual understanding via RL. To conclude, we describe several current areas of research within the field.
Key Findings
1
DRL algorithms are being applied to robotics, allowing control policies to be learned directly from real-world camera inputs.
2
Deep neural networks provide unique advantages in visual understanding when combined with RL, supporting higher-level perception for autonomous systems.
3
Deep reinforcement learning (DRL) enables reinforcement learning to scale to previously intractable problems, such as learning to play video games directly from pixels.
4
The paper identifies and describes several current research areas within deep reinforcement learning as directions for future work.
5
The survey organizes DRL into main streams: value-based methods and policy-based methods, and covers central algorithms including DQN, TRPO, and A3C.
Research Object
Deep reinforcement learning (DRL) as a research area and set of algorithms
Research Subject
Core algorithms, methods, and capabilities of DRL—including value-based and policy-based approaches (e.g., DQN, TRPO, A3C), their use of deep neural networks for visual understanding, scaling RL to high-dimensional inputs, and applications such as game playing and robotic control
Publication Details
Publication Date
2017-11-01
Journal
Publisher
ISSN
Cited by
4452
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai2
Cited by11
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions2021
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next2022
Review of Deep Learning Algorithms and Architectures2019
Machine learning & artificial intelligence in the quantum domain: a review of recent progress2018
Deep learning modelling techniques: current progress, applications, advantages, and challenges2023
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications2021
A survey on data‐efficient algorithms in big data era2021
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications2024
A Review of Practical AI for Remote Sensing in Earth Sciences2023
RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs2025
Federated Learning in Mobile Edge Networks: A Comprehensive Survey2020