Using Reinforcement Learning to Reduce Energy Consumption of Ultra-Dense Networks With 5G Use Cases Requirements
Использование обучения с подкреплением для снижения энергопотребления сверхплотных сетей с учетом требований вариантов использования 5G
2023-01-01
SCID: 54.1/df8cpqdn
Discuss with AI
5G ultra-dense networksSARSAbase station sleep modesenergy efficiencyreinforcement learning
Figures from the paper
Abstract (AI)
In mobile networks, 5G Ultra-Dense Networks (UDNs) have emerged as they effectively increase the network capacity due to cell splitting and densification. A Base Station (BS) is a fixed transceiver that is the main communication point for one or more wireless mobile client devices. As UDNs are densely deployed, the number of BSs and communication links is dense, raising concerns about resource management with regard to energy efficiency, since BSs consume much of the total cost of energy in a cellular network. It is expected that 6G next-generation mobile networks will include technologies such as artificial intelligence as a service and focus on energy efficiency. Using machine learning it is possible to optimize energy consumption with cognitive management of dormant, inactive and active states of network elements. Reinforcement learning enables policies that allow sleep mode techniques to gradually deactivate or activate components of BSs and decrease BS energy consumption. In this work, a sleep mode management based on State Action Reward State Action (SARSA) is proposed, which allows the use of specific metrics to find the best tradeoff between energy reduction and Quality of Service (QoS) constraints. The results of the simulations show that, depending on the target of the 5G use case, in low traffic load scenarios and when a reduction in energy consumption is preferred over QoS, it is possible to achieve energy savings up to 80% with 50 ms latency, 75% with 20 ms and 10 ms latencies and 20% with 1 ms latency. If the QoS is preferred, then the energy savings reach a maximum of 5% with minimal impact in terms of latency.
Key Findings
1
A SARSA-based sleep-mode management method optimizes activation and deactivation of base-station components in ultra-dense 5G networks.
2
The achievable energy savings depend strongly on the target 5G use case and its latency requirements.
3
The method explicitly balances energy reduction against Quality of Service constraints using application-specific metrics.
4
Under low traffic loads, energy savings reach up to 80% for 50 ms latency, 75% for 20 ms and 10 ms latencies, and 20% for 1 ms latency when energy reduction is prioritized.
5
When QoS is prioritized, the approach achieves up to 5% energy savings with minimal latency impact.
Research Object
5G ultra-dense cellular networks and their base stations
Research Subject
reinforcement-learning-based sleep-mode management for reducing base-station energy consumption while balancing energy savings with QoS and latency constraints
Publication Details
Publication Date
2023-01-01
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest