Optimizing Energy Consumption in 5G HetNets: A Coordinated Approach for Multi-Level Picocell Sleep Mode with Q-Learning
DOI:
https://doi.org/10.56294/dm2024333Keywords:
5G, Hetnets, Energy Consumption, Energy Modeling, Sleep Mode, Machine LearningAbstract
Cell standby, particularly picocell sleep mode (SM), is a prominent strategy for reducing energy consumption in 5G networks. The emergence of multi-state sleep states necessitates new optimization approaches. This paper proposes a novel energy optimization strategy for 5G heterogeneous networks (HetNets) that leverages macrocell-picocell coordination and machine learning. The proposed strategy focuses on managing the four available picocell sleep states. The picocell manages the first three states using the Q-learning algorithm, an efficient reinforcement learning technique. The associated macrocell based on picocell energy efficiency controls the final, deeper sleep state. This hierarchical approach leverages localized and network-wide control strengths for optimal energy savings. By capitalizing on macrocell-picocell coordination and machine learning, this work presents a promising solution for achieving significant energy reduction in 5G HetNets while maintaining network performance
References
1. Cell size breathing and possibilities. Micallef, G., Mogensen, P. and Scheck, H. 2010, 2010 European Wireless Conference (EW), pp. 111-115.
2. Base Station ON-OFF Switching in 5G Wireless Networks: Approaches and Challenges. Feng, Mingjie, Mao, Shiwen and Jiang, Tao. 4, Aug. 2017, IEEE Wireless Communications, Vol. 24, pp. 46-54.
3. A Survey of Energy-Efficient Techniques for 5G Networks and Challenges Ahead. Buzzi, Stefano, et al. 4, April 2016, IEEE Journal on Selected Areas in Communications, Vol. 34, pp. 697-709.
4. Energy Optimization with Multi-Sleeping Control in 5G Heterogeneous Networks using Reinforcement Learning. Amine, Ali El, et al. 4, Dec. 2022, IEEE Transactions on Network and Service Management, Vol. 19, pp. 4310-4322.
5. Sleep mode implementation issues in green base stations. Saker, L. and Elayoubi, S. E. 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, pp. 1683-1688.
6. S. Elayoubi, L. Saker and T. Chahed. 2011, 2011 Proceedings IEEE INFOCOM, pp. 106-110.
7. Reducing Energy Consumption in LTE with Cell DTX. Frenger, P., et al. Yokohama, : s.n., 2011. 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring). pp. 1-5.
8. A Flexible and Future-Proof Power Model for Cellular Base Stations. Debaillie, Bjorn, Desset, Claude and Louagie, Filip. May 2015, IEEE 81st Vehicular Technology Conference (VTC Spring).
9. Optimal Control of Wake Up Mechanisms of Femtocells in Heterogeneous Networks. Saker, L., et al. 3, April 2012, IEEE Journal on Selected Areas in Communications, Vol. 30, pp. 664-672.
10. Pervaiz, Haris, et al. 4, Dec 2018, EEE Vehicular Technology Magazine, Vol. 13, pp. 51-59.
11. Reinforcement learning approach for Advanced Sleep Modes management in 5G networks. Salem, Fatma Ezzahra, et al. Aug 2018, 2018 88th Vehicular Technology Conference (VTC-FALL).
12. Reinforcement Learning for Traffic-Adaptive Sleep Mode Management in 5G Networks. Masoudi, Meysam, et al. Oct 2020, 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications.
13. Reinforcement Learning for Delay-Constrained Energy-Aware Small Cells with Multi-Sleeping Control. Amine, Ali El, Dini, Paolo and Nuaymi, Loutfi. Jul 2020, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).
14. Towards Sustainable 5G Networks: A Proposed Coordination Solution for Macro and Pico Cells to Optimize Energy Efficiency. FALL, MACOUMBA, et al. May 2023, IEEE Access, Vol. 11.
15. Management of advanced sleep modes for energy-efficient 5G networks. Salem, Fatma Ezzahra. Dec 2019, Networking and Internet Architecture [cs.NI].
16. 3GPP. TR 36.814 Evolved Universal Terrestrial Radio Access (E-UTRA); Further advancements for E-UTRA physical layer aspects (Release 9). Mar. 2017.
17. Energy Optimization With Multi-Sleeping Control in 5G Heterogeneous Networks Using Reinforcement Learning. Amine, Ali El, et al. 4, Dec. 2022, EEE Transactions on Network and Service Management, Vol. 19, pp. 4310-4322.
18. Energy efficiency of 5G mobile networks with base station sleep modes. Lähdekorpi, Panu, et al. 2017, 2017 IEEE Conference on Standards for Communications and Networking (CSCN), pp. 163-168.
19. Sutton, Richard S. and Barton, Andrew G. Reinforcement learning : An introduction. s.l. : Cambridge, MA : The MIT Press, 2018.
20. ETSI - ETSI TR 138 913 V14.3.0. 5G - Study on scenarios and requirements for next generation access technologies. 2017.
21. Khandekar, A., Bhushan, N. and Tingfang, J. LTE-Advanced: Heterogeneous. 2010.
22. 3GPP. 3GPP Release 10 - TR 36.942 V10.2.0. 2010.
23. Wu, J., et al. 2, 2015, IEEE Communications Surveys & Tutorials, Vol. 17, pp. 803-826.
24. Abdellaoui, Maroua and Fattah, Mohammed. Characterization of Ultra Wide Band indoor propagation. Mediterranean Congress of Telecommunications (CMT). 24-25 October 2019.
25. Resource placement strategy optimization for smart grid application using 5G wireless networks. Chafi, Saad-Eddine, et al. 4, 2022, International Journal of Electrical and Computer Engineering (IJECE), Vol. 12, pp. 3932-3942.
26. 5G uplink interference simulations, analysis and solutions: The case of pico cells dense deployment. Younes, Balboul, et al. 3, June 2021, International Journal of Electrical and Computer Engineering (IJECE), Vol. 11, pp. 2245-2255.
27. The impact of scheduling algorithms for real-time traffic in the 5G femto-cells network. MAMANE, Asmae, et al. Rabat : s.n., 09 May 2019, International Symposium on Signal, Image, Video and Communications (ISIVC).
Published
Issue
Section
License
Copyright (c) 2024 Macoumba Fall, Mohammed Fattah, Mohammed Mahfoudi, Younes Balboul, Said Mazer, Moulhime El Bekkali, Ahmed D. Kora (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.
