volume | PIER Journals

Abstract

This paper focuses on optimizing the radiation pattern of sparse array antennas using reinforcement learning, with many algorithms. The paper aims to leverage Proximal Policy Optimization's (PPO's) advantages in optimization and its effectiveness in handling stochastic transitions and rewards to achieve a reduced number of elements while maintaining desired signal performance and minimizing unnecessary side lobe signals. By removing a few of the antennas using reinforcement learning and PPO optimization, the same results as a complete array have been obtained. The anticipated outcomes of this research hold the promise of significantly enhancing the effectiveness and utility of sparse array antennas in communication systems.

1. Liu, Yanhui, Zaiping Nie, and Qing Huo Liu, "Reducing the number of elements in a linear antenna array by the matrix pencil method," IEEE Transactions on Antennas and Propagation, Vol. 56, No. 9, 2955-2962, 2008.

2. Merino-Fernandez, Irene, Sunil L. Khemchandani, Javier Del Pino, and Jose Saiz-Perez, "Phased array antenna analysis workflow applied to gateways for LEO satellite communications," Sensors, Vol. 22, No. 23, 9406, 2022.

3. Luo, Qi, Steven Shichang Gao, Wei Liu, and Chao Gu, Low-cost Smart Antennas, John Wiley & Sons, 2019.

4. Rahmat-Samii, Yahya, Joshua M. Kovitz, and Harish Rajagopalan, "Nature-inspired optimization techniques in communication antenna designs," Proceedings of the IEEE, Vol. 100, No. 7, 2132-2144, Jul. 2012.

5. Koziel, Slawomir and Anna Pietrenko-Dabrowska, "Accelerated gradient-based optimization of antenna structures using multifidelity simulations and convergence-based model management scheme," IEEE Transactions on Antennas and Propagation, Vol. 69, No. 12, 8778-8789, Dec. 2021.

6. Casula, Giovanni Andrea, Giuseppe Mazzarella, and Nicola Sirena, "Evolutionary design of wide-band parasitic dipole arrays," IEEE Transactions on Antennas and Propagation, Vol. 59, No. 11, 4094-4102, Nov. 2011.

7. Bray, Matthew G., Douglas H. Werner, Daniel W. Boeringer, and David W. Machuga, "Optimization of thinned aperiodic linear phased arrays using genetic algorithms to reduce grating lobes during scanning," IEEE Transactions on Antennas and Propagation, Vol. 50, No. 12, 1732-1742, 2002.

8. Larmour, C., N. Buchanan, V. Fusco, and M. Ali Babar Abbasi, "Sparse array mutual coupling reduction," IEEE Open Journal of Antennas and Propagation, Vol. 5, No. 1, 201-216, Feb. 2024.

9. Wang, Shuoguang, Shiyong Li, Bailing Ren, Ke Miao, Guoqiang Zhao, and Houjun Sun, "Convex optimization-based design of sparse arrays for 3-D near-field imaging," IEEE Sensors Journal, Vol. 23, No. 9, 9640-9648, May 2023.

10. Huan, Mingsai, Junli Liang, Yifan Wu, Yongkang Li, and Wei Liu, "SASA: Super-resolution and ambiguity-free sparse array geometry optimization with aperture size constraints for MIMO radar," IEEE Transactions on Antennas and Propagation, Vol. 71, No. 6, 4941-4954, Jun. 2023.

11. Willey, R., "Space tapaering of linear and planar arrays," IRE Transactions on Antennas and Propagation, Vol. 10, No. 4, 369-377, Jul. 1962.

12. Haupt, Randy L., "Thinned arrays using genetic algorithms," IEEE Transactions on Antennas and Propagation, Vol. 42, No. 7, 993-999, Jul. 1994.

13. Deparateanu, Daniel, Florin Enache, Andrei Enache, Florin Popescu, and Ioan Nicolaescu, "Sparse array antenna optimization using genetic alghoritms," 2016 8th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), 1-4, Ploiesti, Romania, 2016.

14. Yang, Ping, Bin Chen, and Ke-Ren Shi, "A novel method to design sparse linear arrays for ultrasonic phased array," Ultrasonics, Vol. 44, e717-e721, Dec. 2006.

15. Balanis, Constantine A., Antenna Theory: Analysis and Design, John Wiley & Sons, 2016.

16. Yang, Xin, Deqiang Yang, Yanwen Zhao, Jin Pan, and Yongpin Chen, "Synthesis of linear sparse array using DNN-based machine-learning method," IEEE Transactions on Antennas and Propagation, Vol. 71, No. 8, 6513-6522, Aug. 2023.

17. Li, Hailin, Yachao Jiang, Yuan Ding, Jing Tan, and Jianjiang Zhou, "Low-sidelobe pattern synthesis for sparse conformal arrays based on PSO-SOCP optimization," IEEE Access, Vol. 6, 77429-77439, 2018.

18. Liang, Zhipeng, Jun Ouyang, and Feng Yang, "A hybrid GA-PSO optimization algorithm for conformal antenna array pattern synthesis," Journal of Electromagnetic Waves and Applications, Vol. 32, No. 13, 1601-1615, 2018.

19. Cui, Liangze, Yao Zhang, Runren Zhang, and Qing Huo Liu, "A modified efficient KNN method for antenna optimization and design," IEEE Transactions on Antennas and Propagation, Vol. 68, No. 10, 6858-6866, Oct. 2020.

20. Willey, R., "Space tapaering of linear and planar arrays," IRE Transactions on Antennas and Propagation, Vol. 10, No. 4, 369-377, 1962.

21. Lapan, Maxim, Deep Reinforcement Learning Hands-on: Apply Modern RL Methods to Practical Problems of Chatbots, Robotics, Discrete Optimization, Web Automation, and More, Packt Publishing Ltd, 2020.

22. Fu, Kai, Xiwen Cai, Bo Yuan, Yang Yang, and Xin Yao, "An efficient surrogate assisted particle swarm optimization for antenna synthesis," IEEE Transactions on Antennas and Propagation, Vol. 70, No. 7, 4977-4984, Jul. 2022.

23. He, Yuanzhi and Changxu Wang, "Optimization design for sparse planar array in satellite communications," Electronics, Vol. 12, No. 8, 1763, 2023.

Dr. Sajad Mohammad-Ali-Nezhad

Dr. Mohammad Hassan Kassem