volume | PIER Journals

Abstract

There is an increasing demand in real-time imagery applications such as rapid response to disaster rescue and security screening to name a few. The throughput of a radar imaging system is mainly controlled by two parameters; data acquisition time and signal processing time. To minimize the data acquisition time, various methods are being tried and tested by researchers worldwide. Among them is the computational imaging (CI) technique, which relies on using coded apertures to encode the radar back-scattered measurements onto a set of spatio-temporarily incoherent radiation patterns. Such a CI-based imaging approach eliminates the requirement for a raster scan and can substantially simplify the physical hardware architecture. Equally important is the processing time needed to retrieve the scene information from the coded back-scattered measurements. In CI, the simplification in the hardware layer comes at the cost of increased complexity in the signal processing layer due to the indirect mapping and compression of the scene information through the spatio-temporally incoherent transfer function of the coded apertures. To address this particular challenge, this paper presents a hardware-based solution for CI signal processing using a Field Programmable Gate Array (an Xilinx Virtex-7 (XC7VX485T) FPGA chip) architecture. In particular, the proposed method consists of calculating the CI sensing matrix using the FPGA chip and storing it on the FPGA platform for image reconstruction. For the adjoint operation, the calculated sensing matrix is applied on the measured back-scattered waves from the target object. We demonstrate that the FPGA based calculation can reach 21.9 times faster speed than conventional brute-force solutions.

1. Ahmed, S. S., A. Genghammer, A. Schiessl, and L.-P. Schmidt, "Fully electronic e-band personnel imager of 2m² aperture based on a multistatic architecture," IEEE Transactions on Microwave Theory and Techniques, Vol. 61, No. 1, 651-657, 2012.
doi:10.1109/TMTT.2012.2228221

2. Yurduseven, O., "Indirect microwave holographic imaging of concealed ordnance for airport security imaging systems," Progress In Electromagnetics Research, Vol. 146, 7-13, 2014.
doi:10.2528/PIER14032304

3. Wang, Z., T. Chang, and H. Cui, "Review of active millimeter wave imaging techniques for personnel security screening," IEEE Access, Vol. 7, 148336-148350, 2019.
doi:10.1109/ACCESS.2019.2946736

4. Yurduseven, O., T. Fromenteze, C. Decroze, and V. Fusco, "Frequency-diverse computational automotive radar technique for debris detection," IEEE Sensors Journal, Vol. 20, No. 22, 13167-13177, 2020.
doi:10.1109/JSEN.2020.3004065

5. Castro, J., S. Singh, A. Arora, S. Louie, and D. Senic, "Enabling safe autonomous vehicles by advanced mm-wave radar simulations," IEEE MTT-S International Microwave Symposium Digest, Vol. 2019-June, 1476-1479, 2019.

6. Diebold, A., M. Imani, and D. Smith, "Phaseless radar coincidence imaging with a MIMO SAR platform," Remote Sensing, Vol. 11, No. 5, 2019.
doi:10.3390/rs11050533

7. Sarabandi, K., M. Vahidpour, M. Moallem, and J. East, "Compact beam scanning 240 GHz radar for navigation and collision avoidance," Proceedings of SPIE — The International Society for Optical Engineering, Vol. 8031, 2011.

8. Detlefsen, J., "Industrial applications of microwave imaging," 1991 21st European Microwave Conference, Vol. 1, 108-119, 1991.
doi:10.1109/EUMA.1991.336423

9. Bilik, I., O. Longman, S. Villeval, and J. Tabrikian, "The rise of radar for autonomous vehicles: Signal processing solutions and future research directions," IEEE Signal Processing Magazine, Vol. 36, No. 5, 20-31, 2019.
doi:10.1109/MSP.2019.2926573

10. Shehab, S., J. Feng, and N. Karmakar, "Trends on remote sensing technology: Receiver architectures and antenna systems," 1st International Conference on Robotics, Electrical and Signal Processing Techniques, ICREST 2019, 227-232, 2019.
doi:10.1109/ICREST.2019.8644361

11. Li, Q., K. Chen, W. Guo, L. Lang, F. He, L. Chen, and Z. Xiong, "An aperture synthesis radiometer at millimeter wave band," 2008 International Conference on Microwave and Millimeter Wave Technology Proceedings, ICMMT, Vol. 4, 1699-1701, 2008.

12. Piddyachiy, V., V. Shulga, V. Myshenko, A. Korolev, A. Myshenko, and A. Antyufeyev, "Ground-based 3 mm-wave radiometer for spectroscopic observations of atmospheric ozone and carbon monoxide," 2010 International Kharkov Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves, MSMW’2010, 2010.

13. Sheen, D. M., D. L. McMakin, and T. E. Hall, "Three-dimensional millimeter-wave imaging for concealed weapon detection," IEEE Transactions on Microwave Theory and Techniques, Vol. 49, No. 9, 1581-1592, 2001.
doi:10.1109/22.942570

14. Martınez-Lorenzo, J., F. Quivira, and C. Rappaport, "SAR imaging of suicide bombers wearing concealed explosive threats," Progress In Electromagnetics Research, Vol. 125, 255-272, 2012.
doi:10.2528/PIER11120518

15. Demirci, S., H. Cetinkaya, E. Yigit, C. Ozdemir, and A. Vertiy, "A study on millimeter-wave imaging of concealed objects: Application using backprojection algorithm," Progress In Electromagnetics Research, Vol. 128, 457-477, 2012.
doi:10.2528/PIER12050210

16. Hansen, H., A. Kulessa, and G. Brooker, "Millimetre-wave radars in targeting and data linking operations," 2003 Proceedings of the International Conference on Radar, RADAR 2003, 230-234, 2003.
doi:10.1109/RADAR.2003.1278744

17. Fromenteze, T., O. Yurduseven, M. F. Imani, J. Gollub, C. Decroze, D. Carsenat, and D. R. Smith, "Computational imaging using a mode-mixing cavity at microwave frequencies," Applied Physics Letters, Vol. 106, No. 19, 2015.
doi:10.1063/1.4921081

18. Qi, F., I. Ocket, D. Schreurs, and B. Nauwelaers, "A system-level simulator for indoor mmW SAR imaging and its applications," Optics Express, Vol. 20, No. 21, 23811-23820, 2012.
doi:10.1364/OE.20.023811

19. Laviada, J., A. Arboleya-Arboleya, Y. Alvarez-Lopez, C. Garcia-Gonzalez, and F. Las-Heras, "Phaseless synthetic aperture radar with efficient sampling for broadband near-field imaging: Theory and validation," IEEE Transactions on Antennas and Propagation, Vol. 63, No. 2, 573-584, 2015.
doi:10.1109/TAP.2014.2378262

20. Charvat, G., L. Kempel, E. Rothwell, C. Coleman, and E. Mokole, "An Ultrawideband (UWB) switched-antenna-array radar imaging system," IEEE International Symposium on Phased Array Systems and Technology, 543-550, 2010.
doi:10.1109/ARRAY.2010.5613313

21. Withington, S., G. Saklatvala, and M. Hobson, "Partially coherent analysis of imaging and interferometric phased arrays: Noise, correlations, and uctuations," Journal of the Optical Society of America A: Optics and Image Science, and Vision, Vol. 23, No. 6, 1340-1348, 2006.
doi:10.1364/JOSAA.23.001340

22. Gollub, J., O. Yurduseven, K. Trofatter, D. Arnitz, F. Imani, T. Sleasman, M. Boyarsky, A. Rose, A. Pedross-Engel, H. Odabasi, M. Reynolds, and D. Smith, "Large metasurface aperture for millimeter wave computational imaging at the human-scale," Scientific Reports, Vol. 7, 2017.

23. Molaei, A., J. Heredia-Juesas, G. Ghazi, J. Vlahakis, and J. A. Martinez-Lorenzo, "Digitized metamaterial absorber-based compressive reflector antenna for high sensing capacity imaging," IEEE Access, Vol. 7, 1160-1173, 2019.
doi:10.1109/ACCESS.2018.2881103

24. Barbastathis, G., A. Ozcan, and G. Situ, "On the use of deep learning for computational imaging," Optica, Vol. 6, No. 8, 921-943, 2019.
doi:10.1364/OPTICA.6.000921

25. Fromenteze, T., E. L. Kpre, D. Carsenat, C. Decroze, and T. Sakamoto, "Single-shot compressive multiple-inputs multiple-outputs radar imaging using a two-port passive device," IEEE Access, Vol. 4, 1050-1060, 2016.
doi:10.1109/ACCESS.2016.2543525

26. Hunt, J., T. Driscoll, A. Mrozack, G. Lipworth, M. Reynolds, D. Brady, and D. R. Smith, "Metamaterial apertures for computational imaging," Science, Vol. 339, No. 6117, 310-313, 2013.
doi:10.1126/science.1230054

27. Yurduseven, O., V. R. Gowda, J. N. Gollub, and D. R. Smith, "Printed aperiodic cavity for computational and microwave imaging," IEEE Microwave and Wireless Components Letters, Vol. 26, No. 5, 367-369, 2016.
doi:10.1109/LMWC.2016.2548443

28. Yurduseven, O., J. Gollub, A. Rose, D.Marks, and D. Smith, "Design and simulation of a frequency-diverse aperture for imaging of human-scale targets," IEEE Access, Vol. 4, 5436-5451, 2016.
doi:10.1109/ACCESS.2016.2604823

29. Chi, W. and N. George, "Phase-coded aperture for optical imaging," Optics Communications, Vol. 282, 2110-2117, June 2008.

30. Don, M. L., C. Fu, and G. R. Arce, "Compressive imaging via a rotating coded aperture," Applied Optics, Vol. 56, No. 3, B142, 2017.
doi:10.1364/AO.56.00B142

31. Watts, C. M., D. Shrekenhamer, J. Montoya, G. Lipworth, J. Hunt, T. Sleasman, S. Krishna, D. R. Smith, and W. J. Padilla, "Terahertz compressive imaging with metamaterial spatial light modulators," Nature Photonics, Vol. 8, No. 8, 605, 2014.
doi:10.1038/nphoton.2014.139

32. Sleasman, T., M. F. Imani, J. N. Gollub, and D. R. Smith, "Dynamic metamaterial aperture for microwave imaging," Applied Physics Letters, Vol. 107, No. 20, 204104, 2015.
doi:10.1063/1.4935941

33. Imani, M., J. Gollub, O. Yurduseven, A. Diebold, M. Boyarsky, T. Fromenteze, L. Pulido-Mancera, T. Sleasman, and D. Smith, "Review of metasurface antennas for computational microwave imaging," IEEE Transactions on Antennas and Propagation, Vol. 68, No. 3, 1860-1875, 2020.
doi:10.1109/TAP.2020.2968795

34. Andrecut, M., "Fast GPU implementation of sparse signal recovery from random projections," Engineering Letters, Vol. 17, No. 3, 2009.

35. Zhou, B., Y. Peng, C. Yeh, and J. Tang, "GPGPU accelerated fast convolution back-projection for radar image reconstruction," Tsinghua Science and Technology, Vol. 16, No. 3, 256-263, 2011.
doi:10.1016/S1007-0214(11)70037-2

36. Park, S. and D. Shires, "CUDA optimization techniques for SAR imaging algorithm," Proceedings of the 2010 International Conference on Image Processing, Computer Vision, and Pattern Recognition, IPCV 2010, Vol. 1, 36-40, 2010.

37. Clemente, C., M. Di Bisceglie, M. Di Santo, N. Ranaldo, and M. Spinelli, "Processing of synthetic aperture radar data with GPGPU," IEEE Workshop on Signal Processing Systems, SiPS: Design and Implementation, 309-314, 2009.

38. Rybalkin, V. and N. Wehn, "When massive GPU parallelism Ain’t enough: A novel hardware architecture of 2D-LSTM neural network," FPGA 2020 — 2020 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, 111-121, 2020.
doi:10.1145/3373087.3375301

39. Farhadi, M., M. Ghasemi, and Y. Yang, "A novel design of adaptive and hierarchical convolutional neural networks using partial reconfiguration on FPGA," 2019 IEEE High Performance Extreme Computing Conference, HPEC 2019, 2019.

40. Zhou, X., Z. Yu, Y. Cao, and S. Jiang, "SAR imaging realization with FPGA based on VIVADO HLS," ICSIDP 2019 — IEEE International Conference on Signal, Information and Data Processing 2019, 2019.

41. Liu, R., D. Zhu, D. Wang, and W. Du, "High resolution SAR signal processing system using FPGA," 2019 International Applied Computational Electromagnetics Society Symposium-China, ACES 2019, 2019.

42. Di, W., C. Chen, and Y. Liu, "FPGA-based parallel system for synthetic aperture radar imaging," 2018 International Conference on Electronics Technology, ICET 2018, 430-433, 2018.

43. Yurduseven, O., M. A. B. Abbasi, T. Fromenteze, and V. Fusco, "Lens-loaded coded aperture with increased information capacity for computational microwave imaging," Remote Sensing, Vol. 12, No. 9, 1531, 2020.
doi:10.3390/rs12091531

44. Sleasman, T., M. Boyarsky, M. F. Imani, T. Fromenteze, J. N. Gollub, and D. R. Smith, "Single-frequency microwave imaging with dynamic metasurface apertures," JOSA B, Vol. 34, No. 8, 1713-1726, 2017.
doi:10.1364/JOSAB.34.001713

45. Yurduseven, O., M. Imani, H. Odabasi, J. Gollub, G. Lipworth, A. Rose, and D. Smith, "Resolution of the frequency diverse metamaterial aperture imager," Progress In Electromagnetics Research, Vol. 150, 97-107, 2015.
doi:10.2528/PIER14113002

46. Peng, R., O. Yurduseven, T. Fromenteze, and D. R. Smith, "Advanced processing of 3D computational microwave polarimetry using a near-field frequency-diverse antenna," IEEE Access, Vol. 8, 166261-166272, 2020.
doi:10.1109/ACCESS.2020.3021418

47. Fromenteze, T., O. Yurduseven, M. Boyarsky, J. Gollub, D. L. Marks, and D. R. Smith, "Computational polarimetric microwave imaging," Optics Express, Vol. 25, No. 22, 27488-27505, 2017.
doi:10.1364/OE.25.027488

48. Lipworth, G., A. Rose, O. Yurduseven, V. R. Gowda, M. F. Imani, H. Odabasi, P. Trofatter, J. Gollub, and D. R. Smith, "Comprehensive simulation platform for a metamaterial imaging system," Applied Optics, Vol. 54, No. 31, 9343-9353, 2015.
doi:10.1364/AO.54.009343

49. Mandel, L. and E. Wolf, Optical Coherence and Quantum Optics, Cambridge University Press, 1995.
doi:10.1017/CBO9781139644105

50. Hecht, K. T., The Born Approximation, 462-476, Springer New York, 2000.

51. Rashidi-Ranjbar, E. and M. Dehmollaian, "Microwave imaging using frequency-diverse scattering of a random rough surface," ICEE 2019 — 27th Iranian Conference on Electrical Engineering, 1679-1681, 2019.

52. Venkatesh, S., N. Viswanathan, and D. Schurig, "W-band sparse synthetic aperture for computational imaging," Optics Express, Vol. 24, No. 8, 8317-8331, 2016.
doi:10.1364/OE.24.008317

53. Kowdle, A., C. Rhemann, S. Fanello, A. Tagliasacchi, J. Taylor, P. Davidson, M. Dou, K. Guo, C. Keskin, S. Khamis, V. Tankovich, and J. Valentin, "The need 4 speed in real-time dense visual tracking," ACM Transactions on Graphics, Vol. 37, No. 6, 2018.

54. Malczewski, K., "Rapid diffusion weighted imaging with enhanced resolution," Applied Magnetic Resonance, Vol. 51, No. 3, 221-239, 2020.
doi:10.1007/s00723-019-01185-x

55. X. Inc. Virtex-7 FPGA Design Summary, p. 5, Xilinx, February 27, 2018.

56. X. Inc. CORDIC v6.0 LogiCORE IP Product Guide, Xilinx, December 20, 2017.

57. X. Inc. 7 Series DSP48E1 Slice User Guide, Xilinx, March 27, 2018.

58. Andraka, R., "A survey of CORDIC algorithms for FPGA based computers," Tech. Rep., 1998.

59. Yurduseven, O., T. Fromenteze, and D. R. Smith, "Relaxation of alignment errors and phase calibration in computational frequency-diverse imaging using phase retrieval," IEEE Access, Vol. 6, 14884-14894, 2018.
doi:10.1109/ACCESS.2018.2816341

60. Yurduseven, O., J. N. Gollub, K. P. Trofatter, D. L. Marks, A. Rose, and D. R. Smith, "Software calibration of a frequency-diverse, multistatic, computational imaging system," IEEE Access, Vol. 4, 2488-2497, 2016.
doi:10.1109/ACCESS.2016.2570678

61. Sleasman, T., M. F. Imani, O. Yurduseven, K. P. Trofatter, V. R. Gowda, D. L. Marks, J. N. Gollub, and D. R. Smith, "Near field scan alignment procedure for electrically large apertures," IEEE Transactions on Antennas and Propagation, Vol. 65, No. 6, 3257-3262, 2017.
doi:10.1109/TAP.2017.2691465

Dr. Rahul Sharma

Dr. Okan Yurduseven

Prof. Bhabesh Deka

Professor Vincent Fusco