Non-line-of-sight (NLOS)  imaging in short and long-wave infrared wavelengths

Roueinfar, Mohammad; Salmanian, Mahdi

Non-line-of-sight (NLOS) imaging in short and long-wave infrared wavelengths

Document Type : Original Article

Authors

¹ Researcher, Imam Hossein University, Tehran, Iran

² Master's degree, Imam Hossein University (AS), Tehran, Iran

Abstract

This paper presents a method for Non-Line Of Sight (NLOS) imaging that works passively in the long-wave infrared and actively in the short-wave infrared. An LWIR camera, an uncooled camera with 320×240 pixels and a size of 30 µm per pixel, is used for imaging in the long-wave infrared. In this passive imaging, the image of a hot object, such as a soldering iron, was successfully captured. In other imaging, which is actively performed in short-wave infrared by using a light source with a short-wave infrared wavelength and aiming it at an object that is not in the camera's direct field of view, the wave reflected from a reflective surface enters the SWIR camera model SX-1.7-320 and finally the target image is captured. The images obtained from non-line-of-sight (NLOS) imaging demonstrate the efficacy of this technique in both the long-wave infrared (LWIR) and short-wave infrared (SWIR) wavelengths under passive and active modes, respectively. The validation of this imaging method is conducted by comparing the captured images with the original images, employing the Mean Squared Error (MSE) and Root Mean Squared Error (RMSE) criteria.

Keywords

20.1001.1.23454024.1402.11.2.6.4

References

[1] M. O’Toole, D. B. Lindell, and G. Wetzstein, “Confocal non-line-of-sight imaging based on the light-cone transform,” Nature, vol. 555, no. 7696, pp. 338–341, Mar. 2018, doi: 10.1038/nature25489.

[2] X. Liu et al., “Non-line-of-sight imaging using phasor-field virtual wave optics,” Nature, vol. 572, no. 7771, pp. 620–623, Aug. 2019, doi: 10.1038/s41586-019-1461-3.

[3] A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, “Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging,” Nature Communications, vol. 3, no. 1, Mar. 2012, doi: 10.1038/ncomms1747.

[4] V. Arellano, D. Gutierrez, and A. Jarabo, “Fast back-projection for non-line of sight reconstruction,” ACM SIGGRAPH 2017 Posters, Jul. 2017, doi: 10.1145/3102163.3102241.

[5] F. Heide, L. Xiao, W. Heidrich, and M. B. Hullin, “Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors,” 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3222–3229, Jun. 2014, doi: 10.1109/cvpr.2014.418.

[6] D. B. Lindell, G. Wetzstein, and M. O’Toole, “Wave-based non-line-of-sight imaging using fast f-k migration,” ACM Transactions on Graphics, vol. 38, no. 4, pp. 1–13, Jul. 2019, doi: 10.1145/3306346.3322937.

[7] X. Liu, S. Bauer, and A. Velten, “Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,” Nature Communications, vol. 11, no. 1, Apr. 2020, doi: 10.1038/s41467-020-15157-4.

[8] X. Liu, S. Bauer, and A. Velten, “Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,” Nature Communications, vol. 11, no. 1, Apr. 2020, doi: 10.1038/s41467-020-15157-4.

[9] M. Batarseh, S. Sukhov, Z. Shen, H. Gemar, R. Rezvani, and A. Dogariu, “Passive sensing around the corner using spatial coherence,” Nature Communications, vol. 9, no. 1, Sep. 2018, doi: 10.1038/s41467-018-05985-w.

[10] A. Beckus, A. Tamasan, and G. K. Atia, “Multi-Modal Non-Line-of-Sight Passive Imaging,” IEEE Transacti-ons on Image Processing, vol. 28, no. 7, pp. 3372–3382, Jul. 2019, doi: 10.1109/tip.2019.2896517.

[11] J. Boger-Lombard and O. Katz, “Passive optical time-of-flight for non line-of-sight localization,” Nature Communications, vol. 10, no. 1, Jul. 2019, doi: 10.1038/s41467-019-11279-6.

[12] C. Saunders, R. Bose, J. Murray-Bruce, and V. K. Goyal, “Multi-Depth Computational Periscopy with an Ordinary Camera,” ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9299–9305, May 2020, doi: 10.1109/icassp40776.2020.9054518.

[13] S. W. Seidel, J. Murray-Bruce, Y. Ma, C. Yu, W. T. Freeman, and V. K. Goyal, “Two-Dimensional Non-Line-of-Sight Scene Estimation From a Single Edge Occluder,” IEEE Transactions on Computational Imaging, vol. 7, pp. 58–72, 2021, doi: 10.1109/tci.2020.3037405.

[14] C. Thrampoulidis et al., “Exploiting Occlusion in Non-Line-of-Sight Active Imaging,” IEEE Transactions on Computational Imaging, vol. 4, no. 3, pp. 419–431, Sep. 2018, doi: 10.1109/tci.2018.2829599.

[15] X. Liu, S. Bauer, and A. Velten, “Analysis of Feature Visibility in Non-Line-Of-Sight Measurements,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10132–10140, Jun. 2019, doi: 10.1109/cvpr.2019.01038.

[16] I. Gkioulekas, A. Levin, F. Durand, and T. Zickler, “Micron-scale light transport decomposition using interferometry,” ACM Transactions on Graphics, vol. 34, no. 4, pp. 1–14, Jul. 2015, doi: 10.1145/2766928.

[17] I. Gkioulekas, A. Levin, F. Durand, and T. Zickler, “Micron-scale light transport decomposition using interferometry,” ACM Transactions on Graphics, vol. 34, no. 4, pp. 1–14, Jul. 2015, doi: 10.1145/2766928.

[18] C. Jin, M. Tang, L. Jia, X. Tian, J. Yang, K. Qiao, and S. Zhang, “Scannerless Non-Line-of-Sight Three Dimensional Imaging with a 32x32 SPAD Array,” arXiv:2011.05122.

[19] C. Wu et al., “Non–line-of-sight imaging over 1.43 km,” Proceedings of the National Academy of Sciences, vol. 118, no. 10, Mar. 2021, doi: 10.1073/pnas.2024468118.

[20] A. Pediredla, A. Dave, and A. Veeraraghavan, “SNLOS: Non-line-of-sight Scanning through Temporal Focusing,” 2019 IEEE International Conference on Computational Photography (ICCP), pp. 1–13, May 2019, doi: 10.1109/iccphot.2019.8747336.

[21] S. Xin, S. Nousias, K. N. Kutulakos, A. C. Sankaranarayanan, S. G. Narasimhan, and I. Gkioulekas, “A Theory of Fermat Paths for Non-Line-Of-Sight Shape Reconstruction,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6793–6802, Jun. 2019, doi: 10.1109/cvpr.2019.00696.

[22] X. Liu, J. Wang, L. Xiao, Z. Shi, X. Fu, and L. Qiu, “Non-line-of-sight imaging with arbitrary illumination and detection pattern,” Nature Communications, vol. 14, no. 1, Jun. 2023, doi: 10.1038/s41467-023-38898-4.

[23] M. Kaga, T. Kushida, T. Takatani, K. Tanaka, T. Funatomi, and Y. Mukaigawa, “Thermal non-line-of-sight imaging from specular and diffuse reflections,” IPSJ Transactions on Computer Vision and Applications, vol. 11, no. 1, Nov. 2019, doi: 10.1186/s41074-019-0060-4.

[24] C. Hashemi, T. Sasaki, and J. Leger, “Parallax-Driven Denoising of Passive Non-Line-of-Sight Thermal Imagery,” 2023 IEEE International Conference on Computational Photography (ICCP), pp. 1–12, Jul. 2023, doi: 10.1109/iccp56744.2023.10233749.

[25] T. Maeda, Y. Wang, R. Raskar, and A. Kadambi, “Thermal Non-Line-of-Sight Imaging,” 2019 IEEE International Conference on Computational Photography (ICCP), pp. 1–11, May 2019, doi: 10.1109/iccphot.2019.8747343.

[26] M. Kaga, T. Kushida, T. Takatani, K. Tanaka, T. Funatomi, and Y. Mukaigawa, “Thermal non-line-of-sight imaging from specular and diffuse reflections,” IPSJ Transactions on Computer Vision and Applications, vol. 11, no. 1, Nov. 2019, doi: 10.1186/s41074-019-0060-4.

[27] https://www.photonicsonline.com/doc/swir-mwir-and-lwir-one-use-case-for-each-0001.

[28] A. Nazar, N. A. Jasem, and N. Kh. Abdalameer, “Optimized Design of Optical Filters for LWIR Region,” Journal of Optics, vol. 53, no. 3, pp. 1914–1917, Aug. 2023, doi: 10.1007/s12596-023-01295-7.

[29] F. S. Marvasti, M. Nasiri, M. R. Mousav,“Flying Small Target Detection in Infrared Images Based on Adaptive

Top-Hat Transform,” Journal Of Electronical & Cyber Defence,vol. 5, no. 3, 2017.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1396.5.3.2.5

[30] M. Nasiri, S. Chehrehsa, S. A. Mirmahdavi, “Small Target Enhancement in Infrared Image using Local Statistical Weighted Entropy,” Journal Of Electronical & Cyber Defence,vol. 4, no. 2, 2016.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1395.4.2.6.0

[31] H. Moslemi, I. Abaspur Kazerouni, A. Rabaninejad, “Hand Vessels Authentication Using SVM Classification in Infrared Images,” Journal Of Electronical & Cyber Defence, vol. 5, no. 3, 2017.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1396.5.3.3.6

[32] K. Eyvazi, M. A. Karami, “Optimizing Plasmonic Color Filter for Imaging Sensor,” Journal of Applied Electromagnetics,vol. 7, no. 2, 2020.(in Persian). https://dor.isc.ac/dor/20.1001.1.26455153.1398.7.2.12.7