تصویربرداری دید غیر مستقیم NLOS در طول موج مادون قرمز موج کوتاه و بلند

نوع مقاله : مقاله پژوهشی

نویسندگان

1 پژوهشگر،دانشگاه جامع امام حسین (ع)، تهران ، ایران

2 کارشناسی ارشد،دانشگاه جامع امام حسین (ع)، تهران ، ایران

چکیده

در این مقاله یک روش تصویربرداری از اهداف خارج از دیدمستقیم یا Non-Line of Sight Imaging در طول‌موج مادون‌قرمز بلند (LWIR) به‌صورت غیرفعال و در طول‌موج مادون‌قرمز کوتاه (SWIR) به‌صورت فعال ارائه‌شده است. در تصویربرداری خارج از دیدمستقیم در طول‌موج مادون‌قرمز موج‌بلند از یک دوربین LWIR که یک دوربین uncooled Camera-320×240 pixel بوده و اندازه هر پیکسل آن 30 µm است، استفاده‌شده است. در این تصویربرداری که به‌صورت غیرفعال انجام‌شده تصویر یک جسم گرم نظیر هویه با موفقیت بازیابی شده است. در تصویربرداری خارج از دیدمستقیم دیگر که در طول مادون‌قرمز موج‌کوتاه به‌صورت فعال انجام‌شده با استفاده از یک منبع نور با طول‌موج مادون‌قرمز موج‌کوتاه و تابش آن به یک جسم که در دیدمستقیم دوربین قرار ندارد، موج منعکس‌شده از یک سطح بازتابنده، وارد دوربین SWIR مدل SX-1.7-320 شده و نهایتاً تصویر هدف بازیابی می‌شود. نتایج تصویربرداری موفقیت این نوع تصویربرداری در طول‌موج‌های مادون‌قرمز موج‌بلند و موج‌کوتاه به ترتیب در حالت غیرفعال و فعال را نشان می‌دهد. تصاویر به‌دست‌آمده از تصویربرداری دید غیرمستقیم NLOS کارایی این روش را به ترتیب در طول‌موج‌های LWIR و SWIR در حالت‌های غیرفعال و فعال نشان می‌دهند. اعتبار سنجی این روش تصویربرداری با مقایسه تصاویر به‌دست‌آمده با تصاویر اصلی، با استفاده از معیارهای MSE و RMSE انجام می‌شود.

کلیدواژه‌ها


عنوان مقاله [English]

Non-line-of-sight (NLOS) imaging in short and long-wave infrared wavelengths

نویسندگان [English]

  • Mohammad Roueinfar 1
  • mahdi salmanian 2
1 Researcher, Imam Hossein University, Tehran, Iran
2 Master's degree, Imam Hossein University (AS), Tehran, Iran
چکیده [English]

This paper presents a method for Non-Line Of Sight (NLOS) imaging that works passively in the long-wave infrared and actively in the short-wave infrared. An LWIR camera, an uncooled camera with 320×240 pixels and a size of 30 µm per pixel, is used for imaging in the long-wave infrared. In this passive imaging, the image of a hot object, such as a soldering iron, was successfully captured. In other imaging, which is actively performed in short-wave infrared by using a light source with a short-wave infrared wavelength and aiming it at an object that is not in the camera's direct field of view, the wave reflected from a reflective surface enters the SWIR camera model SX-1.7-320 and finally the target image is captured. The images obtained from non-line-of-sight (NLOS) imaging demonstrate the efficacy of this technique in both the long-wave infrared (LWIR) and short-wave infrared (SWIR) wavelengths under passive and active modes, respectively. The validation of this imaging method is conducted by comparing the captured images with the original images, employing the Mean Squared Error (MSE) and Root Mean Squared Error (RMSE) criteria.

کلیدواژه‌ها [English]

  • Non-Line-Of-Sight imaging
  • long wave infrared
  • short wave infrared
  • resolution
[1]      M. O’Toole, D. B. Lindell, and G. Wetzstein, “Confocal non-line-of-sight imaging based on the light-cone transform,” Nature, vol. 555, no. 7696, pp. 338–341, Mar. 2018, doi: 10.1038/nature25489.
[2]      X. Liu et al., “Non-line-of-sight imaging using phasor-field virtual wave optics,” Nature, vol. 572, no. 7771, pp. 620–623, Aug. 2019, doi: 10.1038/s41586-019-1461-3.
[3]      A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, “Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging,” Nature Communications, vol. 3, no. 1, Mar. 2012, doi: 10.1038/ncomms1747.
[4]      V. Arellano, D. Gutierrez, and A. Jarabo, “Fast back-projection for non-line of sight reconstruction,” ACM SIGGRAPH 2017 Posters, Jul. 2017, doi: 10.1145/3102163.3102241.
[5]      F. Heide, L. Xiao, W. Heidrich, and M. B. Hullin, “Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors,” 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3222–3229, Jun. 2014, doi: 10.1109/cvpr.2014.418.
[6]      D. B. Lindell, G. Wetzstein, and M. O’Toole, “Wave-based non-line-of-sight imaging using fast f-k migration,” ACM Transactions on Graphics, vol. 38, no. 4, pp. 1–13, Jul. 2019, doi: 10.1145/3306346.3322937.
[7]      X. Liu, S. Bauer, and A. Velten, “Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,” Nature Communications, vol. 11, no. 1, Apr. 2020, doi: 10.1038/s41467-020-15157-4.
[8]      X. Liu, S. Bauer, and A. Velten, “Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,” Nature Communications, vol. 11, no. 1, Apr. 2020, doi: 10.1038/s41467-020-15157-4.
[9]      M. Batarseh, S. Sukhov, Z. Shen, H. Gemar, R. Rezvani, and A. Dogariu, “Passive sensing around the corner using spatial coherence,” Nature Communications, vol. 9, no. 1, Sep. 2018, doi: 10.1038/s41467-018-05985-w.
[10]      A. Beckus, A. Tamasan, and G. K. Atia, “Multi-Modal Non-Line-of-Sight Passive Imaging,” IEEE Transacti-ons on Image Processing, vol. 28, no. 7, pp. 3372–3382, Jul. 2019, doi: 10.1109/tip.2019.2896517.
[11]      J. Boger-Lombard and O. Katz, “Passive optical time-of-flight for non line-of-sight localization,” Nature Communications, vol. 10, no. 1, Jul. 2019, doi: 10.1038/s41467-019-11279-6.
[12]      C. Saunders, R. Bose, J. Murray-Bruce, and V. K. Goyal, “Multi-Depth Computational Periscopy with an Ordinary Camera,” ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 9299–9305, May 2020, doi: 10.1109/icassp40776.2020.9054518.
[13]      S. W. Seidel, J. Murray-Bruce, Y. Ma, C. Yu, W. T. Freeman, and V. K. Goyal, “Two-Dimensional Non-Line-of-Sight Scene Estimation From a Single Edge Occluder,” IEEE Transactions on Computational Imaging, vol. 7, pp. 58–72, 2021, doi: 10.1109/tci.2020.3037405.
[14]      C. Thrampoulidis et al., “Exploiting Occlusion in Non-Line-of-Sight Active Imaging,” IEEE Transactions on Computational Imaging, vol. 4, no. 3, pp. 419–431, Sep. 2018, doi: 10.1109/tci.2018.2829599.
[15]      X. Liu, S. Bauer, and A. Velten, “Analysis of Feature Visibility in Non-Line-Of-Sight Measurements,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10132–10140, Jun. 2019, doi: 10.1109/cvpr.2019.01038.
[16]      I. Gkioulekas, A. Levin, F. Durand, and T. Zickler, “Micron-scale light transport decomposition using interferometry,” ACM Transactions on Graphics, vol. 34, no. 4, pp. 1–14, Jul. 2015, doi: 10.1145/2766928.
[17]      I. Gkioulekas, A. Levin, F. Durand, and T. Zickler, “Micron-scale light transport decomposition using interferometry,” ACM Transactions on Graphics, vol. 34, no. 4, pp. 1–14, Jul. 2015, doi: 10.1145/2766928.
[18]      C. Jin, M. Tang, L. Jia, X. Tian, J. Yang, K. Qiao, and S. Zhang, “Scannerless Non-Line-of-Sight Three Dimensional Imaging with a 32x32 SPAD Array,” arXiv:2011.05122.
[19]      C. Wu et al., “Non–line-of-sight imaging over 1.43 km,” Proceedings of the National Academy of Sciences, vol. 118, no. 10, Mar. 2021, doi: 10.1073/pnas.2024468118.
[20]      A. Pediredla, A. Dave, and A. Veeraraghavan, “SNLOS: Non-line-of-sight Scanning through Temporal Focusing,” 2019 IEEE International Conference on Computational Photography (ICCP), pp. 1–13, May 2019, doi: 10.1109/iccphot.2019.8747336.
[21]      S. Xin, S. Nousias, K. N. Kutulakos, A. C. Sankaranarayanan, S. G. Narasimhan, and I. Gkioulekas, “A Theory of Fermat Paths for Non-Line-Of-Sight Shape Reconstruction,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6793–6802, Jun. 2019, doi: 10.1109/cvpr.2019.00696.
[22]      X. Liu, J. Wang, L. Xiao, Z. Shi, X. Fu, and L. Qiu, “Non-line-of-sight imaging with arbitrary illumination and detection pattern,” Nature Communications, vol. 14, no. 1, Jun. 2023, doi: 10.1038/s41467-023-38898-4.
[23]      M. Kaga, T. Kushida, T. Takatani, K. Tanaka, T. Funatomi, and Y. Mukaigawa, “Thermal non-line-of-sight imaging from specular and diffuse reflections,” IPSJ Transactions on Computer Vision and Applications, vol. 11, no. 1, Nov. 2019, doi: 10.1186/s41074-019-0060-4.
[24]      C. Hashemi, T. Sasaki, and J. Leger, “Parallax-Driven Denoising of Passive Non-Line-of-Sight Thermal Imagery,” 2023 IEEE International Conference on Computational Photography (ICCP), pp. 1–12, Jul. 2023, doi: 10.1109/iccp56744.2023.10233749.
[25]      T. Maeda, Y. Wang, R. Raskar, and A. Kadambi, “Thermal Non-Line-of-Sight Imaging,” 2019 IEEE International Conference on Computational Photography (ICCP), pp. 1–11, May 2019, doi: 10.1109/iccphot.2019.8747343.
[26]      M. Kaga, T. Kushida, T. Takatani, K. Tanaka, T. Funatomi, and Y. Mukaigawa, “Thermal non-line-of-sight imaging from specular and diffuse reflections,” IPSJ Transactions on Computer Vision and Applications, vol. 11, no. 1, Nov. 2019, doi: 10.1186/s41074-019-0060-4.
[27]      https://www.photonicsonline.com/doc/swir-mwir-and-lwir-one-use-case-for-each-0001.
[28]      A. Nazar, N. A. Jasem, and N. Kh. Abdalameer, “Optimized Design of Optical Filters for LWIR Region,” Journal of Optics, vol. 53, no. 3, pp. 1914–1917, Aug. 2023, doi: 10.1007/s12596-023-01295-7.
[29]      F. S. Marvasti, M. Nasiri, M. R. Mousav,“Flying Small Target Detection in Infrared Images Based on Adaptive
Top-Hat Transform,” Journal Of Electronical & Cyber Defence,vol. 5, no. 3, 2017.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1396.5.3.2.5
[30]      M. Nasiri, S. Chehrehsa, S. A. Mirmahdavi, “Small Target Enhancement in Infrared Image using Local Statistical Weighted Entropy,” Journal Of Electronical & Cyber Defence,vol. 4, no. 2, 2016.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1395.4.2.6.0
[31]      H. Moslemi, I. Abaspur Kazerouni, A. Rabaninejad, “Hand Vessels Authentication Using SVM Classification in Infrared Images,”  Journal Of Electronical & Cyber Defence, vol. 5, no. 3, 2017.(in Persian).https://dor.isc.ac/dor/20.1001.1.23224347.1396.5.3.3.6
[32]      K. Eyvazi, M. A. Karami,  “Optimizing Plasmonic Color Filter for Imaging Sensor,” Journal of Applied Electromagnetics,vol. 7, no. 2, 2020.(in Persian). https://dor.isc.ac/dor/20.1001.1.26455153.1398.7.2.12.7
دوره 11، شماره 2
پاییز و زمستان
بهمن 1402
صفحه 61-70
  • تاریخ دریافت: 19 مرداد 1402
  • تاریخ بازنگری: 08 آبان 1402
  • تاریخ پذیرش: 21 آذر 1402
  • تاریخ انتشار: 01 دی 1402