Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

PLUTO / PLUTO-2 Spatial Light Modulators
Deep Learning / Neuronal Network Imaging/ Image Processing Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han
Abstract:

The speckle degradation caused by scattering media posed barriers to capturing the displacement information of moving objects. Moreover, the optical memory effect (OME) further restricts the imaging range, and current methodologies neglect the long-term temporal dynamics of the entire motion process. To overcome these limitations, we propose the temporal and phase recurrent neural network (TP-RNN), which leverages the temporal properties of recurrent neural networks (RNNs) and incorporates the phase extraction block (PEB) for handling phase spectrum information. The RNN unit captures and transmits temporal information between speckle image frames, while the PEB focuses on extracting key phase spectrum details from the features. This fusion strategy enables the network to recover moving objects and perform accurate quantitative predictions effectively. Experimental results validate that TP-RNN achieves high-precision imaging for moving targets across diverse trajectories and complexities, limiting prediction errors to within 1 pixel.

Open Access

Publication: Optics Express
Issue/Year: Opt. Express 32, 45978-45994 (2024)
DOI: 10.1364/OE.544809
Link: https://doi.org/10.1364/OE.544809

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Erkhembaatar Dashdavaa, Erdenebayar Bayarsaikhan, Munkh-Uchral Erdenebat, Jae-Yeol Cha, Jae-Won Lee, Jin-Hyeok Seo, Hyeon-Su Jeong, Min-Seok Kim, Ji-Sub Park, and Hak-Rin Kim

Dynamic eyebox expansion in holographic near-eye displays via active switching quarter-waveplate geometric phase prisms

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Tianlong Man, Yuwen Zhang, Yuchen Wu, Zhiqing Zhang, Hongqiang Zhou, Liyun Zhong, and Yuhong Wan

Three-dimensional neural network driving self-interference digital holography enables high-fidelity, non-scanning volumetric fluorescence microscopy

Applications: Beam Shaping / Beam Steering,Deep Learning / Neuronal Network,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenxuan Xu, Li Pei, Jianshuai Wang, Zhouyi Hu, Bing Bai, and Tigang Ning

Phase mask localization for multi-pass cavity and mode conversion

Applications: Imaging/ Image Processing,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yuwei Jiang, Wenyu Yang, Yongxin Zhu, and Zunkai Huang

High-Quality Phase-Only Holography via Frequency-Domain Hybrid Encoding and Multi-Scale Complex Attention

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sai Deepika Sure, Jawahar Prabhakar Desai, and Joseph Rosen

Single-shot incoherent imaging with extended and engineered field of view using coded phase apertures

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chuncheng Zhang, Zhaoxuan Hu, Tianting Zhong, Haofan Huang, Ji Liang, Yu Wang, Tingting Liu, Zheyi Yao, Qian Chen, Puxiang Lai, and Xiubao Sui

Unlocking high-frequency speckle details via relative frequency learning for robust imaging through scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hyunmin Ban, Wenbin Zhou, Xiangyu Meng, and Yifan Evan Peng

Multi-color compressive hologram synthesis with learned wave propagation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Xinkuo Li, Chenduan Chen, Ke Sun, Linhan Li, Zhu Xiao, Zhou Li, Yuanzheng Yue, Jianrong Qiu, and Dezhi Tan

Perovskite nanocrystals-in-glass hierarchical structures enable stable continuous-wave random lasers

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, MD. Haider Ansari, Satish Anamalamudi, Ravi Kumar, Shashi Prabhakar, and Salla Gangi Reddy

Higher-Order Spatial Mode Detection Leveraging Deep Learning on Random Optical Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Chong Wang, Yuchen He, Yadi Wang, Hui Chen, Huaibin Zheng, Jianbin Liu, Yu Zhou, and Zhuo Xu

Implicit representation optimization method for enhanced ghost imaging through scattering medium

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenqi Ma, Fan Yang, Xiuquan Li, Haiyan Wang, and Guijun Hu

Modeling and performance analysis for few-mode free-space optical communication reception based on optical-domain coherent beam combining

Applications: Optical Communication,Telecom / Optical Switching / WSS,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:J. Arriaga Hernández, B. Cuevas Otahola, A. Diaz Nayotl, A. Jaramillo Núñez, A. Pérez Villegas, O. Valenzuela b

Machine learning K-means algorithm applied to wavefront sensing in Bi-Ronchi/Hartmann tests with SLM

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Wenzhang Lin, Chengyu Zhou, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Compressive incoherent digital holography for high-fidelity 3D imaging

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:C. Hainaut, K. Ouahrouche, A. Rancon, G. Patera, C. Ouarkoub, M. Le Parquier, P. Suret, A. Amo

Bidimensional measurements of photon statistics within a multimodal temporal framework

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Chen, Fan Wang, Zhonghao Wang, Pin Wang, Yongwei Yao, Bing Zhang, Yaping Zhang, and Ting-Chung Poon

Unified analytical framework for continuous shading and texture rendering in polygon-based computer-generated holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
ERIS PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guillaume Noetinger, Tim Tuuva, Romain Fleury

Tutorial: A practical guide to the alignment of defocused spatial light modulators for fast diffractive neural networks

Applications: Complex Modulation,Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adam J. Vallance, Aleksandr Boldin, Ultan J. Daly, and Martin P.J. Lavery

Structured light probe for turbulent media

Applications: Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yaping Tian, Yuhan Zhou, Shiyi Lu, Liming Zhu, Khian-Hooi Chew, Rui-Pin Chen

Mueller matrix-based deep neural network for adaptive reconstruction of orthogonal polarization components of a vector beam transmitted through a highly scattering medium

Applications: Deep Learning / Neuronal Network,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhihao Zhou, Jing Han, Zhuang Zhao, Haotian Yu, and Dongliang Zheng

Large depth range DH-PSF with high peak confinement invariance

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Ruidong Li, Caihua Zhang, Kejian Zhu, Zheng Huang, Conghe Wang, Shukai Wu, and Hongwei Chen

Implementation of fully connected layers in optical convolutional neural networks for pre-sensor computing

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Atefeh Akbarpour, Adad Yepiz, Benjamin Perez-Garcia, J. A. Alvarez-Chavez, Herman L. Offerhaus & Raul I. Hernandez-Aranda

Partially coherent Mathieu–Gauss beams

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
HES / HEO 6001 Spatial Light Modulators
Authors:Yining Hao, Yang Peng, Tianshun Zhang, and Wen Chen

High-quality photon-limited imaging through dynamic and complex scattering media with a single-photon detector

Applications: Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruitao Wu, Juncheng Fang, Rui Pan, Rongyi Lin, Kaiyuan Li, Ting Lei, Luping Du, Xiaocong Yuan

Physical Interpretation of Diffractive Optical Networks for High-Dimensional Vortex Mode Sorting

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ivan B. Djordjevic and Ignacio A. Rojas

SLM steering-based covert communication over strong atmospheric turbulence channels

Applications: Beam Shaping / Beam Steering,Optical Communication,Turbid-/ Opaque Media /Multi Scattering