Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

PLUTO / PLUTO-2 Spatial Light Modulators
Adaptive Optics / Wavefront Control Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH Imaging/ Image Processing Microscopy Misc.: Speckle / Characterization / Metrology Phase Measurement / Phase Retrieval Polarization Generation Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen
Abstract:

Imaging technologies based on vector optical fields hold significant potential in the biomedical field, particularly for non-invasive scattering imaging of anisotropic biological tissues. However, the dynamic and anisotropic nature of biological tissues poses severe challenges to the propagation and reconstruction of vector optical fields due to light scattering. To address this, we propose a deep learning-based polarization-resolved restoration method aimed at achieving the efficient and accurate imaging reconstruction from speckle patterns generated after passing through anisotropic and dynamic time-varying biological scattering media. By innovatively leveraging the two orthogonal polarization components of vector optical fields, our approach significantly enhances the robustness of imaging reconstruction in dynamic and anisotropic biological scattering media, benefiting from the additional information dimension of vectorial optical fields and the powerful learning capacity of a deep neural network. For the first time, a hybrid network model is designed that integrates convolutional neural networks (CNN) with a Transformer architecture for capturing local and global features of a speckle image, enabling adaptive vectorial restoration of dynamically time-varying speckle patterns. The experimental results demonstrate that the model exhibits excellent robustness and generalization capabilities in reconstructing the two orthogonal polarization components from dynamic speckle patterns behind anisotropic biological media. This study not only provides an efficient solution for scattering imaging of dynamic anisotropic biological tissues but also advances the application of vector optical fields in dynamic scattering environments through the integration of deep learning and optical technologies.

Open Access

Open Access

Publication: Sensors: Computational Optical Sensing and Imaging
Issue/Year: Sensors 2025, 25(6), 1803
DOI: 10.3390/s25061803
Link: https://doi.org/10.3390/s25061803

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sai Deepika Sure, Harsh Vardhan, Ravi Kumar, Gangi Reddy Salla, and Joseph Rosen

Optical imaging with extended field of view using three multiplexing techniques of coded phase apertures

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Optical Communication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yang Zhang, Ruiwen Yang, Xing Li, Dan Dan, Yanlong Yang, Yuzhu Liu, Runze Li, Jia Qian, Taiqiang Dai, Liang Kong, Xianghua Yu, and Baoli Yao

Aberration correction and complementary beam subtraction in light-sheet fluorescence microscopy

Applications: Adaptive Optics / Wavefront Control,Beam Shaping / Beam Steering,Bessel-/ Airy Beam Generation,Digital-/ Computer Holography/ CGH,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Shiva Shankar Mutupuri, Mohammad Haider Ansari, Ganesh Velagala, Satish Anamalamudi, Ganesh M. Balasubramaniam, Ravi Kumar, and Salla Gangi Reddy

Deep-Learning-Enabled Continuous Regression of Fractional Topological Charge from Speckle Patterns

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ebraheem Farea, Radhwan A.A. Saleh, Huiling Huang, Feibin Wu, Biao Mei, and Jun Han

SCPC-Net: Physics-informed spatial contrast and phase correction for imaging through dynamic scattering media

Applications: Deep Learning / Neuronal Network,Turbid-/ Opaque Media /Multi Scattering
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Artur Szawerdak, Dawid Ciesielski, Maksymilian Chlipała, Dominik Drąg, and Tomasz Kozacki

Wide-angle RGB multi-order holographic near eye display

Applications: AR/VR/MR / Holographic Display,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Daiki Shingu, Koki Oishi, and Wataru Watanabe

Effect of spatial speckle mixing on data poisoning vulnerability in deep-learning-based scattering imaging

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Marshall B. Lindsay, Scott D. Kovaleski, Derek T. Anderson, Stanton R. Price, and Steven R. Price

Deep diffractive cooperative optimization

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:O.A. Ramírez-Espinosa, D. Salamanca-Roldán, L.E.C. Rosales-Zárate, F. Arce, C. Rosales-Guzmán, P.D. Yepiz-Graciano, A.A. Aguilar-Cardoso, J.M. López-Romero, and R. Ramírez-Alarcón

Accurate and fast determination of the topological charge of Laguerre–Gauss entangled photons with convolutional neural networks

Applications: Deep Learning / Neuronal Network,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Francesco Reda, Marcella Salvatore, Sergio Balestrieri, Salvatore Formato, I Komang Januariyasa, Mario Iodice, Fabio Borbone, Marco Piccardo, and Stefano Luigi Oscurato

Light-surface coupling in deep azopolymer surface relief diffraction gratings

Applications: Digital-/ Computer Holography/ CGH,Lithography,Materials Processing / Optical Fabrication,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Daixuan Wu, Sitong Huang, Jiawei Luo, Yuecheng Shen, Shile Yang, Zhengyang Wang, Jiaming Liang, Dalong Qi, Yunhua Yao, Lianzhong Deng, Zhenrong Sun, Xiaohua Feng, and Shian Zhang

Wide-field single-pixel complex-field microscopy through a multimode fiber

Applications: Microscopy,Turbid-/ Opaque Media /Multi Scattering
LETO / LETO-3 Spatial Light Modulators
Authors:Maria Merin Antony, C.S. Suchand Sandeep, and Murukeshan Vadakke Matham

SIHM: A high-resolution hyperspectral microscope for plant diagnostics

Applications: Beam Shaping / Beam Steering,Imaging/ Image Processing,Microscopy
LC 2012 Spatial Light Modulators
Authors:Minwook Kim, Chansuk Park, Chulmin Oh, KyeoReh Lee, Herve Hugonnet, and YongKeun Park

Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:N. Gorunski, G. Maleshkov, A. Stefanov, M. Mincheva, E. Lazarov, I. Stefanov, L. I. Stoyanov, and A. Dreischuh

Controlling the Gouy phase of coherent beams by necklace-like structures of optical vortices

Applications: Adaptive Optics / Wavefront Control,Complex Modulation,Higher Order Modes / Optical Vortex / OAM
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Harsh Vardhan, Aswathi K Sivarajan, Sakshi Choudhar, Salla Gangi Reddy, and Ravi Kumar

Mode-Dependent Statistical Characteristics of Speckle Patterns From Structured Light Beams

Applications: Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiangfeng Huang, Ruonan Fan, Yibin Pan, Xiaohua Lv, and Ling Fu

Parallel multi-region adaptive optics module for high-resolution imaging in deep brain microendoscopy

Applications: Adaptive Optics / Wavefront Control,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jennyfer Morales-Marín, Walter Torres-Sepúlveda, and Alejandro Mira-Agudelo

Adaptive Hartmann–Shack Wavefront Sensor

Applications: Adaptive Optics / Wavefront Control
LUNA PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Hanlong Chen, Çağatay Işıl, Che-Yung Shen, Shiqi Chen, Tianyi Gan, Mona Jarrahi, and Aydogan Ozcan

Super-resolution image projection over an extended depth of field using a diffractive decoder

Applications: Deep Learning / Neuronal Network,Telecom / Optical Switching / WSS
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Guang-Ze Li, Yuhan Zhou, Lu-Hong Zhang, Ning-Chen Cao, Xiao-Bo Hu, Khian-Hooi Chew, and Rui-Pin Chen

Flexible polarization-multiplexing manipulation through a highly scattering medium for high-resolution arbitrary-polarization vector light field generation

Applications: Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Daixuan Wu, Zhen Yi, Jiaming Liang, Tijian Li, Zhongzheng Zhu, Zexian Zhang, Haitao Ye, Jiawei Luo, Zhengyang Wang, Meng Liu, Zhi-Chao Luo, and Yuecheng Shen

Inverse theory of wavefront shaping in nonlinear scattering media

Applications: Adaptive Optics / Wavefront Control,Pulse Application / -Shaping
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu Liu, Peng Su, Jianhua Huang, Huifang Lin, Pengfei Wang, and Feng Huang

Focusing light through turbid and thick scattering media via a hybrid genetic neural network algorithm

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
LC 2012 Spatial Light Modulators
Authors:Yuetian Ren, Yue Yang, Shuaihang Luo, Zheng Zhou, Keren Chen, and Zejun Yan

A High Depth-Resolution, Reconfigurable Raman Spectroscopy Based on Programmable Cone-Shell Excitation

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Light Mkhumbuza, Pedro Ornelas, Angela Dudley, Isaac Nape, and Kayn A. Forbes

Topological control of chirality and spin with structured light

Applications: Higher Order Modes / Optical Vortex / OAM,Polarization Generation
GAEA / GAEA-2 / GAEA-C Spatial Light Modulators
Authors:Yanqiu Hu, Zihe Zhang, Tao Zhang, Lanqing Jia, Xiao Zhang, Zhujun Wan, Leixin Meng, Kai Wei, and Liangjia Zong

Achieving high diffraction efficiency in LCoS-SLMs via neural-network-based precise fringe-field compensation

Applications: Deep Learning / Neuronal Network,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Alban Degezelle, Jonas Strobelt, Sarah Loebner, Moussa Mebarki, Stéphane Fusil, Vincent Garcia, Bruno Bérini, Vincent Polewczyk, Yves Dumont, Sylvia Matzen, Philippe Lecoeur, Svetlana Santer, and Thomas Maroutian

Light-Induced Photomechanical Patterning of Ferroelectric Polarization

Applications: Materials Processing / Optical Fabrication,Polarization Generation