Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

PLUTO / PLUTO-2 Spatial Light Modulators
Adaptive Optics / Wavefront Control Deep Learning / Neuronal Network Digital-/ Computer Holography/ CGH Imaging/ Image Processing Microscopy Misc.: Speckle / Characterization / Metrology Phase Measurement / Phase Retrieval Polarization Generation Turbid-/ Opaque Media /Multi Scattering
Published on:
Authors: Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen
Abstract:

Imaging technologies based on vector optical fields hold significant potential in the biomedical field, particularly for non-invasive scattering imaging of anisotropic biological tissues. However, the dynamic and anisotropic nature of biological tissues poses severe challenges to the propagation and reconstruction of vector optical fields due to light scattering. To address this, we propose a deep learning-based polarization-resolved restoration method aimed at achieving the efficient and accurate imaging reconstruction from speckle patterns generated after passing through anisotropic and dynamic time-varying biological scattering media. By innovatively leveraging the two orthogonal polarization components of vector optical fields, our approach significantly enhances the robustness of imaging reconstruction in dynamic and anisotropic biological scattering media, benefiting from the additional information dimension of vectorial optical fields and the powerful learning capacity of a deep neural network. For the first time, a hybrid network model is designed that integrates convolutional neural networks (CNN) with a Transformer architecture for capturing local and global features of a speckle image, enabling adaptive vectorial restoration of dynamically time-varying speckle patterns. The experimental results demonstrate that the model exhibits excellent robustness and generalization capabilities in reconstructing the two orthogonal polarization components from dynamic speckle patterns behind anisotropic biological media. This study not only provides an efficient solution for scattering imaging of dynamic anisotropic biological tissues but also advances the application of vector optical fields in dynamic scattering environments through the integration of deep learning and optical technologies.

Open Access

Publication: Sensors: Computational Optical Sensing and Imaging
Issue/Year: Sensors 2025, 25(6), 1803
DOI: 10.3390/s25061803
Link: https://doi.org/10.3390/s25061803

Related Papers

GAEA / GAEA-2 Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Vijayakumar Anand and Joseph Rosen

Multiple Incoherent Deconvolutions for Improving the Image Resolution of Diffraction-Limited Imaging Systems

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhiyuan Ye, Chen-Xin Ding, Jilun Zhao, Wanting Hou, Xue-Jiao Men, Yi Cui, Hong-Chao Liu, Hai-Bo Wang and Jun Xiong

Vortex memory effect of light for scattering-assisted massive data transmission

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Communication,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
LETO / LETO-3 Spatial Light Modulators
Authors:Siteng Li, Fei Wang, Zhenfeng Fu, Yaoming Bian and Guohai Situ

Dynamic quantitative phase imaging using deep spatial-temporal prior

Applications: Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Bahadır Utku Kesgin and Uğur Teğin

Photonic neural networks at the edge of spatiotemporal chaos in multimode fibers

Applications: Deep Learning / Neuronal Network
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LC-R 720 Spatial Light Modulators
Authors:Xuan Liu, Rupak Bhakta, Emily Kryvorutsky and Yuanwei Zhang

Imaging cells and nanoparticles using modulated optically computed phase microscopy

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zun Htay, Fabio A. Barbosa and Filipe M. Ferreira

Analysis of crosstalk drift and optimization of spatial light modulator based mode-selective multiplexers for multimode fibers

Applications: Adaptive Optics / Wavefront Control,Beam Shaping / Beam Steering,Telecom / Optical Switching / WSS
LC-R 2500 Spatial Light Modulators
Authors:Jianyi Li, Qingfeng Liu, Liying Tan, Jing Ma and Nanxing Chen

Enhanced Neural Architecture for Real-Time Deep Learning Wavefront Sensing

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yi-Jing Wu, Jing-Han Zhuang, Pan-Pan Yu, Yi-Fan Liu, Zi-Qiang Wang, Yin-Mei Li, Cheng-Wei Qiu & Lei Gong

Time-varying 3D optical torque via a single beam

Applications: Higher Order Modes / Optical Vortex / OAM,Optical Trapping /-Tweezers,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:P. Parkprom, N. Chattrapiban and N. Thaicharoen

Aberration correction of optical dipole-traps array utilizing phase-modulated holographic technique

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qi Jia, Bojian Shi, Yanxia Zhang, Hang Li, Xiaoxin Li, Rui Feng, Fangkui Sun, Yongyin Cao, Jian Wang, Cheng-Wei Qiu, Min Gu and Weiqiang Ding

Partially coherent diffractive optical neural network

Applications: Deep Learning / Neuronal Network,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jan Marx, Malte Seefeldt, Damian Haske, Christian Lutz, Ralf Hellmann, Cemal Esen, Andreas Ostendorf

Holographic freeform micro hole processing using Bessel beams

Applications: Bessel-/ Airy Beam Generation,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhenting Yan, Huiling Huang, Yili Chen, Hanfei Lin, Ebraheem Farea, Xingzhao Hua and Jun Han

Scattering imaging of moving targets based on recurrent neural networks: a fusion of temporal and phase information

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
LC 2002 Spatial Light Modulators
Authors:Jyoti Bikash Mohapatra, Naveen K. Nishchal and Jyothish Monikantan

Object Recognition in Foggy and Hazy Conditions Using Dark Channel Prior-Based Fringe-Adjusted Joint Transform Correlator

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiwei Fang, Huadong Zheng, Xinxing Xia, Junchang Peng, Tengfei Zhang, Xingyu Lin and Yingjie Yu

Diffraction model-driven neural network with semi-supervised training strategy for real-world 3D holographic photography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Sara Aissati, Tianlun Zou, Sabyasachi Goswami, Len Zheleznyak, Susana Marcos

Visual Quality and Accommodation With Novel Optical Designs for Myopia Control

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
LETO / LETO-3 Spatial Light Modulators
Authors:Haifeng Qin, Chao Han, Xuan Shi, Tao Gu and Kangsheng Sun

Complex-valued generative adversarial network for real-time and high-quality computer-generated holography

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH