Energy-Efficient Adaptive 3D Sensing

GAEA / GAEA-2 Spatial Light Modulators
Digital-/ Computer Holography/ CGH Imaging/ Image Processing Misc.: Speckle / Characterization / Metrology
Published on:
Authors: Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian
Abstract:

“Active depth sensing achieves robust depth estimation but is usually limited by the sensing range. Naively increasing the optical power can improve sensing range but induces eye-safety concerns for many applications, including autonomous robots and augmented reality. In this paper, we propose an adaptive active depth sensor that jointly optimizes range, power consumption, and eye-safety. The main observation is that we need not project light patterns to the entire scene but only to small regions of interest where depth is necessary for the application and passive stereo depth estimation fails. We theoretically compare this adaptive sensing scheme with other sensing strategies, such as full-frame projection, line scanning, and point scanning. We show that, to achieve the same maximum sensing distance, the proposed method consumes the least power while having the shortest (best) eye-safety distance. We implement this adaptive sensing scheme with two hardware prototypes, one with a phase-only spatial light modulator (SLM) and the other with a micro-electro-mechanical (MEMS) mirror and diffractive optical elements (DOE). Experimental results validate the advantage of our method and demonstrate its capability of acquiring higher quality geometry adaptively.”

Open Access

Publication: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Issue/Year: June 2023, Pages 5054-5063
Link: https://openaccess.thecvf.com/content/CVPR2023/html/Tilmon_Energy-Efficient_Adaptive_3D_Sensing_CVPR_2023_paper.html

Related Papers

LUNA Spatial Light Modulators
Authors:Xiangrui Duan and Zichun Le

Inter-layer edge supplementation in computer-generated multi-depth 3D holograms

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Youngrok Kim, Dong-Woo Seo, Chihyun In and Sung-Wook Min

Phase-assisted camera-in-the-loop hologram optimization with Fourier aperture function constraint

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Carlos Vargas-Castrillón, Alejandro Velez-Zea, and John Fredy Barrera-Ramírez

Intensity equivalence between free-space propagation and a single-lens processor: application to adjustable magnification in hologram reconstruction

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Maksymilian Chlipala, Maria-Luisa Cruz, Juan Martinez-Carranza, Moncy Idicula, Rafal Kukolowicz, and Tomasz Kozacki

Wide-angle color holographic near eye display with full bandwidth frequency multiplexing

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ning Xu, Dalong Qi, Long Cheng, Zhen Pan, Chengyu Zhou, Wenzhang Lin, Hongmei Ma, Yunhua Yao, Yuecheng Shen, Lianzhong Deng, Zhenrong Sun, and Shian Zhang

Sparse point spread function-based multi-image optical encryption

Applications: Digital-/ Computer Holography/ CGH,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kenneth Chen, Anzhou Wen, Yunxiang Zhang, Praneeth Chakravarthula and Qi Sun

View synthesis for 3D computer-generated holograms using deep neural fields

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Reza Esmaeilzadeh, Jamasp Jhabvala, Lucas Schlenger, Mathijs van der Meer, Eric Boillat, Cyril Cayron, Amir Mohammad Jamili, Junfeng Xiao, and Roland E. Logé

Toward Architected Microstructures Using Advanced Laser Beam Shaping in Laser Powder Bed Fusion of Ti-6Al-4V

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adolphe Ndagijimana, Iñigo Ederra and Miguel Heredia Conde

Single-Pixel Compressive Terahertz 3D Imaging

Applications: Complex Modulation,Imaging/ Image Processing
LUNA Spatial Light Modulators
Authors:Sascha Fricke, Susana Castillo, Martin Eisemann, and Marcus Magnor

Real-Time Rendering Framework for Holography

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Yuki Takemura, Hirohito Nishi, Kyoji Matsushima

Denisyuk-type wavefront printer and its computational correction of aberration in optical system

Applications: Adaptive Optics / Wavefront Control,Digital-/ Computer Holography/ CGH
LETO / LETO-3 Spatial Light Modulators
Authors:Augusto Arias, Susanna P. Clement, Pablo Artal and Siegfried Wahl

Chromatic imaging properties of myopia control spectacle lenses

Applications: Adaptive Optics / Wavefront Control,Imaging/ Image Processing
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenqi Xu, Junmin Leng, Ping Dai and Chao Wang

DSCCNet for high-quality 4K computer-generated holograms

Applications: AR/VR/MR / Holographic Display,Complex Modulation,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Yu-Chen Chen, Shi-Xuan Mi, Ya-Ping Tian, Xiao-Bo Hu, Qi-Yao Yuan, Khian-Hooi Chew and Rui-Pin Chen

Adaptive Vectorial Restoration from Dynamic Speckle Patterns Through Biological Scattering Media Based on Deep Learning

Applications: Adaptive Optics / Wavefront Control,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Imaging/ Image Processing,Microscopy,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval,Polarization Generation,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Wenjun Yi, Shuyue Zhu, Meicheng Fu, Nan Gu, Junli Qi, Siyu Liu, Mengjun Zhu, Ping Wang, Xin Chen, Yi Zhang, Hongyu Zhang, Yao Xu, Junyi Du, Peng Xiong, Zhaohua Dong, Luobing Dong, Qiong Liu and Xiujian Li

Relay-projection microscopic telescopy

Applications: Imaging/ Image Processing,Microscopy
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Allarakha Shikder, Naveen K. Nishchal

Image encryption using arbitrary modes of Hermite-Gaussian beams

Applications: Higher Order Modes / Optical Vortex / OAM,Imaging/ Image Processing,Optical Computing / Quantum Optics
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qiukun Liao, Shijie Zhang, Yongtian Wang and Juan Liu

High-quality real-time 3D holographic display for real-world scenes based on the optimized layered angular spectrum method

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Misc.: Speckle / Characterization / Metrology,Phase Measurement / Phase Retrieval
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jawahar Prabhakar Desai, Vijayakumar Anand and Joseph Rosen

Multiple Incoherent Deconvolutions for Improving the Image Resolution of Diffraction-Limited Imaging Systems

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Jiajia Wu, Xinkuo Li, Ke Sun, Kai Gao, Chenduan Chen, Jianrong Qiu and Dezhi Tan

Tight Focusing Holographic Network Enables 3D Real Time and Accurate Light Field Modulation

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han Gao, Li Pei, Jianshuai Wang, Zhouyi Hu, Bing Bai, Tigang Ning, Kaihua Hu, and Wenxuan Xu

Enhanced angular misalignment resiliency in multimode fiber imaging leveraging deep learning

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ruisi Wang

Visualization of pure phase objects with optical spatial differentiation operations

Applications: Imaging/ Image Processing,Phase Measurement / Phase Retrieval
GAEA / GAEA-2 Spatial Light Modulators
Authors:Zhenxing Dong, Yuye Ling, Yan Li and Yikai Su

Motion Hologram: Jointly optimized hologram generation and motion planning for photorealistic 3D displays via reinforcement learning

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
GAEA / GAEA-2 Spatial Light Modulators
Authors:Riku Watanabe, Seok Kang and Yuji Sakamoto

Binocular holographic display with a wide viewing zone using eye-tracking and multiple reconstruction lights

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LC-R 720 Spatial Light Modulators
Authors:Xuan Liu, Rupak Bhakta, Emily Kryvorutsky and Yuanwei Zhang

Imaging cells and nanoparticles using modulated optically computed phase microscopy

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zihao Pang and Ady Arie

Coherence synthesis in nonlinear optics

Applications: Higher Order Modes / Optical Vortex / OAM,Misc.: Speckle / Characterization / Metrology