Energy-Efficient Adaptive 3D Sensing

GAEA Spatial Light Modulators
Digital-/ Computer Holography/ CGH Imaging/ Image Processing Misc.: Speckle / Characterization / Metrology
Published on:
Authors: Tilmon, Brevin; Sun, Zhanghao; Koppal, Sanjeev; Wu, Yicheng; Evangelidis, Georgios; Zahreddine, Ramzi; Krishnan, Guru; Ma, Sizhuo & Wang, Jian
Abstract:

“Active depth sensing achieves robust depth estimation but is usually limited by the sensing range. Naively increasing the optical power can improve sensing range but induces eye-safety concerns for many applications, including autonomous robots and augmented reality. In this paper, we propose an adaptive active depth sensor that jointly optimizes range, power consumption, and eye-safety. The main observation is that we need not project light patterns to the entire scene but only to small regions of interest where depth is necessary for the application and passive stereo depth estimation fails. We theoretically compare this adaptive sensing scheme with other sensing strategies, such as full-frame projection, line scanning, and point scanning. We show that, to achieve the same maximum sensing distance, the proposed method consumes the least power while having the shortest (best) eye-safety distance. We implement this adaptive sensing scheme with two hardware prototypes, one with a phase-only spatial light modulator (SLM) and the other with a micro-electro-mechanical (MEMS) mirror and diffractive optical elements (DOE). Experimental results validate the advantage of our method and demonstrate its capability of acquiring higher quality geometry adaptively.”

Open Access

Publication: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Issue/Year: June 2023, Pages 5054-5063
Link: https://openaccess.thecvf.com/content/CVPR2023/html/Tilmon_Energy-Efficient_Adaptive_3D_Sensing_CVPR_2023_paper.html

Related Papers

PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Rui Li, Yuan Tao, Jiawen Li, Dongdong Jin, Chen Xin, Shengyun Ji, Chaowei Wang, Yachao Zhang, Yanlei Hu, Dong Wu, Li Zhang, Jiaru Chu

Rapid fabrication of reconfigurable helical microswimmers with environmentally adaptive locomotion

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Kumar, Rahul, Naveen K. Nishchal, and Ayman Alfalou

Improving the False Alarm Capability of the Extended Maximum Average Correlation Height Filter

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors: U. Ruiz and T. Cerda

Polarization sensitive security system

Applications: Digital-/ Computer Holography/ CGH,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhang, Yantong, Huiling Huang, Feibin Wu, Jun Han, Yi Yang, and Ruyi Li

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Huadong Zheng, Zhen Wang, Junchang Peng, Xinxing Xia, Yingjie Yu

Multiplane full-color phase-only holograms generation based on iterative algorithm with a modified amplitude constraint

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:León Schweickhardt , Dirk Stöbener und Andreas Fischer

Specklebasierte Charakterisierung anisotroper Oberflächen

Applications: Imaging/ Image Processing
GAEA Spatial Light Modulators
Authors:Andreas Georgiou, Jia Jia, Charlie Hewitt, Changwon Jang, Jacob Hadnett-Hunter, Jinsoo Jeong, Joel Kollin

A holographic near-eye display with glass form factor and spectacle-free operation

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
LUNA Spatial Light Modulators
Authors:Michael Flachhuber, Johannes Scheuchenpflug, Thomas Hilbert, Norbert Danz, Peter Schreiber, Leo M. Wilhelm, Markus Metz, Jean-Christope Olaya, Tobias Reusch

MaMeK: a wide-angle dynamic holographic projection system for human-vehicle communication

Applications: Digital-/ Computer Holography/ CGH
GAEA Spatial Light Modulators
Authors:Yingsi Qin, Wei-Yu Chen, Matthew O’Toole, Aswin C. Sankaranarayanan

Split-Lohmann Multifocal Displays

Applications: AR/VR/MR / Holographic Display,Beam Shaping / Beam Steering,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Qingyang Fu, Yaping Zhang, Bing Zhang, Wenlong Qin, Xianfeng Gu, and Ting-Chung Poon

Efficient rendering by parallelogram-approximation for full analytical polygon-based computer-generated holography using planar texture mapping

Applications: Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Nitin Dubey, Ravi Kumar, Joseph Rosen

Multi-wavelength imaging with extended depth of field using coded apertures and radial quartic phase functions

Applications: Imaging/ Image Processing
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Adrián Garmendía-Martínez, Walter D. Furlan, Juan C. Castro-Palacio, Juan A. Monsoriu & Vicente Ferrando

Quadrifocal diffractive lenses based on the aperiodic silver mean sequence

Applications: Adaptive Optics / Wavefront Control,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhu, Jialong / Zou, Fucheng / Wang, Le / Lu, Xiaodong / Zhao, Shengmei

Multiplexing Perfect Optical Vortex for Holographic Data Storage

Applications: Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH,Higher Order Modes / Optical Vortex / OAM
LC 2012 Spatial Light Modulators
Authors:Weng, Xiaojing / Feng, Ji / Perry, Altai / Vuong, Luat T.

Non-Line-of-Sight Full-Stokes Polarimetric Imaging with Solution-Processed Metagratings and Shallow Neural Networks

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Polarization Generation
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zheng, Huadong / Peng, Junchang / Wang, Zhen / xinghua Shui / yu yingjie / Xia, Xinxing

Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography

Applications: AR/VR/MR / Holographic Display,Deep Learning / Neuronal Network,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Chaohui; Xin, Jun; Li, Yanan; Lu, Xiao-Ming

Measuring small displacements of an optical point source with digital holography

Applications: Digital-/ Computer Holography/ CGH,Imaging/ Image Processing
LC 2012 Spatial Light Modulators
Authors:Tsukada, Takumi / Watanabe, Wataru

Central wavelength estimation in spectral imaging behind a diffuser via deep learning

Applications: Deep Learning / Neuronal Network,Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Pan, Shu; Wang, Li; Ma, Yuanzheng; Zhang, Guangyu; Liu, Rui; Zhang, Tao; Xiong, Kedi; Chen, Siyu; Zhang, Jian; Li, Wende; Yang, Sihua

Photoacoustic-enabled automatic vascular navigation: accurate and naked-eye real-time visualization of deep-seated vessels

Applications: AR/VR/MR / Holographic Display,Digital-/ Computer Holography/ CGH
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Zhehai; Hu, Guoqing; Zhao, Shuang; Li, Huiyu; Zhang, Fan

Holographic Optical Tweezers That Use an Improved Gerchberg–Saxton Algorithm

Applications: Digital-/ Computer Holography/ CGH,Optical Trapping /-Tweezers
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Han, Tongyu; Peng, Tong; Li, Runze; Wang, Kaige; Sun, Dan & Yao, Baoli

Extending the Imaging Depth of Field through Scattering Media by Wavefront Shaping of Non-Diffraction Beams

Applications: Bessel-/ Airy Beam Generation,Imaging/ Image Processing,Turbid-/ Opaque Media /Multi Scattering
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Fusco, Sandra; Oscurato, Stefano Luigi; Salvatore, Marcella; Reda, Francesco; Moujdi, Sara; Oliveira, Michael De; Ambrosio, Antonio; Centore, Roberto & Borbone, Fabio

Efficient High-Refractive-Index Azobenzene Dendrimers Based on a Hierarchical Supramolecular Approach

Applications: Digital-/ Computer Holography/ CGH,Materials Processing / Optical Fabrication
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Zhou, Dongxu; Zhang, Lu; Zhang, Hongzhi; Zhang, Guoquan

Ghost images with controllable visibility and spatial resolution

Applications: Imaging/ Image Processing,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Torres-Sepúlveda, Walter; lveda; Mira-Agudelo, Alejandro; Barrera-Ramirez, John Fredy & Kolodziejczyk, Andrzej

Objective method for visual performance prediction

Applications: Adaptive Optics / Wavefront Control,Misc.: Speckle / Characterization / Metrology
PLUTO / PLUTO-2 Spatial Light Modulators
Authors:Ye, Zhiyuan; Hou, Wanting; Zhao, Jilun; Wang, Hai-Bo & Xiong, Jun

Computational holographic ghost diffraction

Applications: Imaging/ Image Processing,Phase Measurement / Phase Retrieval