Real-time holographic camera for obtaining real 3D scene hologram

Zhao-Song Li; Chao Liu; Xiao-Wei Li; Yi Zheng; Qian Huang; Yi-Wei Zheng; Ye-Hao Hou; Chen-Liang Chang; Da-Wei Zhang; Song-Lin Zhuang; Di Wang; Qiong-Hua Wang

doi:10.1038/s41377-024-01730-9

Go to Nature Website

Your Location：

Home >

Browse articles >

Real-time holographic camera for obtaining real 3D scene hologram

Original Articles

- Real-time holographic camera for obtaining real 3D scene hologram
- Light: Science & Applications Vol. 14, Issue 3, Pages: 789-799(2025)
- Affiliations：
  
  1.School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
  2.School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
- Author bio：
  
  Di Wang (diwang18@buaa.edu.cn)
  Qiong-Hua Wang (qionghua@buaa.edu.cn)
- Funds：
- DOI：10.1038/s41377-024-01730-9
  CLC：
- Received：17 August 2024，
  
  Revised：21 December 2024，
  
  Accepted：2024-12-23，
  
  Published Online：08 February 2025，
  
  Published：31 March 2025
- Accepted：
Scan QR Code
Li, Z. S. et al. Real-time holographic camera for obtaining real 3D scene hologram. Light: Science & Applications, 14, 789-799 (2025).
DOI：

Li, Z. S. et al. Real-time holographic camera for obtaining real 3D scene hologram. Light: Science & Applications, 14, 789-799 (2025). DOI： 10.1038/s41377-024-01730-9.

摘要

Abstract

As a frontier technology

holography has important research values in fields such as bio-micrographic imaging

light field modulation and data storage. However

the real-time acquisition of 3D scenes and high-fidelity reconstruction technology has not yet made a breakthrough

which has seriously hindered the development of holography. Here

a novel holographic camera is proposed to solve the above inherent problems completely. The proposed holographic camera consists of the acquisition end and the calculation end. At the acquisition end of the holographic camera

specially configured liquid materials and liquid lens structure based on voice-coil motor-driving are used to produce the liquid camera

so that the liquid camera can quickly capture the focus stack of the real 3D scene within 15 ms. At the calculation end

a new structured focus stack network (FS-Net) is designed for hologram calculation. After training the FS-Net with the focus stack renderer and learnable Zernike phase

it enables hologram calculation within 13 ms. As the first device to achieve real-time incoherent acquisition and high-fidelity holographic reconstruction of a real 3D scene

our proposed holographic camera breaks technical bottlenecks of difficulty in acquiring the real 3D scene

low quality of the holographic reconstructed image

and incorrect defocus blur. The experimental results demonstrate the effectiveness of our holographic camera in the acquisition of focal plane information and hologram calculation of the real 3D scene. The proposed holographic camera opens up a new way for the application of holography in fields such as 3D display

light field modulation

and 3D measurement.

关键词

Keywords

references

Rivenson, Y., Wu, Y. C. & Ozcan, A. Deep learning in holography and coherent imaging. Light Sci. Appl. 8 , 85 (2019)..

Wetzstein, G. et al. Inference in artificial intelligence with deep optics and photonics. Nature 588 , 39–47 (2020)..

Siegel, N. et al. High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers. Nat. Photonics 10 , 802–808 (2016)..

Li, L. L. et al. Intelligent metasurfaces: control, communication and computing. eLight 2 , 7 (2022)..

Wang, D. et al. Decimeter-depth and polarization addressable color 3D meta-holography. Nat. Commun. 15 , 8242 (2024)..

Xu, C. et al. Quasicrystal metasurface for dual functionality of holography and diffraction generation. eLight 4 , 9 (2024)..

Rubin, N. A. et al. Matrix Fourier optics enables a compact full-Stokes polarization camera. Science 365 , eaax1839 (2019)..

Gu, M., Zhang, Q. M. & Lamon, S. Nanomaterials for optical data storage. Nat. Rev. Mater. 1 , 16070 (2016)..

Gu, M., Li, X. P. & Cao, Y. Y. Optical storage arrays: a perspective for future big data storage. Light Sci. Appl. 3 , e177 (2014)..

Hu, P. et al. Highly sensitive photopolymer for holographic data storage containing methacryl polyhedral oligomeric silsesquioxane. ACS Appl. Mater. Interfaces 14 , 21544–21554 (2022)..

Yang, H. et al. Angular momentum holography via a minimalist metasurface for optical nested encryption. Light Sci. Appl. 12 , 79 (2023)..

Hu, Z. et al. Reversible 3D optical data storage and information encryption in photo-modulated transparent glass medium. Light Sci. Appl. 10 , 140 (2021)..

Hou, J. F. & Situ, G. Image encryption using spatial nonlinear optics. eLight 2 , 3 (2022)..

Tsang, P. W. M., Poon, T. C. & Wu, Y. M. Review of fast methods for point-based computer-generated holography [Invited ] . Photonics Res. 6 , 837–846 (2018)..

Nishitsuji, T. et al. Review of fast calculation techniques for computer-generated holograms with the point-light-source-based model. IEEE Trans. Ind. Inform. 13 , 2447–2454 (2017)..

Blinder, D. et al. The state-of-the-art in computer generated holography for 3D display. Light: Adv. Manuf. 3 , 572–600 (2022)..

Wang, D. et al. Large viewing angle holographic 3D display system based on maximum diffraction modulation. Light: Adv. Manuf. 4 , 195–205 (2023)..

Wang, D. et al. Color liquid crystal grating based color holographic 3D display system with large viewing angle. Light Sci. Appl. 13 , 16 (2024)..

Li, Y. L. et al. Tunable liquid crystal grating based holographic 3D display system with wide viewing angle and large size. Light Sci. Appl. 11 , 188 (2022)..

Wang, D. et al. High-quality holographic 3D display system based on virtual splicing of spatial light modulator. ACS Photonics 10 , 2297–2307 (2023)..

Bianco, V. et al. Strategies for reducing speckle noise in digital holography. Light Sci. Appl. 7 , 48 (2018)..

Peng, Y. F. et al. Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration. Sci. Adv. 7 , eabg5040 (2021)..

Choi, S. et al. Optimizing image quality for holographic near-eye displays with Michelson Holography. Optica 8 , 143–146 (2021)..

Sahin, E. et al. Computer-generated holograms for 3D imaging: a survey. ACM Comput. Surv. 53 , 32 (2021)..

Sui, X. M. et al. Non-convex optimization for inverse problem solving in computer-generated holography. Light Sci. Appl. 13 , 158 (2024)..

Zhong, C. L. et al. Real-time 4K computer-generated hologram based on encoding conventional neural network with learned layered phase. Sci. Rep. 13 , 19372 (2023)..

Zhang, S. J. et al. End-to-end real-time holographic display based on real-time capture of real scenes. Opt. Lett. 48 , 1850–1853 (2023)..

Lee, B. et al. High-contrast, speckle-free, true 3D holography via binary CGH optimization. Sci. Rep. 12 , 2811 (2022)..

Choi, S. et al. Neural 3D holography: learning accurate wave propagation models for 3D holographic virtual and augmented reality displays. ACM Trans. Graph. (TOG) 40 , 240 (2021)..

Qin, Y. S. et al. Split-lohmann multifocal displays. ACM Trans. Graph. (TOG) 42 , 57 (2023)..

Wang, D. et al. Liquid lens based holographic camera for real 3D scene hologram acquisition using end-to-end physical model-driven network. Light Sci. Appl. 13 , 62 (2024)..

Song, X. L. et al. Real-time intelligent 3D holographic photography for real-world scenarios. Opt. Express 32 , 24540–24552 (2024)..

Dong, J. Q. et al. High-speed real 3D scene acquisition and 3D holographic reconstruction system based on ultrafast optical axial scanning. Opt. Express 31 , 21721–21730 (2023)..

Yu, H. et al. Deep learning-based incoherent holographic camera enabling acquisition of real-world holograms for holographic streaming system. Nat. Commun. 14 , 3534 (2023)..

Liu, C. et al. Continuous optical zoom microscope with extended depth of field and 3D reconstruction. PhotoniX 3 , 20 (2022)..

Chang, C. L. et al. From picture to 3D hologram: end-to-end learning of real-time 3D photorealistic hologram generation from 2D image input. Opt. Lett. 48 , 851–854 (2023)..

Liu, C. et al. Real scene acquisition and holographic near-eye display system based on a zoom industrial endoscope. Opt. Express 30 , 33170–33181 (2022)..

Liu, S. B. et al. Deep learning enables parallel camera with enhanced-resolution and computational zoom imaging. PhotoniX 4 , 17 (2023)..

Liu, C. et al. Tunable liquid lenses: emerging technologies and future perspectives. Laser Photonics Rev. 17 , 2300274 (2023)..

Wang, D. et al. Holographic capture and projection system of real object based on tunable zoom lens. PhotoniX 1 , 6 (2020)..

Huang, Q. et al. Fast point-based hologram generation method using high-frequency information extraction. Opt. Lasers Eng. 176 , 108104 (2024)..

Fricke, S. et al. Modern hardware accelerated point based holography. Opt. Express 32 , 26994–27009 (2024)..

Wang, F. et al. Acceleration of polygon-based computer-generated holograms using look-up tables and reduction of the table size via principal component analysis. Opt. Express 29 , 35442–35455 (2021)..

Zhang, Y. P. et al. Fast generation of full analytical polygon-based computer-generated holograms. Opt. Express 26 , 19206–19224 (2018)..

Chen, J. S. & Chu, D. P. Improved layer-based method for rapid hologram generation and real-time interactive holographic display applications. Opt. Express 23 , 18143–18155 (2015)..

Zhao, Y. et al. Accurate calculation of computer-generated holograms using angular-spectrum layer-oriented method. Opt. Express 23 , 25440–25449 (2015)..

Liu, K. X. et al. 4K-DMDNet: diffraction model-driven network for 4K computer-generated holography. Opto-Electron. Adv. 6 , 220135 (2023)..

Shi, L., Li, B. C. & Matusik, W. End-to-end learning of 3D phase-only holograms for holographic display. Light Sci. Appl. 11 , 247 (2022)..

Shi, L. et al. Towardsreal-time photorealistic 3D holography with deep neural networks. Nature 591 , 234–239 (2021)..

Gopakumar, M. et al. Full-colour 3D holographic augmented-reality displays with metasurface waveguides. Nature 629 , 791–797 (2024)..

Yang, D. et al. Diffraction-engineered holography: beyond the depth representation limit of holographic displays. Nat. Commun. 13 , 6012 (2022)..

Liu, N. H. et al. DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network. Opt. Express 31 , 23867–23876 (2023)..

Shui, X. H. et al. Diffraction model-informed neural network for unsupervised layer-based computer-generated holography. Opt. Express 30 , 44814–44826 (2022)..

Lee, J. K. et al. Design and fabrication of PMMA-micromachined fluid lens based on electromagnetic actuation on PMMA-PDMS bonded membrane. J. Micromech. Microeng. 22 , 115028 (2012)..

Cheng, H. C. et al. Adaptive mechanical-wetting lens actuated by ferrofluids. Opt. Commun. 284 , 2118–2121 (2011)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰