Lensless light-field imaging through diffuser encoding

Zewei Cai; Jiawei Chen; Giancarlo Pedrini; Wolfgang Osten; Xiaoli Liu; Xiang Peng

doi:10.1038/s41377-020-00380-x

Go to Nature Website

Your Location：

Home >

Browse articles >

Lensless light-field imaging through diffuser encoding

Article

- Lensless light-field imaging through diffuser encoding
- Light: Science & Applications Vol. 9, Issue 5, Pages: 1392-1400(2020)
- Affiliations：
  
  1.Institut für Technische Optik, Universität Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
  2.College of Physics and Optoelectronic Engineering, Shenzhen University, 518060 Guangdong, Shenzhen, China
- Author bio：
  
  Xiaoli Liu (lxl@szu.edu.cn)
  Xiang Peng (xpeng@szu.edu.cn)
- Funds：
- DOI：10.1038/s41377-020-00380-x
  CLC：
- Published：2020，
  
  Published Online：19 August 2020，
  
  Received：10 April 2020，
  
  Revised：24 July 2020，
  
  Accepted：02 August 2020
- Accepted：
Scan QR Code
Cai, Z. W. et al. Lensless light-field imaging through diffuser encoding. Light: Science & Applications, 9, 1392-1400 (2020).
DOI：

Cai, Z. W. et al. Lensless light-field imaging through diffuser encoding. Light: Science & Applications, 9, 1392-1400 (2020). DOI： 10.1038/s41377-020-00380-x.

摘要

Abstract

Microlens array-based light-field imaging has been one of the most commonly used and effective technologies to record high-dimensional optical signals for developing various potential high-performance applications in many fields. However

the use of a microlens array generally suffers from an intrinsic trade-off between the spatial and angular resolutions. In this paper

we concentrate on exploiting a diffuser to explore a novel modality for light-field imaging. We demonstrate that the diffuser can efficiently angularly couple incident light rays into a detected image without needing any lens. To characterize and analyse this phenomenon

we establish a diffuser-encoding light-field transmission model

in which four-dimensional light fields are mapped into two-dimensional images via a transmission matrix describing the light propagation through the diffuser. Correspondingly

a calibration strategy is designed to flexibly determine the transmission matrix

so that light rays can be computationally decoupled from a detected image with adjustable spatio-angular resolutions

which are unshackled from the resolution limitation of the sensor. The proof-of-concept approach indicates the possibility of using scattering media for lensless four-dimensional light-field recording and processing

not just for two- or three-dimensional imaging.

关键词

Keywords

references

Levoy, M.&Hanrahan, P. Light field rendering. inProc. 23rd Annual Conference on Computer Graphics and Interactive Techniques.(ACM, New Orleans, 1996).

Gortler, S. J. et al. The lumigraph. inProc. 23rd Annual Conference on Computer Graphics and Interactive Techniques. (ACM, New Orleans, 1996).

Levoy, M. et al. Light field microscopy.ACM Trans. Graph.25, 924–934 (2006)..

Tian, L.&Waller, L. 3D intensity and phase imaging from light field measurements in an LED array microscope.Optica2, 104–111 (2015)..

Lin, X. et al. Camera array based light field microscopy.Biomed. Opt. Express6, 3179–3189 (2015)..

Pégard, N. C. et al. Compressive light-field microscopy for 3D neural activity recording.Optica3, 517–524 (2016)..

Skocek, O. et al. High-speed volumetric imaging of neuronal activity in freely moving rodents.Nat. Methods15, 429–432 (2018)..

Levoy, M. et al. Synthetic aperture confocal imaging.ACM Trans. Graph.23, 825–834 (2004)..

Vaish, V. et al. Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust measures. inProc. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. (IEEE, New York, 2006).

Dansereau, D. G. et al. Plenoptic flow: Closed-form visual odometry for light field cameras. inProc. 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. (IEEE, San Francisco, 2011).

Zeller, N., Quint, F.&Stilla, U. From the calibration of a light-field camera to direct plenoptic odometry.IEEE J. Sel. Top. Signal Process.11, 1004–1019 (2017)..

Wilburn, B. et al. High performance imaging using large camera arrays.ACM Trans. Graph.24, 765–776 (2005)..

Liang, C.-K. et al. Programmable aperture photography: multiplexed light field acquisition.ACM Trans. Graph.27, 1–10 (2008)..

Ives, F. E. Parallax stereogram and process of making same. United States Patent 725567 (1903).

Lippmann, G. Epreuves reversibles. Photographies integrals.Comptes Rendus de. l'Académie des. Sci.444, 446–451 (1908)..

Ng, R. et al.Light field photography with a hand-held plenoptic camera.Stanford Technical Report CSTR 005-02. (Stanford University, 2005).

Lumsdaine, A.&Georgiev, T.Full Resolution Lightfield Rendering(Adobe Systems, 2008).

Perwaß, C.&Wietzke, L. Single lens3D-camera with extended depth-of-field. inProc. SPIE 8291, Human Vision and Electronic Imaging XVII. (SPIE, Burlingame, 2012).

Veeraraghavan, A. et al. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing.ACM Trans. Graph.26, 69 (2007)..

Marwah, K. et al. Compressive Light field photography using overcomplete dictionaries and optimized projections.ACM Trans. Graph.32, 46 (2013)..

Tajima, K. et al. Lensless light-field imaging with multi-phased fresnel zone aperture. inProc. 2017 IEEE International Conference on Computational Photography. (IEEE, Stanford, 2017).

Antipa, N. et al. Single-shot diffuser-encoded light field imaging. inProc. 2016 IEEE International Conference on Computational Photography. (IEEE, Evanston, 2016).

Singh, A. K. et al. Exploiting scattering media for exploring 3D objects.Light. Sci. Appl.6, e16219 (2017)..

Antipa, N. et al. DiffuserCam: lensless single-exposure 3D imaging.Optica5, 1–9 (2018)..

Jin, X., Wei, D. M. S.&Dai, Q. H. Point spread function for diffuser cameras based on wave propagation and projection model.Opt. Express27, 12748–12761 (2019)..

Monakhova, K. et al. Learned reconstructions for practical mask-based lensless imaging.Opt. Express27, 28075–28090 (2019)..

Feng, S. C. et al. Correlations and fluctuations of coherent wave transmission through disordered media.Phys. Rev. Lett.61, 834–837 (1988)..

Bertolotti, J. et al. Non-invasive imaging through opaque scattering layers.Nature491, 232–234 (2012)..

Ng. R. Fourier slice photography. inProc. 2005 ACM Special Interest Group on Computer Graphics and Interactive Techniques Conference. (ACM, Los Angeles, 2005).

Popoff, S. M. et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media.Phys. Rev. Lett.104, 100601 (2010)..

Choi, Y. et al. Overcoming the diffraction limit using multiple light scattering in a highly disordered medium.Phys. Rev. Lett.107, 023902 (2011)..

Drémeau, A. et al. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques.Opt. Express23, 11898–11911 (2015)..

Cai, Z. et al. Source-code website:https://github.com/czw1102/light_field_diffuser.githttps://github.com/czw1102/light_field_diffuser.git(2020).

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰