Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram

Yichen Wu; Yilin Luo; Gunvant Chaudhari; Yair Rivenson; Ayfer Calis; Kevin de Haan; Aydogan Ozcan

doi:10.1038/s41377-019-0139-9

Go to Nature Website

Your Location：

Home >

Browse articles >

Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram

Letters

- Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram
- Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram
- LSA 2019年8卷第2期页码：219-225
- Affiliations：
  
  1.Electrical and Computer Engineering Department, University of California, Los Angeles, CA 90095, USA
  2.Bioengineering Department, University of California, Los Angeles, CA 90095, USA
  3.California Nano Systems Institute (CNSI), University of California, Los Angeles, CA 90095, USA
  4.David Geffen School of Medicine, University of California, Los Angeles, CA 90095, USA
- Author bio：
  
  Aydogan Ozcan (ozcan@ucla.edu)
- Funds：
- DOI：10.1038/s41377-019-0139-9
  中图分类号：
- 纸质出版日期：2019，
  
  网络出版日期：2019-03-06，
  
  收稿日期：2018-12-10，
  
  修回日期：2019-02-15，
  
  录用日期：2019-02-15
- Accepted：
Scan QR Code
Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram[J]. LSA, 2019,8(2):219-225.

Wu, Y. C. et al. Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram. Light: Science & Applications, 8, 219-225 (2019).
Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram[J]. LSA, 2019,8(2):219-225. DOI： 10.1038/s41377-019-0139-9.

Wu, Y. C. et al. Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram. Light: Science & Applications, 8, 219-225 (2019). DOI： 10.1038/s41377-019-0139-9.

摘要

Abstract

Digital holographic microscopy enables the 3D reconstruction of volumetric samples from a single-snapshot hologram. However

unlike a conventional bright-field microscopy image

the quality of holographic reconstructions is compromised by interference fringes as a result of twin images and out-of-plane objects. Here

we demonstrate that cross-modality deep learning using a generative adversarial network (GAN) can endow holographic images of a sample volume with bright-field microscopy contrast

combining the volumetric imaging capability of holography with the speckle- and artifact-free image contrast of incoherent bright-field microscopy. We illustrate the performance of this "bright-field holography" method through the snapshot imaging of bioaerosols distributed in 3D

matching the artifact-free image contrast and axial sectioning performance of a high-NA bright-field microscope. This data-driven deep-learning-based imaging method bridges the contrast gap between coherent and incoherent imaging

and enables the snapshot 3D imaging of objects with bright-field contrast from a single hologram

benefiting from the wave-propagation framework of holography.

关键词

Keywords

references

Xu, W., Jericho, M. H., Meinertzhagen, I. A.&Kreuzer, H. J. Digital in-line holography for biological applications.Proc. Natl Acad. Sci.98, 11301-11305 (2001)..

Marquet, P. et al. Digital holographic microscopy: a noninvasive contrast imaging technique allowing quantitative visualization of living cells with subwavelength axial accuracy.Opt. Lett.30, 468-470 (2005)..

Greenbaum, A. et al. Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy.Nat. Methods9, 889-895 (2012)..

Wu, Y.&Ozcan, A. Lensless digital holographic microscopy and its applications in biomedicine and environmental monitoring.Methods136, 4-16 (2018)..

Bianco, V. et al. Endowing a plain fluidic chip with micro-optics: a holographic microscope slide.Light Sci. Appl.6, e17055 (2017)..

Memmolo, P. et al. Automatic focusing in digital holography and its application to stretched holograms.Opt. Lett.36, 1945-1947 (2011)..

Mudanyali, O. et al. Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications.Lab. Chip10, 1417-1428 (2010)..

Fienup, J. Phase Retrieval Algorithms—a comparison.Appl. Opt.21, 2758-2769 (1982)..

Greenbaum, A.&Ozcan, A. Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy.Opt. Express20, 3129-3143 (2012)..

Rivenson, Y. et al. Sparsity-based multi-height phase recovery in holographic microscopy.Sci. Rep.6, srep37862 (2016)..

Rivenson, Y., Zhang, Y., Günaydın, H., Teng, D.&Ozcan, A. Phase recovery and holographic image reconstruction using deep learning in neural networks.Light Sci. Appl.7, 17141 (2018)..

Sinha, A., Lee, J., Li, S.&Barbastathis, G. Lensless computational imaging through deep learning.Optica4, 1117-1125 (2017)..

Wu, Y. et al. Extended depth-of-field in holographic imaging using deep-learning-based autofocusing and phase recovery.Optica5, 704-710 (2018)..

Brady, D. J., Choi, K., Marks, D. L., Horisaki, R.&Lim, S. Compressive holography.Opt. Express17, 13040-13049 (2009)..

Goodfellow, I. et al. Generative adversarial nets. inAdvances in Neural Information ProcessingSystems27, 2672-2680https://papers.nips.cc/paper/5423-generative-adversarial-netshttps://papers.nips.cc/paper/5423-generative-adversarial-nets(2014)..

Mirza, M.&Osindero, S. Conditional generative adversarial nets. Preprint athttp://arxiv.org/abs/1411.1784http://arxiv.org/abs/1411.1784(2014).

Isola, P., Zhu, J.-Y., Zhou, T.&Efros, A. A. Image-To-Image Translation With Conditional Adversarial Networks. inIEEE Conference on Computer Vision and Pattern Recognition (CVPR)1125-1134https://arxiv.org/abs/1411.1784https://arxiv.org/abs/1411.1784(2017)..

Wu, Y. et al. Label-free bioaerosol sensing using mobile microscopy and deep learning.ACS Photonics5,4617-4627 https://doi.org/10.1021/acsphotonics.8b01109 (2018)..

Wang, Z., Bovik, A. C., Sheikh, H. R.&Simoncelli, E. P. Image quality assessment: from error visibility to structural similarity.IEEE Trans. Image Process.13, 600-612 (2004)..

Wang, Z.&Bovik, A. C. A universal image quality index.IEEE Signal Process. Lett.9, 81-84 (2002)..

Zhang, Y. et al. 3D imaging of optically cleared tissue using a simplified CLARITY method and on-chip microscopy.Sci. Adv.3, e1700553 (2017)..

Gӧrӧcs, Z. et al. A deep learning-enabled portable imaging flow cytometer for cost-effective, high-throughput, and label-free analysis of natural water samples.Light Sci. Appl.7, 66 (2018)..

Wang, H. et al. Deep learning enables cross-modality super-resolution in fluorescence microscopy.Nat. Methods16, 103 https://doi.org/10.1038/s41592-018-0239-0 (2019)..

Rivenson Y., et al. Virtual histological staining of unlabelled tissue autofluorescence images via deep learning.Nat. Biomed. Eng. https://doi.org/10.1038/s41551-019-0362-y (2019)

Thevenaz, P., Ruttimann, U. E.&Unser, M. A pyramid approach to subpixel registration based on intensity.IEEE Trans. Image Process.7, 27-41 (1998)..

Daubechies, I.Ten Lectures on Wavelets. (Society for Industrial and Applied Mathematics, Philadelphia, 1992).https://doi.org/10.1137/1.9781611970104https://doi.org/10.1137/1.9781611970104.

Goodman, J. W.Introduction to Fourier Optics3rd Edition. (Roberts and Company Publishers, Greenwood Village, 2005).

Zhang, Y., Wang, H., Wu, Y., Tamamitsu, M.&Ozcan, A. Edge sparsity criterion for robust holographic autofocusing.Opt. Lett.42, 3824-3827 (2017)..

Ronneberger, O., Fischer, P.&Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. inMedical Image Computing and Computer-Assisted Intervention - MICCAI2015, 234-241https://doi.org/10.1007/978-3-319-24574-4_28https://doi.org/10.1007/978-3-319-24574-4_28(2015)..

He, K., Zhang, X., Ren, S.&Sun, J. Deep Residual Learning for Image Recognition. inIEEE Conference on Computer Vision and Pattern Recognition (CVPR)2016, 770-778 doi:10.1109/CVPR.2016.90https://doi.org/10.1109/CVPR.2016.90(2016)..

Abadi, M. et al. TensorFlow: a system for large-scale machine learning.OSDI16, 265-283 (2016)..

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据