Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution

Antonio C Sobieranski; Fatih Inci; H Cumhur Tekin; Mehmet Yuksekkaya; Eros Comunello; Daniel Cobra; Aldo von Wangenheim; Utkan Demirci

doi:10.1038/lsa.2015.119

Go to Nature Website

Your Location：

Home >

Browse articles >

Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution

Original Articles

- Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution
- Light: Science & Applications Vol. 4, Issue 4, (2015)
- Affiliations：
  
  1.Demirci Bio-Acoustic-MEMS in Medicine (BAMM) Laboratory, Division of Biomedical Engineering, Division of Renal Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
  2.Demirci Bio-Acoustic-MEMS in Medicine (BAMM) Laboratory, Division of Infectious Diseases, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
  3.INCoD – National Brazilian Institute for Digital Convergence/LAPIX, Image Processing and Computer Graphics Lab, Federal University of Santa Catarina, Brazil
  4.Demirci Bio-Acoustic-MEMS in Medicine (BAMM) Laboratory, Stanford University School of Medicine, Canary Center at Stanford for Cancer Early Detection, Palo Alto, CA, USA
  5.Present Address: Department of Biomedical Engineering Faculty of Engineering, Başkent University, Ankara, Turkey
  6.4VisionLab, Master in Applied Computing, University of Itajaí Valley, Brazil
  7.CERTI Foundation, Florianopolis, Brazil
- Author bio：
  
  U Demirci. Email: utkan@stanford.edu
- Funds：
- DOI：10.1038/lsa.2015.119
  CLC：
- Published：2015-12，
  
  Published Online：29 June 2015，
  
  Received：25 December 2014，
  
  Revised：12 June 2015，
  
  Accepted：24 June 2015
- Accepted：
Scan QR Code
Sobieranski, A. C. et al. Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution. Light: Science & Applications, 4, e346 (2015).
DOI：

Sobieranski, A. C. et al. Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution. Light: Science & Applications, 4, e346 (2015). DOI： 10.1038/lsa.2015.119.

摘要

Abstract

In this paper

an irregular displacement-based lensless wide-field microscopy imaging platform is presented by combining digital in-line holography and computational pixel super-resolution using multi-frame processing. The samples are illuminated by a nearly coherent illumination system

where the hologram shadows are projected into a complementary metal-oxide semiconductor-based imaging sensor. To increase the resolution

a multi-frame pixel resolution approach is employed to produce a single holographic image from multiple frame observations of the scene

with small planar displacements. Displacements are resolved by a hybrid approach: (ⅰ) alignment of the LR images by a fast feature-based registration method

and (ⅱ) fine adjustment of the sub-pixel information using a continuous optimization approach designed to find the global optimum solution. Numerical method for phase-retrieval is applied to decode the signal and reconstruct the morphological details of the analyzed sample. The presented approach was evaluated with various biological samples including sperm and platelets

whose dimensions are in the order of a few microns. The obtained results demonstrate a spatial resolution of 1.55 μm on a field-of-view of ≈30 mm

关键词

Keywords

digital in-line holographyimage registrationlensless imagingpoint-of-care platformpixel super-resolution

references

Schawlow AL, Townes CH. Infrared and optical masers.Phys Rev1958;112: 1940–1949..

Gabor D. A new microscopic principle.Nature1948;161: 777–778..

Wang SQ, Xu F, Demirci U. Advances in developing HIV-1 viral load assays for resource-limited settings.Biotechnol Adv2010;28: 770–781..

Wang SQ, Inci F, de Libero G, Singhal A, Demirci U. Point-of-care assays for tuberculosis: role of nanotechnology/microfluidics.Biotechnol Adv2013;31: 438–449..

Tasoglu S, Gurkan UA, Wang SQ, Demirci U. Manipulating biological agents and cells in micro-scale volumes for applications in medicine.Chem Soc Rev2013;42: 5788–5808..

Inci F, Filippini C, Baday M, Ozen MO, Calamak Set al. Multitarget, quantitative nanoplasmonic electrical field-enhanced resonating device (NE2RD) for diagnostics.Proc Natl Acad Sci USA2015;112: E4354–E4363..

Shafiee H, Asghar W, Inci F, Yuksekkaya M, Jahangir Met al. Paper and flexible substrates as materials for biosensing platforms to detect multiple biotargets.Sci Rep2015;5: 8719..

Inci F, Tokel O, Wang S, Gurkan UA, Tasoglu Set al. Nanoplasmonic quantitative detection of intact viruses from unprocessed whole blood.ACS Nano2013;7: 4733–4745..

Lissandrello C, Inci F, Francom M, Paul M, Demirci Uet al. Nanomechanical motion of Escherichia coli adhered to a surface.Appl Phys Lett2014,105: 113701..

Shafiee H, Wang S, Inci F, Toy M, Henrich TJet al. Emerging technologies for point-of-care management of HIV infection.Annu Rev Med2015;66: 387–405..

Tokel O, Inci F, Demirci U. Advances in plasmonic technologies for point of care applications.Chem Rev2014;114: 5728–5752..

Tokel O, Yildiz UH, Inci F, Durmus NG, Ekiz OOet al. Portable microfluidic integrated plasmonic platform for pathogen detection.Sci Rep2015;5: 9152..

Ozcan A, Demirci U. Ultra wide-field lens-free monitoring of cells on-chip.Lab Chip2008;8: 98–106..

Moon SJ, Gurkan UA, Blander J, Fawzi WW, Aboud Set al. Enumeration of CD4+T-cells using a portable microchip count platform in Tanzanian HIV-infected patients.PLoS One2011;6: e21409..

Seo S, Su TW, Tseng DK, Erlinger A, Ozcan A. Lensfree holographic imaging for on-chip cytometry and diagnostics.Lab Chip2009;9: 777–787..

Mudanyali O, Tseng D, Oh C, Isikman SO, Sencan Iet al. Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications.Lab Chip2010;10: 1417–1428..

Quan C, Chen W, Tay CJ. Numerical reconstruction in in-line digital holography by translation of CCD position and gradient operator method.Opt Commun2011;284: 2767–2770..

Sheppard CJR. Fundamentals of superresolution.Micron2007;38: 165–169..

Zhang LP, Zhang HY, Shen HF, Li PX. A super-resolution reconstruction algorithm for surveillance images.Signal Process2010;90: 848–859..

Glasner D, Bagon S, Irani M. Super-resolution from a single image. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. IEEE: Kyoto, 2009, pp. 349–356.

Li JM, Gong WG, Li WH, Pan FY. Single-image super-resolution reconstruction based on global non-zero gradient penalty and non-local Laplacian sparse coding.Digital Signal Process2014;26: 101–112..

van Alert S, van Dyck D, den Dekker AJ. Resolution of coherent and incoherent imaging systems reconsidered – classical criteria and a statistical alternative.Opt Express2006;14: 3830–3839..

Pickup LC. Machine learning in multi-frame image super-resolution. PhD thesis, University of Oxford, Oxford, 2008.

Li XL, Hu YT, Gao XB, Tao DC, Ning BJ. A multi-frame image super-resolution method.Signal Process2010;90: 405–414..

Ning BJ, Gao XB. Multi-frame image super-resolution reconstruction using sparse co-occurrence prior and sub-pixel registration.Neurocomputing2013;117: 128–137..

Goshtasby AA.Image Registration: Principles, Tools and Methods. London: Springer; 2012.

Bay H, Ess A, Tuytelaars T, van Gool L. Speeded-up robust features (SURF).Comp Vis Image Underst2008;110: 346–359..

Muja M, Lowe DG. Scalable nearest neighbor algorithms for high dimensional data.IEEE Trans Pattern Anal Mach Intell2014;36: 2227–2240..

Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography.Commun ACM1981;24: 381–395..

Socha K, Dorigo M. Ant colony optimization for continuous domains.Eur J Oper Res2008;185: 1155–1173..

Brox T. From pixels to regions: partial differential equations in image analysis. PhD thesis, Mathematical Image Analysis Group, Department of Mathematics and Computer Science, Saarland University, Saarbrücken, Germany, 2005.

Mochizuki Y, Kameda Y, Imiya A, Sakai T, Imaizumi T. Variational method for super-resolution optical flow.Signal Process2011;91: 1535–1567..

Mitzel D, Pock T, Schoenemann T, Cremers D. Video super resolution using duality based TV-L1optical flow. Proceedings of the 31st DAGM Symposium on Pattern Recognition. Springer-Verlag, : Berlin, Heidelberg, 2009, pp. 432–441..

Nayar SK, Nakagawa Y. Shape from focus.IEEE Trans Pattern Anal Mach Intell1994;16: 824–831..

El-Ghobashy AA, West CR. The human sperm head: a key for successful fertilization.J Androl2003;24: 232–238..

Baltz JM, Katz DF, Cone RA. Mechanics of sperm-egg interaction at the zona pellucida.Biophys J1988;54: 643–654..

Reece JB, Urry LA, Cain ML, Wasserman SA, Minorsky PVet al.Campbell Biology. 9th edn. Benjamin Cummings; San Francisco. 2010..

Wang SQ, Inci F, Chaunzwa TL, Ramanujam A, Vasudevan Aet al. Portable microfluidic chip for detection ofEscherichia coliin produce and blood.Int J Nanomedicine2012;7: 2591–2600..

Wang SQ, Esfahani M, Gurkan UA, Inci F, Kuritzkes DRet al. Efficient on-chip isolation of HIV subtypes.Lab Chip2012;12: 1508–1515..

Gabor D. Microscopy by reconstructed wave fronts: Ⅱ.Proc Phys Soc B1951;64: 449–469..

Micó V, Zalevsky Z, García J. Edge processing by synthetic aperture superresolution in digital holographic microscopy.3D Res2011;2: 1..

Hussain A, Mudassar AA. Holography based super resolution.Opt Commun2012;285: 2303–2310..

Hussain A, Martínez JL, Campos J. Holographic superresolution using spatial light modulator.J Eur Opt Soc – Rapid Publicat2013;8: 13007..

Singh VR, Sui LS, Asundi A. Compact handheld digital holographic microscopy system development.Proc of SPIE2010;7522: 75224L..

Shimobaba T, Taniguchi Y, Shiraki A, Masuda N, Ito T. Portable and low-cost digital holographic microscopy using web camera, point light source LED and open-source libraries. Biomedical Optics and 3-D Imaging, OSA Technical Digest, Optical Society of America, Miami, FL, USA, 28 April–2 May 2012.

Lu Y, Liu Y, Lau TK. Simple, portable, and low-cost microscope based on off-axis digital holography using two spherical waves.Opt Lett2014;39: 4549–4552..

Garcia-Sucerquia J, Xu WB, Jericho SK, Klages P, Jericho MHet al. Digital in-line holographic microscopy.Appl Opt2006;45: 836–850..

Zheng GA, Lee SA, Antebi Y, Elowitz MB, Yang C. The ePetri dish, an on-chip cell imaging platform based on subpixel perspective sweeping microscopy (SPSM).Proc Natl Acad Sci USA2011;108: 16889–16894..

Yan M, Huang XW, Jia QX, Nadipalli R, Wang TXet al. (eds). High-speed CMOS image sensor for high-throughput lensless microfluidic imaging system.Proc of SPIE2012, 2012;8298: 829804..

Huang X, Guo J, Wang X, Yan M, Kang Yet al. A contact-imaging based microfluidic cytometer with machine-learning for single-frame super-resolution processing.PLoS One2014;9: e104539..

Bishara W, Su TW, Coskun AF, Ozcan A. Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution.Opt Express2010;18: 11181–11191..

Bishara W, Sikora U, Mudanyali O, Su TW, Yaglidere Oet al. Portable and cost-effective pixel super-resolution on-chip microscope for telemedicine applications.Conf Proc IEEE Eng Med Biol Soc2011;2011: 8207–8210..

Su TW, Erlinger A, Tseng D, Ozcan A. Compact and light-weight automated semen analysis platform using lensfree on-chip microscopy.Anal Chem2010;82: 8307–8312..

Su TW, Isikman SO, Bishara W, Tseng D, Erlinger Aet al. Multi-angle lensless digital holography for depth resolved imaging on a chip.Opt Express2010;18: 9690–9711..

Isikman SO, Bishara W, Mavandadi S, Yu FW, Feng Set al. Lens-free optical tomographic microscope with a large imaging volume on a chip.Proc Natl Acad Sci USA2011;108: 7296–7301..

Su TW, Xue L, Ozcan A. High-throughput lensfree 3D tracking of human sperms reveals rare statistics of helical trajectories.Proc Natl Acad Sci USA2012;109: 16018–16022..

Su TW, Choi I, Feng JW, Huang K, McLeod Eet al. Sperm trajectories form chiral ribbons.Sci Rep2013;3: 1664..

Luo W, Greenbaum A, Zhang YB, Ozcan A. Synthetic aperture-based on-chip microscopy.Light: Sci Appl2015;4: e261; doi: 10.1038/lsa.2015.34..

Paturzo M, Merola F, Grilli S, de Nicola S, Finizio Aet al. Super-resolution in digital holography by a two-dimensional dynamic phase grating.Opt Express2008;16: 17107–17118..

Greenbaum A, Luo W, Su TW, Göröcs Z, Xue Let al. Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy.Nat Methods2012;9: 889–895..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Exploiting scattering media for exploring 3D objects

Pixel super-resolution using wavelength scanning

Related Author

Alok Kumar Singh

Dinesh N Naik

Giancarlo Pedrini

Mitsuo Takeda

Wolfgang Osten

Wei Luo

Yibo Zhang

Alborz Feizi

Related Institution

Institut für Technische Optik (ITO) and Stuttgart Research Center of Photonic Engineering (SCoPE), University of Stuttgart, Pfaffenwaldring 9

School of Physics, University of Hyderabad, Hyderabad 6

Center for Optical Research and Education (CORE), Utsunomiya University, Yoto 7-1-2, Utsunomiya, Tochigi, 321

Electrical Engineering Department, University of California

Bioengineering Department, University of California

⁰