Fig 1 Design principle of meta Shack-Hartmann wavefront sensor.
Published:30 September 2024,
Published Online:12 August 2024,
Received:05 March 2024,
Revised:05 July 2024,
Accepted:11 July 2024
Scan QR Code
Cite this article
Shack–Hartmann wavefront sensors measure the local slopes of an incoming wavefront based on the displacement of focal spots created by a lenslet array, serving as key components for adaptive optics for astronomical and biomedical imaging. Traditionally, the challenges in increasing the density and the curvature of the lenslet have limited the use of such wavefront sensors in characterizing slowly varying wavefront structures. Here, we develop a metasurface-enhanced Shack–Hartmann wavefront sensor (meta SHWFS) to break this limit, considering the interplay between the lenslet parameters and the performance of SHWFS. We experimentally validate the meta SHWFS with a sampling density of 5963 per mm2 and a maximum acceptance angle of 8° which outperforms the traditional SFWFS by an order of magnitude. Furthermore, to the best of our knowledge, we demonstrate the first use of a wavefront sensing scheme in single-shot phase imaging of highly complex patterns, including biological tissue patterns. The proposed approach opens up new opportunities in incorporating exceptional light manipulation capabilities of the metasurface platform in complex wavefront characterization.
The importance of optical phase measurement has been increasingly recognized in a wide range of optical applications, including optical metrology, adaptive optics, biomedical imaging, and LiDAR technology
The current phase imaging techniques can be broadly divided into two categories: interferometry-based and computational phase retrieval methods. In the interferometry-based method, two beam paths-one for signal (object) and one for the reference- are commonly employed. The signal beam illuminates the object or sample, while the reference beam usually bypasses the sample entirely, resulting in a path difference to make interference patterns on a sensor plane. Consequently, the interferometry-based methods directly convert measured interference patterns into a phase map of an incoming beam via holographic reconstruction, providing superior phase measurement accuracy and large space-bandwidth product. However, they require bulky interferometry set-ups with a reference arm and are sensitive to even small fluctuations in wavelength scale
Alternatively, wavefront sensing techniques can be considered as an indirect way to retrieve optical phase maps. A wavefront of light is a surface over which light waves have the same phase, and the light propagates perpendicular to the wavefront. Therefore, wavefront sensing techniques typically measure the propagation direction where an intensity pattern (e.g., focal spot) is captured at the Fourier plane. The displacement of the pattern can then be related to the incident wavefront angle and in turn to the optical phase gradient. Lastly, a 2D phase map can be retrieved by performing numerical integration of the optical phase gradient. In contrast to the conventional phase imaging techniques based on coherent light sources, wavefront sensing techniques are compatible with incoherent light sources as the amount of the intensity pattern displacement is irrelevant to an incoming wavelength. This feature enables its application in astronomical imaging, beam quality diagnosis, optical testing, fluorescence-based adaptive optical microscopy, and ophthalmology
Shack–Hartmann wavefront sensor (SHWFS) is the most widely used class of wavefront sensing methods. With its simple design composed of a lenslet array and an image sensor, it enables single-shot operation and exhibits excellent stability under various practical settings
Here, we aimed to break this conventional limit to enable phase imaging with metasurface-enhanced SHWFS, so-called meta SHWFS. Based on inherent capabilities, compact design, low weight, and compatibility of metasurface platforms, several research efforts on metalens array have been reported, but their exploration has been confined to beam diagnosis, light field imaging, or multiphoton quantum source
Fig 1 Design principle of meta Shack-Hartmann wavefront sensor.
a Schematic of the meta SHWFS. b Effect of sampling density of SHWFS in phase reconstruction. c Illustration of a sampling unit of the meta SHWFS with related lenslet parameters. The maximum allowable displacement ∆max is set with a minimum space S to take account of the finite width of the focal spot. d Maximum allowable displacement ∆max, localization accuracy ∆res, and their ratio ∆max/∆res for different focal lengths. The ∆max/∆res is maximized at the focal length of 30 μm
In general, the performance of SHWFS is defined by the three key parameters—the maximum acceptance angle θmax, the number of resolvable angles (i.e., the number of resolvable levels of phase gradient) Nθ, and the sampling density Nl. To avoid the cross-talk between neighboring lenses, the incident angle θ should be set within the angular range where the corresponding displacement Δ does not exceed the boundary of each lens (i.e., [−D/2, D/2] where D is the size of each meta lens). Therefore, θmax is roughly set as
The metalens diameter is the key parameter that determines the sampling density of meta SHWFS, as illustrated in
Along with the lenslet diameter D, the focal length of the metalens f serves as a crucial parameter that determines θmax and Nθ. In our configuration with a small D, it is particularly challenging to achieve practically usable Nθ as Nθ has at least a power-of-two dependence on D. For phase imaging, Nθ needs to be sufficiently high to resolve various levels of phase slopes presented in complex structures like biological objects. Although, in the general relation, θmax and Nθ monotonically increase with decreasing f, the ratio of the imaging pixel size P to the focal spot size should be taken into consideration in a practical scenario with a finite pixel size of an image sensor. If the spot size is smaller than a single pixel, it becomes impossible to accurately localize the spot for a subpixel displacement. Conversely, when the spot size is significantly larger than a single pixel, the presence of numerous noise sources, such as shot noise and dark noise, hinders the accurate tracking of the centroid position.
Therefore, we determined the optimum value of focal length considering the spot localization errors at various signal-to-noise levels. First, we defined the maximum allowable displacement of the focal spot Δmax more accurately with a minimum space S to take account of the finite width of the focal spot (i.e.,
The lenslet array in our meta SHWFS, composed of 100 × 100 metalenses, shares the same working principle with dielectric metasurfaces reported in previous studies
Fig 2 Large angle calibration of the meta SHWFS.
a Experimental setup for large angle calibration and the SEM image of the fabricated metalenses. b Focal intensity distribution created by the metalens array. The numbers outside the image denote the order of the metalenses. White dotted lines indicate the central lines of each metalens. The lower plot depicts the intensity profile along the yellow line. c Focal spot behaviors of a central metalens for different angles of incidence, following the equation ∆i = f tanθi (i = x, y). d Focal spot displacements for various incident angles. The 100 × 100 focal spots uniformly move together as the incident angle changes. The large fluctuations in spot localization for the large angles beyond 8° is attributed to cross-talk between the focal spots of adjacent metalenses
To characterize the meta SHWFS, we measured the behaviors of focal spots for varying incidence angles in the configuration where each metalens corresponds to the sensor area of 28 × 28 pixels, as shown in
To verify the capability of the proposed meta SHWFS for an incoherent light source, we demonstrated 3D position tracking of a light-emitting diode (LED) with a size of 0.3 mm and an emission spectrum of 520–535 nm. Since our metalens is designed for 532 nm, chromatic aberration can occur. This aberration arises from dispersion within the periodic lattice, akin to Fresnel lenses, resulting in different focal lengths given by
1
Fig 3 3D position tracking of incoherent light source.
a Experiment setup to demonstrate position tracking of a LED. b, c The behaviors of focal spots at (SX, SY, SZ) = (0, 0, 15) mm and (SX, SY, SZ) = (8, 0, 70) mm, respectively. d, e Wavefronts reconstructed by the focal spot displacements, presented in (b, c), respectively. f, g Measured LED positions versus actual positions. The LED positions were determined by quadratic fitting of the reconstructed wavefronts. h Distribution of measured LED positions in the x–y plane (left) and x–z plane (right), respectively. The dotted grid represents the actual position of the LED. Note that the sensing area of meta SHWFS is much larger than that of conventional SHWFS
Therefore, the LED position (SX, SY, SZ) was determined through quadratic fitting of the measured wavefront.
Finally, we validated the phase imaging capability of the meta SHWFS. The phase imaging targets were synthesized using a spatial light modulator (SLM), as shown in
Fig 4 Demonstration of phase imaging using meta SHWFS.
a Experiment setup for phase imaging via meta SHWFS. b Result of phase imaging. The first, second, and third rows represent the ground truth image (input image of SLM), the reconstructed phase, and the difference between them, respectively
In this study, we have presented a meta SHWFS composed of 100×100 metalenses with a high sampling density of 5963 per mm2 and a large acceptance angle of 8°, representing a 100× better spatial resolution and 10× larger angular range compared to traditional SHWFS systems. We confirmed that each metalens provides a large number of degrees of freedom (i.e., Nθ ~ 3600) for measuring wavefront slopes even with the extremely small lens size of D = 12.95 µm. With this superior performance, we have demonstrated the 3D position tracking of an LED source with a large angular field of view and the phase imaging of complex objects. The experimental error for phase imaging of complex objects is 0.12λ, which is consistent with the theoretical prediction. The calibration method of SHWFS would further help in correcting marginal errors that may exist in our alignment and fabrication procedures
Sampling density Nl of the SHWFS is mainly determined by the lens size as following the relation:
In general, the number of pixels on an image sensor roughly sets the upper bound for the degrees of freedom of SHWFS, which can be quantified as the product of the number of wavefront sampling positions (i.e., the number of lenslets) and the number of resolvable angles in each lens Nθ. Since the first development of SHWFS, CMOS sensor technology has evolved towards larger pixel numbers with smaller pixel sizes, achieving pixel numbers larger than 108 and a pixel size of less than 1 µm. However, due to the limitations in conventional microlens arrays, the development of Shack–Hartmann-type wavefront sensors has primarily focused on the direction of increasing measurement accuracy rather than increasing spatial resolution, thereby not fully exploring the possible design space supported by the recent developments in CMOS sensor technology. Here, we have implemented the SHWFS with 100 × 100 sampling positions and 3600 resolvable angles with a sampling period in the range of 10 µm, exploring the new design space supported by the metasurface platform and the advanced sensor technology. Within this new design space, we could achieve the first successful demonstration of microscopic phase imaging. In this study, we used the CMOS censor (BFS-U3-120S4M), which has 4000 × 3000 pixels with a size of 1.85 µm. Because 28 × 28 camera pixels were allocated per metalens, the maximum number of metalenses was limited to 142 × 107. This number can be significantly increased based on the development in sensor technology, potentially along with on-chip integration of meta SHWFS. For instance, with the adoption of superior camera sensors (e.g., Samsung's ISOCELL HP3, 200 MP with a pixel size of 0.56 µm), it is indeed possible to implement a small form-factor quantitative phase imaging unit, which achieves the sampling points of 500 × 500 without additional imaging system.
Due to the increased interest for biomedical imaging, optical system characterization, and industrial inspections, many interesting approaches have been proposed for single-shot complex field measurements. For instance, the input field can be obtained from the output intensity, exploiting light mixing within turbid media described based on transmission matrix formalism or utilizing a thin diffuser to generate a speckle pattern with shift-invariant property based on memory effect
Meta SHWFS consisted of a silicon nitride rectangular cuboid arranged on a subwavelength square lattice with a periodicity of U = 350 nm. The width of each metaatom is precisely controlled within a range from 60 nm to 275 nm to achieve 2π phase coverage within a height of 630 nm at a wavelength of 532 nm. The phase delay imparted by the metaatoms were retrieved by using rigorous coupled-wave analysis (Supplementary Note 4 in the Supplementary Information). The meta SHWFS was fabricated on 630 nm thick silicon nitride on 500 μm thick fused silica. Silicon nitride film was deposited by plasma-enhanced chemical vapor deposition. The sample was spin-coated with a 300 nm thick positive electron beam resist (AR-P 6200) and the pattern was generated using electron beam lithography. After development, an electron-beam-evaporated aluminum oxide layer was used to reverse the generated pattern using a lift-off process and was used as a hard mask for dry etching of the underlying silicon nitride layer. The dry etching was performed using an inductively coupled plasma reactive ion etching process. The aluminum oxide layer was then dissolved in buffered oxide etchant. Figure S5 in the Supplementary Information shows the fabrication flow.
This work was supported by the Samsung Research Funding and Incubation Center of Samsung Electronics grant SRFC-IT2002-03, Samsung Electronics Co., Ltd. (IO220908-02403-01), and the National Research Foundation of Korea grant funded by the Korean government (grant nos. NRF-2021R1A5A1032937, NRF-2021R1C1C1011307, RS-2023-00275923, RS-2023-00251628, and RS-2024-00397673).
G.-H.G. and M.J. initiated the study and designed all experiments. G.-H.G. and D.L. designed and fabricated the meta SHWFS. G.-H.G. carried out the optical experiments with the help of J.O., G.S., and D.L. G.-H.G. and M.J. developed theoretical modeling and analyzed the experimental data. G.-H.G. and M.J. wrote the manuscript, supported by all co-authors.
The authors declare no competing interests.
Supplementary information The online version contains supplementary material available at https://doi.org/10.1038/s41377-024-01528-9.
Kemper, B.&von Bally, G. Digital holographic microscopy for live cell applications and technical inspection.Appl. Opt.47, A52–A61 (2008).. [Baidu Scholar]
Kemper, B., Langehanenberg, P.&von Bally, G. Digital holographic microscopy: a new method for surface analysis and marker‐free dynamic life cell imaging.Opt. Photonik2, 41–44 (2007).. [Baidu Scholar]
Marquet, P. et al. Digital holographic microscopy: a noninvasive contrast imaging technique allowing quantitative visualization of living cells with subwavelength axial accuracy.Opt. Lett.30, 468–470 (2005).. [Baidu Scholar]
Gabor, D. A new microscopic principle.Nature161, 777–778 (1948).. [Baidu Scholar]
Gabor, D. Microscopy by reconstructed wave-fronts.Proc. R. Soc. A Math. Phys. Eng. Sci.197, 454–487 (1949).. [Baidu Scholar]
Hariharan, P.Optical Holography: Principles, Techniques And Applications2nd edn (Cambridge University Press, 1996). [Baidu Scholar]
Lee, K. et al. Quantitative phase imaging techniques for the study of cell pathophysiology: from principles to applications.Sensors13, 4170–4191 (2013).. [Baidu Scholar]
Zuo, C. et al. Transport of intensity equation: a tutorial.Opt. Lasers Eng.135, 106187 (2020).. [Baidu Scholar]
Rodenburg, J. M. et al. Hard-X-ray lensless imaging of extended objects.Phys. Rev. Lett.98, 034801 (2007).. [Baidu Scholar]
Zheng, G. A., Horstmeyer, R.&Yang, C. Wide-field, high-resolution Fourier ptychographic microscopy.Nat. Photonics7, 739–745 (2013).. [Baidu Scholar]
Gerchberg, R. W.&Saxton, W. O. A practical algorithm for the determination of phase from image and diffraction plane pictures.Optik35, 237–246 (1972).. [Baidu Scholar]
Miao, J. W. et al. Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens.Nature400, 342–344 (1999).. [Baidu Scholar]
Zuo, J. M. et al. Atomic resolution imaging of a carbon nanotube from diffraction intensities.Science300, 1419–1421 (2003).. [Baidu Scholar]
Eisebitt, S. et al. Lensless imaging of magnetic nanostructures by X-ray spectro-holography.Nature432, 885–888 (2004).. [Baidu Scholar]
Drémeau, A. et al. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques.Opt. Express23, 11898–11911 (2015).. [Baidu Scholar]
Fienup, J. R. Phase retrieval algorithms: a comparison.Appl. Opt.21, 2758–2769 (1982).. [Baidu Scholar]
Kwon, H. et al. Single-shot quantitative phase gradient microscopy using a system of multifunctional metasurfaces.Nat. Photonics14, 109–114 (2020).. [Baidu Scholar]
Baek, Y.&Park, Y. Intensity-based holographic imaging via space-domain Kramers–Kronig relations.Nat. Photonics15, 354–360 (2021).. [Baidu Scholar]
Pfund, J. et al. Absolute sphericity measurement: a comparative study of the use of interferometry and a Shack–Hartmann sensor.Opt. Lett.23, 742–744 (1998).. [Baidu Scholar]
Booth, M. J. Adaptive optics in microscopy.Philos. Trans. R. Soc. A Math. Phys. Eng. Sci.365, 2829–2843 (2007).. [Baidu Scholar]
Dayton, D. et al. Atmospheric structure function measurements with a Shack–Hartmann wave-front sensor.Opt. Lett.17, 1737–1739 (1992).. [Baidu Scholar]
Ricklin, J. C.&Davidson, F. M. Atmospheric turbulence effects on a partially coherent Gaussian beam: implications for free-space laser communication.J. Optical Soc. Am. A19, 1794–1802 (2002).. [Baidu Scholar]
Liang, J. Z. et al. Objective measurement of wave aberrations of the human eye with the use of a Hartmann–Shack wave-front sensor.J. Optical Soc. Am. A11, 1949–1957 (1994).. [Baidu Scholar]
Cha, J. W., Ballesta, J.&So, P. T. C. Shack–Hartmann wavefront-sensor-based adaptive optics system for multiphoton microscopy.J. Biomed. Opt.15, 046022 (2010).. [Baidu Scholar]
Gigan, S. et al. Roadmap on wavefront shaping and deep imaging in complex media.J. Phys. Photonics4, 042501 (2022).. [Baidu Scholar]
Yi, S. et al. Angle-based wavefront sensing enabled by the near fields of flat optics.Nat. Commun.12, 6002 (2021).. [Baidu Scholar]
Soldevila, F. et al. Phase imaging by spatial wavefront sampling.Optica5, 164–174 (2018).. [Baidu Scholar]
Park, Y., Depeursinge, C.&Popescu, G. Quantitative phase imaging in biomedicine.Nat. Photonics12, 578–589 (2018).. [Baidu Scholar]
Jang, M. et al. Wavefront shaping with disorder-engineered metasurfaces.Nat. Photonics12, 84–90 (2018).. [Baidu Scholar]
Mosk, A. P. et al. Controlling waves in space and time for imaging and focusing in complex media.Nat. Photonics6, 283–292 (2012).. [Baidu Scholar]
Cui, X. Q. et al. Wavefront image sensor chip.Opt. Express18, 16685–16701 (2010).. [Baidu Scholar]
Platt, B. C.&Shack, R. History and principles of Shack–Hartmann wavefront sensing.J. Refractive Surg.17, S573–S577 (2001).. [Baidu Scholar]
Fan, Z. B. et al. A broadband achromatic metalens array for integral imaging in the visible.Light Sci. Appl.8, 67 (2019).. [Baidu Scholar]
Lin, R. J. et al. Achromatic metalens array for full-colour light-field imaging.Nat. Nanotechnol.14, 227–231 (2019).. [Baidu Scholar]
Arbabi, E. et al. Full-stokes imaging polarimetry using dielectric metasurfaces.ACS Photonics5, 3132–3140 (2018).. [Baidu Scholar]
Yang, Z. Y. et al. Generalized Hartmann–Shack array of dielectric metalens sub-arrays for polarimetric beam profiling.Nat. Commun.9, 4607 (2018).. [Baidu Scholar]
Li, L. et al. Metalens-array-based high-dimensional and multiphoton quantum source.Science368, 1487–1490 (2020).. [Baidu Scholar]
Fan, Q. B. et al. Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field.Nat. Commun.13, 2130 (2022).. [Baidu Scholar]
Parthasarathy, R. Rapid, accurate particle tracking by calculation of radial symmetry centers.Nat. Methods9, 724–726 (2012).. [Baidu Scholar]
Genevet, P. et al. Recent advances in planar optics: from plasmonic to dielectric metasurfaces.Optica4, 139–152 (2017).. [Baidu Scholar]
Backlund, M. P. et al. Removing orientation-induced localization biases in single-molecule microscopy using a broadband metasurface mask.Nat. Photonics10, 459–462 (2016).. [Baidu Scholar]
Arbabi, A. et al. Subwavelength-thick lenses with high numerical apertures and large efficiency based on high-contrast transmitarrays.Nat. Commun.6, 7069 (2015).. [Baidu Scholar]
Mei, A. Y. et al. A hole-conductor-free, fully printable mesoscopic perovskite solar cell with high stability.Science345, 295–298 (2014).. [Baidu Scholar]
Yu, N. F.&Capasso, F. Flat optics with designer metasurfaces.Nat. Mater.13, 139–150 (2014).. [Baidu Scholar]
Khorasaninejad, M. et al. Metalenses at visible wavelengths: diffraction-limited focusing and subwavelength resolution imaging.Science352, 1190–1194 (2016).. [Baidu Scholar]
Veksler, D. et al. Multiple wavefront shaping by metasurface based on mixed random antenna groups.ACS Photonics2, 661–667 (2015).. [Baidu Scholar]
Chen, W. T. et al. A broadband achromatic metalens for focusing and imaging in the visible.Nat. Nanotechnol.13, 220–226 (2018).. [Baidu Scholar]
Kim, J. et al. Scalable manufacturing of high-index atomic layer-polymer hybrid metasurfaces for metaphotonics in the visible.Nat. Mater.22, 474–481 (2023).. [Baidu Scholar]
Park, J. S. et al. All-glass, large metalens at visible wavelength using deep-ultraviolet projection lithography.Nano Lett.19, 8673–8682 (2019).. [Baidu Scholar]
Hu, T. et al. CMOS-compatible a-Si metalenses on a 12-inch glass wafer for fingerprint imaging.Nanophotonics9, 823–830 (2020).. [Baidu Scholar]
She, A. L. et al. Large area metalenses: design, characterization, and mass manufacturing.Opt. Express26, 1573–1585 (2018).. [Baidu Scholar]
Min, S. Y. et al. Ultrasensitive molecular detection by imaging of centimeter‐scale metasurfaces with a deterministic gradient geometry.Adv. Mater.33, 2100270 (2021).. [Baidu Scholar]
Harker, M.&O'Leary, P. Direct regularized surface reconstruction from gradients for industrial photometric stereo.Comput. Ind.64, 1221–1228 (2013).. [Baidu Scholar]
Harker, M.&O'Leary, P. Regularized reconstruction of a surface from its measured gradient field: algorithms for spectral, Tikhonov, constrained, and weighted regularization.J. Math. Imaging Vis.51, 46–70 (2015).. [Baidu Scholar]
Chernyshov, A. et al. Calibration of a Shack–Hartmann sensor for absolute measurements of wavefronts.Appl. Opt.44, 6419–6425 (2005).. [Baidu Scholar]
Yang, J. M. et al. Large dynamic range Shack–Hartmann wavefront sensor based on adaptive spot matching.Light Adv. Manuf.4, 42–51 (2024).. [Baidu Scholar]
Pfund, J., Lindlein, N.&Schwider, J. Dynamic range expansion of a Shack–Hartmann sensor by use of a modified unwrapping algorithm.Opt. Lett.23, 995–997 (1998).. [Baidu Scholar]
Martins, A. et al. On metalenses with arbitrarily wide field of view.ACS Photonics7, 2073–2079 (2020).. [Baidu Scholar]
Go, G. H. et al. Scannable dual-focus metalens with hybrid phase.Nano Lett.23, 3152–3158 (2023).. [Baidu Scholar]
Arbabi, A. et al. Dielectric metasurfaces for complete control of phase and polarization with subwavelength spatial resolution and high transmission.Nat. Nanotechnol.10, 937–943 (2015).. [Baidu Scholar]
Zhang, Y. B. et al. Wide-field imaging of birefringent synovial fluid crystals using lens-free polarized microscopy for gout diagnosis.Sci. Rep.6, 28793 (2016).. [Baidu Scholar]
Berto, P., Rigneault, H.&Guillon, M. Wavefront sensing with a thin diffuser.Opt. Lett.42, 5117–5120 (2017).. [Baidu Scholar]
Lee, K.&Park, Y. Exploiting the speckle-correlation scattering matrix for a compact reference-free holographic image sensor.Nat. Commun.7, 13359 (2016).. [Baidu Scholar]
27
Views
7
Downloads
0
CSCD
Related Articles
Related Author
Related Institution