Fig 1 Principle of UDI operation.
Published:31 October 2024,
Published Online:26 August 2024,
Received:22 April 2024,
Revised:03 August 2024,
Accepted:13 August 2024
Scan QR Code
Cite this article
Strict requirement of a coherent spectrum in coherent diffractive imaging (CDI) architectures poses a significant obstacle to achieving efficient photon utilization across the full spectrum. To date, nearly all broadband computational imaging experiments have relied on accurate spectroscopic measurements, as broad spectra are incompatible with conventional CDI systems. This paper presents an advanced approach to broaden the scope of CDI to ultra-broadband illumination with unknown probe spectrum, effectively addresses the key challenges encountered by existing state-of-the-art broadband diffractive imaging frameworks. This advancement eliminates the necessity for prior knowledge of probe spectrum and relaxes constraints on non-dispersive samples, resulting in a significant extension in spectral bandwidth, achieving a nearly fourfold improvement in bandlimit compared to the existing benchmark. Our method not only monochromatizes a broadband diffraction pattern from unknown illumination spectrum, but also determines the compressive sampled profile of spectrum of the diffracted radiation. This superiority is experimentally validated using both CDI and ptychography techniques on an ultra-broadband supercontinuum with relative bandwidth exceeding 40%, revealing a significantly enhanced coherence and improved reconstruction with high fidelity under ultra-broadband illumination.
Coherent diffraction imaging (CDI) is an elegant lensfree computational imaging technology to high-resolution imaging fields
Full coherence of illumination is generally assumed in CDI, driven by the inherent chromaticity of diffractive optics that the diffracted angle from any microstructure only depends on its wavelength. A diffraction pattern for a varying spectrum channel undergoes a spatial scaling towards the corresponding wavelength. Thus, the extension in spectrum results in diffraction aliasing, preventing CDI from correct convergence
The first utilization of broadband CDI (BCDI) introduced by Fienup in 1999 has opened a new window to characterize a broadband radiation from multi-wavelength mapping with insufficient number of wavelengths
In a recent development, we introduced a ultra-streamlined diffraction-based computational spectrometer based on the coherent mode decomposition from broadband diffraction measurement
Method | Spectrum knowledge | Non-dispersive object assumption | Bandwidth (FWHM) | Computational complexity |
---|---|---|---|---|
Mixed-State | No | No | Several harmonics | Moderate |
PIM | Yes | Yes | Several harmonics | Moderate |
Multiwavelength | Yes | Yes | Several harmonics | Moderate |
Poly CDI | Yes | Yes | 3% | High |
Mono CDI | Yes | Yes | 11% | Low |
SPIRE | No | No | 28% | Extremely High |
BBSSP | No | No | 5.6% | Extremely High |
This work | No | No | 41% | Extremely low |
As the schematic principle demonstrated in
1
where the PSF(λi) is a spectrum propagation function from a reference diffraction field
Fig 1 Principle of UDI operation.
a Geometry of UDI operation. A spectral filter is placed to modulate a quasi-monochromatic or broadband illumination the from a supercontinuum source. b PSF mapping from a monochromatic diffraction at wavelength λm. A broadband diffraction Ib captured in-situ can be thought of as a superposition of PSFs of Im at different wavelengths over full spectrum, each multiplied by its corresponding power spectrum weighting ω(λ). The CSS is reconstructed via adaptive Tikhonov regularization. c Monochromatization procedure consists in the inversion of the ill-posed matrix function Ib = CIm to retrieve the CSM pattern from the solved CSS
Importantly, since ω(λ) represents neither the probe spectrum P(λ) nor the diffracted radiation, but the final corrected spectrum for the sample's spectral transmissivity function T(λ) and the quantum efficiency of detector QE(λ), ω(λ)= P(λ) T(λ) QE(λ). Thus, the CSS represents the principal component of the final corrected power spectrum, which considers the light-matter interaction between the broadband diffractive radiation through the sample and the diffraction photons read out by the detector over the full spectrum. Thus, there is no need to correct the spectrum for the detector response or make the strong constraint of non-dispersive specimen over the entire spectrum for BCDI. Practically, the CSS is calculated just once and can be applied to various non-dispersive samples. In situations involving dispersive objects, the objects spectral transmissivity can also be obtained from the CSS matrix.
As outlined in mono CDI, the retrieval of the monochromatic pattern can be further reduced to a linear algebra problem, rewritten to a matrix form in simplicity
2
where m stands for the vector of the monochromatic pattern, b represents the broadband pattern, and C can be regarded as containing the spectrally dependent PSFs over the calculated CSS. Here, we adopt a specific expression to calculate C in one dimension (detailed in Supplementary S2). Note that C is fully determined by the calculated CSS and the dimension of the measured broadband pattern (
We firstly present a broadband ptychography conducted with a bandwidth of 20% to illustrate the performance of UDI (experimental set-up detailed in Supplementary S4). Initially, we conducted a capture of coherent diffraction at 532 nm with a 3 nm full width at half maximum (FWHM) and broadband diffraction in-situ at any identical position of the USAF target (
Fig 2 UDI ptychography at 20% bandwidth.
a The pre-captured quasi-monochromatic diffraction pattern at 532 nm (up right) and the corresponding broadband pattern captured in-situ (bottom left) to calculate the CSS. b The broadband source spectrum (black curve) and the recovered CSS consisting of 87 sparse spectral profiles (green scatters). c. Matrix C generated from the spectrum measurement in a. d A comparison of the sparse matrix C obtained from the CSS in b. e A frame of the broadband pattern. f The corresponding CSM pattern recovered from the broadband data in e. g and h depict the reconstructed images from the broadband ptychography and the proposed UDI ptychography, respectively, after 600 iterations of mPIE
A comparison of the broadband measurement and the corresponding narrowband pattern captured in-situ reveals that the use of broadband illumination introduces a noticeable decoherence (
We further extended the bandwidth of the source spectrum to 41% FWHM, and repeated the UDI ptychography experiment. The CSS can still be precisely computed (green scatters in
Fig 3 UDI ptychography at 41% bandwidth.
a Same as
Additionally, a BCDI application is also showcased in
Fig 4 Broadband diffractive imaging at 20% bandwidth
a The pre-captured coherent pattern at 532 nm with 5 ms exposure time. b The corresponding broadband pattern captured in-situ with 20% bandwidth (spectrum ranging from 480 nm to 600 nm) with only 0.05 ms exposure time. c The CSM pattern recovered from the broadband data in b. d A photograph of the Siemens star target, a micro pinhole with100 μm in diameter is employed to intercept the incoming light illumination, resulting in a circular planar wave approximately 100 μm that is incident on the Siemens star. e–g depict the reconstructed patterns obtained from the CDI in a, BCDI in b, and the proposed UDI in c, respectively, after 500 iterations of RAAR. h shows an average image of ten trails of UDI reconstructions
We are further considering a more general case of broadband diffractive imaging, where the specimen is spectrally dispersive. Most of the current state-of-the-art research on BCDI relies heavily on the strong assumption that the specimen should be non-dispersive over the spectrum
Fig 5 Broadband diffractive imaging with a spectrally chromatic EUV mask.
a Schematic setup for a BCDI application with a chromatic EUV mask. b–d show the reconstructed images after 600 iterations of CDI using three different approaches: direct reconstruction from the recorded broadband diffraction pattern, mono CDI with a pre-knowledge of the broadband HHG source, and the proposed UDI, respectively. e The calculated CSS with only 18 sparse points of the spectrum
It should be emphasized that the UDI outperforms the existing mono CDI for two main reasons. Firstly, UDI accurately recovers the spectral information of the imaging system. In contrast, mono CDI relies heavily on precise prior spectral measurements. Due to the detector's spectral nonlinearity or the sample's spectral dispersion, there is a significant deviation between the spectrum measurement of the light source and the spectral features in the captured diffraction image, preventing accurate spectral characterization. Besides, UDI also offers comprehensive improvements in monochromatization, coherence enhancement, noise robustness, and wide-spectrum robustness. This results in superior ultra-broadband computational imaging outcomes.
We first performed a numerical investigation to evaluate how CSS affects the accuracy of broadband diffraction pattern fitting. We chose a broadband HHG source with a bandwidth of 22% FWHM as the illumination source in numerical calculation. Our analysis involved measuring the fitting error of a broadband diffraction pattern while varying the spectral sampling channels between 25 to 600 and the detector noise levels ranging from 20 dB to noisefree, as detailed in
Fig 6 Broadband diffraction fitting error analysis.
a Varying sampling intervals in HHG spectrum ranging from 12 nm to 15 nm. b The evolution of the broadband diffraction pattern fitting MSE with varying spectral sampling intervals in a and varying noise levels
We characterized the performances of CSS calculation with broadband diffractions under varying levels of noise. The "HSUT" logo (inside
Fig 7 CSS accuracy analysis.
a–e show the calculated CSS from the noised broadband patterns with varying detector noises ranging from 60 dB to 20 dB with 10 dB interval, respectively. f compares the MSE between the fitted broadband patterns generated from the calculated CSSs in a–e with the ground-truth spectrum, while varying the spectral sampling numbers. g A presentive shot of coherent diffraction pattern at 13.5 nm with 40 dB detector noise. h. The broadband diffraction pattern generated from the broadband HHG source in ground-truth with 600 discrete sampling points (black scatters in
Images inside
We utilized the recovered CSS with a bandwidth of 22% and 29 sparse spectral channels to create the sparse matrix C (
Fig 8 Broadband diffraction monochromatization.
a The calculated CSS from the broadband pattern with 60 dB detector noise. b A 2D matrix C calculated from the CSS with 29 sparse spectral points in a. c Similar with b but calculated from the full spectrum with 600 sampled spectral channels for comparison. d The recovered monochromatized patterns after 3 iterations of CSM and mono, respectively
The generation of the matrix C from the CSS allows us to recover the optimal monochromatization from a broadband measurement.
We have introduced a powerful UDI method for ultra-broadband diffractive imaging. Our research comprehensively addresses the key challenges of current state-of-art BCDI. By employing UDI, we successfully achieve a significant enhancement in coherence of ultra-broadband diffraction patterns. We provide a detailed explanation of the theory and design process for our UDI method in broadband diffractive imaging, which has been experimentally verified. It presents a natural sort of superiorities:
Firstly, UDI represents an advancement in ultra-broadband diffractive imaging with an unknown probe spectrum, while simultaneously recovering the spectrum information of the diffracted radiation. UDI overcomes limitations posed by constraints on spectrally non-dispersive specimens across a wide spectrum. It is inherently applicable across a broad wavelength range and eliminates the need for prior spectral knowledge, particularly crucial for applications in EUV and soft X-ray ranges where the absorption edge effects of materials are more pronounced.
Fig 9 UDI workflow.
The sparse matrix C is constructed as a pre-calculation process in the broadband CDI application, as indicated by the red dashed box. Subsequently, the measured broadband pattern b is monochromatized using the pre-calculated matrix C, resulting in the monochromatic pattern m, as depicted in the blue dashed box. Notably, this monochromatization process does not require any prior knowledge of the spectrum
Secondly, the UDI achieves coherence-enhanced, superfast-solving, and noise-robust monochromatization under ultra-wide spectral illumination. It efficiently utilizes the entire flux from a broadband source and results in a significant reduction in data acquisition time. This makes UDI highly beneficial for ultra-broadband imaging, offering a nearly fourfold improvement in bandwidth compared to existing mono CDI benchmark. The monochromatization in UDI operates with high efficiency, achieving optimal results within the initial iteration, which is 30 times faster than the state-of-the-art CGLS method
Nevertheless, certain critical matters still require clarification and warrant further research. Despite the potent ultra-broadband imaging capabilities exhibited by the UDI when handling unknown probe spectrum, it is crucial to acknowledge that UDI relies on the Fresnel diffraction approximation. Consequently, its applicability may be constrained in scenarios involving multi-layer or multi-scattering samples, potentially impeding its capacity to fully leverage the entire performance in such intricate situations. Additionally, the optimization algorithm for monochromatization and the spectral quantum efficiency of the detector may also limit further spectral bandwidth extension in UDI. Our UDI experiments demonstrate ultra-broadband diffractive imaging with a relative spectral bandwidth exceeding 40% FWHM. This bandwidth is currently limited by the detector's quantum efficiency, not by the UDI algorithm itself.
As described in Supplementary S1, Eq. (2) can be treated as an ill-posed multi-variable linear regression problem, which can be solved by Tikhonov regularization, to prevent overfitting and suppress the noise signals during reconstruction
3
where A is a given M*N*n matrix with elements of each column of a flattened PSF(λi) matrix in 1D array corresponding to the i-th slice of spectrum and b is a vector of a broadband diffraction flattened in 1D array, ω is the vector of unknown spectrum coefficients for the function. Γ is the regularization coefficient that controls the weight given to minimization of the side constraint relative to minimization of the residual norm. ||.||2 is the l2 norm. Note that the efficiency of these estimates depends on appropriately choice of the regularization coefficient
4
where I is the identity matrix and the operator Tr sums elements on the main diagonal of a matrix. As a result, we can have the CSS estimates
5
The algorithm of the CSS calculation is described in detail in the supplementary information in ref.
As described in Supplementary S2, C is a sparse, symmetric, and positive definite matrix. The sparsity and positive definiteness of matrix C make Eq. (3) particularly well-suited for iterative solutions using BiCGStab. This algorithm performs as an implementation of an orthogonal projection technique onto the Krylov subspace. It involves minimizing the least squares problem to achieve the desired monochromatization. Implicitly, BiCGStab solves not only the original system
6
where
The flowchart of BiCGStab algorithm is detailed in Supplementary S3.
Step 1: Pre-capture a shot of broadband pattern and a quasi-coherent pattern in-situ, respectively.
Step 2: Calculate the CSS from the measurements in Step 1 via adaptive Tikhonov regularization.
Step 3: Calculate the sparse matrix C which contains the spectral information of CSS.
Step 4: Monochromatize the broadband patterns in broadband imaging experiments via BiCGStab along with the pre-calculated sparse matrix C in Step 3.
Step 5: Output the optimal diffraction pattern m with enhanced-coherence in broadband imaging applications.
The authors thank the technical support from the Experiment Centre for Advanced Manufacturing and Technology in School of Mechanical Science & amp; Engineering of HUST. This work was supported by the Natural Science Foundation of China (52130504), Key Research and Development Program of Hubei Province (2021BAA013), Innovation Project of Optics Valley Laboratory (OVL2023PY003), Natural Science Foundation of Hubei Province (2021CFB322), Fundamental Research Funds for the Central Universities (2021XXJS113), and Guangdong Basic and Applied Basic Research Foundation (2023A1515030149).
C.C. conceived the project, conducted the experiments, preformed the algorithm derivation, and analyzed the spectroscopic data. L.S. and G.H. conceived and supervised the project. C.C., L.S., and G.H. drafted the manuscript.
The data and codes that support the plots within this paper and other findings of this study are available from the corresponding author upon reasonable request. Source data are provided with this paper.
The authors declare no competing interests.
Supplementary information The online version contains supplementary material available at https://doi.org/10.1038/s41377-024-01581-4.
Chapman, H. N.&Nugent, K. A. Coherent lensless X-ray imaging.Nat. Photonics4, 833–839 (2010).. [Baidu Scholar]
Miao, J. W. et al. Extending the methodology of X-ray crystallography to allow imaging of micrometre-sized non-crystalline specimens.Nature400, 342–344 (1999).. [Baidu Scholar]
Thibault, P. et al. High-resolution scanning X-ray diffraction microscopy.Science321, 379–382 (2008).. [Baidu Scholar]
Gerchberg, R. W.&Saxton, W. O. Practical algorithm for the determination of phase from image and diffraction plane pictures.Opt. (Stuttg.)35, 237–246 (1972).. [Baidu Scholar]
Fienup, J. R. Reconstruction of an object from the modulus of its Fourier transform.Opt. Lett.3, 27–29 (1978).. [Baidu Scholar]
Elser, V. Phase retrieval by iterated projections.J. Optical Soc. Am. A20, 40–55 (2003).. [Baidu Scholar]
Luke, D. R. Relaxed averaged alternating reflections for diffraction imaging.Inverse Probl.21, 37–50 (2005).. [Baidu Scholar]
Eisebitt, S. et al. Lensless imaging of magnetic nanostructures by X-ray spectro-holography.Nature432, 885–888 (2004).. [Baidu Scholar]
Zhang, W. H. et al. Twin-image-free holography: a compressive sensing approach.Phys. Rev. Lett.121, 093902 (2018).. [Baidu Scholar]
Rodenburg, J. M.&Faulkner, H. M. L. A phase retrieval algorithm for shifting illumination.Appl. Phys. Lett.85, 4795–4797 (2004).. [Baidu Scholar]
Maiden, A., Johnson, D.&Li, P. Further improvements to the ptychographical iterative engine.Optica4, 736–745 (2017).. [Baidu Scholar]
Sha, H. Z., Cui, J. Z.&Yu, R. Deep sub-angstrom resolution imaging by electron ptychography with misorientation correction.Sci. Adv.8, eabn2275 (2022).. [Baidu Scholar]
Jiang, S. W. et al. Resolution-enhanced parallel coded ptychography for high-throughput optical imaging.ACS Photonics8, 3261–3271 (2021).. [Baidu Scholar]
Zheng, G. A., Horstmeyer, R.&Yang, C. Wide-field, high-resolution Fourier ptychographic microscopy.Nat. Photonics7, 739–745 (2013).. [Baidu Scholar]
Li, S. et al. Far-field synthetic aperture imaging via fourier ptychography with quasi-plane wave illumination.Adv. Photonics Res.4, 2300180 (2023).. [Baidu Scholar]
Whitehead, L. W. et al. Diffractive imaging using partially coherent X rays.Phys. Rev. Lett.103, 243902 (2009).. [Baidu Scholar]
Gardner, D. F. et al. Subwavelength coherent imaging of periodic samples using a 13.5 nm tabletop high-harmonic light source.Nat. Photonics11, 259–263 (2017).. [Baidu Scholar]
Baksh, P. D. et al. Quantitative and correlative extreme ultraviolet coherent imaging of mouse hippocampal neurons at high resolution.Sci. Adv.6, eaaz3025 (2020).. [Baidu Scholar]
Ravasio, A. et al. Single-shot diffractive imaging with a table-top femtosecond soft x-ray laser-harmonics source.Phys. Rev. Lett.103, 028104 (2009).. [Baidu Scholar]
Fienup, J. R. Phase retrieval for undersampled broadband images.J. Optical Soc. Am. A16, 1831–1837 (1999).. [Baidu Scholar]
Thibault, P.&Menzel, A. Reconstructing state mixtures from diffraction measurements.Nature494, 68–71 (2013).. [Baidu Scholar]
Batey, D. J., Claus, D.&Rodenburg, J. M. Information multiplexing in ptychography.Ultramicroscopy138, 13–21 (2014).. [Baidu Scholar]
Goldberger, D. et al. Spatiospectral characterization of ultrafast pulse-beams by multiplexed broadband ptychography.Opt. Express29, 32474–32490 (2021).. [Baidu Scholar]
Loetgering, L. et al. Tailoring spatial entropy in extreme ultraviolet focused beams for multispectral ptychography.Optica8, 130–138 (2021).. [Baidu Scholar]
Noom, D. W. E. et al. High-speed multi-wavelength Fresnel diffraction imaging.Opt. Express22, 30504–30511 (2014).. [Baidu Scholar]
Chen, B. et al. Multiple wavelength diffractive imaging.Phys. Rev. A79, 023809 (2009).. [Baidu Scholar]
Yao, Y. et al. Broadband X-ray ptychography using multi-wavelength algorithm.J. Synchrotron Radiat.28, 309–317 (2021).. [Baidu Scholar]
Abbey, B. et al. Lensless imaging using broadband X-ray sources.Nat. Photonics5, 420–424 (2011).. [Baidu Scholar]
Baksh, P. D. et al. Wide-field broadband extreme ultraviolet transmission ptychography using a high-harmonic source: publisher's note.Opt. Lett.41, 3057 (2016).. [Baidu Scholar]
Goldberger, D. et al. Single-pulse, reference-free, spatiospectral measurement of ultrashort pulse-beams.Optica9, 894–902 (2022).. [Baidu Scholar]
Rana, A. et al. Potential of attosecond coherent diffractive imaging.Phys. Rev. Lett.125, 086101 (2020).. [Baidu Scholar]
Jansen, G. S. M. et al. Diffractive shear interferometry for extreme ultraviolet high-resolution lensless imaging.Opt. Express26, 12479–12489 (2018).. [Baidu Scholar]
De Beurs, A. C. C. et al. Extreme ultraviolet lensless imaging without object support through rotational diversity in diffractive shearing interferometry.Opt. Express28, 5257–5266 (2020).. [Baidu Scholar]
Huijts, J. et al. Broadband coherent diffractive imaging.Nat. Photonics14, 618–622 (2020).. [Baidu Scholar]
Witte, S. et al. Lensless diffractive imaging with ultra-broadband table-top sources: from infrared to extreme-ultraviolet wavelengths.Light Sci. Appl.3, e163 (2014).. [Baidu Scholar]
Chen, C. C., Gu, H. G.&Liu, S. Y. Ultra-simplified diffraction-based computational spectrometer.Light Sci. Appl.13, 9 (2024).. [Baidu Scholar]
Phillips, D. L. A technique for the numerical solution of certain integral equations of the first kind.J. ACM9, 84–97 (1962).. [Baidu Scholar]
Doicu, A., Trautmann, T.&Schreier, F. Tikhonov regularization for nonlinear problems. In:Numerical Regularization for Atmospheric Inverse Problems. Springer Berlin Heidelberg: Berlin, Heidelberg, 163-220 (2010). [Baidu Scholar]
Bell, B. Solutions of Ill-posed problems. by A. N. Tikhonov, V. Y. Arsenin.Math. Comput.32, 1320–1322 (1978).. [Baidu Scholar]
Van Der Vorst, H. A. Bi-CGSTAB: a fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems.SIAM J. Sci. Stat. Comput.13, 631–644 (1992).. [Baidu Scholar]
Hansen, P. C. REGULARIZATION TOOLS: a matlab package for analysis and solution of discrete ill-posed problems.Numer. Algorithms6, 1–35 (1994).. [Baidu Scholar]
Liu, R. F. et al. Broadband ptychographic imaging with an accurately sampled spectrum.Phys. Rev. A107, 033510 (2023).. [Baidu Scholar]
Chen, B. et al. Diffraction imaging: the limits of partial coherence.Phys. Rev. B86, 235401 (2012).. [Baidu Scholar]
Dilanian, R. A. et al. Diffractive imaging using a polychromatic high-harmonic generation soft-x-ray source.J. Appl. Phys.106, 023110 (2009).. [Baidu Scholar]
Tanksalvala, M. et al. Nondestructive, high-resolution, chemically specific 3D nanostructure characterization using phase-sensitive EUV imaging reflectometry.Sci. Adv.7, eabd9667 (2021).. [Baidu Scholar]
Wood II, O. et al. Alternative materials for high numerical aperture extreme ultraviolet lithography mask stacks. Proceedings of SPIE 9422, Extreme Ultraviolet (EUV) Lithography VI. San Jose: SPIE, 94220I. 2015) [Baidu Scholar]
Horé, A.&Ziou, D. Image quality metrics: PSNR vs. SSIM. Proceedings of 20th International Conference on Pattern Recognition. Istanbul: IEEE, 2366-2369. 2010) [Baidu Scholar]
Chen, C. C., Gu, H. G.&Liu, S. Y. Noise-robust ptychography using dynamic sigmoid-remolding.Opt. Laser Technol.172, 110510 (2024).. [Baidu Scholar]
Craven, P.&Wahba, G. Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation.Numerische Mathematik31, 377–403 (1978).. [Baidu Scholar]
22
Views
12
Downloads
0
CSCD
Related Articles
Related Author
Related Institution