Fig 1 Mechanisms of light loss in a waveguide-based AR display.
Published:30 September 2024,
Published Online:12 August 2024,
Received:25 April 2024,
Revised:16 July 2024,
Accepted:16 July 2024
Scan QR Code
Cite this article
Augmented reality (AR) displays, heralded as the next-generation platform for spatial computing, metaverse, and digital twins, empower users to perceive digital images overlaid with real-world environment, fostering a deeper level of human-digital interactions. With the rapid evolution of couplers, waveguide-based AR displays have streamlined the entire system, boasting a slim form factor and high optical performance. However, challenges persist in the waveguide combiner, including low optical efficiency and poor image uniformity, significantly hindering the long-term usage and user experience. In this paper, we first analyze the root causes of the low optical efficiency and poor uniformity in waveguide-based AR displays. We then discover and elucidate an anomalous polarization conversion phenomenon inherent to polarization volume gratings (PVGs) when the incident light direction does not satisfy the Bragg condition. This new property is effectively leveraged to circumvent the tradeoff between in-coupling efficiency and eyebox uniformity. Through feasibility demonstration experiments, we measure the light leakage in multiple PVGs with varying thicknesses using a laser source and a liquid-crystal-on-silicon light engine. The experiment corroborates the polarization conversion phenomenon, and the results align with simulation well. To explore the potential of such a polarization conversion phenomenon further, we design and simulate a waveguide display with a 50° field of view. Through achieving first-order polarization conversion in a PVG, the in-coupling efficiency and uniformity are improved by 2 times and 2.3 times, respectively, compared to conventional couplers. This groundbreaking discovery holds immense potential for revolutionizing next-generation waveguide-based AR displays, promising a higher efficiency and superior image uniformity.
After decades of device innovation and vibrant advances in microdisplay technologies, ultra-compact imaging optics, and high-speed digital processors, augmented reality (AR) has evolved from a futuristic concept to a tangible and pervasive technology. By seamlessly blending the projected virtual content with real-world scenes, AR enhances our perception and interaction with environment, opening exciting possibilities for metaverse, digital twins, and spatial computing. AR displays have enabled widespread applications in smart education and training, smart healthcare, navigation and wayfinding, gaming and entertainment, and smart manufacturing, just to name a few.
Since its primitive conception in the 1990s, AR has made significant strides, particularly with the emergence and development of waveguide-based AR displays. These displays enable wearable systems to be lightweight and have a slim form factor while maintaining high optical performance. Furthermore, the rapid development of couplers, including partial reflective mirrors, surface relief gratings (SRGs), volume holographic gratings, polarization volume gratings (PVGs), metasurfaces, etc., has dramatically improved the optical performance of AR displays over the past few decades
While waveguide displays have dramatically reduced the form factor, the low efficiency of optical combiners, particularly the diffractive waveguide combiners, remains a major concern
The low optical efficiency primarily stems from four aspects, all related to the nonuniformity issues, such as color nonuniformity, FoV nonuniformity, and eyebox nonuniformity
Fig 1 Mechanisms of light loss in a waveguide-based AR display.
a Blue light absorption during propagation in a high-index waveguide substrate. b Effective pupil expansion process for a certain field angle in a traditional 2D exit pupil expansion (EPE). c Angular response for unoptimized and optimized SRGs. d Light loss due to multiple interactions at the diffractive in-coupler
The second major source of optical loss occurs during the pupil expansion process. As illustrated in
The third major optical loss mechanism is the limited angular and spectral bandwidth of the couplers in the high diffraction efficiency region
As depicted in
Light leakage at the in-coupler is a longstanding issue over the past few decades
As depicted in
In this paper, we present the discovery of an anomalous polarization conversion phenomenon in the PVGs. This phenomenon offers an intuitive solution to the abovementioned issue for achieving a high and uniform in-coupling efficiency throughout the entire FoV while maintaining continuous eyebox functionality. To prove concept, preliminary experiments are conducted to validate this polarization conversion process. The experimental results closely align with the Rigorous Coupled-Wave Analysis (RCWA) simulation. Moreover, the in-coupling efficiency limit of a 50° FoV waveguide-based AR display system is enhanced by two times with the first-order polarization conversion in a PVG, compared to conventional couplers. Concurrently, the uniformity throughout the FoV is also improved by 2.3 times. Furthermore, by combining an additional polarization compensation film at the in-coupler, nearly all light can be coupled into the waveguides.
The PVG is a polarization-selective holographic optical element that records the polarization information of two interfering beams comprising a right-handed circular polarization (RCP) and a left-handed circular polarization (LCP). As illustrated in
Fig 2 Working principles of PVG as in-coupler in waveguide displays.
a Slanted structure of PVG, which reflects LCP and transmits RCP. b PVG functions as a tilted twisted-nematic (TN) LC waveplate when the incident angle of light approaches the Bragg plane. c PVG functions as a tilted TN LC waveplate from the perspective of incident angle by rotating PVG. d 0th order transmission efficiency and (e) Stokes parameter
However, here we discover an anomalous phenomenon that deviates from the abovementioned rule. As depicted in
1
where
Due to these two superior polarization properties, employing PVG as an in-coupler in waveguide displays can dramatically enhance the in-coupling efficiency and uniformity throughout the FoV, while keeping a good eyebox continuity (or uniformity), in comparison with all other traditional in-couplers and metasurface couplers. Specifically, as illustrated in
However, TIR is accompanied by a non-trivial phase shift as the Fresnel reflection coefficient acquires a non-zero imaginary part
2
3
where
To validate the concept, we conducted an experiment using a 532 nm laser source and PVGs with varying thicknesses. We employed reactive mesogen RM257, which possesses a birefringence
4
where
Furthermore,
Fig 3 Experimental results of the anomalous polarization conversion in PVG.
a +1st order (
While the polarization conversion phenomenon has been successfully demonstrated at normal incidence using a laser source, it is crucial to assess its angular performance. By varying the incident angle of the laser source, the angular performance of the second interaction is investigated, as shown in
Fig 4 Experimental results of angular performance of the anomalous polarization conversion in PVG.
a Angular response of 0th order (
Although the polarization conversion phenomenon in a PVG has been well verified using a laser source and an LCoS light engine, these experiments do not fully demonstrate its full potential due to the limited birefringence (
It should be noted that, similar to a half-wave plate (HWP), the angular bandwidth of the polarization conversion is inherently limited due to dispersion. Additionally, multiple half-wave conditions exist, as depicted in
Fig 5 Response of multiple half-wave polarization conversion in PVG.
a Reflected 0th order diffraction efficiency varying with the PVG thickness. Spectral and angular response of reflected 0th order at PVG thickness of (b) 500 nm (first-order half-wave condition) and (c) 2200 nm (second-order half-wave condition). The birefringence of PVG for simulation is 0.4 (
Next, we further investigate the angular performance of the first-order and second-order polarization conversions in a PVG-based waveguide display with 50° [30° (H) × 40° (V)] diagonal FoV at λ = 532 nm. Both orders demonstrate significant enhancements in in-coupling efficiency and uniformity throughout the entire FoV, surpassing the theoretical in-coupling efficiency limit of conventional diffractive in-couplers.
Before conducting polarization raytracing, the system configuration and parameters must be designed meticulously, including the display panel, collimation lens, in-coupler, and out-coupler. For the light engine, we assume that the in-coupler of the waveguide display (or exit pupil of the light engine) is a circle with a diameter
5
Fig 6 Design of light engine and waveguide combiner.
a Light engine of waveguide displays. b Schematic of light propagation inside a waveguide around in-coupler region. c Cross section of the second interaction between in-coupler and one beam for a certain FoV.
Moreover, to achieve a diagonal FoV of 50° [30° (H) × 40° (V)], the panel size is set to 3 mm × 4.075 mm. Subsequently, a waveguide substrate with thickness
6
the maximum TIR angle is around 70°. Therefore, the minimum TIR angle
Parameters | Design value |
---|---|
FoV | 50° (30° (H) × 40° (V)) |
In-coupler size | 3 mm |
Working wavelength | 532 nm |
Panel Size | 3 mm × 4.075 mm |
Focal length of CL | 5.6 mm |
Refractive index of waveguide | 1.7 |
Thickness of waveguide | 0.55 mm |
Maximum TIR angle | 70° |
Birefringence of PVG | 0.4 |
Horizontal period of PVG | 407 nm |
Slanted angle of PVG | 23° |
Due to the multiple interactions between incident light and conventional in-couplers
7
where
To analyze how to improve the in-coupling efficiency and uniformity using PVG as an in-coupler, we conduct polarization ray-tracing simulations using OpticStudio (Ansys Zemax). The RCWA model of PVG is compiled into a dynamic-link library (DLL) file and linked to OpticStudio, operating in non-sequential mode. As shown in
8
Fig 7 Polarization raytracing results of PVG as an in-coupler in waveguide displays.
a Dynamics workflow between RCWA and Raytracing. b Shaded configuration of a waveguide display with a low-efficiency out-coupling grating. c Angular response of PVG with birefringence of 0.4 at slanted angle of 23° and thickness of 0.7 µm. d Improved in-coupling efficiency with optimized PVG by achieving the first-order half-wave condition. e Angular response of PVG with birefringence of 0.4 at slanted angle of 23.3° and thickness of 2.41 µm. f Improved in-coupling efficiency with optimized PVG by achieving the second-order half-wave condition
where
Furthermore, by optimizing the thickness and slanted angle of the in-coupler PVG to satisfy the second-order half-wave condition around the extreme field, the in-coupling efficiency and uniformity can be improved to 63.8% (1.77x enhancement) and 75.3% (2.09× enhancement), respectively, at slanted angle of 23.3° and thickness of 2.41 μm.
To further enhance the in-coupling efficiency and uniformity, one straightforward approach is to utilize a waveguide with a higher refractive index. However, it's worth noting that the in-coupling efficiency may decrease again as the FoV gets wider. Besides, such polarization conversion in PVG can only address the efficiency issues caused by the second interaction between the incident beam and the in-coupler. To further enhance the in-coupling efficiency affected by the third interaction, as illustrated in
Fig 8 Generalization of the polarization conversion in PVG-based waveguide displays.
a Polarization compensation layer in the in-coupling process
Besides, our results can be readily applied to various waveguide designs, including different pupil expansion schemes and different numbers of waveguides
9
where
More importantly, the polarization properties will facilitate more efficient rolling k vector designs
While the polarization conversion phenomenon in PVG can significantly enhance the in-coupling efficiency and uniformity, its efficacy is heavily dependent on the polarized light sources. When the light source is polarized, such as in a Liquid-Crystal-on-Silicon (LCOS) panel, PVG with the novel polarization properties demonstrates substantial advantages over conventional in-couplers. However, when using an unpolarized light source like micro-LEDs, a single PVG with the novel polarization property may only achieve a comparable level to traditional polarization-independent in-couplers due to the polarization selectivity of CLC. Nonetheless, this polarization selectivity can be leveraged to implement polarization multiplexing in two waveguides
As the polarization conversion phenomenon is intricately linked to the PVG thickness, careful consideration of PVG surface roughness during the fabrication process is essential. In
Moreover, the fabrication procedures and complexity remain consistent with previous PVG iterations. Therefore, implementing the polarization conversion phenomenon incurs no additional cost, as it is inherent to PVG and was first identified in this study. However, compared to mature fabrication techniques
In conclusion, we have discovered and demonstrated an anomalous polarization conversion phenomenon in PVGs. This new property effectively resolves the tradeoff between in-coupling efficiency and uniformity throughout the eyebox and FoV. By studying the multiple half-wave conditions in a PVG, we achieve a remarkable 2× improvement in in-coupling efficiency and 2.3× enhancement in uniformity across the FoV for a waveguide display with 50° FoV, compared to conventional couplers. To further overcome the in-coupling efficiency limit affected by the third interaction and achieve an approximately threefold enhancement, an additional compensation layer can be incorporated at the in-coupler PVG. Moreover, we delve into the broad applicability of the polarization conversion process, emphasizing its potential to be integrated into various waveguide display designs, especially full-color displays. Additionally, we examine and discuss the impact of the surface roughness of the PVG on the polarization conversion process. Overall, this polarization conversion phenomenon serves as the first evidence to showcase the superiority of PVG in-coupler in waveguide-based AR displays compared to other couplers. This advancement is expected to accelerate the development of high-efficiency waveguide-based AR displays and contribute to the commercialization of PVG technology.
The photoalignment material used in our experiments is Brilliant Yellow (BY) from Sinopharm Chemical Reagent Co., Ltd. BY powders were dissolved in dimethyl-formamide with a weight concentration of 0.5%. The mixed solution was filtered using a 0.2 μm Teflon syringe before spin-coating onto the glass substrate. The LC mixture is composed of solvent toluene and precursor which contains LC monomer RM 257 purchased from Jiangsu Hecheng Advanced Materials Co., Ltd., surfactant Zonyl 8857A from Dupont, and photo-initiator Irgcure 184 from MACKLIN.
Fig 9 Fabrication of PVG.
a Fabrication flowchart of PVGs. b Exposure setup for PVGs. c Cross section SEM image and (d) POM image of a PVG with a horizontal period of 411 nm
The 0.7 mm-thick glass substrates were purchased from Luoyang Guluo Glass. The substrate was cleaned using ethanol and then treated by vacuum plasma for 40 s before the spin-coating of BY solutions. The humidity of the environment for spin-coating was controlled to be under 40%. The BY layer on the glass substrate was exposed to a 460 nm laser (Coherent, Genesis CX-460) with 1 W output power for 2 min. We preheated the LC mixture on a hot plate stage at 70 ℃ before spin-coating because the viscosity decreases with increased temperature. Besides, we also put the LC substrates on top of the hot plate right after the spin-coating process for several seconds to obtain better alignment. Detailed recipes are summarized in
Sample | Solute | Solvent | Concentration | Coating speed (rpm) | Sample thickness (nm) |
---|---|---|---|---|---|
1 | RM257 (95.06%) R5011 (2.09%) Irgcure 184(2.85%) | Toluene | 6 wt% | 600 (30 s) | 500 |
2 | – | – | 12 wt.% | 1500 (30 s) | 720 |
3 | – | – | 12 wt% | 1000 (30 s) | 960 |
4 | – | – | 12 wt% | 600 (30 s) | 1200 |
5 | – | – | 18 wt% | 1500 (30 s) | 1650 |
6 | – | – | 38 wt% | 3000 (30 s) | 2850 |
7 | – | – | 38 wt% | 2500 (30 s) | 3050 |
8 | – | – | 38 wt% | 2000 (30 s) | 3300 |
9 | – | – | 38 wt% | 1000 (30 s) | 4400 |
The UCF group is indebted to Meta Platforms Technologies for the financial support and Dr. Lu Lu for useful discussion.
Y.D. and Y.G. contributed equally to this work. Y.D. proposed the idea and initiated the project. Y.D. and Y.G. mainly conducted the experiments and wrote the manuscript. Q.Y., Z.Y., and Y.H. helped with simulation and technical discussion. S.W. and Y.Z. supervised the project and edited the manuscript.
All data needed to evaluate the conclusions in the paper are present in the paper. Additional data related to this paper may be requested from the authors.
The authors declare no competing interests.
Ding, Y. Q. et al. Waveguide-based augmented reality displays: perspectives and challenges.eLight3, 24 (2023).. [Baidu Scholar]
Kress, B. C.&Chatterjee, I. Waveguide combiners for mixed reality headsets: a nanophotonics design perspective.Nanophotonics10, 41–74 (2021).. [Baidu Scholar]
Xiong, J. H.&Wu, S. T. Planar liquid crystal polarization optics for augmented reality and virtual reality: from fundamentals to applications.eLight1, 3 (2021).. [Baidu Scholar]
Lu, Y. Q.&Li, Y. Planar liquid crystal polarization optics for near-eye displays.Light Sci. Appl.10, 122 (2021).. [Baidu Scholar]
Xiong, J. H. et al. Augmented reality and virtual reality displays: emerging technologies and future perspectives.Light Sci. Appl.10, 216 (2021).. [Baidu Scholar]
Greenhalgh, P. A. Diffractive and reflective waveguides: a game of trade-offs (conference presentation). InProc. of SPIE 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR)(San Francisco, SPIE, 2020). [Baidu Scholar]
Sigel, G. H. Jr Optical absorption of glasses.Treatise Mater. Sci. Technol.12, 5–89 (1977).. [Baidu Scholar]
Ni, D. W. et al. Uniformity improvement of two-dimensional surface relief grating waveguide display using particle swarm optimization.Opt. Express30, 24523–24543 (2022).. [Baidu Scholar]
Yan, S. F. et al. Eyebox uniformity optimization over the full field of view for optical waveguide displays based on linked list processing.Opt. Express30, 38139–38151 (2022).. [Baidu Scholar]
Weng, M. H. et al. Study on two-dimensional exit pupil expansion for diffractive waveguide based on holographic volume grating.Appl. Sci.13, 11858 (2023).. [Baidu Scholar]
Levola, T. Method and optical system for coupling light into a waveguide. (2005). [Baidu Scholar]
Goodsell, J. et al. Metagrating meets the geometry-based efficiency limit for AR waveguide in-couplers.Opt. Express31, 4599–4614 (2023).. [Baidu Scholar]
Zhou, Y., Zhang, J. F.&Fang, F. Z. Stray light analysis and design optimization of geometrical waveguide.Adv. Opt. Technol.10, 71–79 (2021).. [Baidu Scholar]
Lin, Y. Y. et al. Enhanced diffraction efficiency with angular selectivity by inserting an optical interlayer into a diffractive waveguide for augmented reality displays.Opt. Express30, 31244–31255 (2022).. [Baidu Scholar]
Kobashi, J., Yoshida, H.&Ozaki, M. Planar optics with patterned chiral liquid crystals.Nat. Photonics10, 389–392 (2016).. [Baidu Scholar]
Weng, Y. S. et al. Polarization volume grating with high efficiency and large diffraction angle.Opt. Express24, 17746–17759 (2016).. [Baidu Scholar]
Lee, Y. H., He, Z. Q.&Wu, S. T. Optical properties of reflective liquid crystal polarization volume gratings.J. Opt. Soc. Am. B36, D9–D12 (2019).. [Baidu Scholar]
Nys, I. et al. Tilted chiral liquid crystal gratings for efficient large-angle diffraction.Adv. Opt. Mater.7, 1901364 (2019).. [Baidu Scholar]
Zheng, Z. G., Lu, Y. Q.&Li, Q. Photoprogrammable mesogenic soft helical architectures: a promising avenue toward future chiro-optics.Adv. Mater.32, 1905318 (2020).. [Baidu Scholar]
Zhang, Y. X., Zheng, Z. G.&Li, Q. Multiple degrees-of-freedom programmable soft-matter-photonics: configuration, manipulation, and advanced applications.Responsive Mater.2, e20230029 (2024).. [Baidu Scholar]
Feng, X. Y. et al. Closer look at transmissive polarization volume holograms: geometry, physics, and experimental validation.Appl. Opt.60, 580–592 (2021).. [Baidu Scholar]
Schadt, M.&Helfrich, W. Voltage-dependent optical activity of a twisted nematic liquid crystal.Appl. Phys. Lett.18, 127–128 (1971).. [Baidu Scholar]
Moharam, M. G.&Gaylord, T. K. Rigorous coupled-wave analysis of planar-grating diffraction.J. Opt. Soc. Am.71, 811–818 (1981).. [Baidu Scholar]
Xiong, J. H.&Wu, S. T. Rigorous coupled-wave analysis of liquid crystal polarization gratings.Opt. Express28, 35960–35971 (2020).. [Baidu Scholar]
Pedrotti, F. L., Pedrotti, L. S.&Pedrott, L. M.Introduction to Optics. 3rd edn, (Upper Saddle River, Addison-Wesley, 2006). [Baidu Scholar]
Wei, R. et al. Realizing the imaging simulation of reflective polarization volume gratings.Opt. Express30, 6355–6364 (2022).. [Baidu Scholar]
Ding, Y. Q. et al. Design optimization of polarization volume gratings for full-color waveguide-based augmented reality displays.J. Soc. Inf. Disp.31, 380–386 (2023).. [Baidu Scholar]
Yu, C. et al. Highly efficient waveguide displaywith space-variant volume holographic gratings.Appl. Opt.56, 9390–9397 (2017).. [Baidu Scholar]
Xiong, J. H. et al. Full degree-of-freedom polarization hologram by freeform exposure and inkjet printing.PhotoniX4, 35 (2023).. [Baidu Scholar]
Weng, Y. S. et al. High-efficiency and compact two-dimensional exit pupil expansion design for diffractive waveguide based on polarization volume grating.Opt. Express31, 6601–6614 (2023).. [Baidu Scholar]
Wang, J. R. et al. Liquid crystal polarization hologram device comprising an optic axis with a spatially varying orientation and compensated wavy structures. (2023). [Baidu Scholar]
Guo, L. J. Nanoimprint lithography: methods and material requirements.Adv. Mater.19, 495–513 (2007).. [Baidu Scholar]
Cheng, D. W. et al. Design and manufacture AR head-mounted displays: a review and outlook.Light. Adv. Manuf.2, 350–369 (2021).. [Baidu Scholar]
30
Views
9
Downloads
0
CSCD
Related Articles
Related Author
Related Institution