MetaSeeker: sketching an open invisible space with self-play reinforcement learning

Bei Wu; Chao Qian; Zhedong Wang; Pujing Lin; Erping Li; Hongsheng Chen

doi:10.1038/s41377-025-01876-0

Your Location：

Home >

Browse articles >

MetaSeeker: sketching an open invisible space with self-play reinforcement learning

Original Articles

- MetaSeeker: sketching an open invisible space with self-play reinforcement learning
- Light: Science & Applications Vol. 14, Issue 8, Pages: 2213-2225(2025)
- Affiliations：
  
  1.ZJU-UIUC Institute, Interdisciplinary Center for Quantum Information, State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou, China
  2.ZJU-Hangzhou Global Science and Technology Innovation Center, Zhejiang Key Laboratory of Intelligent Electromagnetic Control and Advanced Electronic Integration, Hangzhou, China
  3.Jinhua Institute of Zhejiang University, Zhejiang University, Jinhua, China
  4.Zhejiang Province Key Laboratory of Intelligent Vehicle Electronics, Hangzhou Dianzi University, Hangzhou, China
- Author bio：
  
  Chao Qian (chaoq@intl.zju.edu.cn)
  Hongsheng Chen (hansomchen@zju.edu.cn)
- Funds：
- DOI：10.1038/s41377-025-01876-0
  CLC：
- Received：11 November 2024，
  
  Revised：07 April 2025，
  
  Accepted：24 April 2025，
  
  Published Online：04 June 2025，
  
  Published：31 August 2025
- Accepted：
Scan QR Code
Wu, B. et al. MetaSeeker: sketching an open invisible space with self-play reinforcement learning. Light: Science & Applications, 14, 2213-2225 (2025).
DOI：

Wu, B. et al. MetaSeeker: sketching an open invisible space with self-play reinforcement learning. Light: Science & Applications, 14, 2213-2225 (2025). DOI： 10.1038/s41377-025-01876-0.

摘要

Abstract

Controlling electromagnetic (EM) waves at will is fundamentally important for diverse applications

ranging from optical microcavities

super-resolution imaging

to quantum information processing. Decades ago

the forays into metamaterials and transformation optics have ignited unprecedented interest to create an invisibility cloak—a closed space with any object inside invisible. However

all feat

ures of the scattering waves become stochastic and uncontrollable when EM waves interact with an open and disordered environment

making an open invisible space almost impossible. Counterintuitively

here we for the first time present

an open

cluttered

and dynamic

but invisible space

wherein any freely-moving object maintains invisible. To adapt to the disordered environment

we randomly organize a swarm of reconfigurable metasurfaces

and master them by MetaSeeker

a population-based reinforcement learning (RL). MetaSeeker constructs a narcissistic internal world to mirror the stochastic physical world

capable of autonomous preferment

evolution

and adaptation. In the perception-decision-execution experiment

multiple RL agents automatically interact with the ever-changing environments and integrate a post-hoc explainability to visualize the decision-making process. The hidden objects

such as vehicle cluster and experimenter

can freely scale

race

and track in the invisible space

with the environmental similarity of 99.5%. Our results constitute a monumental stride to reshape the evolutionary landscape of metasurfaces from individual to swarm intelligence and usher in the remote management of entire EM space.

关键词

Keywords

references

Engheta, N.&Ziolkowski, R. W. Metamaterials: Physics and Engineering Explorations. (Hoboken: John Wiley&Sons, 2006).

Zheludev, N. I. & Kivshar, Y. S. From metamaterials to metadevices. Nat. Mater. 11 , 917–924 (2012)..

Fang, X., Zheng, X., Li, M., Li, Z. & Ding, D. Wireless secure communication based on code domain space-time modulated metasurface. Electromagn. Sci. 2 , 1–11 (2024)..

Qian, C. et al. Performing optical logic operations by a diffractive neural network. Light Sci. Appl. 9 , 59 (2020)..

Devlin, R. C. et al. Arbitrary spin-to-orbital angular momentum conversion of light. Science 358 , 896–901 (2017)..

So, S., Mun, J. & Rho, J. Simultaneous inverse design of materials and structures via deep learning: demonstration of dipole resonance engineering using core-shell nanoparticles. ACS Appl. Mater. Interfaces 11 , 24264–24268 (2019)..

Shaltout, A. M., Shalaev, V. M. & Brongersma, M. L. Spatiotemporal light control with active metasurfaces. Science 364 , eaat3100 (2019)..

Chu, H. et al. A hybrid invisibility cloak based on integration of transparent metasurfaces and zero-index materials. Light Sci. Appl. 7 , 50 (2018)..

Alù, A. & Engheta, N. Achieving transparency with plasmonic and metamaterial coatings. Phys. Rev. E 72 , 016623 (2005)..

Yang, Y. H. et al. Realization of a three-dimensional photonic topological insulator. Nature 565 , 622–626 (2019)..

Pendry, J. B., Schurig, D. & Smith, D. R. Controlling electromagnetic fields. Science 312 , 1780–1782 (2006)..

Qian, C. et al. Deep-learning-enabled self-adaptive microwave cloak without human intervention. Nat. Photonics 14 , 383–390 (2020)..

Qian, C. et al. Dynamic recognition and mirage using neuro-metamaterials. Nat. Commun. 13 , 2694 (2022)..

Qian, C., Kaminer, I. & Chen, H. S. A guidance to intelligent metamaterials and metamaterials intelligence. Nat. Commun. 16 , 115 4 (2025)..

Qian, C. & Chen, H. S. The rise of intelligent adaptive metasurfaces. J. Opt. 27 , 012501 (2025)..

Fan, Z. X. et al. Holographic multiplexing metasurface with twisted diffractive neural network. Nat. Commun. 15 , 9416 (2024)..

Wang, Z. D. et al. 3D intelligent cloaked vehicle equipped with thousand-level reconfigurable full-polarization metasurfaces. Adv. Mater. 36 , 2400797 (2024)..

Tsilipakos, O. et al. Toward intelligent metasurfaces: the progress from globally tunable metasurfaces to software-defined metasurfaces with an embedded network of controllers. Adv. Optical Mater. 8 , 2000783 (2020)..

Qian, C. & Chen, H. S. A perspective on the next generation of invisibility cloaks—intelligent cloaks. Appl. Phys. Lett. 118 , 180501 (2021)..

Qian, C. et al. Autonomous aeroamphibious invisibility cloak with stochastic-evolution learning. Adv. Photonics 6 , 016001 (2024)..

Yu, S. et al. Engineered disorder in photonics. Nat. Rev. Mater. 6 , 226–243 (2021)..

Hsu, C. W. et al. Correlation-enhanced control of wave focusing in disordered media. Nat. Phys. 13 , 497–502 (2017)..

Vasquez, F. G., Milton, G. W. & Onofrei, D. Broadband exterior cloaking. Opt. Express 17 , 14800–14805 (2009)..

Fan, Z. X. et al. Homeostatic neuro-metasurfaces for dynamic wireless channel management. Sci. Adv. 8 , eabn7905 (2022)..

Del Hougne, P., Fink, M. & Lerosey, G. Optimally diverse communication channels in disordered environments with tuned randomness. Nat. Electron. 2 , 36–41 (2019)..

Faccio, D., Velten, A. & Wetzstein, G. Non-line-of-sight imaging. Nat. Rev. Phys. 2 , 318–327 (2020)..

Juliano Martins, R. et al. Metasurface-enhanced light detection and ranging technology. Nat. Commun. 13 , 5724 (2022)..

Goertzel, B. Artificial general intelligence: concept, state of the art, and future prospects. J. Artif. Gen. Intell. 5 , 1–48 (2014)..

Schrittwieser, J. et al. Mastering Atari, go, chess and shogi by planning with a learned model. Nature 588 , 604–609 (2020)..

Bellemare, M. G. et al. The arcade learning environment: an evaluation platform for general agents. J. Artif. Intell. Res. 47 , 253–279 (2013)..

Jaderberg, M. et al. Human-level performance in 3d multiplayer games with population-based reinforcement learning. Science 364 , 859–865 (2019)..

Silver, D. et al. Mastering the game of go with deep neural networks and tree search. Nature 529 , 484–489 (2016)..

He, K. M. et al. Mask R-CNN. Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2980–2988 (2017).

Sutton, R. S.&Barto, A. G. Reinforcement learning: An introduction. (Cambridge: A Bradford Book, 2018).

Coulom, R. Efficient selectivity and backup operators in Monte-Carlo tree search. Proceedings of the 5th International Conference on Computers and Games. Turin, Italy: Springer, 72–83 (2006).

Silver, D. et al. Mastering the game of go without human knowledge. Nature 550 , 354–359 (2017)..

Zhou, X. et al. Swarm of micro flying robots in the wild. Sci. Robot. 7 , eabm5954 (2022)..

Murphy, R. R. Swarm robots in science fiction. Sci. Robot. 6 , eabk0451 (2021)..

Wang, Z. D. et al. Demonstration of Spider-Eyes-Like intelligent antennas for dynamically perceiving incoming waves. Adv. Intell. Syst. 3 , 2100066 (2021)..

Lundberg, S. M.&Lee, S. I. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, California, USA: Curran Associates Inc., 4768-4777 (2017).

Jia, Y. T. et al. A knowledge-inherited learning for intelligent metasurface design and assembly. Light Sci. Appl. 12 , 82 (2023)..

Chen, J. T. et al. Correlating metasurface spectra with a generation-elimination framework. Nat. Commun. 14 , 4872 (2023)..

Qian, C. et al. Breaking the fundamental scattering limit with gain metasurfaces. Nat. Commun. 13 , 4383 (2022)..

Feng, N. X. et al. Highly accurate and efficient 3D implementations empowered by deep neural network for 2DLMs-based metamaterials. Prog. Electromagnetics Res. 180 , 1–11 (2024)..

Trinh, T. H. et al. Solving olympiad geometry without human demonstrations. Nature 625 , 476–482 (2024)..

Lin, P. J. et al. Enabling intelligent metasurfaces for semi-known input. Prog. Electromagnetics Res. 178 , 83–91 (2023)..

Tan, Q. Z., Qian, C. & Chen, H. S. Inverse-designed metamaterials for on-chip combinational optical logic circuit. Prog. Electromagnetics Res. 176 , 55–65 (2023)..

Ta n, Q. Z. et al. Solving multivariable equations with tandem metamaterial kernels. Prog. Electromagnetics Res. 175 , 139–147 (2022)..

Qian, C., Tian, L. W. & Chen, H. S. Progress on intelligent metasurfaces for signal relay, transmitter, and processor. Light Sci. Appl. 14 , 93 (2025)..

\hskip 3pcZheng, B. et al. Revealing the transformation invariance of full-parameter omnidirectional invisibility cloaks. Electromagn. Sci. 1 , 0020092 (2023)..

You, G. F. et al. Flow-based electromagnetic information recovery for inaccessible area and low-resolution detection. Laser Photonics Rev. 19 , 2401199 (2025)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰