State Key Laboratory of Dynamic Optical Imaging and Measurement, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, 130033 Changchun, China
Ping Jia (jiap@ciomp.ac.cn)
Received:17 December 2024,
Revised:02 February 2025,
Accepted:2025-02-02,
Published Online:10 March 2025,
Published:31 March 2025
Scan QR Code
Jia, P. et al. Airborne optical imaging technology: a road map in CIOMP. Light: Science & Applications, 14, 634-655 (2025).
Jia, P. et al. Airborne optical imaging technology: a road map in CIOMP. Light: Science & Applications, 14, 634-655 (2025). DOI: 10.1038/s41377-025-01776-3.
Airborne optical imaging can flexibly obtain the intuitive information of the observed scene from the air
which plays an important role of modern optical remote sensing technology. Higher resolution
longer imaging distance
and broader coverage are the unwavering pursuits in this research field. Nevertheless
the imaging environment during aerial flights brings about multi-source dynamic interferences such as temperature
air pressure
and complex movements
which forms a serious contradiction with the requirements of precision and relative staticity in optical imaging. As the birthplace of Chinese optical industry
the Changchun Institute of Optics
Fine Mechanics and Physics (CIOMP) has conducted the research on airborne optical imaging for decades
resulting in rich innovative achievements
completed research conditions
and exploring a feasible development path. This article provides an overview of the innovative work of CIOMP in the field of airborne optical imaging
sorts out the milestone nodes
and predicts the future development direction of this discipline
with the aim of providing inspiration for related research.
Cohen, C. J. Early history of remote sensing. In: Proceedings 29th Applied Imagery Pattern Recognition Workshop 3-9 (IEEE, 2000).
Smith, W. J. Modern Optical Engineering: the Design of Optical Systems 4th edn (McGraw-Hill, 2008).
Wilhelm, T. A. Five-lens Photographic Objective Comprising Three Members Separated by Air Spaces. U.S. Patent. US2645156A (1953).
Yao, Y. et al. Optical-system design for large field-of-view three-line array airborne mapping camera. Opt. Precis. Eng. 26 , 2334–2343 (2018)..
Xu, Y. S. et al. Trend and development actuality of the real-time transmission airborne reconnaissance camera. OME Inf. 27 , 38–43 (2010)..
Zhang, B., Cui, E. K. & Hong, Y. F. Infrared MWIR/LWIR dual-FOV common-path optical system. Opt. Precis. Eng. 23 , 395–401 (2015)..
Jiang, C. M. et al. Suppressing the polarization aberrations by combining reflection and refraction optical groups. Opt. Express 30 , 41847–41861 (2022)..
Yao, D. et al. Calculation and restoration of lost spatial information in division-of-focal-plane polarization remote sensing using polarization super-resolution technology. Int. J. Appl. Earth Observation Geoinf. 116 , 103155 (2023)..
Wang, Y. T. & Tian, D. P. Review of image shift and image rotation compensation control technology for aviation optoelectronic imaging. Opt. Precis. Eng. 30 , 3128–3138 (2022)..
Li, C. Y. Analysis and Design for the Forward Motion Compensation of Lmk Aerial Survey Camera. MSc thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2001).
Ren, H. & Zhang, T. Imaging CCD translation compensation method based on movement estimation of gradation projection technology. J. Appl. Opt. 30 , 417–422 (2009)..
Meng, Q. Y. et al. High resolution imaging camera (HiRIC) on China’s first Mars exploration Tianwen-1 mission. Space Sci. Rev. 217 , 42 (2021)..
Wang, D. J., Zhang, T. & Kuang, H. P. Clocking smear analysis and reduction for multi phase TDI CCD in remote sensing system. Opt. Express 19 , 4868–4880 (2011)..
Sun, J. J. et al. Conceptual design and image motion compensation rate analysis of two-axis fast steering mirror for dynamic scan and stare imaging system. Sensors 21 , 6441 (2021)..
Zhang, J. et al. Precise alignment method of time-delayed integration charge-coupled device charge shifting direction in aerial panoramic camera. Opt. Eng. 55 , 125101 (2016)..
Sun, C. S. et al. Backscanning step a nd stare imaging system with high frame rate and wide coverage. Appl. Opt. 54 , 4960–4965 (2015)..
Wei, J. C. & Yang, Y. M. Forward motion compensation system based on piezoelectric direct drive. Chin. J. Liq. Cryst. Disp. 30 , 519–524 (2015)..
Wang, J. S. et al. Characteristic analysis and correction technique about the image rotation of aerial camera. Infrared Laser Eng. 37 , 493–496 (2008)..
Tian, D. P. et al. Bilateral control-based compensation for rotation in imaging in scan imaging systems. Opt. Eng. 54 , 124104 (2015)..
Che, X. & Tian, D. P. A survey of line of sight control technology for airborne photoelectric payload. Opt. Precis. Eng. 26 , 1642–1652 (2018)..
Jia, P. & Zhang, B. Critical technologies and their development for airborne opto-electronic reconnaissance platforms. Opt. Precis. Eng. 11 , 82–88 (2003)..
Li, Q. C. et al. Nonorthogonal aerial optoelectronic platform based on triaxial and control method designed for image sensors. Sensors 20 , 10 (2019)..
Wang, M. Y. et al. 3-DOF series-spherical-mechanism control for attitude tracking in inertial space. In: Proc. IECON 2020 the 46th Annual Conference of the IEEE Industrial Electronics Society , 23–28 (IEEE, Singapore, 2020).
Tian, D. P. et al. Adaptive sliding‐mode‐assisted disturbance observer‐based decoupling control for inertially stabilized platforms with a spherical mechanism. IET Control Theory Appl. 16 , 1194–1207 (2022)..
Wang, Y. H. Research on Structure Design of Fast-steering Mirror and It’s Dynamic Characteristics. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2004).
Xu, X. X. et al. Research on key technology of fast-steering mirror. Laser Infrared 43 , 1095–1103 (2013)..
Li, X. T. et al. Adaptive robust control over high-performance VCM-FSM. Opt. Precis. Eng. 25 , 2428–2436 (2017)..
Xu, X. X. et al. Large-diameter fast steering mirror on rigid support technology for dynamic platform. Opt. Precis. Eng. 22 , 117–124 (2014)..
Tan, S. N. et al. Structure design of two-axis fast steering mirror for aviation optoelectronic platform. Opt. Precis. Eng. 30 , 1344–1352 (2022)..
Xuan, M. et al. in Fine Mechanics and Physics: 1952–2002 (Jilin People’s Press, 2002).
Hu, C. C., Yang, H. T. & Niu, H. J. The design of aerial camera focusing mechanism. Proc. SPIE 9677 , 96771F (2015).
Zhang, Y. C. et al. Laser angle attitude measurement technology and its application in aerospace field. Proc. SPIE 12343 ,1234325 (2022)..
Kong, Y. W., Tian, D. P. & Wang, Y. T. An adaptive three-axis attitude estimation method based on multi-sensor fusion for optoelectronic platform. Appl. Sci. 12 , 3693 (2022)..
Tian, D. P., Shen, H. H. & Dai, M. Improving the rapidity of nonlinear tracking differentiator via feedforward. IEEE Trans. Ind. Electron. 61 , 3736–3743 (2014)..
Wang, X. Research on Key Technologies of Stable Tracking System for Airborne Optoelectronic Platform. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2017).
Song, J. H. Development of Image Tracking System and Research of Tracking Algorithms. MSc thesis, Southeast University (2005).
Bolme, D. S. et al.Visual object tracking using adaptive correlation filters. In: Proc. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition , 2544–2550 (IEEE, San Francisco, CA, USA, 2010).
Henriques, J. F. et al. Exploiting the circulant structure of tracking-by-detection with kernels. In: Proc. 12th European Conference on Computer Vision , 702–715 (Springer, Florence, Italy, 2012).
Henriques, J. F. et al. High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 37 , 583–596 (2015)..
Song, C. Research on Target Tracking Based on Particle Filter. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2014).
Wang, X., Liu, J. H. & Zhou, Q. F. Real-time multi-target localization from unmanned aerial vehicles. Sensors 17 , 33 (2016)..
Liu, G. Aero-image Processing and Multi-target Tracking on Moving Carrier Base on Wavelet Transform. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2005).
Liu, G. Y. Research on Algorithms of Visual Target Tracking in Remote Sensing Images. MSc thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2023).
Chu, C. T. & Lee, M. S. A content-adaptive method for single image dehazing. In: Proc.. Advances in Multimedia Information Processing, and 11th Pacific Rim Conference on Multimedia: Part II , 350–361 (Springer, Shanghai, China 2010).
Long, J. et al. Single remote sensing image dehazing. IEEE Geosci. Remote Sens. Lett. 11 , 59–63 (2014)..
Jiang, W. T. et al. An improved dehazing algorithm of aerial high-definition image. Proc. SPIE 9796 , 97962T (2015)..
Liu, J. et al. Image dehazing method of transmission line for unmanned aerial vehicle inspection based on densely connection pyramid network. Wirel. Commun. Mob. Comput. 2020 , 8857271 (2020)..
Yu, J. et al. Aerial image dehazing using reinforcement learning. Remote Sens. 14 , 5998 (2022)..
Zhang, K. M. et al. UAV remote sensing image dehazing based on double-scale transmission optimization strategy. IEEE Geosci. Remote Sens. Lett. 19 , 6516305 (2022)..
Kulkarni, A. & Murala, S. Aerial image Dehazing with attentive deformable transformers. In: Proc. IEEE/CVF Winter Conference on Applications of Computer Vision 6294–6303 (IEEE, Waikoloa, HI, USA, 2023).
Ji, X. Q. Research on Fast Image Defogging and Visibility Restoration. PhD thesis. Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2012).
Liu, L. Research on LQ Control Method of Photoelectric Platform. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2013).
Cheng, J. T. The analysis of atmosphere scattering to oblique imaging of aerial camera and research of enhancement methods of image quality. MSc thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2013).
Tian, H. N. Application of super-resolution reconstruction in aerial E-O imaging system. Foreign Electron. Meas. Technol. 34 , 73–77 (2015)..
He, L. Y. Research on Key Techniques of Super-resolution Reconstruction of Aerial Images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2016).
He, L. Y., Liu, J. H. & Li, G. Super resolution of aerial image by means of polyphase components reconstruction. Acta Phys. Sin. 64 , 114208 (2015)..
Dong, G. J., Zhang, Y. S. & Fan, Y. H. Image fusion for hyperspectral date of PHI and high-resolution aerial image. J. Infrared Millim. Waves 25 , 123–126 (2006)..
Li, Haitao, et al. Fusion of high-resolution aerial imagery and lidar data for object-oriented urban land-cover classification based on svm. In: ISPRS Workshop on Updating Geo-spatial Databases with Imagery & The 5th ISPRS Workshop on DMGISs . Urumqi, China (2007).
Zabuawala, S. et al. Fusion of LIDAR and aerial imagery for accurate building footprint extraction. Proc. SPIE 7251 , 72510Z (2009)..
Zheng, S. C. Pixel-level Image Fusion Algorithms for Multi-camera Imaging System. MSc thesis, University of Tennessee (2010).
Zhou, G. Q. & Zhou, X. Seamless fusion of LiDAR and aerial imagery for building extraction. IEEE Trans. Geosci. Remote Sens. 52 , 7393–7407 (2014)..
Shao, Z. F. & Cai, J. J. Remote sensing image fusion with deep convolutional neural network. IEEE J. Sel. Top. Appl. Earth Observations Remote Sens. 11 , 1656–1669 (2018)..
Liang, H. D. Research on fast registration of spatial remote sensing infrared and visible light images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2019).
Zuo, Y. J. Research on Key Technology of Infrared and Visible Image Fusion System Based on Airborne Photoelectric Platform. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2017).
Luo, N. Research on Visible/infrared Aerial Imaging Payload Image Fusion Algorithm Based on Multiscale Decomposition. MSC dissertation, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences https://doi.org/10.27522/d.cnki.gkcgs.2023.000154 https://doi.org/10.27522/d.cnki.gkcgs.2023.000154 (2023).
LI, Q. Q. Research on Infrared and Visible Image Fusion Based on Multi-level Information Extraction and Transmission. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2022).
Sun, M. C. Research on Fusion of Visible and Infrared Reconnaissance Images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2012).
Li, S. Real-time Restoration Algorithms Research for Aerial Images with Different Rates of Image Motion. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2010).
Wang, L. N. Research on the Registration Technology of Optical and SAR Remote Sensing Images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2021).
Xie, Z. H. et al. Optical and SAR image registration based on the phase congruency framework. Appl. Sci. 13 , 5887 (2023)..
Viola, P. & Jones, M. J. Robust real-time face detection. Int. J. Computer Vis. 57 , 137–154 (2004)..
Felzenszwalb, P., McAllester, D. & Ramanan, D. A discriminatively trained, multiscale, deformable part model. In: Proc. 2008 IEEE Conference on Computer Vision and Pattern Recognition . Anchorage 1–8 (IEEE, AK, USA, 2008).
Felzenszwalb, P. F. et al. Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32 , 1627–1645 (2010)..
Girshick, R. et al. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition , 580–587 (IEEE, Columbus, OH, USA, 2014).
Girshick, R. Fast R-CNN. In: Proc. IEEE International Conference on Computer Vision 1440–1448 (IEEE, Santiago, Chile, 2015).
Ren, S. Q. et al. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39 , 1137–1149 (2017)..
Cai, Z. W. & Vasconcelos, N. Cascade R-CNN: delving into high quality object detection. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition , 6154–6162 (IEEE, Salt Lake City, UT, USA, 2018).
Lin, T. Y. et al. Focal loss for dense object detection. IEEE Trans. Pattern Anal. Mach. Intell. 42 , 318–327 (2020)..
Zhang, S. et al. Single-shot refinement neural network for object detection. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, 2018).
Redmon, J. You only look once: unified, real-time object detection. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition , 779–788 (IEEE, Las Vegas, NV, USA, 2016).
Chen, Y. K. et al. Dynamic scale training for object detection. https://doi.org/10.48550/arXiv.2004.12432 https://doi.org/10.48550/arXiv.2004.12432 (2020).
Bai, Y. et al. SOD-MTGAN: Small object detection via multi-task generative adversarial network. In: Eureopean Conference on Computer Vision , 210–226 (Springer International Publishing, Cham, 2018).
Bell, S. et al. Inside-outside net: detecting objects in context with skip pooling and recurrent neural networks. In: Proc IEEE Conference on Computer Vision and Pattern Recognition , 2874–2883 (Las Vegas, NV, USA, IEEE, 2016).
Lu, X. C. et al. Attention and feature fusion SSD for remote sensing object detection. IEEE Trans. Instrum. Meas. 70 , 5501309 (2021)..
Chen, Y. T. Research on Satellite Image On-board Target Recognition Based on Local Invariant Feature. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2017).
Wang, W. S. Research on Technology of Ship and Aircraft Targets Recognition from Large-field Optical Remote Sensing Image. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2018).
Liu, C. Y. Research on Object Detection in Aerial Optical Remote Sensing Images Based on Regional Proposal. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2020).
He, J. Fast Detection and Recognition of Maritime Targets in Visible Remote Sensing Images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2020).
Xu, F. Research on Key Techniques of Maritime Target Detection in Visible Bands of Optical Remote Sensing Images. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2018).
Dong, C. Research on the Detection of Ship Targets on the Sea Surface in Optical Remote Sensing Image. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2020).
Wang, H. Y. Research on Key Technologies for Target Detection in Aerial Hyperspectral Remote Sensing Imagery. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences (2023).
Dai, D. E., Zhu,R. F. & Chen, C. Z. Aerial small target detection method based on improved Yolov51. Comput. Eng. Des. 44 , 2610–2618 (2023)..
Shen, H. H. et al. Recent progress in aerial electro-optic payloads and their key technologies. Chin. Opt. 5 , 20–29 (2012)..
Cheng, Z. F. et al. Engineering design of an active–passive combined thermal control technology for an aerial optoelectronic platform. Sensors 19 , 5241 (2019)..
Tachikawa, S. et al. Advanced passive thermal control materials and devices for spacecraft: a review. Int. J. Thermophys. 43 , 91 (2022)..
Chen, L. H. & Xu, S. Y. Thermal design of electric cabinet for high-resolution space camera. Opt. Precis. Eng. 19 , 69–76 (2011)..
Jakel, E. K. J., Erne, W. & Soulat, G. The thermal control system of the faint object camera /FOC/. In: Proc. 15th Thermophysics Conference (AIAA, Snowmass, CO, USA, 1980).
Ruck, R. C. & Smith, O. J. KS-127A long range oblique reconnaissance camera for RF-4 aircraft. Proc. SPIE 0242 , 22–31 (1980)..
Augustyn, T. The KS-146A long range oblique photography (LOROP) camera system. Proc. SPIE 0309 , 76–85 (1981)..
Liu, W. Y. et al. Thermal analysis and design of the aerial camera’s primary optical system components. Appl. Therm. Eng. 38 , 40–47 (2012)..
Liu, W. Y. et al. Developing a thermal control strategy with the method of integrated analysis and experimental verification. Optik 126 , 2378–2382 (2015)..
Gao, Y. et al. Thermal design and analysis of the high resolution MWIR/LWIR aerial camera. Optik 179 , 37–46 (2019)..
Li, Y. W. et al. Multilayer thermal control for high-altitude vertical imaging aerial cameras. Appl. Opt. 61 , 5205–5214 (2022)..
An, Y. et al. Research on the device of non-angular vibration for opto-electronic platform. Comput. Simul. 25 , 298–301 (2008)..
Wang, P. et al. Application of metal-rubber dampers in vibration reduction system of an airborne electro-optical pod. J. Vib. Shock 33 , 193–199 (2014)..
Zhang, B., Jia, P. & Huang, M. Passive vibration control of image blur resulting from mechanical vibrations on moving vehicles. Optical Tech. 29 , 281–283 (2003)..
Greiner, B., Brewster, R., Mrzyglod, A. & Wagner, J. Reactivation of the active mass damping system for SOFIA to improve image stability. In: Ground-based and Airborne Telescopes Ⅷ. 114650W (SPIE, 2020)
General Administration of Quality Supervision, Inspection and Quarantine of the People's Republic of China, Standardization Administration of the People's Republic of China. GB/T 10586-2006, Specifications for damp heat chambers (2006).
General Administration of Quality Supervision, Inspection and Quarantine of the People's Republic of China, Standardization Administration of the People's Republic of China. GB/T 10590-2006, Specifications for high and low temperature/low air pressure testing chambers (2006).
Du, Y. L. et al. Dynamic modulation transfer function analysis of images blurred by sinusoidal vibration. J. Optical Soc. Korea 20 , 762–769 (2016)..
Jin, H. et al. Research on integrated acquisition technology of disaster site information. J. People’s Public Security University of China (Sci. Technol.) 27 , 101–108 (2021)...
Leica Geosystems. Leica ADS100 airborne digital sensor (2024). https://leica-geosystems.com/products/airborne-systems/imaging-sensors/leica-ads100-airborne-digital-sensor https://leica-geosystems.com/products/airborne-systems/imaging-sensors/leica-ads100-airborne-digital-sensor ..
Zhang, H. et al. Exterior orientation parameter refinement of the first Chinese airborne three-line scanner mapping system AMS-3000. Remote Sens. 16 , 2362 (2024)..
Xiong, S. P, Duan, Y. S. & Yuan, G. Q. Processing and application of AMS-3000 large field of view triple line array camera in photogrammetry. In: Proc. 7th China High Resolution Earth Observation Conference (CHREOC 2020) , 49–56 (Springer, Singapore, 2022).
Yuan, G. Q. et al. A precise calibration method for line scan cameras. IEEE Trans. Instrum. Meas. 70 , 5013709 (2021)..
Liu, X. J. et al. Two-mirror aerial mapping camera design with a tilted-aplanatic secondary mirror for image motion compensation. Opt. Express 31 , 4108–4121 (2023)..
Li, J. Research on Desensitization and A Thermal Technology of Aerial Catadioptric Optical System Based on the Secondary Mirror Image Motion Compensation. PhD thesis, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences https://doi.org/10.27522/d.cnki.gkcgs.2023.000011 https://doi.org/10.27522/d.cnki.gkcgs.2023.000011 (2023).
Xing, Z. C., Hong, Y. F. & Zhang, B. The influence of dichroic beam splitter on the airborne multiband co-aperture optical system. Optoelectron. Lett. 14 , 252–256 (2018)..
0
Views
0
Downloads
0
CSCD
Publicity Resources
Related Articles
Related Author
Related Institution