Real-time molecular imaging of near-surface tissue using Raman spectroscopy

Wei Yang; Florian Knorr; Ines Latka; Matthias Vogt; Gunther O. Hofmann; Jürgen Popp; Iwan W. Schie

doi:10.1038/s41377-022-00773-0

Go to Nature Website

Your Location：

Home >

Browse articles >

Real-time molecular imaging of near-surface tissue using Raman spectroscopy

Articles

- Real-time molecular imaging of near-surface tissue using Raman spectroscopy
- Light: Science & Applications Vol. 11, Issue 5, Pages: 820-831(2022)
- Affiliations：
  
  1.Leibniz Institute of Photonic Technology Jena, Albert-Einstein-Straße 9, 07745, Jena, Germany
  2.Department of Trauma, Hand and Reconstructive Surgery, University Hospital Jena, Am Klinikum 1, 07747, Jena, Germany
  3.Institute of Physical Chemistry and Abbe Center of Photonics, Friedrich-Schiller University Jena, Helmholtzweg 4, 07743, Jena, Germany
  4.Department of Medical Engineering and Biotechnology, University of Applied Sciences - Jena, Carl-Zeiss-Promenade 2, 07745, Jena, Germany
- Author bio：
  
  Iwan W. Schie (iwan.schie@leibniz-ipht.de)
- Funds：
- DOI：10.1038/s41377-022-00773-0
  CLC：
- Published：31 May 2022，
  
  Published Online：08 April 2022，
  
  Received：30 September 2021，
  
  Revised：09 March 2022，
  
  Accepted：19 March 2022
- Accepted：
Scan QR Code
Yang, W. et al. Real-time molecular imaging of near-surface tissue using Raman spectroscopy. Light: Science & Applications, 11, 820-831 (2022).
DOI：

Yang, W. et al. Real-time molecular imaging of near-surface tissue using Raman spectroscopy. Light: Science & Applications, 11, 820-831 (2022). DOI： 10.1038/s41377-022-00773-0.

摘要

Abstract

The steady progress in medical diagnosis and treatment of diseases largely hinges on the steady development and improvement of modern imaging modalities. Raman spectroscopy has attracted increasing attention for clinical applications as it is label-free

non-invasive

and delivers molecular fingerprinting information of a sample. In combination with fiber optic probes

it also allows easy access to different body parts of a patient. However

image acquisition with fiber optic probes is currently not possible. Here

we introduce a fiber optic probe-based Raman imaging system for the real-time molecular virtual reality data visualization of chemical boundaries on a computer screen and the physical world. The approach is developed around a computer vision-based positional tracking system in conjunction with photometric stereo and augmented and mixed chemical reality

enabling molecular imaging and direct visualization of molecular boundaries of three-dimensional surfaces. The proposed approach achieves a spatial resolution of 0.5 mm in the transverse plane and a topology resolution of 0.6 mm

with a spectral sampling frequency of 10 Hz

and can be used to image large tissue areas in a few minutes

making it highly suitable for clinical tissue-boundary demarcation. A variety of applications on biological samples

i.e.

distribution of pharmaceutical compounds

brain-tumor phantom

and various types of sarcoma have been characterized

showing that the system enables rapid and intuitive assessment of molecular boundaries.

关键词

Keywords

references

Cordero, E. et al. In-vivo Raman spectroscopy: from basics to applications.J. Biomed. Opt.23, 071210 (2018)..

Krafft, C. et al. Label-free molecular imaging of biological cells and tissues by linear and nonlinear Raman spectroscopic approaches.Angew. Chem. Int. Ed.56, 4392–4430 (2017)..

Upchurch, E. et al. An update on the use of Raman spectroscopy in molecular cancer diagnostics: current challenges and further prospects.Expert Rev. Mol. Diagn.18, 245–258 (2018)..

Jermyn, M. et al. A review of Raman spectroscopy advances with an emphasis on clinical translation challenges in oncology.Phys. Med. Biol.61, R370–R400 (2016)..

Austin, L. A., Osseiran, S.&Evans, C. L. Raman technologies in cancer diagnostics.Analyst141, 476–503 (2016)..

Wang, W. B. et al. Real-time in vivo cancer diagnosis using Raman spectroscopy.J. Biophotonics8, 527–545 (2015)..

Santos, I. P. et al. Raman spectroscopy for cancer detection and cancer surgery guidance: translation to the clinics.Analyst142, 3025–3047 (2017)..

Baker, M. J. et al. Clinical applications of infrared and Raman spectroscopy: state of play and future challenges.Analyst143, 1735–1757 (2018)..

Latka, I. et al. Fiber optic probes for linear and nonlinear Raman applications-current trends and future development.Laser Photonics Rev.7, 698–731 (2013)..

Krafft, C. et al. Diagnosis and screening of cancer tissues by fiber-optic probe Raman spectroscopy.Biomed. Spectrosc. Imaging1, 39–55 (2012)..

Pence, I.&Mahadevan-Jansen, A. Clinical instrumentation and applications of Raman spectroscopy.Chem. Soc. Rev.45, 1958–1979 (2016)..

Desroches,J. et al. A new method using Raman spectroscopy for in vivo targeted brain cancer tissue biopsy.Sci. Rep.8, 1792 (2018)..

St-Arnaud, K. et al. Development and characterization of a handheld hyperspectral Raman imaging probe system for molecular characterization of tissue on mesoscopic scales.Med. Phys.45, 328–339 (2018)..

Reisner, L. A. et al. A prototype biosensor-integrated image-guided surgery system.Int. J. Med. Robot. Comput. Assist. Surgry3,82–88 (2007)..

Lapeer, R. J. et al. Using a passive coordinate measurement arm for motion tracking of a rigid endoscope for augmented-reality image-guided surgery.Int. J. Med. Robot. Comput. Assist. Surgry10, 65–77 (2014)..

Ashok, P. C. et al. A Raman spectroscopy bio-sensor for tissue discrimination in surgical robotics.J. Biophotonics7, 103–109 (2014)..

GORPAS, D. et al. Real-time visualization of tissue surface biochemical features derived from fluorescence lifetime measurements.IEEE Trans. Med. Imaging35, 1802–1811 (2016)..

Yang, W. et al. Raman ChemLighter: fiber optic Raman probe imaging in combination with augmented chemical reality.J. Biophotonics12, e201800447 (2019)..

Lagarto, J. L. et al. Simultaneous fluorescence lifetime and Raman fiber-based mapping of tissues.Opt. Lett.45, 2247–2250 (2020)..

Huang, Z. W. et al. Rapid near-infrared Raman spectroscopy system for real-time in vivo skin measurements.Opt. Lett.26, 1782–1784 (2001)..

Huang, Z. W. et al. Near-infrared Raman spectroscopy for optical diagnosis of lung cancer.Int. J. Cancer107, 1047–1052 (2003)..

Nicolau, S. et al. Augmented reality in laparoscopic surgical oncology.Surg. Oncol.20, 189–201 (2011)..

Pratt, P. et al. Through the HoloLensTMlooking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels.Eur. Radiol. Exp.2, 2 (2018)..

Lee, D. et al. In vivo near infrared virtual intraoperative surgical photoacoustic optical coherence tomography.Sci. Rep.6, 35176 (2016)..

Morita, J. et al. MRI overlay system using optical see-through for marking assistance. InProceedings of the 2015 IEEE Virtual Reality (VR)239–240 (IEEE, 2015).

Tabrizi, L. B.&Mahvash, M. Augmented reality–guided neurosurgery: accuracy and intraoperative application of an image projection technique.J. Neurosurg.123, 206–211 (2015)..

Yang, L. et al. Vision-based endoscope tracking for 3D ultrasound image-guided surgical navigation.Comput. Med. Imaging Graph.40, 205–216 (2015)..

Mahmood, F. et al. Augmented reality and ultrasound education: initial experience.J. Cardiothorac. Vasc. Anesth.32, 1363–1367 (2018)..

Baek, S. J. et al. Baseline correction using asymmetrically reweighted penalized least squares smoothing.Analyst140, 250–257 (2015)..

Schie, I. W. et al. Direct comparison of fatty acid ratios in single cellular lipid droplets as determined by comparative Raman spectroscopy and gas chromatography.Analyst138, 6662–6670 (2013)..

Amidror, I. Scattered data interpolation methods for electronic imaging systems: a survey.J. Electron. Imaging11, 157–176 (2002)..

Rosin, P. L. Further five-point fit ellipse fitting.Graph. Models Image Process.61, 245–259 (1999)..

Wang, J.&Fleischmann, D. Improving spatial resolution at CT: development, benefits, and pitfalls.Radiology289, 261–262 (2018)..

Stucht, D. et al. Highest resolution in vivo human brain MRI using prospective motion correction.PLoS ONE10, e0133921 (2015)..

Yang, W. et al. Development and evaluation of ahand-held fiber-optic Raman probe with an integrated autofocus unit.Opt. Express28, 30760–30770 (2020)..

Barsky, S.&Petrou, M. The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows.IEEE Trans. Pattern Anal. Mach. Intell.25, 1239–1252 (2003)..

Zhang, Y. W. et al. A fast 3D reconstruction system with a low-cost camera accessory.Sci. Rep.5, 10909 (2015)..

Quéau, Y. et al. LED-based photometric stereo: modeling, calibration and numerical solution.J. Math. Imaging Vis.60, 313–340 (2018)..

Esteban, C. H., Vogiatzis, G.&Cipolla, R. Multiview photometric stereo.IEEE Trans. Pattern Anal. Mach. Intell.30, 548–554 (2008)..

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰