Abstract
Intravascular Optical Coherence Tomography (IVOCT) is considered as the gold standard for the atherosclerotic plaque analysis in clinical application. A continuous and accurate plaque tracking algorithm is critical for coronary heart disease diagnosis and treatment. However, continuous and accurate plaque tracking frame-by-frame is very challenging because of some difficulties from IVOCT imaging conditions, such as speckle noise, complex and various intravascular morphology, and large numbers of IVOCT images in a pullback. To address such a challenging problem, for the first time we proposed a novel Reinforcement Learning (RL) based framework for accurate and continuous plaque tracking frame-by-frame on IVOCT images. In this framework, eight transformation actions are well-designed for IVOCT images to fit any possible changes of plaque’s location and scale, and the spatio-temporal location correlation information of adjacent frames is modeled into state representation of RL to achieve continuous and accurate plaque detection, avoiding potential omissions. What’s more, the proposed method has strong expansibility, because the fully-automated and semi-automated tracking patterns are both allowed to fit the clinical practice. Experiments on the large-scale IVOCT data show that the plaque-level accuracy of the proposed method can achieve 0.89 and 0.94 for the fully-automated tracking pattern and semi-automated tracking pattern respectively. This proves that our method has big application potential in future clinical practice. The code is open accessible: https://github.com/luogongning/PlaqueRL.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gessert, N., et al.: Automatic plaque detection in IVOCT pullbacks using convolutional neural networks. IEEE Trans. Med. imaging 38(2), 426–434 (2019)
Jang, I.K., et al.: Visualization of coronary atherosclerotic plaques in patients using optical coherence tomography: comparison with intravascular ultrasound. J. Am. Coll. Cardiol. 39(4), 604–609 (2002)
Ughi, G.J., Adriaenssens, T., Sinnaeve, P., Desmet, W., D’hooge, J.: Automated tissue characterization of in vivo atherosclerotic plaques by intravascular optical coherence tomography images. Biomed. Opt. Express 4(7), 1014–1030 (2013)
Wang, Z., et al.: Semiautomatic segmentation and quantification of calcified plaques in intracoronary optical coherence tomography images. J. Biomed. Opt. 15(6), 061711 (2010)
Van Soest, G., et al.: Atherosclerotic tissue characterization in vivo by optical coherence tomography attenuation imaging. J. Biomed. Opt. 15(1), 011105 (2010)
Abdolmanafi, A., Duong, L., Dahdah, N., Cheriet, F.: Deep feature learning for automatic tissue classification of coronary artery using optical coherence tomography. Biomed. Opt. Express 8(2), 1203–1220 (2017)
He, S., et al.: Convolutional neural network based automatic plaque characterization for intracoronary optical coherence tomography images. In: Medical Imaging 2018: Image Processing, vol. 10574. International Society for Optics and Photonics (2018). 1057432
Oliveira, D.A., Macedo, M.M., Nicz, P., Campos, C., Lemos, P., Gutierrez, M.A.: Coronary calcification identification in optical coherence tomography using convolutional neural networks. In: Medical Imaging 2018: Biomedical Applications in Molecular, Structural, and Functional Imaging, vol. 10578. International Society for Optics and Photonics (2018). 105781Y
Caicedo, J.C., Lazebnik, S.: Active object localization with deep reinforcement learning. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2488–2496 (2015)
Yun, S., Choi, J., Yoo, Y., Yun, K., Young Choi, J.: Action-decision networks for visual tracking with deep reinforcement learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2711–2720 (2017)
Acknowledgments
This work was supported by the National Key R&D Program of China under Grant 2017YFC0113000.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Luo, G. et al. (2019). A Deep Reinforcement Learning Framework for Frame-by-Frame Plaque Tracking on Intravascular Optical Coherence Tomography Image. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11764. Springer, Cham. https://doi.org/10.1007/978-3-030-32239-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-32239-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32238-0
Online ISBN: 978-3-030-32239-7
eBook Packages: Computer ScienceComputer Science (R0)