Automatic localization of anatomical landmarks in cardiac MR perfusion using random forests

https://doi.org/10.1016/j.bspc.2017.07.001Get rights and content

Highlights

Abstract

Automatic localization of anatomical landmarks in myocardial perfusion magnetic resonance (MR) data is considered to be a preliminary step toward fully automatic quantification of regional upslope or blood flow in the myocardium. The goal of this work is to develop an automatic method based on supervised learning and detect anatomical landmarks with high accuracy from myocardial perfusion MR data. Dynamic contrast enhanced myocardial MR perfusion data were acquired using a standard perfusion sequence. To effectively extract characteristic features for left ventricle (LV) center point and anterior right ventricle (RV) insertion point, we performed feature extraction of the two landmarks independently from an LV enhancement frame and an RV enhancement frame. Feature extraction of pixel intensity, Sobel gradient, and Haar-like features was performed. Cross-validation from training data was used to build a random forests classifier. We used 38 subjects’ data as training datasets and 21 subjects’ data as test datasets. The proposed method provided high accuracy in localization of the LV center point and anterior RV insertion point. The mean (±SD) localization errors of the proposed method were 3.38 (±2.36) mm for the LV center point and 4.23 (±1.97) mm for the anterior RV insertion point. The proposed method shows the potential to automatically localize anatomical landmarks for the segmental analysis of myocardial perfusion in MRI.

Introduction

Automatic localization of anatomical landmarks is an important preliminary step toward fully automatic processing of myocardial perfusion MR data. In myocardial MR perfusion analysis [1], anatomical landmarks can be the LV center point and RV anterior insertion point (see Fig. 1a). After the identification of these locations, one can divide the myocardium into regional myocardial segments [2] (see Fig. 1a) and obtain myocardial perfusion indices (e.g., myocardial blood flow, upslope) in each myocardial segment (see Fig. 1b) [3], [4]. This segmental analysis helps regional quantitative assessment of myocardial ischemia which is likely to result from stenosis of one of three main coronary arteries [1].

Landmark localization in cardiac MR perfusion has not been a primary topic of research, and the procedures of localizing the RV insertion point were introduced in the literature. Weng et al. found the RV insertion point by searching for the uppermost pixel in the right ventricular blood pool that touches the myocardium [5]. However, this method relied on the performance of myocardial segmentation in which automatic and accurate segmentation of the myocardium in cardiac MR perfusion is a challenging task [6]. In Tarroni et al. [7], the user manually identified the anterior point of insertion of the RV free wall into the interventricular septum. This manual procedure is tedious and is subject to intra or inter-subject variabilities. Automatic selection of the landmarks would be beneficial since it is objective and serves as a sub-procedure for fully automating the regional quantification of myocardial perfusion.

Several research groups have investigated supervised learning based approaches for automatic detection and localization of anatomical landmarks in a variety of biomedical imaging applications [8], [9], [10], [11], [12], [13]. Vandaele et al. extracted a vector of visual features at different resolutions for each labeled pixel and used a randomized forests algorithm to accurately detect the landmarks in unseen X-ray cephalometry images [9]. Stern et al. used a random forests classifier [14] and applied it to zebrafish images [10]. Lu et al. adopted a joint context based approach to automatically detect the apex and the two basal annulus points from a single cardiac cine MR long axis slice [11]. Sedai et al. extracted multiscale histogram of oriented gradients (HOG) descriptors and applied a random forests classifier to RV landmark detection in cardiac cine MR data [12]. Mahapatra used a combination of graph cut segmentation, low level features, and random forests classifier to detect landmarks in long and short axis orientations of cardiac cine MR data [13].

In this work we apply a supervised learning approach based on random forests to myocardial MR perfusion data. To our knowledge, automatic localization of anatomical landmarks using machine learning has not been demonstrated in cardiac perfusion MR dataset in the literature. As myocardial MR perfusion data contain multiple frames reflecting the sequential dynamic contrast enhancement in the RV blood pool, and LV blood pool, followed by the myocardium, we obtain features for RV insertion point detection from an RV enhancement frame and features for LV center point detection from an LV enhancement frame, respectively. We present image processing procedures for feature extraction and assess cross-validation results of the random forests model. Finally, we demonstrate the performance of model prediction in detecting the two landmarks in 21 test subjects.

Section snippets

Experimental setup

MRI scans were performed on a 1.5T scanner (Siemens Avanto, Erlangen, Germany). A body coil was used for radiofrequency (RF) transmission, and a 32-channel phased-array receiver coil was used for RF signal reception. For stress perfusion imaging, adenosine was injected at 140 μg/kg/min for 3 min before perfusion imaging, and the adenosine infusion continued during perfusion imaging. A single bolus of Gd-DTPA was injected into the subject’s antecubital vein. The subject was scanned immediately

Results

Fig. 6 shows 5-fold cross-validation results for the cases of LV center point and RV insertion point. Although the plots do not exhibit a monotonically increasing pattern, the average cross-validation score increases as the number of trees increases. Since an increase in the number of trees results in an increase in computation time, we chose an appropriate number of trees by trading off between computation cost and cross-validation accuracy. In this work, we empirically chose 25 trees for the

Discussion

We have demonstrated fully automatic localization of RV anterior insertion point and LV center point using supervised learning in myocardial perfusion MR data. Typically, the RV anterior insertion point is manually selected by the user for segmental analysis of myocardial perfusion. The LV center point can serve as a seed point for region growing or level set segmentation in endocardial border detection as well as being used to divide the myocardium into 6 or 4 segments in basal, mid, and

Conclusions

We have demonstrated the feasibility of an automatic landmark detection method for MR perfusion data analysis. The proposed method is based on random forests classifier and extracts features for the LV center point and RV insertion point from the LV enhanced frame and RV enhanced frame, respectively. The proposed landmark localization shows the potential to fully automate the quantification of regional myocardial blood flow and upslope in cardiac MR perfusion.

Acknowledgements

This work was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT, and Future Planning (Grant Number: 2015 R1C1A1A02036340).

References (25)

  • O. Stern et al.

    Automatic localization of interest points in zebrafish images with tree-based methods

    Pattern Recog. Bioinform.

    (2011)
  • X. Lu et al.

    Discriminative joint context for automatic landmark set detection from a single cardiac MR long axis slice

    International Conference on Functional Imaging and Modeling of the Heart

    (2009)
  • Cited by (13)

    • Hybrid curvature-geometrical detection of landmarks for the automatic analysis of the reduction of supracondylar fractures of the femur

      2022, Computer Methods and Programs in Biomedicine
      Citation Excerpt :

      Furthermore, surgical procedures like cardiac interventions require knowing several parameters of the heart performance. Kim et al. [12] proposed a supervised machine learning approach to automatically localize the left ventricle center and the anterior right ventricle insertion point to quantify the blood flow. In addition, Zheng et al. [13] presented a discriminative learning algorithm to segment aortic landmarks for valve implanting surgery.

    • Techniques for automatic landmark detection of human tissue

      2022, Digital Human Modeling and Medicine: The Digital Twin
    • Deep learning applications in myocardial perfusion imaging, a systematic review and meta-analysis

      2022, Informatics in Medicine Unlocked
      Citation Excerpt :

      The applications of deep learning on stress perfusion CMR has been increasing in recent years. There are some promising data on the effectiveness of using deep learning with CNNs to the pre-processing stage of perfusion quantification in CMR by automated identification of anatomical landmarks, such as the right ventricle (RV) insertion point into the septum and left ventricle (LV) centre on peak contrast enhancement [23,31,43]. Furthermore, CNN algorithms have been successfully applied to the segmentation of CMR perfusion images [27,30] with high performance.

    View all citing articles on Scopus
    View full text