Using multi-task learning to improve diagnostic performance of convolutional neural networks

Mengjie Fang; Di Dong; Ruijia Sun; Li Fan; Yingshi Sun; Shiyuan Liu; Jie Tian

doi:10.1117/12.2512153

13 March 2019 Using multi-task learning to improve diagnostic performance of convolutional neural networks

Mengjie Fang, Di Dong, Ruijia Sun, Li Fan, Yingshi Sun, Shiyuan Liu, Jie Tian

Proceedings Volume 10950, Medical Imaging 2019: Computer-Aided Diagnosis; 109501V (2019) https://doi.org/10.1117/12.2512153
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Due to the complex biological and physical mechanisms, the correlations between the classification objects of clinical tasks and the medical imaging phenotype are always ambiguous and implied, which makes it difficult to train a powerful diagnostic convolutional neural network (CNN) model efficiently. In this study, we propose a generic multi-task learning (MTL) CNN framework to achieve higher classification accuracy and better generalization. The proposed framework is designed to carry out the major diagnostic task and several auxiliary tasks simultaneously. It encourages the models to learn more beneficial representation following the underlying relation among patients’ clinical characteristics, obvious imaging findings and quantitative imaging phenotype. We evaluate our approach on two clinical applications, namely advanced gastric cancer (AGC) serosa invasion diagnosis and discrimination of lung invasive adenocarcinoma manifesting as ground-glass nodule (GGN). Two datasets are utilized, which contain 357 AGC patients’ venous phase contrast-enhanced CT volumes and 236 GGN patients’ non-contrast CT volumes respectively. Several subjective CT morphology characteristics and common clinical characteristics are collected and used as the auxiliary tasks. To evaluate the generality of our strategy, CNNs with and without natural image-based pre-training are successively incorporated into the framework. The experimental results demonstrate that the proposed MTL CNN framework is able to improve the diagnostic performance significantly (7.4%-12.8% AUC increase and 3.5%-7.9% accuracy increase).

Conference Presentation

Citation Download Citation

Mengjie Fang, Di Dong, Ruijia Sun, Li Fan, Yingshi Sun, Shiyuan Liu, and Jie Tian "Using multi-task learning to improve diagnostic performance of convolutional neural networks", Proc. SPIE 10950, Medical Imaging 2019: Computer-Aided Diagnosis, 109501V (13 March 2019); https://doi.org/10.1117/12.2512153

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available