Integrate memory efficiency methods for self-supervised learning on pathological image analysis

Quan Liu; Bryan A. Millis; Zuhayr Asad; Can Cui; William F. Dean; Isabelle T. Smith; Christopher Madden; Joseph T. Roland; Jeffrey P. Zwerner; Shilin Zhao; Lee E. Wheless; Yuankai Huo

doi:10.1117/12.2607976

4 April 2022 Integrate memory efficiency methods for self-supervised learning on pathological image analysis

Quan Liu, Bryan A. Millis, Zuhayr Asad, Can Cui, William F. Dean, Isabelle T. Smith, Christopher Madden, Joseph T. Roland, Jeffrey P. Zwerner, Shilin Zhao, Lee E. Wheless, Yuankai Huo

Author Affiliations +

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120322M (2022) https://doi.org/10.1117/12.2607976
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Contrastive learning, a recent family of self-supervised learning, leverages pathological image analysis by learning from large-scale unannotated data. However, the state-of-the-art contrastive learning methods (e.g., SimCLR, BYOL) are typically limited by the more expensive computational hardware (with large GPU memory) as compared with traditional supervised learning approaches in achieving large training batch size. Fortunately, recent advances in the machine learning community provide multiple approaches to reduce GPU memory usage, such as (1) activation compressed training, (2) In-place activation, and (3) mixed precision training. Yet, such approaches are currently deployed independently without systematical assessments for contrastive learning. In this work, we applied these memory-efficient approaches into a self-supervised framework. The contribution of this paper is three-fold: (1) We combined previously independent GPU memory-efficient methods with self-supervised learning framework; (2) Our experiments are to maximize the memory efficiency via limited computational resources (a single GPU); (3) The self-supervised learning framework with GPU memory-efficient method allows a single GPU to triple the batch size that typically requires three GPUs. From the experimental results, contrastive learning model with larger batch size leads to higher accuracy enabled by GPU memory-efficient method on single GPU.

Citation Download Citation

Quan Liu, Bryan A. Millis, Zuhayr Asad, Can Cui, William F. Dean, Isabelle T. Smith, Christopher Madden, Joseph T. Roland, Jeffrey P. Zwerner, Shilin Zhao, Lee E. Wheless, and Yuankai Huo "Integrate memory efficiency methods for self-supervised learning on pathological image analysis", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120322M (4 April 2022); https://doi.org/10.1117/12.2607976

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available