skip to main content
10.1145/3624062.3626085acmotherconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
research-article

Towards Rapid Autonomous Electron Microscopy with Active Meta-Learning

Published: 12 November 2023 Publication History

Abstract

We introduce a novel approach, Active Meta-learning, to improve computational control across various scientific experiments. It's particularly valuable for spectral reconstruction in STEM EELS nanoparticle plasmonic images. Traditionally, separate AI models were trained for each experiment via active learning, but this approach could face scalability issues with high-resolution data and the need for complex AI models due to intricate structure-property relationships. In this work we demonstrate the feasibility of learning AI structural representations across multiple experiments. We train a meta model from 10 prior experiments carried out such that the model can adapt to new unseen conditions in considerably less time than when trained from scratch. We utilize the Reptile algorithm, a first-order, model-agnostic meta-learning approach. To enhance and expand the meta-training dataset, conventional computer vision methods are applied to augment images from previous experiments. We observe up to ∼30-40% reduction in the number of training epochs for active learning exploration. The approach will be extended to distributed meta-learning workflows; meta-model trained in HPC datacenter using data from different microscopy sites and pushed to individual sites for active learning.

Supplemental Material

MP4 File
Recording of "Towards Rapid Autonomous Electron Microscopy with Active Meta-Learning" presentation at AI4S 2023.

References

[1]
Bhowmik, Debsindhu, Mukherjee, Debangshu, Oxley, Mark, Ziatdinov, Maxim, Jesse, Stephen, Kalinin, Sergei V., and Ovchinnikova, Olga. 2021. "Building an edge computing infrastructure for rapid multi-dimensional electron microscopy". United States. https://www.osti.gov/servlets/purl/1813209.
[2]
Mukherjee, Debangshu, Kevin M. Roccapriore, Anees Al-Najjar, Ayana Ghosh, Jacob Hinkle, Andrew R. Lupini, Rama K. Vasudevan, Sergei V. Kalinin, Olga S. Ovchinnikova, Maxim A. Ziatdinov and Nageswara S. V. Rao. “A Roadmap for Edge Computing Enabled Automated Multidimensional Transmission Electron Microscopy.” Microscopy Today 30 (2022): 10 - 19.
[3]
Al-Najjar, Anees, Nageswara S. V. Rao, Ramanan Sankaran, Maxim A. Ziatdinov, Debangshu Mukherjee, Olga S. Ovchinnikova, Kevin M. Roccapriore, Andrew R. Lupini and Sergei V. Kalinin. “Enabling Autonomous Electron Microscopy for Networked Computation and Steering.” 2022 IEEE 18th International Conference on e-Science (e-Science) (2022): 267-277.
[4]
Roccapriore, Kevin M., Sergei V. Kalinin and Maxim A. Ziatdinov. “Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy.” Advanced Science 9 (2021): n. pag.
[5]
Kalinin, Sergei V., Maxim A. Ziatdinov, Mahshid Ahmadi, Ayana Ghosh, Kevin M. Roccapriore, Yongtao Liu and Rama K. Vasudevan. “Designing Workflows for Materials Characterization.” (2023).
[6]
Nichol, Alex, Joshua Achiam and John Schulman. “On First-Order Meta-Learning Algorithms.” ArXiv abs/1803.02999 (2018)
[7]
Nichol, Alex & Schulman, John. (2018). Reptile: a Scalable Metalearning Algorithm. https://openai.com/research/reptile
[8]
Finn, Chelsea, P. Abbeel and Sergey Levine. “Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks.” International Conference on Machine Learning (2017).
[9]
Chitta, Kashyap, José Manuel Álvarez and Adam Lesnikowski. “Large-Scale Visual Active Learning with Deep Probabilistic Ensembles.” ArXiv abs/1811.03575 (2018).
[10]
Pengyu Yuan, Aryan Mobiny, Jahandar Jahanipour, Xiaoyang Li, Pietro Antonio Cicalese, Badrinath Roysam, Vishal Patel, Maric Dragan, and Hien Van Nguyen, “Few Is Enough: Task-Augmented Active Meta-Learning for Brain Cell Classification”, The Medical Image Computing and Computer Assisted Intervention Society Conference (2020)
[11]
Abu Al-Haija, Qasem & Adebanjo, Adeola. “Breast Cancer Diagnosis in Histopathological Images Using ResNet-50 Convolutional Neural Network”,(2020). 10.1109/IEMTRONICS51293.2020.9216455.
[12]
Gupta, Karan & Chawla, Nidhi. “Analysis of Histopathological Images for Prediction of Breast Cancer Using Traditional Classifiers with Pre-Trained CNN. Procedia Computer Science”, (2020). 167. 878-889. 10.1016/j.procs.2020.03.427.
[13]
Y. Ro, C. Xu, A. Ciborowska, S. Bhattacharya, F. Li and M. Foltin, "Dataset Efficient Training with Model Ensembling," 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada, 2023, pp. 4700-4704.
[14]
Python Optuna from: https://optuna.org

Cited By

View all
  • (2024)Active Learning Surrogates for Integrating Electron Microscopy and Computational Insights from Simulations in Autonomous ExperimentsProceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00270(2154-2161)Online publication date: 17-Nov-2024
  • (2024)Towards FAIR Workflows for Federated Experimental Sciences2024 IEEE Conference on Artificial Intelligence (CAI)10.1109/CAI59869.2024.00256(1436-1437)Online publication date: 25-Jun-2024

Index Terms

  1. Towards Rapid Autonomous Electron Microscopy with Active Meta-Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SC-W '23: Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis
    November 2023
    2180 pages
    ISBN:9798400707858
    DOI:10.1145/3624062
    Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 November 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Active Learning
    2. BO
    3. DKL
    4. DKLGPR
    5. EELS
    6. MAML
    7. Meta-learning
    8. Reptile
    9. STEM

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SC-W 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Active Learning Surrogates for Integrating Electron Microscopy and Computational Insights from Simulations in Autonomous ExperimentsProceedings of the SC '24 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis10.1109/SCW63240.2024.00270(2154-2161)Online publication date: 17-Nov-2024
    • (2024)Towards FAIR Workflows for Federated Experimental Sciences2024 IEEE Conference on Artificial Intelligence (CAI)10.1109/CAI59869.2024.00256(1436-1437)Online publication date: 25-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media