skip to main content
10.1145/3573942.3574096acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Weakly-Supervised Estimation of Auroral Motion Field Via Iterative Pseudo Ground Truth Learning

Published: 16 May 2023 Publication History

Abstract

The small scale auroral structure is a far less explored field. Provided by auroral images which record the vivid auroral behaviors with satisfied temporal and spatial resolution, we are devoted to studying local auroral motions and the fine scale auroral activities. In order to estimate the auroral motion field, the method of optical flow is introduced to analyze auroral motion. However, the technology requires expensive dense annotations while training the network. Leveraged between the strong learning ability of the fully-supervised deep learning methods and the uncertainty of auroral data, we propose an iterative ground-truth learning approach to mine the pixel-level pseudo ground truth for auroral motion. Specifically, we first train a fully-supervised estimator on synthetic data via the Recurrent All-Pairs Field Transforms (RAFT) algorithm. The reconstructability and robustness of the estimated motion field are used as the criteria to measure applicability of the fully-supervised estimator for auroral images. Then, the mined motion fields as pseudo ground truths are in turn fed into the RAFT algorithms to fine-tune the fully-supervised estimator again, which is iterated until the high-quality pseudo ground truths for auroral data are found. Experiments on auroral data from the Yellow River Station demonstrate the effectiveness of our method. More and more pseudo ground truths of auroral data are used to gradually improve the estimated motion field results by refining the contextual features of auroral images. With iterative pseudo ground truth learning, estimated errors can be reduced effectively.

References

[1]
Syrjasuo M, Partamies N . Numeric Image Features for Detection of Aurora[J]. IEEE Geoscience & Remote Sensing Letters, 2012, 9(2):176-179.
[2]
Yang X, Gao X, Tian Q . Polar Embedding for Aurora Image Retrieval[J]. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, 2015, 24(11):3332-44.
[3]
Gao X, Rong F, Li X, Aurora image segmentation by combining patch and texture thresholding[J]. Computer Vision and Image Understanding, 2011, 115(3):390-402.
[4]
JAMES, J, GIBSON. On the analysis of change in the optic array[J]. Scandinavian Journal of Psychology, 1977.
[5]
Horn B, Schunck B G . Determining Optical Flow[J]. Artificial Intelligence, 1981, 17(1-3):185-203.
[6]
Fischer P, Dosovitskiy A, Ilg E, FlowNet: Learning Optical Flow with Convolutional Networks[J]. IEEE, 2016.
[7]
Ronneberger O, Fischer P, Brox T . U-Net: Convolutional Networks for Biomedical Image Segmentation[J]. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015.
[8]
Ilg E, Mayer N, Saikia T, FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks[J]. IEEE, 2017.
[9]
Ranjan A, Black M J . Optical Flow Estimation using a Spatial Pyramid Network[J]. arXiv e-prints, 2016.
[10]
Sun D, Yang X, Liu M Y, PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume[J]. 2017.
[11]
Teed Z, Deng J . RAFT: Recurrent All-Pairs Field Transforms for Optical Flow[J]. 2020.
[12]
Jiang S, Lu Y, Li H, Learning Optical Flow from a Few Matches[J]. 2021.
[13]
Luo K, Wang C, Liu S, UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning[J]. 2020.
[14]
Guan S, Li H, Zheng W S . Unsupervised Learning for Optical Flow Estimation Using Pyramid Convolution LSTM[J]. IEEE, 2019.
[15]
Wang G, Ren S, Wang H . NccFlow: Unsupervised Learning of Optical Flow With Non-occlusion from Geometry[J]. 2021.
[16]
Hu Z J, Yang H, D Huang, Synoptic distribution of dayside aurora: Multiple-wavelength all-sky observation at Yellow River Station in Ny-lesund, Svalbard[J]. Journal of Atmospheric and Solar-Terrestrial Physics, 2009, 71(8-9):794-804.
[17]
Niu C, Zhang J, Wang Q, Weakly supervised semantic segmentation for joint key local structure localization and classification of aurora image[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(12): 7133-7146.
[18]
Mayer N, Ilg E, Hausser P, A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation[J]. IEEE, 2016.
[19]
Chan K, Wang X, Yu K, BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond[J]. 2020.
[20]
Corpetti T, Memin E, Perez P . Dense Estimation of Fluid Flows[J]. Pattern Analysis & Machine Intelligence IEEE Transactions on, 2002, 24(3):365-380.
[21]
Thanammal K K, Vijayalakshmi R R, Arumugaperumal S, Effective Histogram Thresholding Techniques for Natural Images Using Segmentation[J]. J. Image Graph., 2014, 2(2).
[22]
Khan W. Image segmentation techniques: A survey[J]. Journal of Image and Graphics, 2013, 1(4): 166-170.

Index Terms

  1. Weakly-Supervised Estimation of Auroral Motion Field Via Iterative Pseudo Ground Truth Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
    September 2022
    1221 pages
    ISBN:9781450396899
    DOI:10.1145/3573942
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Auroral image
    2. Optical flow estimation
    3. Transfer learning
    4. Weakly supervised

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AIPR 2022

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 22
      Total Downloads
    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media