skip to main content
10.1145/3573942.3574049acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Keypoint Extraction of Auroral Arc Using Curvature-Constrained PointNet++

Published: 16 May 2023 Publication History

Abstract

The study of auroral morphology and evolution process is an effective tool to study the influence of solar wind on the Earth's magnetosphere-ionosphere, which can be used for space weather prediction. Aurora is caused by charged particles originating from the solar wind that precipitate along magnetic field lines toward Earth and collide with neutral constituents of the upper atmosphere. In this paper, we propose a new perspective for the study of auroras, which is no longer limited to morphological information but based on point sets. Specifically, the U-Net network is used to efficiently and accurately segment the aurora arc region, and then the aurora arc region is represented by a set of points. Considering the diversity of auroral shapes, we first calculate the curvature of the aurora arc and combine it with the aurora arc curvature image to constrain the number of keypoints extracted by the PointNet++. Experiments show that the extracted keypoints can represent the objects' structural information and local details well. In addition, it can be further applied to other tasks.

References

[1]
Li X, Ramachandran R, He M, Comparing different thresholding algorithms for segmenting auroras[C]// Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004. International Conference on. 2004.
[2]
Luo K, Meng F, Wu Q, Weakly Supervised Semantic Segmentation by Multiple Group Cosegmentation[C]// 2018 IEEE Visual Communications and Image Processing (VCIP). IEEE, 2018.
[3]
Lyu H, Fu H, Hu X, Esnet: Edge-Based Segmentation Network for Real-Time Semantic Segmentation in Traffic Scenes[C]// 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 2019.
[4]
Ronneberger O, Fischer P, Brox T . U-Net: Convolutional Networks for Biomedical Image Segmentation[C]// International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer International Publishing, 2015.
[5]
Long J, Shelhamer E, Darrell T . Fully Convolutional Networks for Semantic Segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 39(4):640-651.
[6]
Syrjasuo M, Partamies N . Numeric Image Features for Detection of Aurora[J]. IEEE Geoscience & Remote Sensing Letters, 2012, 9(2):176-179.
[7]
Yang X, Gao X, Tian Q . Polar Embedding for Aurora Image Retrieval[J]. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, 2015, 24(11):3332-44.
[8]
Gao X, Fu R, Li X L, Aurora image segmentation by combining patch and texture thresholding[J]. Computer Vision and Image Understanding, 2011.
[9]
Guo Y, Wang H, Hu Q, Deep Learning for 3D Point Clouds: A Survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, PP(99):1-1.
[10]
Elbaz G, Avraham T, Fischer A . 3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder[C]// Computer Vision & Pattern Recognition. IEEE Computer Society, 2017.
[11]
Han X F, Laga H, Bennamoun M . Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019.
[12]
Yu Z . Intrinsic shape signatures: A shape descriptor for 3D object recognition[C]// IEEE International Conference on Computer Vision Workshops. IEEE, 2010.
[13]
Qi C R, Su H, Mo K, PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2017.
[14]
Qi C R, Li Y, Hao S, PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space[C]// 2017.
[15]
Sipiran I, Bustos B . Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes[J]. Visual Computer, 2011, 27(11):963.
[16]
Sun J, Ovsjanikov M, Guibas L . A Concise and Provably Informative Multi-Scale Signature Based on Heat Diffusion[C]// John Wiley & Sons, Ltd. John Wiley & Sons, Ltd. 2009:1383-1392.
[17]
Tombari F, Salti S, Di Stefano L . Unique Signatures of Histograms for Local Surface Description[J]. Lecture Notes in Computer Science, 2010, 6313:356-369.
[18]
Jha D, Smedsrud P H, Riegler M A, Kvasir-SEG: A Segmented Polyp Dataset[C]// 26TH INTERNATIONAL CONFERENCE ON MULTIMEDIA MODELING. 2020.
[19]
Shi R, Xue Z, You Y, Skeleton Merger: an Unsupervised Aligned Keypoint Detector[C]// 2021.
[20]
Kipf T N, Welling M . Variational Graph Auto-Encoders[J]. 2016.
[21]
Koren Y, Bell R, Volinsky C . Matrix Factorization Techniques for Recommender Systems[J]. Computer, 2009, 42(8):30-37.
[22]
Nickel M, Murphy K, Tresp V, A Review of Relational Machine Learning for Knowledge Graphs[J]. Proceedings of the IEEE, 2015, 104(1):11-33.

Cited By

View all
  • (2024)SelfGeo: Self-supervised and Geodesic-Consistent Estimation of Keypoints on Deformable ShapesComputer Vision – ECCV 202410.1007/978-3-031-73013-9_5(71-88)Online publication date: 27-Nov-2024

Index Terms

  1. Keypoint Extraction of Auroral Arc Using Curvature-Constrained PointNet++

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
    September 2022
    1221 pages
    ISBN:9781450396899
    DOI:10.1145/3573942
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Curvature
    2. Keypoint
    3. PointNet++
    4. Self-adaption

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AIPR 2022

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)SelfGeo: Self-supervised and Geodesic-Consistent Estimation of Keypoints on Deformable ShapesComputer Vision – ECCV 202410.1007/978-3-031-73013-9_5(71-88)Online publication date: 27-Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media