skip to main content
10.1145/3197768.3201533acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

Multidimensional Trajectory Similarity Estimation via Spatial-Temporal Keyframe Selection and Signal Correlation Analysis

Published: 26 June 2018 Publication History

Abstract

In this paper, we present a framework for trajectory matching in asynchronous time sequences. The proposed methodology is applied on sequences of traditional Greek dances to quantify the choreographic similarity between them, using body joints' position and orientation, as well as the temporal dimension as inputs. The adopted methodology uses a two-step approach over the provided body joints' trajectories: a) representative frame selection and b) keyframe comparison. The dance act is captured using a single, markerless, low-cost sensor. The recorded sequence is summarized by selecting the most descriptive frames, which are then compared to other dances' keyframes to calculate similarity scores.

References

[1]
K. Dimitropoulos et al., "Capturing the intangible an introduction to the i-Treasures project," in 2014 International Conference on Computer Vision Theory and Applications (VISAPP), 2014, vol. 2, pp. 773--781.
[2]
A. Shay and B. Sellers-Young, "Dance and Ethnicity," Jul. 2016.
[3]
M. Ioannides et al., "Online 4d Reconstruction Using Multi-Images Available Under Open Access," ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., vol. II-5/W1, pp. 169--174, Jul. 2013.
[4]
G. Kyriakaki et al., "4D Reconstruction of Tangible Cultural Heritage Objects from Web-Retrieved Images," Int. J. Herit. Digit. Era, vol. 3, no. 2, pp. 431--452, Jun. 2014.
[5]
A. D. Doulamis, N. D. Doulamis, K. Makantasis, and M. Klein, "A 4D Virtual/Augmented Reality Viewer Exploiting Unstructured Web-based Image Data.," in VISAPP, 2015, pp. 631--639.
[6]
A. Voulodimos, N. Doulamis, D. Fritsch, K. Makantasis, A. Doulamis, and M. Klein, "Four-dimensional reconstruction of cultural heritage sites based on photogrammetry and clustering," J. Electron. Imaging, vol. 26, no. 1, p. 011013, Nov. 2016.
[7]
N. Doulamis, A. Doulamis, C. Ioannidis, M. Klein, and M. Ioannides, "Modelling of Static and Moving Objects: Digitizing Tangible and Intangible Cultural Heritage," in Mixed Reality and Gamification for Cultural Heritage, Springer, Cham, 2017, pp. 567--589.
[8]
A. Kitsikidis, K. Dimitropoulos, E. Yilmaz, S. Douka, and N. Grammalidis, "Multi-sensor Technology and Fuzzy Logic for Dancer's Motion Analysis and Performance Evaluation within a 3D Virtual Environment," in Universal Access in Human-Computer Interaction. Design and Development Methods for Universal Access, 2014, pp. 379--390.
[9]
A. Kitsikidis, K. Dimitropoulos, S. Douka, and N. Grammalidis, "Dance analysis using multiple Kinect sensors," in 2014 International Conference on Computer Vision Theory and Applications (VISAPP), 2014, vol. 2, pp. 789--795.
[10]
K. Dimitropoulos, P. Barmpoutis, A. Kitsikidis, and N. Grammalidis, "Classification of Multidimensional Time-Evolving Data using Histograms of Grassmannian Points," IEEE Trans. Circuits Syst. Video Technol., vol. PP, no. 99, pp. 1--1, 2016.
[11]
A. Voulodimos, D. Kosmopoulos, G. Veres, H. Grabner, L. Van Gool, and T. Varvarigou, "Online classification of visual tasks for industrial workflow monitoring," Neural Netw., vol. 24, no. 8, pp. 852--860, Oct. 2011.
[12]
A. Laggis, N. Doulamis, E. Protopapadakis, and A. Georgopoulos, "a Low-Cost Markerless Tracking System for Trajectory Interpretation," ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., pp. 413--418, 2017.
[13]
E. Protopapadakis, A. Grammatikopoulou, A. Doulamis, and N. Grammalidis, "Folk Dance Pattern Recognition Over Depth Images Acquired via Kinect Sensor," in 3D ARCH - 3D Virtual Reconstruction and Visualization of Complex Architectures, Nafplio, Greece, 2017.
[14]
E. Protopapadakis, A. Voulodimos, A. Doulamis, and S. Camarinopoulos, "A Study on the Use of Kinect Sensor in Traditional Folk Dances Recognition via Posture Analysis," in Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, New York, NY, USA, 2017, pp. 305--310.
[15]
I. Rallis, I. Georgoulas, N. Doulamis, A. Voulodimos, and P. Terzopoulos, "Extraction of key postures from 3D human motion data for choreography summarization," in 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), 2017, pp. 94--101.
[16]
A. Doulamis et al., "5D modelling: an efficient approach for creating spatiotemporal predictive 3D maps of large-scale cultural resources," ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., vol. 2, no. 5, p. 61, 2015.
[17]
A. Doulamis et al., "Selective 4D modelling framework for spatial-temporal land information management system," in Third International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2015), 2015, vol. 9535, p. 953506.
[18]
E. Protopapadakis, A. Voulodimos, A. Doulamis, S. Camarinopoulos, N. Doulamis, and G. Miaoulis, "Dance Pose Identification from Motion Capture Data: A Comparison of Classifiers," Technologies, vol. 6, no. 1, p. 31, Mar. 2018.
[19]
M. Daszykowski, B. Walczak, and D. L. Massart, "Representative subset selection," Anal. Chim. Acta, vol. 468, no. 1, pp. 91--103, Sep. 2002.
[20]
E. Protopapadakis and A. Doulamis, "Semi-Supervised Image Meta-Filtering Using Relevance Feedback in Cultural Heritage Applications," Int. J. Herit. Digit. Era, vol. 3, no. 4, pp. 613--627, Dec. 2014.
[21]
E. Protopapadakis, A. Voulodimos, A. Doulamis, N. Doulamis, D. Dres, and M. Bimpas, "Stacked Autoencoders for Outlier Detection in Over-The-Horizon Radar Signals," 2017.
[22]
A. Grammatikopoulou, S. Laraba, O. Sahbenderoglu, K. Dimitropoulos, and N. Grammalidis, "An adaptive framework for the creation of bodymotion-based games," in 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), 2017, pp. 209--216.
[23]
M. Daszykowski, B. Walczak, and D. L. Massart, "Looking for Natural Patterns in Analytical Data. 2. Tracing Local Density with OPTICS," J. Chem. Inf. Comput. Sci., vol. 42, no. 3, pp. 500--507, May 2002.

Cited By

View all
  • (2020)Digitizing the IntangibleRecent Advances in 3D Imaging, Modeling, and Reconstruction10.4018/978-1-5225-5294-9.ch004(79-107)Online publication date: 2020
  • (2019)Choreographic Pattern Analysis from Heterogeneous Motion Capture Systems Using Dynamic Time WarpingTechnologies10.3390/technologies70300567:3(56)Online publication date: 16-Aug-2019
  • (2018)Physics-based keyframe selection for human motion summarizationMultimedia Tools and Applications10.1007/s11042-018-6935-zOnline publication date: 7-Dec-2018

Index Terms

  1. Multidimensional Trajectory Similarity Estimation via Spatial-Temporal Keyframe Selection and Signal Correlation Analysis

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference
    June 2018
    591 pages
    ISBN:9781450363907
    DOI:10.1145/3197768
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • NSF: National Science Foundation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Trajectory similarity
    2. dance
    3. representative frames
    4. similarity assessment
    5. skeleton data

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    PETRA '18

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)Digitizing the IntangibleRecent Advances in 3D Imaging, Modeling, and Reconstruction10.4018/978-1-5225-5294-9.ch004(79-107)Online publication date: 2020
    • (2019)Choreographic Pattern Analysis from Heterogeneous Motion Capture Systems Using Dynamic Time WarpingTechnologies10.3390/technologies70300567:3(56)Online publication date: 16-Aug-2019
    • (2018)Physics-based keyframe selection for human motion summarizationMultimedia Tools and Applications10.1007/s11042-018-6935-zOnline publication date: 7-Dec-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media