skip to main content
10.1145/3615834.3615856acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiwoarConference Proceedingsconference-collections
poster

Preliminary studies of measuring skateboarding forces by combining inertial sensors and camera-based pose estimation.

Published: 11 October 2023 Publication History

Abstract

Understanding acceleration forces and making progress in learning Skateboarding is a process of trial and error. In our paper we are describing our preliminary experiments for describing the complex interactions while pushing for speed in ramps and pump tracks. Therefore, we capture and visualize the body movement, the joint relations from hip to ankle and the resulting forces by joining inertial sensors on the skateboard and camera-based machine learning pose estimation of the athlete.

References

[1]
Abdullah, M.A., Ibrahim, M.A.R., Shapiee, M.N.A.B., Mohd Razman, M.A., Musa, R.M. and Abdul Majeed, A.P.P. 2020. The Classification of Skateboarding Trick Manoeuvres Through the Integration of IMU and Machine Learning. Intelligent Manufacturing and Mechatronics (Singapore, 2020), 67–74.
[2]
Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F. and Grundmann, M. 2020. BlazePose: On-device Real-time Body Pose tracking. arXiv.
[3]
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E. and Sheikh, Y. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv.
[4]
Colaboratory, T. 2017. Google Colaboratory.
[5]
Groh, B.H., Kautz, T., Schuldhaus, D. and Eskofier, B.M. 2015. IMU-based trick classification in skateboarding. KDD workshop on large-scale sports analytics (2015).
[6]
Hennermann, C. and deLahunta, S. 2013. Motion Bank: starting points & aspirations = Motion Bank: ansatzpunkte & intentionen. Motion Bank/The Forsythe Company.
[7]
Hubbard, M. 1980. Human control of the skateboard. Journal of Biomechanics. 13, 9 (1980), 745–754.
[8]
Hubbard, M. 1979. Lateral dynamics and stability of the skateboard. (1979).
[9]
ITP, N. 2018. Ml5js: Friendly machine learning for the web. Retrieved June. 15, (2018), 2018.
[10]
Keays, G. and Dumas, A. 2014. Longboard and skateboard injuries. Injury. 45, 8 (2014), 1215–1219.
[11]
Kendall, A., Grimes, M. and Cipolla, R. 2015. PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization. (2015), 2938–2946.
[12]
Kreiss, S., Bertoni, L. and Alahi, A. 2021. Openpifpaf: Composite fields for semantic keypoint detection and spatio-temporal association. IEEE Transactions on Intelligent Transportation Systems. (2021).
[13]
Kuleshov, A.S. 2006. Mathematical model of the skateboard. ISBS-Conference Proceedings Archive (2006).
[14]
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P. and Zitnick, C.L. 2014. Microsoft coco: Common objects in context. Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13 (2014), 740–755.
[15]
Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.-L., Yong, M.G., Lee, J., and others 2019. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172. (2019).
[16]
Nicla Sense ME: https://store.arduino.cc/products/nicla-sense-me. Accessed: 2023-01-19.
[17]
OpenKinect 2011. OpenKinect: Open Source Drivers for Kinect v1.
[18]
Rosatello, M., Dion, J.-L., Renaud, F. and Garibaldi, L. 2015. The Skateboard Speed Wobble. IDETC-CIE2015 (Volume 6: 11th International Conference on Multibody Systems, Nonlinear Dynamics, and Control, Aug. 2015).
[19]
Runway - Next-generation creation suite: 2023. https://runwayml.com. Accessed: 2023-01-19.
[20]
Sandberg, E. 2019. Creative Coding on the Web in p5.js: A Library Where JavaScript Meets Processing.
[21]
Sárándi, I., Linder, T., Arras, K.O. and Leibe, B. 2021. MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation. IEEE Transactions on Biometrics, Behavior, and Identity Science. 3, 1 (Jan. 2021), 16–30.
[22]
Severance, C. 2014. Massimo banzi: Building arduino. Computer. 47, 1 (2014), 11–12.
[23]
Smart sensor BHI260AP: https://www.bosch-sensortec.com/products/smart-sensors/bhi260ap/. Accessed: 2023-03-25.
[24]
The Intel®3D Athlete Tracking (3DAT) scalable architecture deploys pose estimation models using Amazon Kinesis Data Streams and Amazon EKS | AWS Machine Learning Blog: 2022. https://aws.amazon.com/blogs/machine-learning/the-intel3d-athlete-tracking-3dat-scalable-architecture-deploys-pose-estimation-models-using-amazon-kinesis-data-streams-and-amazon-eks/. Accessed: 2023-03-25.
[25]
Villaroman, N., Rowe, D. and Swan, B. 2011. Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor. Proceedings of the 2011 conference on Information technology education (2011), 227–232.
[26]
Warden, P. and Situnayake, D. 2019. Tinyml: Machine learning with tensorflow lite on arduino and ultra-low-power microcontrollers. O'Reilly Media.
[27]
Zöllner, M., Zapf, A., Truong, N.D. and Scheer, S. 2016. okinesio: the development of open hardware for quantified self. Proceedings of the 3rd International Workshop on Sensor-based Activity Recognition and Interaction (New York, NY, USA, Jun. 2016), 1–5.
[28]
2022. One More Try - an experimental skate video.

Index Terms

  1. Preliminary studies of measuring skateboarding forces by combining inertial sensors and camera-based pose estimation.
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        iWOAR '23: Proceedings of the 8th international Workshop on Sensor-Based Activity Recognition and Artificial Intelligence
        September 2023
        171 pages
        ISBN:9798400708169
        DOI:10.1145/3615834
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 11 October 2023

        Check for updates

        Author Tags

        1. Data Visualization
        2. Embedded Computing
        3. Machine Learning

        Qualifiers

        • Poster
        • Research
        • Refereed limited

        Conference

        iWOAR 2023

        Acceptance Rates

        Overall Acceptance Rate 46 of 73 submissions, 63%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 43
          Total Downloads
        • Downloads (Last 12 months)26
        • Downloads (Last 6 weeks)2
        Reflects downloads up to 22 Jan 2025

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media