skip to main content
10.1145/3498361.3538768acmconferencesArticle/Chapter ViewAbstractPublication PagesmobisysConference Proceedingsconference-collections
poster

Personalized health monitoring via vital sign measurements leveraging motion sensors on AR/VR headsets

Published: 27 June 2022 Publication History

Abstract

Augmented reality/virtual reality (AR/VR) headsets have attracted millions of users and gained predictable popularity. However, long-period usage of immersive technology may lead to health issues (e.g., cybersickness, anxiety). In this poster, we design a low-cost and personalized healthcare monitoring system grounded on vital sign tracking (i.e., breathing and heartbeat rate tracking), by exploiting built-in AR/VR motion sensors. The key insight is that the conductive vibrations induced by chest and heart movements can propagate through the user's cranial bones, thereby vibrating the AR/VR headset mounted on the user's head. To realize this system, we design signal processing techniques to cancel the human motions and derive the periods of breathing and heartbeat through frequency-domain analyses. We further design a user identification scheme based on respiratory and cardiac biometrics, which works with vital sign monitoring to provide personalized healthcare recommendations. Our experiment shows that the proposed scheme can achieve less than 5.7% error rate on breathing/heartbeat rate estimation and 95% accuracy on user identification.

References

[1]
Lucas Bastos, Thais Tavares, Denis Rosário, Eduardo Cerqueira, Aldri Santos, and Michele Nogueira. 2020. Double Authentication Model based on PPG and ECG Signals. In 2020 International Wireless Communications and Mobile Computing (IWCMC). 601--606.
[2]
statista. 2022. Number of virtual reality (VR) and augmented reality (AR) users in the United States from 2017 to 2023. https://www.statista.com/statistics/1017008/united-states-vr-ar-users/.
[3]
Tianming Zhao, Yan Wang, Jian Liu, Yingying Chen, Jerry Cheng, and Jiadi Yu. 2020. TrueHeart: Continuous Authentication on Wrist-worn Wearables Using PPG-based Biometrics. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications. 30--39.

Cited By

View all
  • (2025)State-of-the-art in real-time virtual interfaces for tractors and farm machines: A systematic reviewComputers and Electronics in Agriculture10.1016/j.compag.2025.109947231(109947)Online publication date: Apr-2025
  • (2024)UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997718:4(1-26)Online publication date: 21-Nov-2024

Index Terms

  1. Personalized health monitoring via vital sign measurements leveraging motion sensors on AR/VR headsets

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MobiSys '22: Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services
    June 2022
    668 pages
    ISBN:9781450391856
    DOI:10.1145/3498361
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2022

    Check for updates

    Author Tags

    1. AR/VR headsets
    2. user identification
    3. vital sign monitoring

    Qualifiers

    • Poster

    Funding Sources

    • National Science Foundation

    Conference

    MobiSys '22

    Acceptance Rates

    Overall Acceptance Rate 274 of 1,679 submissions, 16%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)41
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 30 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)State-of-the-art in real-time virtual interfaces for tractors and farm machines: A systematic reviewComputers and Electronics in Agriculture10.1016/j.compag.2025.109947231(109947)Online publication date: Apr-2025
    • (2024)UbiHR: Resource-efficient Long-range Heart Rate Sensing on Ubiquitous DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997718:4(1-26)Online publication date: 21-Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media