Vivek Chandel
Avik Ghose
ABSTRACT
In this work, we demonstrate a radically novel approach towards inertial-only tracking of wrist in real-time on a smartwatch for air-writing tasks. Deriving motion trajectories from commercial-grade Inertial Measurement Units (IMU) has always been a challenging task due to inherent sensor errors and associated trajectory drift. Computationally expensive solutions offered in literature cannot be used for a fully real-time tracking while also maintaining acceptable accuracy. This work presents 'NNTrak', marking our attempt to address these issues using a Convolutional Neural Network (CNN), which is trained to learn various strokes of the wrist and efficiently generates motion trajectory in real-time for air-writing. For this demonstration, we show computationally constrained Raspberry Pi 3B running our solution and a smartwatch worn while drawing a gesture in air with the trajectory being displayed in true real-time.
- Vivek Chandel, Shivam Singhal, and Avik Ghose. 2020. Airite: Towards accurate & infrastructure-free 3-d tracking of smart devices. In 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 1--6.Google Scholar
Cross Ref
- Vivek Chandel, Shivam Singhal, Varsha Sharma, Nasimuddin Ahmed, and Avik Ghose. 2019. Pi-sole: A low-cost solution for gait monitoring using off-the-shelf piezoelectric sensors and imu. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 3290--3296.Google ScholarCross Ref
- Neha Dawar, Sarah Ostadabbas, and Nasser Kehtarnavaz. 2018. Data augmentation in deep learning-based fusion of depth and inertial sensing for action recognition. IEEE Sensors Letters 3, 1 (2018), 1--4.Google ScholarCross Ref
- Nermine Hendy, Haytham M. Fayek, and Akram Al-Hourani. 2022. Deep Learning Approaches for Air-Writing Using Single UWB Radar. IEEE Sensors Journal 22, 12 (2022), 11989--12001. Google ScholarCross Ref
- Sheng Shen, He Wang, and Romit Roy Choudhury. 2016. I am a smartwatch and i can track my user's arm. In Proceedings of the 14th annual international conference on Mobile systems, applications, and services. 85--96.Google ScholarDigital Library
- Edwin Valarezo Añazco, Seung Ju Han, Kangil Kim, Patricio Rivera Lopez, Tae-Seong Kim, and Sangmin Lee. 2021. Hand gesture recognition using single patchable six-axis inertial measurement unit via recurrent neural networks. Sensors 21, 4 (2021), 1404.Google ScholarCross Ref
Index Terms
- NNTrak: Real-Time Wrist Tracking Using Smartwatch with CNN
Recommendations
Activity Recognition using Head Worn Inertial Sensors
iWOAR '18: Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and InteractionHuman activity recognition using inertial sensors is an increasingly used feature in smartphones or smartwatches, providing information on sports and physical activities of each individual. But while the position a smartphone is worn in varies between ...
Detecting Compensatory Trunk Movements in Stroke Survivors using a Wearable System
WearSys '17: Proceedings of the 2017 Workshop on Wearable Systems and ApplicationsBecause of the redundancy in the human body, stroke survivors often use atypical compensatory movements, such as reaching with trunk motion to compensate for deficits in arm function. Prior studies have established that minimizing these compensatory ...
Body sensor networks to evaluate standing balance: interpreting muscular activities based on inertial sensors
HealthNet '08: Proceedings of the 2nd International Workshop on Systems and Networking Support for Health Care and Assisted Living EnvironmentsIn this paper, we present a system that integrates inertial sensors and electromyogram (EMG) signals, which measures the muscular activities while performing motions. The objective of our study is to investigate the behaviour of the EMG signals to ...
Comments