Sheng Shen
ABSTRACT
A rich body of work has focused on motion tracking techniques using inertial sensors, namely accelerometers, gyroscopes, and magnetometers. Applications of these techniques are in indoor localization, gesture recognition, inventory tracking, vehicular motion, and many others. This paper identifies room for improvement over today's motion tracking techniques. The core observation is that conventional systems have trusted gravity more than the magnetic North to infer the 3D orientation of the object. We find that the reverse is more effective, especially when the object is in continuous fast motion. We leverage this opportunity to design MUSE, a magnetometer-centric sensor fusion algorithm for orientation tracking. Moreover, when the object's motion is somewhat restricted (e.g., human-arm motion restricted by elbow and shoulder joints), we find new methods of sensor fusion to fully leverage the restrictions. Real experiments across a wide range of uncontrolled scenarios show consistent improvement in orientation and location accuracy, without requiring any training or machine learning. We believe this is an important progress in the otherwise mature field of IMU-based motion tracking.
- “Grush smart oral care,” https://www.grushgamer.com/.Google Scholar
- Billur Barshan and Hugh F Durrant-Whyte, “Inertial navigation systems for mobile robots,” IEEE Transactions on Robotics and Automation, vol. 11, no. 3, pp. 328--342, 1995.Google ScholarCross Ref
- Jo ao Lu'is Marins, Xiaoping Yun, Eric R Bachmann, Robert B McGhee, and Michael J Zyda, “An extended Kalman filter for quaternion-based orientation estimation using MARG sensors,” in Intelligent Robots and Systems, 2001. Proceedings. 2001 IEEE/RSJ International Conference on. IEEE, 2001, vol. 4, pp. 2003--2011.Google ScholarCross Ref
- Angelo M Sabatini, “Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing,” IEEE Transactions on Biomedical Engineering, vol. 53, no. 7, pp. 1346--1356, 2006.Google ScholarCross Ref
- Sebastian OH Madgwick, Andrew JL Harrison, and Ravi Vaidyanathan, “Estimation of IMU and MARG orientation using a gradient descent algorithm,” in Rehabilitation Robotics (ICORR), 2011 IEEE International Conference on. IEEE, 2011, pp. 1--7.Google ScholarCross Ref
- Hyung-Jik Lee and Seul Jung, “Gyro sensor drift compensation by Kalman filter to control a mobile inverted pendulum robot system,” in Industrial Technology, 2009. ICIT 2009. IEEE International Conference on. IEEE, 2009, pp. 1--6. Google ScholarDigital Library
- Mark Euston, Paul Coote, Robert Mahony, Jonghyuk Kim, and Tarek Hamel, “A complementary filter for attitude estimation of a fixed-wing uav,” in Intelligent Robots and Systems, 2008. IROS 2008. IEEE/RSJ International Conference on. IEEE, 2008, pp. 340--345.Google ScholarCross Ref
- Eric R Bachmann, Robert B McGhee, Xiaoping Yun, and Michael J Zyda, “Inertial and magnetic posture tracking for inserting humans into networked virtual environments,” in Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 2001, pp. 9--16. Google ScholarDigital Library
- John L Crassidis, F Landis Markley, and Yang Cheng, “Survey of nonlinear attitude estimation methods,” Journal of guidance, control, and dynamics, vol. 30, no. 1, pp. 12--28, 2007.Google ScholarCross Ref
- Haiyang Chao, Calvin Coopmans, Long Di, and YangQuan Chen, “A comparative evaluation of low-cost IMUs for unmanned autonomous systems,” in Multisensor Fusion and Integration for Intelligent Systems (MFI), 2010 IEEE Conference on. IEEE, 2010, pp. 211--216.Google ScholarCross Ref
- P. Zhou, M. Li, and G. Shen, “Use it free: Instantly knowing your phone attitude,” in Proceedings of the 20th annual international conference on Mobile computing and networking. ACM, 2014, pp. 605--616. Google ScholarDigital Library
- Sheng Shen, He Wang, and Romit Roy Choudhury, “I am a smartwatch and i can track my user's arm,” in Proceedings of the 14th annual international conference on Mobile systems, applications, and services, 2016. Google ScholarDigital Library
- Mahmoud El-Gohary, Sean Pearson, and James McNames, “Joint angle tracking with inertial sensors,” in Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE. IEEE, 2008, pp. 1068--1071.Google ScholarCross Ref
- M. El-Gohary and J. McNames, “Shoulder and elbow joint angle tracking with inertial sensors,” Biomedical Engineering, IEEE Transactions on, vol. 59, no. 9, pp. 2635--2641, 2012.Google ScholarCross Ref
- Jarosław Go'sli'nski, Michał Nowicki, and Piotr Skrzypczy'nski, “Performance comparison of EKF-based algorithms for orientation estimation on android platform,” IEEE Sensors Journal, vol. 15, no. 7, pp. 3781--3792, 2015.Google ScholarCross Ref
- Michał Nowicki, Jan Wietrzykowski, and Piotr Skrzypczy'nski, “Simplicity or flexibility? complementary filter vs. EKF for orientation estimation on mobile devices,” in Cybernetics (CYBCONF), 2015 IEEE 2nd International Conference on. IEEE, 2015, pp. 166--171.Google ScholarCross Ref
- Nguyen Ho Quoc Phuong, Hee-Jun Kang, Young-Soo Suh, and Young-Sik Ro, “A DCM based orientation estimation algorithm with an inertial measurement unit and a magnetic compass,” Journal of Universal Computer Science, vol. 15, no. 4, pp. 859--876, 2009.Google Scholar
- Ezzaldeen Edwan, Jieying Zhang, Junchuan Zhou, and Otmar Loffeld, “Reduced DCM based attitude estimation using low-cost IMU and magnetometer triad,” in Positioning Navigation and Communication (WPNC), 2011 8th Workshop on. IEEE, 2011, pp. 1--6.Google ScholarCross Ref
- Håvard Fjær Grip, Thor I Fossen, Tor A Johansen, and Ali Saberi, “Globally exponentially stable attitude and gyro bias estimation with application to gnss/ins integration,” Automatica, vol. 51, pp. 158--166, 2015. Google ScholarDigital Library
- M Romanovas, L Klingbeil, M Trachtler, and Y Manoli, “Efficient orientation estimation algorithm for low cost inertial and magnetic sensor systems,” in Statistical Signal Processing, 2009. SSP'09. IEEE/SP 15th Workshop on. IEEE, 2009, pp. 586--589.Google ScholarCross Ref
- Benoit Huyghe, Jan Doutreloigne, and Jan Vanfleteren, “3d orientation tracking based on unscented Kalman filtering of accelerometer and magnetometer data,” in Sensors Applications Symposium, 2009. SAS 2009. IEEE. IEEE, 2009, pp. 148--152.Google ScholarCross Ref
- O. D. Lara and M. A. Labrador, “A survey on human activity recognition using wearable sensors,” Communications Surveys & Tutorials, IEEE, vol. 15, no. 3, pp. 1192--1209, 2013.Google ScholarCross Ref
- Y. Dong, A. Hoover, J. Scisco, and E. Muth, “A new method for measuring meal intake in humans via automated wrist motion tracking,” Applied psychophysiology and biofeedback, vol. 37, no. 3, pp. 205--215, 2012.Google Scholar
- A. Parate, M. Chiu, C. Chadowitz, D. Ganesan, and E. Kalogerakis, “RisQ: Recognizing smoking gestures with inertial sensors on a wristband,” in ACM MobiSys, 2015. Google ScholarDigital Library
- H. Wang, T. T. Lai, and R. Roy Choudhury, “Mole: Motion leaks through smartwatch sensors,” in ACM MobiCom. ACM, 2015, pp. 155--166. Google ScholarDigital Library
- Chao Xu, Parth H Pathak, and Prasant Mohapatra, “Finger-writing with smartwatch: A case for finger and hand gesture recognition using smartwatch,” in Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 2015, pp. 9--14. Google ScholarDigital Library
- Wonho Kang and Youngnam Han, “Smartpdr: Smartphone-based pedestrian dead reckoning for indoor localization,” IEEE Sensors journal, vol. 15, no. 5, pp. 2906--2916, 2015.Google ScholarCross Ref
- Ngoc-Huynh Ho, Phuc Huu Truong, and Gu-Min Jeong, “Step-detection and adaptive step-length estimation for pedestrian dead-reckoning at various walking speeds using a smartphone,” Sensors, vol. 16, no. 9, pp. 1423, 2016.Google ScholarCross Ref
- He Wang, Souvik Sen, Ahmed Elgohary, Moustafa Farid, Moustafa Youssef, and Romit Roy Choudhury, “No need to war-drive: Unsupervised indoor localization,” in Proceedings of the 10th international conference on Mobile systems, applications, and services. ACM, 2012, pp. 197--210. Google ScholarDigital Library
- H. Zhou, H. Hu, and Y. Tao, “Inertial measurements of upper limb motion,” Medical and Biological Engineering and Computing, vol. 44, no. 6, pp. 479--487, 2006.Google ScholarCross Ref
- H. Zhou and H. Hu, “Upper limb motion estimation from inertial measurements,” International Journal of Information Technology, vol. 13, no. 1, pp. 1--14, 2007.Google Scholar
- A. G. Cutti, A. Giovanardi, L. Rocchi, A. Davalli, and R. Sacchetti, “Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors,” Medical & biological engineering & computing, vol. 46, no. 2, pp. 169--178, 2008.Google Scholar
- Robert Mahony, Tarek Hamel, and Jean-Michel Pflimlin, “Nonlinear complementary filters on the special orthogonal group,” IEEE Transactions on automatic control, vol. 53, no. 5, pp. 1203--1218, 2008.Google ScholarCross Ref
- Sebastian Madgwick, “An efficient orientation filter for inertial and inertial/magnetic sensor arrays,” Report x-io and University of Bristol (UK), vol. 25, pp. 113--118, 2010.Google Scholar
- Seanglidet Yean, Bu Sung Lee, Chai Kiat Yeo, and Chan Hua Vun, “Algorithm for 3d orientation estimation based on Kalman filter and gradient descent,” in Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2016 IEEE 7th Annual. IEEE, 2016, pp. 1--6.Google Scholar
- Vadim Bistrov, “Performance analysis of alignment process of MEMS IMU,” International Journal of Navigation and Observation, vol. 2012, 2012.Google ScholarCross Ref
- Lu Lou, Xin Xu, Juan Cao, Zhili Chen, and Yi Xu, “Sensor fusion-based attitude estimation using low-cost MEMS-IMU for mobile robot navigation,” in Information Technology and Artificial Intelligence Conference (ITAIC), 2011 6th IEEE Joint International. IEEE, 2011, vol. 2, pp. 465--468.Google ScholarCross Ref
- Wei Li and Jinling Wang, “Effective adaptive Kalman filter for MEMS-IMU/magnetometers integrated attitude and heading reference systems,” The Journal of Navigation, vol. 66, no. 1, pp. 99--113, 2013.Google ScholarCross Ref
- Z Ercan, V Sezer, H Heceoglu, C Dikilitas, M Gokasan, A Mugan, and S Bogosyan, “Multi-sensor data fusion of DCM based orientation estimation for land vehicles,” in Mechatronics (ICM), 2011 IEEE International Conference on. IEEE, 2011, pp. 672--677.Google ScholarCross Ref
- David Jurman, Marko Jankovec, Roman Kamnik, and Marko Topivc , “Calibration and data fusion solution for the miniature attitude and heading reference system,” Sensors and Actuators A: Physical, vol. 138, no. 2, pp. 411--420, 2007.Google ScholarCross Ref
- Rong Zhu, Dong Sun, Zhaoying Zhou, and Dingqu Wang, “A linear fusion algorithm for attitude determination using low cost MEMS-based sensors,” Measurement, vol. 40, no. 3, pp. 322--328, 2007.Google ScholarCross Ref
- Eric Foxlin, “Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter,” in Virtual Reality Annual International Symposium, 1996., Proceedings of the IEEE 1996. IEEE, 1996, pp. 185--194. Google ScholarDigital Library
- Rodrigo Munguia and Antoni Grau, “Attitude and heading system based on EKF total state configuration,” in Industrial Electronics (ISIE), 2011 IEEE International Symposium on. IEEE, 2011, pp. 2147--2152.Google ScholarCross Ref
- Demoz Gebre-Egziabher, Roger C Hayward, and J David Powell, “Design of multi-sensor attitude determination systems,” IEEE Transactions on aerospace and electronic systems, vol. 40, no. 2, pp. 627--649, 2004.Google ScholarCross Ref
- N Shantha Kumar and T Jann, “Estimation of attitudes from a low-cost miniaturized inertial platform using Kalman filter-based sensor fusion algorithm,” Sadhana, vol. 29, no. 2, pp. 217--235, 2004.Google ScholarCross Ref
- Hector Garcia De Marina, Fernando J Pereda, Jose M Giron-Sierra, and Felipe Espinosa, “Uav attitude estimation using unscented Kalman filter and triad,” IEEE Transactions on Industrial Electronics, vol. 59, no. 11, pp. 4465--4474, 2012.Google ScholarCross Ref
- “Position sensors, android developers,” https://developer.android.com/guide/topics/sensors/sensors_position#sensors-pos-orient.Google Scholar
- “Motion capture systems - vicon,” http://vicon.com/.Google Scholar
- “Motion capture systems - optitrack,” http://optitrack.com/.Google Scholar
- “Microsoft kinect,” https://dev.windows.com/en-us/kinect.Google Scholar
- “Intel realsense technology,” http://www.intel.com/content/www/us/en/architecture-and-technology/realsense-overview.html.Google Scholar
- Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller, “3d tracking via body radio reflections,” in 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14), 2014, pp. 317--329. Google ScholarDigital Library
- Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel, “Whole-home gesture recognition using wireless signals,” in Proceedings of the 19th annual international conference on Mobile computing & networking. ACM, 2013, pp. 27--38. Google ScholarDigital Library
- Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Frédo Durand, “Capturing the human figure through a wall,” ACM Transactions on Graphics (TOG), vol. 34, no. 6, pp. 219, 2015. Google ScholarDigital Library
- Deepak Vasisht, Swarun Kumar, and Dina Katabi, “Decimeter-level localization with a single wifi access point.,” in NSDI, 2016, vol. 16, pp. 165--178. Google ScholarDigital Library
- Longfei Shangguan, Zimu Zhou, and Kyle Jamieson, “Enabling gesture-based interactions with objects,” in Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2017, pp. 239--251. Google ScholarDigital Library
- Teng Wei and Xinyu Zhang, “Gyro in the air: tracking 3d orientation of batteryless internet-of-things,” in Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 2016, pp. 55--68. Google ScholarDigital Library
- Tianxing Li, Qiang Liu, and Xia Zhou, “Practical human sensing in the light,” in Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2016, pp. 71--84. Google ScholarDigital Library
- Wenguang Mao, Jian He, and Lili Qiu, “Cat: high-precision acoustic motion tracking,” in Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 2016, pp. 69--81. Google ScholarDigital Library
- Sangki Yun, Yi-Chao Chen, and Lili Qiu, “Turning a mobile device into a mouse in the air,” in Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2015, pp. 15--29. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota, “Fingerio: Using active sonar for fine-grained finger tracking,” in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2016, pp. 1515--1525. Google ScholarDigital Library
Index Terms
- Closing the Gaps in Inertial Motion Tracking
Recommendations
Sensor-based dead-reckoning for indoor positioning
This paper presents a method of indoor position determination using an accelerometer, compass and gyroscope which are typically available in devices such as smart phones. The method makes use of measurements from such a device worn on the body, such as ...
Prototyping orientation and motion sensing objects with open hardware
TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied InteractionThis studio aims to introduce participants to orientation and motion sensing based upon inertial, magnetic and atmospheric pressure MEMS sensors. By using two Open Hardware projects we developed, FreeIMU and LibreMote, through hands on experimentation, ...
Assessing the Accuracy of an Algorithm for the Estimation of Spatial Gait Parameters Using Inertial Measurement Units: Application to Healthy Subject and Hemiparetic Stroke Survivor
MOCO '17: Proceedings of the 4th International Conference on Movement ComputingWe have reviewed and assessed the reliability of a dead reckoning and drift correction algorithm for the estimation of spatial gait parameters using Inertial Measurement Units (IMUs). In particular, we are interested in obtaining accurate stride lengths ...
Comments