Irina Diaconita
Christoph Rensing
ABSTRACT
Smartphones have become ubiquitous in recent years and offer many useful services to their users, such as notifications about incoming calls and messages, or news updates in real-time. These notifications however do not consider the current user's and phone's context. As a result, they can disturb users in important meetings or remain unnoticed in noisy environment. In this paper, we therefore propose an approach to infer the phone's context based on its vibration motor. To this end, we trigger the phone's vibration motor for short time periods and measure the response of its environments using the built-in microphone and/or accelerometers.Our evaluation shows that leveraging accelerometers allows to recognize the current phone's context with an accuracy of more than 99%. As a result, our proposed solution outperforms our previous work based on played and recorded ringtones in terms of classification performance, user annoyance, as well as potential privacy threats.
- N. Aharony, W. Pan, C. Ip, I. Khayal, and A. Pentland. Social fMRI: Investigating and Shaping Social Mechanisms in the Real World. Pervasive and Mobile Computing, 2011. Google Scholar
Digital Library
- M. Azizyan, I. Constandache, and R. Roy Choudhury. SurroundSense: Mobile Phone Localization via Ambience Fingerprinting. In Proceedings of the 15th Annual International Conference on Mobile Computing and Networking, 2009. Google ScholarDigital Library
- L. Bao and S. S. Intille. Activity Recognition from User-Annotated Acceleration Data. In Pervasive Computing. 2004.Google ScholarCross Ref
- M. Böhmer, B. Hecht, J. Schöning, A. Krüger, and G. Bauer. Falling Asleep with Angry Birds, Facebook and Kindle: A Large Scale Study on Mobile Application Usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, 2011. Google ScholarDigital Library
- J. Cho, I. Hwang, and S. Oh. Vibration-Based Surface Recognition for Smartphones. In IEEE 18th International Conference on Embedded and Real-Time Computing Systems and Applications, 2012. Google ScholarDigital Library
- I. Diaconita, A. Reinhardt, D. Christin, and C. Rensing. Bleep bleep! Determining Smartphone Locations by Opportunistically Recording Notification Sounds. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, 2014. Google ScholarDigital Library
- R. Elias and A. Elnahas. An Accurate Indoor Localization Technique Using Image Matching. In Proceedings of the International Conference on Intelligent Environments, 2007.Google ScholarCross Ref
- K. Fujinami and S. Kouchi. Recognizing a Mobile Phone's Storing Position as a Context of a Device and a User. In Mobile and Ubiquitous Systems: Computing, Networking, and Services. 2013.Google Scholar
- S. Hardy, A. El Saddik, S. Göbel, and R. Steinmetz. Context Aware Serious Games Framework for Sport and Health. In IEEE International Workshop on Medical Measurements and Applications Proceedings, 2011.Google Scholar
- S. Hemminki, P. Nurmi, and S. Tarkoma. Accelerometer-based Transportation Mode Detection on Smartphones. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems, 2013. Google ScholarDigital Library
- M. Kranz, A. Möller, N. Hammerla, S. Diewald, T. Plötz, P. Olivier, and L. Roalter. The Mobile Fitness Coach: Towards Individualized Skill Assessment Using Personalized Mobile Devices. Pervasive and Mobile Computing, 2013. Google ScholarDigital Library
- E. C. Larson, T. Lee, S. Liu, M. Rosenfeld, and S. N. Patel. Accurate and Privacy Preserving Cough Sensing Using a Low-cost Microphone. In Proceedings of the 13th International Conference on Ubiquitous Computing, 2011. Google ScholarDigital Library
- Q. Li, J. A. Stankovic, M. A. Hanson, A. T. Barth, J. Lach, and G. Zhou. Accurate, fast fall detection using gyroscopes and accelerometer-derived posture information. In Proceedings of the 6th International Workshop on Wearable and Implantable Body Sensor Networks, 2009. Google ScholarDigital Library
- Q. Li, J. A. Stankovic, M. A. Hanson, A. T. Barth, J. Lach, and G. Zhou. Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information. In 6th International Workshop on Wearable and Implantable Body Sensor Networks, 2009. Google ScholarDigital Library
- J. Liu, L. Zhong, J. Wickramasuriya, and V. Vasudevan. uWave: Accelerometer-based Personalized Gesture Recognition and its Applications. Pervasive and Mobile Computing, 2009. Google ScholarDigital Library
- B. Logan et al. Mel Frequency Cepstral Coefficients for Music Modeling. In Proceedings of the 11th International Society for Music Information Retrieval Conference, 2000.Google Scholar
- H. Lu, A. J. Bernheim Brush, B. Priyantha, A. K. Karlson, and J. Liu. SpeakerSense: Energy Efficient Unobtrusive Speaker Identification on Mobile Phones. In Pervasive Computing. 2011. Google ScholarDigital Library
- H. Lu, D. Frauendorfer, M. Rabbi, M. S. Mast, G. T. Chittaranjan, A. T. Campbell, D. Gatica-Perez, and T. Choudhury. StressSense: Detecting Stress in Uconstrained Acoustic Environments Using Smartphones. In Proceedings of the ACM Conference on Ubiquitous Computing, 2012. Google ScholarDigital Library
- R. J. Marsan. Weka for Android. GitHub Repository, 2011.Google Scholar
- S. Mazilu, U. Blanke, M. Hardegger, G. Troster, E. Gazit, M. Dorfman, and J. M. Hausdorff. GaitAssist: A Wearable Assistant for Gait Training and Rehabilitation in Parkinson's Disease. In Proceedings of the International Conference on Pervasive Computing and Communications Workshops, 2014.Google ScholarCross Ref
- E. Miluzzo, M. Papandrea, N. D. Lane, H. Lu, and A. T. Campbell. Pocket, Bag, Hand, etc.-Automatically Detecting Phone Context Through Discovery. In Proceedings of the ACM International Workshop on Sensing Applications on Mobile Phones, 2010.Google Scholar
- S. Nirjon, R. F. Dickerson, P. Asare, Q. Li, D. Hong, J. A. Stankovic, P. Hu, G. Shen, and X. Jiang. Auditeur: A Mobile-Cloud Service Platform for Acoustic Event Detection on Smartphones. In Proceedings of the The 11th International Conference on Mobile Systems, Applications, and Services, 2013. Google ScholarDigital Library
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 2011. Google ScholarDigital Library
- M. Rossi, S. Feese, O. Amft, N. Braune, S. Martis, and G. Troster. AmbientSense: A Real-Time Ambient Sound Recognition System for Smartphones. In Proceedings of the International Conference on Pervasive Computing and Communications, 2013.Google ScholarCross Ref
- S. Scellato, M. Musolesi, C. Mascolo, V. Latora, and A. T. Campbell. Nextplace: A spatio-temporal prediction framework for pervasive systems. In Pervasive Computing. 2011. Google ScholarDigital Library
- A. Schmidt, K. A. Aidoo, A. Takaluoma, U. Tuomela, K. Van Laerhoven, and W. Van de Velde. Advanced Interaction in Context. In Handheld and Ubiquitous Computing, 1999. Google ScholarDigital Library
- A. Schmidt, M. Beigl, and H. Gellersen. There is More to Context than Location. Computers and Graphics, 1998.Google Scholar
- R. V. Shannon, F.-G. Zeng, V. Kamath, J. Wygonski, and M. Ekelid. Speech Recognition With Primarily Temporal Cues. Science, 1995.Google Scholar
- S. Srivastava, S. Bhardwaj, A. Bhandari, K. Gupta, H. Bahl, and J. Gupta. Wavelet Packet Based Mel Frequency Cepstral Features for Text Independent Speaker Identification. In Intelligent Informatics. 2013.Google Scholar
- R. P. Troiano, D. Berrigan, K. W. Dodd, L. C. Mâsse, T. Tilert, and M. McDowell. Physical Activity in the United States Measured by Accelerometer. Medicine and Science in Sports and Exercise, 2008.Google ScholarCross Ref
- G. Tzanetakis and P. Cook. Musical Genre Classification of Audio Signals. IEEE Transactions on Speech and Audio Processing, 2002.Google Scholar
- L. Vu, Q. Do, and K. Nahrstedt. Jyotish: Constructive Approach for Context Predictions of People Movement from Joint Wifi/Bluetooth Trace. Pervasive and Mobile Computing, 2011. Google ScholarDigital Library
- J. Wiese, T. S. Saponas, and A. B. Brush. Phoneprioception: Enabling Mobile Phones to Infer Where They Are Kept. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013. Google ScholarDigital Library
Index Terms
- Inferring Smartphone Positions Based on Collecting the Environment's Response to Vibration Motor Actuation
Recommendations
Listening through a Vibration Motor
MobiSys '16: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and ServicesThis paper demonstrates the feasibility of using the vibration motor in mobile devices as a sound sensor, almost like a microphone. We show that the vibrating mass inside the motor -- designed to oscillate to changing magnetic fields -- also responds to ...
PM Synchronous Motor Induced Vibration
2018 21st International Conference on Electrical Machines and Systems (ICEMS)Permanent magnet synchronous motors (PMSMs) are widely used in the industry. Radial dynamic forces arise when the rotor is eccentrically located relative to the geometric center of the stator due to electromagnetic (EM) fields in the motor. A possibly ...
Contextual usage patterns in smartphone communication services
The mobile end user context has received a lot of attention from the mobile services industry lately. The location-based and context-sensitive information that are characteristic for smartphones can be utilized to study the use context of mobile end ...
Comments