research-article

PBN: towards practical activity recognition using smartphone-based body sensor networks

Authors:

Matthew Keally,

Andrew PylesAuthors Info & Claims

SenSys '11: Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems

Pages 246 - 259

https://doi.org/10.1145/2070942.2070968

Published: 01 November 2011 Publication History

Abstract

The vast array of small wireless sensors is a boon to body sensor network applications, especially in the context awareness and activity recognition arena. However, most activity recognition deployments and applications are challenged to provide personal control and practical functionality for everyday use. We argue that activity recognition for mobile devices must meet several goals in order to provide a practical solution: user friendly hardware and software, accurate and efficient classification, and reduced reliance on ground truth. To meet these challenges, we present PBN: Practical Body Networking. Through the unification of TinyOS motes and Android smartphones, we combine the sensing power of on-body wireless sensors with the additional sensing power, computational resources, and user-friendly interface of an Android smartphone. We provide an accurate and efficient classification approach through the use of ensemble learning. We explore the properties of different sensors and sensor data to further improve classification efficiency and reduce reliance on user annotated ground truth. We evaluate our PBN system with multiple subjects over a two week period and demonstrate that the system is easy to use, accurate, and appropriate for mobile devices.

Supplemental Material

MP4 File

Download
126.99 MB

References

[1]

F. Albinali, S. Intille, W. Haskell, and M. Rosenberger. Using Wearable Activity Type Detection to Improve Physical Activity Energy Expenditure Estimation. In UbiComp '10, pages 311--320. ACM, 2010.

Digital Library

[2]

M. Azizyan, I. Constandache, and R. Choudhury. Surround-Sense: Mobile Phone Localization via Ambience Fingerprinting. In MobiCom '09, pages 261--272. ACM, 2009.

Digital Library

[3]

O. Chipara, C. Lu, T. Bailey, and G.-C. Roman. Reliable Clinical Monitoring using Wireless Sensor Networks: Experience in a Step-down Hospital Unit. In SenSys '10, pages 155--168. ACM, 2010.

Digital Library

[4]

J. Cranshaw, E. Toch, J. Hong, A. Kittur, and N. Saleh. Bridging the Gap Between Physical Location and Online Social Networks. In UbiComp '10, pages 119--128. ACM, 2010.

Digital Library

[5]

A. de Quincey. HTC Hero (MSM7201) USB Host Mode, 2010. http://adq.livejournal.com/95689.html.

[6]

S. B. Eisenman, E. Miluzzo, N. D. Lane, R. A. Peterson, G.-S. Ahn, and A. T. Campbell. The BikeNet Mobile Sensing System for Cyclist Experience Mapping. In SenSys '07, pages 87--101. ACM, 2007.

Digital Library

[7]

J. Eriksson, L. Girod, B. Hull, R. Newton, S. Madded, and H. Balakrishnan. The Pothole Patrol: Using a Mobile Sensor Network for Road Surface Monitoring. In MobiSys '08, pages 29--39. ACM, 2008.

Digital Library

[8]

Y. Freund and R. Schapire. A Decision-Theoretic Generalization of On-line Learning and an Application to Boosting. JCSS, 37(3):297--336, 1997.

[9]

R. K. Ganti, P. Jayachandran, T. Abdelzaher, and J. Stankovic. SATIRE: A Software Architecture for Smart AtTIRE. In MobiSys '06, pages 110--123. ACM, 2006.

Digital Library

[10]

H. He and E. Garcia. Learning from Imbalanced Data. IEEE TKDE, 21(9):1263--1284, 2009.

Digital Library

[11]

M. Keally, G. Zhou, G. Xing, and J. Wu. Exploiting Sensing Diversity for Confident Sensing in Wireless Sensor Networks. In INFOCOM '11, pages 1719--1727. IEEE, 2011.

[12]

D. Kim, Y. Kim, D. Estrin, and M. Srivastava. SensLoc: Sensing Everyday Places and Paths using Less Energy. In SenSys '10, pages 43--56. ACM, 2010.

Digital Library

[13]

S. Kullback and R. Leibler. On Information and Sufficiency. Annals of Mathematical Statistics, 22(1):79--86, 1951.

[14]

J. Lester, T. Choudhury, N. Kern, G. Borriello, and B. Hannaford. A Hybrid Discriminative/Generative Approach for Modeling Activities. In IJCAI, pages 766--772, 2005.

Digital Library

[15]

K. Lorincz, B. Chen, G. Challen, A. Chowdhury, S. Patel, P. Bonato, and M. Welsh. Mercury: A Wearable Sensor Network Platform for High-Fidelity Motion Analysis. In SenSys '09, pages 183--196. ACM, 2009.

Digital Library

[16]

H. Lu, W. Pan, N. Lane, T. Choudhury, and A. Campbell. SoundSense: Scalable Sound Sensing for People-Centric Sensing Applications on Mobile Phones. In MobiSys '09, pages 165--178. ACM, 2009.

Digital Library

[17]

H. Lu, J. Yang, Z. Liu, N. Lane, T. Choudhury, and A. Campbell. The Jigsaw Continuous Sensing Engine for Mobile Phone Applications. In SenSys '10, pages 71--84. ACM, 2010.

Digital Library

[18]

E. Miluzzo, C. Cornelius, A. Ramaswamy, T. Choudhury, Z. Liu, and A. Campbell. Darwin Phones: The Evolution of Sensing and Inference on Mobile Phones. In MobiSys '10, pages 5--20. ACM, 2010.

Digital Library

[19]

E. Miluzzo, N. Lane, K. Fodor, R. Peterson, H. Lu, and M. Musolesi. Sensing Meets Mobile Social Networks: The Design, Implementation and Evaluation of the CenceMe Application. In SenSys '08, pages 337--350. ACM, 2008.

Digital Library

[20]

D. Peebles, T. Choudhury, H. Lu, N. Lane, and A. Campbell. Community-Guided Learning: Exploiting Mobile Sensor User to Model Human Behavior. In AAAI, 2010.

[21]

T. Pering, P. Zhang, R. Chaudhri, Y. Anokwa, and R. Want. The PSI Board: Realizing a Phone-Centric Body Sensor Network. In BSN, pages 26--28, 2007.

[22]

M. Quwaider and S. Biswas. Body Posture Identification using Hidden Markov Model with a Wearable Sensor Network. In Bodynets '08, pages 19:1--19:8. ICST, 2008.

Digital Library

[23]

K. Rachuri, M. Musolesi, C. Mascolo, P. Rentfrow, C. Longworth, and A. Acuinas. EmotionSense: A Mobile Phones based Adaptive Platform for Experimental Social Psychology Research. In UbiComp '10, pages 281--290. ACM, 2010.

Digital Library

[24]

Z. Ren, G. Zhou, A. Pyles, M. Keally, W. Mao, and H. Wang. BodyT2: Throughput and Time Delay Performace Assurance for Heterogeneous BSNs. In INFOCOM '11, pages 2750--2758. IEEE, 2011.

[25]

J. Rodgers and W. Nicewander. Thirteen Ways to Look at the Correlation Coefficient. The American Statistician, 42(1):59--66, 1988.

[26]

K. Srinivasan, M. Jain, J. Choi, T. Azim, E. Kim, P. Levis, and B. Krishnamachari. The k Factor: Inferring Protocol Performance Using Inter-Link Reception Correlation. In MobiCom '10, pages 317--328. ACM, 2010.

Digital Library

[27]

Y. Wang, J. Lin, M. Annavaram, Q. Jacobson, J. Hong, B. Krishnamachari, and N. Sadeh. A Framework of Energy Efficient Mobile Sensing for Automatic User State Recognition. In MobiSys '09, pages 179--192. ACM, 2009.

Digital Library

[28]

P. Zappi, C. Lombriser, T. Steifmeier, E. Farella, D. Roggen, L. Benini, and G. Troster. Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection. In EWSN '08, pages 17--33, 2008.

Digital Library

[29]

R. Zhou, Y. Xiong, G. Xing, L. Sun, and J. Ma. ZiFi: Wireless LAN Discovery via ZigBee Interference Signatures. In MobiCom '10, pages 49--60. ACM, 2010.

Digital Library

[30]

Z.-H. Zhou, J. Wu, and W. Tang. Ensembling Neural Networks: Many Could Be Better Than All. Artificial Intelligence, 137:239--263, 2002.

Digital Library

[31]

T. Zhu, Z. Zhong, T. He, and Z. Zhang. Exploring Link Correlation for Efficient Flooding in Wireless Sensor Networks. In NSDI '10. USENIX, 2010.

Digital Library

Cited By

Ghosh SMandi SSen SMitra BDe P(2024)Towards Estimating Missing Emotion Self-reports Leveraging User Similarity: A Multi-task Learning ApproachProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642833(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642833
Leite CByvshev PMauranen HXiao Y(2024)Simulation-driven design of smart gloves for gesture recognitionScientific Reports10.1038/s41598-024-65069-214:1Online publication date: 27-Jun-2024
https://doi.org/10.1038/s41598-024-65069-2
Guo XWang YCheng JChen YGuo XWang YCheng JChen Y(2024)Contactless Activity Identification Using Commodity WiFiMobile Technologies for Smart Healthcare System Design10.1007/978-3-031-57345-3_2(13-47)Online publication date: 3-Jul-2024
https://doi.org/10.1007/978-3-031-57345-3_2
Show More Cited By

Index Terms

PBN: towards practical activity recognition using smartphone-based body sensor networks
1. Computer systems organization
  1. Embedded and cyber-physical systems
  2. Real-time systems

Recommendations

Real-time activity classification using ambient and wearable sensors
Special section on body sensor networks

New approaches to chronic disease management within a home or community setting offer patients the prospect of more individually focused care and improved quality of life. This paper investigates the use of a light-weight ear worn activity recognition ...
Development of field programmable modular wireless sensor network nodes for ambient systems

The goal of this work is to fabricate robust, miniature, wireless sensor modules. These provide an enabling technology platform to conduct research in creating ambient systems, through implementing wireless sensor network applications. The approach ...
MELOS: a low-cost and low-energy generic sensing attachment for mobile phones
NSDR '11: Proceedings of the 5th ACM workshop on Networked systems for developing regions

Ubiquitous availability of cellular network and cheap mobile phones have made them promising sensing platforms for various application domains including healthcare, environment, and astronomy among others. However, existing mobile phone platforms, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SenSys '11: Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems

November 2011

452 pages

ISBN:9781450307185

DOI:10.1145/2070942

General Chair:
Jie Liu
Microsoft Research
,
Program Chairs:
Philip Levis
Stanford University
,
Kay Römer
University of Luebeck, Germany

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SenSys '11

Sponsor:

SenSys '11: The 9th ACM Conference on Embedded Network Sensor Systems

November 1 - 4, 2011

Washington, Seattle

Acceptance Rates

SenSys '11 Paper Acceptance Rate 24 of 123 submissions, 20%;

Overall Acceptance Rate 198 of 990 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

114
Total Citations
View Citations
1,474
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ghosh SMandi SSen SMitra BDe P(2024)Towards Estimating Missing Emotion Self-reports Leveraging User Similarity: A Multi-task Learning ApproachProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642833(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642833
Leite CByvshev PMauranen HXiao Y(2024)Simulation-driven design of smart gloves for gesture recognitionScientific Reports10.1038/s41598-024-65069-214:1Online publication date: 27-Jun-2024
https://doi.org/10.1038/s41598-024-65069-2
Guo XWang YCheng JChen YGuo XWang YCheng JChen Y(2024)Contactless Activity Identification Using Commodity WiFiMobile Technologies for Smart Healthcare System Design10.1007/978-3-031-57345-3_2(13-47)Online publication date: 3-Jul-2024
https://doi.org/10.1007/978-3-031-57345-3_2
Choudhary PGoel NSaini M(2023)A Survey on Seismic Sensor based Target Detection, Localization, Identification, and Activity RecognitionACM Computing Surveys10.1145/356867155:11(1-36)Online publication date: 9-Feb-2023
https://dl.acm.org/doi/10.1145/3568671
Min CMathur AMontanari AKawsar F(2023)SensiX: A System for Best-Effort Inference of Machine Learning Models in Multi-Device EnvironmentsIEEE Transactions on Mobile Computing10.1109/TMC.2022.317391422:9(5525-5538)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1109/TMC.2022.3173914
Meng XZhou JLiu XTong XQu WWang J(2023)Secur-Fi: A Secure Wireless Sensing System Based on Commercial Wi-Fi DevicesIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229055(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229055
Cho HMathur AKawsar F(2022)FLAMEProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502896:3(1-29)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550289
Jain YTang CMin CKawsar FMathur A(2022)ColloSSLProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172466:1(1-28)Online publication date: 29-Mar-2022
https://dl.acm.org/doi/10.1145/3517246
Chatterjee SMitra BChakraborty S(2022)AmicroN: Framework for Generating Micro-Activity Annotations for Human Activity Recognition2022 IEEE International Conference on Smart Computing (SMARTCOMP)10.1109/SMARTCOMP55677.2022.00019(26-31)Online publication date: Jun-2022
https://doi.org/10.1109/SMARTCOMP55677.2022.00019
Zhou ZWang FYu JRen JWang ZGong W(2022)Target-oriented Semi-supervised Domain Adaptation for WiFi-based HARIEEE INFOCOM 2022 - IEEE Conference on Computer Communications10.1109/INFOCOM48880.2022.9796782(420-429)Online publication date: 2-May-2022
https://dl.acm.org/doi/10.1109/INFOCOM48880.2022.9796782
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten