Laleh Jalali
ABSTRACT
Most people already use phones with myriad sensors that continuously generate data streams related to most aspects of their life. By detecting events in basic data streams and correlating and reasoning among them, it is possible to create a chronicle of personal life. We call it Personicle and use this to build individual Health Persona. Such Health Persona may then be used for understanding societal health as well as making decisions in emerging Social Life Networks. In this paper, we present a framework that collects, manages, and correlates personal data from heterogeneous data sources and detects events happening at personal level to build health persona. We use several data streams such as motion tracking, location tracking, activity level, and personal calendar data. We illustrate how two recognition algorithms based on Formal Concept Analysis and Decision Trees can be applied to Life Event detection problem. Also, we demonstrate the applicability of this framework on simulated data from Moves app, GPS, Nike fuel band, and Google calendar. We expect to soon have results for several individuals using real data streams from disparate wearable and smart phone sensors.
- Bettini C., Wang X., Jajodia S. Temporal Granularity. In Encyclopedia of Dayabase Systems, Verlag Berlin Heidelberg. 2009.Google Scholar
- Jain, R. Jalali, L. Fan, M. From Health-Persona to Societal Health. The first international Web Observatory Workshop (WOW13). Google ScholarDigital Library
- Ian Chen. Sensors in Smartphones: Beyond Landscape and Portrait Screen Orientation. Electronic Design. Apr 9 2012.Google Scholar
- Merlo, I. Bertino, E. Elena, F. Giovanna, G. A Temporal Object-Oriented Data Model with Multiple Granularities. Proceeding in 6th Intenational Workshop on Temporal Representation and Reasoning (TIME-99). pp. 73--81. Google ScholarDigital Library
- Quinlan, J.R. C4.5: Programs for machine learning. Morgan Kaufmann, San Francisco, CA (1993). Google ScholarDigital Library
- Protégé, Ontology framework and knowledge-base framework: http://protege.stanford.edu/Google Scholar
- Mihailidis, G. Fernie, J. Barbenel, C. The Use of Artificial Intelligence in the Design of an Intelligent Cognitive Orthosis for People with Dementia, Assistive Technology, Vol. 13, Issue 4, pp. 23--59, 2011.Google Scholar
- Barger, M. Alwan, S. Kell, B. Turner, S. Wood, A. Naidu, 2002. Objective remote assessment of activities of daily living: Analysis of meal preparation patterns. Poster presentation, Medical Automation Research Center, University of Virginia Health System.Google Scholar
- Guralnik, K. Haigh, Learning Models of Human Behavior with Sequential Patterns. Proc. AAAI Workshop Automation as Caregiver, AAAI Press, pp. 24--30, 2002.Google Scholar
- Bush, As We May Think, Atlantic Monthly, 1945.Google Scholar
- B. Rhodes, T. Starner, Remembrance Agent: A Continuously Running Automated Information Retrieval System. Proc. 1st Int'l Conf. Practical App. of Intelligent Agents and Multi-Agent Technology, pp. 122--135, 1996.Google Scholar
- J. Gemmell, G. Bell, R. Lueder, S. Drucker, C. Wong, MyLifeBits: Fulfilling the Memex Vision. Proc. ACM Multimedia, ACM Press, pp. 235--238, 2002. Google ScholarDigital Library
- A.Fitzgibbon, E. Reiter. Memories for Life: Managing Information over a Human Lifetime. UK Computing Research Committee Grand Challenge proposal, 2003.Google Scholar
- S. Vemuri, W. Bender. Next-Generation Personal Memory Aids. BT Technology Journal, Vol. 22, Issue 4, pp 125--138, October 2004. Google ScholarDigital Library
- M. Blum, A. Pentland, G. Troster. InSense: Internet-Based Life Logging, Vol. 13, Issue 4, pp. 40--48, 2006. Google ScholarDigital Library
- K. Mase, B.Clarkson, A. Pentland .The Familiar: A Living Diary and Companion. Proc. ACM Conf. Computer-Human Interaction, ACM Press, pp. 271--272, 2001. Google ScholarDigital Library
- C. Dickie, R. Vertegaal, D. Fono, C. Sohn, D. Chen, D. Cheng, J. S. Shell, O. Aoudeh, Augmenting and sharing memory with eyeBlog. Proc. 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, ACM Press, pp. 105--110, 2004. Google ScholarDigital Library
- J. Gemmell, L. Williams, K. Wood, R. Lueder, G. Bell, Passive Capture and Ensuing Issues for a Personal Lifetime Store. Proc. Continuous Archival and Retrieval of Personal Experiences, ACM Press, pp. 48--52, 2004. Google ScholarDigital Library
- T. van Kasteren, G. Englebienne, and B. Krse, An activity Monitoring System for Elderly Care Using Generative and Discriminative models, Journal on Personal and Ubiquitous Computing, pp. 489--498, 2010. Google ScholarDigital Library
- A.Tolstikov, X. Hong, J. Biswas, C. Nugent, L. Chen, and G. Parente, Comparison of fusion method based on DST and DBN in human activity recognition, Journal of Control Theory and Applications, Vol. 9, pp. 18--27, 2011.Google ScholarCross Ref
- J. Yang, J. Lee, and J. Choi, Activity Recognition Based on RFID Object Usage for Smart Mobile Devices, Journal of Computer Science and Technology, Vol. 26, pp. 239--246, 2011. Google ScholarDigital Library
- J. Sarkar, L. Vinh, Y.-K. Lee, and S. Lee, Gpars: a General-Purpose Activity Recognition System, Applied Intelligence, pp. 1--18, 2010. Google ScholarDigital Library
- E. Kim, S. Helal, and D. Cook, Human Activity Recognition and Pattern Discovery, Pervasive Computing, IEEE, Vol. 9, No. 1, pp. 48--53, 2010. Google ScholarDigital Library
- Wang. P. Smeaton. A. Using Visual Lifelogs to Automatically Characterize Everyday Activities, Information Science journal, pp. 147--161. Google ScholarDigital Library
- Moves application : http://www.moves-app.com/Google Scholar
- L. Chen and C. Nugent, Ontology-based Activity Recognition in Intelligent Pervasive Environments, Information Systems, Vol. 5, No. 4, pp. 410--430, 2009.Google Scholar
- E. M. Tapia and S. Intille. Real-time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor. In International Symposium on Wearable Computers (ISWC), pp. 15--18, 2007. Google ScholarDigital Library
- Tâm Huynh and Bernt Schiele. Towards Less Supervision in Activity Recognition from Wearable Sensors. In Proceedings of the 10th IEEE International Symposium on Wearable Computing (ISWC), 2006.Google Scholar
- U. Maurer, A. Smailagic, D.P. Siewiorek, and M. Deisher. Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions. International Workshop on Wearable and Implantable Body Sensor Networks (BSN), 2006. Google ScholarDigital Library
- T. Huynh, U. Blanke, and B. Schiele. Scalable Recognition of Daily Activities with Wearable Sensors. In 3rd International Symposium on Locationand Context-Awareness (LoCA), pp. 50--67, 2007. Google ScholarDigital Library
- S. Mittal, A. Aggarwal, S. L. Maskara. Situation Recognition in Sensor Based Environments Using Concept Lattices, In Proceedings of the CUBE International Information Technology Conference, pp. 579--584, 2012. Google ScholarDigital Library
- . Carpineto, C. Romano, G. Concept Data Analysis: Theory and Applications, John Wiley, 2004. Google ScholarDigital Library
- California partnership for access to treatment, The Growing Crisis of Chronic Disease in the United States.Google Scholar
- D. J. Patterson, D. Fox, H. Kautz, and M. Philipose. Fine-grained Activity Recognition by Aggregating Abstract Object Usage. InProc. ISWC, pp. 44--51, 2005. Google ScholarDigital Library
- Y. Nam, S. Rho, and C. Lee. Physical Activity Recognition Using Multiple Sensors Embedded in a Wearable Device. ACM Trans. Embed. Comput. Syst., Vol. 12, No. 2, Article 26, Feb. 2013. Google ScholarDigital Library
- D. J. Patterson, L. Liao, K. Gajos, M. Collier, N. Livic, K. Olson, S. Wang, D. Fox, and H. Kautz. Opportunity Knocks: a System to Provide Cognitive Assistance with Transportation Services. Proceedings of the Sixth International Conference on Ubiquitous Computing, Vol. LNCS 3205, pp. 433--450, 2004.Google ScholarCross Ref
- Karlsson, J. Stefan, et al. Wireless Monitoring of Heart Rate and Electromyographic Signals Using a Smart T-shirt, Proceedings of International Workshop on Wearable Micro and Nanosystems for Personalised Health. 2008.Google Scholar
- Ishida, Shuhei, et al. Electrocardiogram Measurement During Sleep with Wearing Clothes Using Capacitively-coupled Eectrodes, Engineering in Medicine and Biology Society, 29th Annual International Conference of the IEEE, pp. 2647--2650, 2007.Google Scholar
- Jung, C. G. Two Essays on Analytical Psychology, Jung's Collected Work #7, London 1953.Google Scholar
- N. Charif, Hammadi, and Stephen J. McKenna. Activity Summarisation and Fall Detection in a Supportive Home Environment. Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004. Vol. 4. IEEE, 2004. Google ScholarDigital Library
- FDA approved first digital pill: http://www.forbes.com/sites/singularity/2012/08/09/no-more-skipping-your-medicine-fda-approves-first-digital-pill/Google Scholar
- Qualcomm Life for reliable sharing of medical device data: http://www.qualcommlife.com/Google Scholar
- Verizon Wireless's digital health suite: http://powerfulanswers.vzwb2bsolutions.com/solutions/healhcare.htmlGoogle Scholar
- Stone, Erik E., and Marjorie Skubic. Evaluation of an Inexpensive Depth Camera for Passive in-home Fall Risk Assessment. 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), 2011.Google ScholarCross Ref
- Schoolwerth AC, Engelgau MM, Hostetter TH, Rufo KH, Chianchiano D, McClellan WM, et al. Chronic kidney disease: a public health problem that needs a public health action plan. Prev Chronic Dis, 2006 Apr Available from: http://www.cdc.gov/pcd/issues/2006/apr/05_0105.htm.Google Scholar
- The Heart Foundation: http://www.theheartfoundation.org/heart-disease-facts/heart-disease-statistics/Google Scholar
- Cynthia L. Ogden, Ph.D.; Margaret D. Carroll, M.S.P.H.; Brian K. Kit, M.D., M.P.H.; and Katherine M. Flegal, Ph.D., Prevalence of Obesity in the United States 2009-2010, NCHS Data Brief, No. 82, January 2012Google Scholar
- Dill, M., Salsberg, D. The Complexities of Physician. Supply and Demand: Projections Through 2025, Center for Workforce Studies, Nov. 2008.Google Scholar
- mHealthWatch, the pulse of mhealth community, By Jared Reitzin, 515 Million mHealth Sensor Shipments Projected for 2017, May 30, 2013.Google Scholar
- V. K. Singh, M. Gao, and R. Jain. Situation Recognition: An Evolving Problem for Heterogeneous Dynamic Big Multimedia Data, In Proc. of the 20th ACM Multimedia Conf., pp. 1209--1218, 2012. Google ScholarDigital Library
- S. Pongpaichet, V. K. Singh, M. Gao, R. Jain, EventShop: Recognizing Situations in Web Data Streams, The first international web Observatory Workshop (WOW13), 2013. Google ScholarDigital Library
Index Terms
- Building health persona from personal data streams
Recommendations
From health-persona to societal health
WWW '13 Companion: Proceedings of the 22nd International Conference on World Wide WebIn this position paper, we propose an approach for Web Observatories that builds on using social media, personal data, and sensors to build Persona for an individual, but also use this data and the concept of Focused Micro Blogs (FMB) for situation ...
Health and wellness monitoring using ambient sensor networks
Smart homes equipped with ambient wireless sensor networks provide new opportunities to help older adults age-in-place, improve their quality of life and help better manage their health and wellness. In this paper, we present a methodology that estimates ...
Communicating and interpreting wearable sensor data with health coaches
PervasiveHealth '15: Proceedings of the 9th International Conference on Pervasive Computing Technologies for HealthcareWe present a pilot study, which investigates the role of activity data visualization in the context of interaction and communication with health coaches. The data is obtained from commercially available wearable wellness sensors such as Basis Watch, or ...
Comments