skip to main content
10.1145/2632048.2636084acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array

Published: 13 September 2014 Publication History

Abstract

We demonstrate that a cheap (30USD) small, low power 8x8 thermal sensor array can by itself provide a broad range of information relevant for human activity monitoring in home and office environments. In particular the sensor can track people with an accuracy in the range of 1m (which is sufficient to recognize activity relevant regions), detect the operation mode of various appliances such as toaster, water cooker or egg cooker and actions such as opening a refrigerator, the oven or taking a shower. While there are sensing modalities for each of the above types of information (e.g. current sensors for appliances) the fact that they can all be detected by such a simple sensor is highly relevant for practical activity recognition systems. Compared to vision (or thermal imaging systems) the system has the advantage is being less privacy invasive allowing it for example to monitor bathroom activities (as shown in one of our evaluation scenarios). The paper describes the sensor, the methods used for activity detection and the evaluation.

Supplementary Material

M4V File (p141-hevesi.m4v)
MOV File (p141-hevesi.mov)

References

[1]
Cook, D. J., and Das, S. K. How smart are our environments? an updated look at the state of the art. Pervasive and mobile computing 3, 2 (2007), 53--73.
[2]
Han, J., and Bhanu, B. Human activity recognition in thermal infrared imagery. In Computer Vision and Pattern Recognition-Workshops, 2005. CVPR Workshops. IEEE Computer Society Conference on, IEEE (2005), 17--17.
[3]
Ho, B.-J., Kao, H.-L. C., Chen, N.-C., You, C.-W., Chu, H.-H., and Chen, M.-S. Heatprobe: a thermal-based power meter for accounting disaggregated electricity usage. In Proceedings of the 13th international conference on Ubiquitous computing, ACM (2011), 55--64.
[4]
Kemper, J., and Hauschildt, D. Passive infrared localization with a probability hypothesis density filter. In Positioning Navigation and Communication (WPNC), 2010 7th Workshop on, IEEE (2010), 68--76.
[5]
Patel, S. N., Robertson, T., Kientz, J. A., Reynolds, M. S., and Abowd, G. D. At the flick of a switch: Detecting and classifying unique electrical events on the residential power line. In UbiComp 2007. Springer, 2007, 271--288.
[6]
Rohrbach, M., Amin, S., Andriluka, M., and Schiele, B. A database for fine grained activity detection of cooking activities. In CVPR, 2012 IEEE, IEEE (2012), 1194--1201.
[7]
Tapia, E. M., Intille, S. S., and Larson, K. Activity recognition in the home using simple and ubiquitous sensors. Springer, 2004.
[8]
Want, R., Hopper, A., Falcao, V., and Gibbons, J. The active badge location system. ACM Transactions on Information Systems (TOIS) 10, 1 (1992), 91--102.

Cited By

View all
  • (2025)Limits of speech in connected homesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103404195:COnline publication date: 1-Jan-2025
  • (2024)Getting it Just Right: Towards Balanced Utility, Privacy, and Equity in Shared Space SensingACM Transactions on Internet of Things10.1145/36484795:2(1-26)Online publication date: 29-Feb-2024
  • (2024)Understanding Perceived Utility and Comfort of In-Home General-Purpose Sensing through Progressive ExposureProceedings of the ACM on Human-Computer Interaction10.1145/36374328:CSCW1(1-32)Online publication date: 26-Apr-2024
  • Show More Cited By

Index Terms

  1. Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    September 2014
    973 pages
    ISBN:9781450329682
    DOI:10.1145/2632048
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 September 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. activity recognition
    2. household monitoring
    3. thermal sensor

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    UbiComp '14
    UbiComp '14: The 2014 ACM Conference on Ubiquitous Computing
    September 13 - 17, 2014
    Washington, Seattle

    Acceptance Rates

    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Limits of speech in connected homesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103404195:COnline publication date: 1-Jan-2025
    • (2024)Getting it Just Right: Towards Balanced Utility, Privacy, and Equity in Shared Space SensingACM Transactions on Internet of Things10.1145/36484795:2(1-26)Online publication date: 29-Feb-2024
    • (2024)Understanding Perceived Utility and Comfort of In-Home General-Purpose Sensing through Progressive ExposureProceedings of the ACM on Human-Computer Interaction10.1145/36374328:CSCW1(1-32)Online publication date: 26-Apr-2024
    • (2023)Combining Smart Speaker and Smart Meter to Infer Your Residential Power Usage by Self-supervised Cross-modal LearningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109057:3(1-26)Online publication date: 27-Sep-2023
    • (2023)A low-cost real-time IoT human activity recognition system based on wearable sensor and the supervised learning algorithmsMeasurement10.1016/j.measurement.2023.113231218(113231)Online publication date: Aug-2023
    • (2023)A Deep Learning and Probabilistic Approach to Recognising Activities of Daily Living with Privacy Preserving Thermal SensorsProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48642-5_15(155-166)Online publication date: 26-Nov-2023
    • (2022)Multiple Thermal Sensor Array Fusion Toward Enabling Privacy-Preserving Human Monitoring ApplicationsIEEE Internet of Things Journal10.1109/JIOT.2022.31505669:17(16677-16688)Online publication date: 1-Sep-2022
    • (2021)Examination of Potential of Thermopile-Based Contactless Respiratory GatingSensors10.3390/s2116552521:16(5525)Online publication date: 17-Aug-2021
    • (2021)Activity Recognition in Residential Spaces with Internet of Things Devices and Thermal ImagingSensors10.3390/s2103098821:3(988)Online publication date: 2-Feb-2021
    • (2021)Healthcare Professionals’ Perspective on Implementing a Detector of Behavioural Disturbances in Long-Term Care HomesInternational Journal of Environmental Research and Public Health10.3390/ijerph1805272018:5(2720)Online publication date: 8-Mar-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media