Alexandra Voit
Dominik Weber
Yomna Abdelrahman
Marie Salm
Paweł W. Woźniak
Katrin Wolf
Stefan Schneegass
Niels Henze
ABSTRACT
With the rise of the Internet of Things, home appliances become connected and they can proactively provide status information to users. Facing a steadily increasing number of notification sources, it is unclear how information from smart home devices should be provided without overloading the users’ attention. In this paper, we investigate the design of non-urgent smart home notifications using a smart plant system. Based on feedback from focus groups, we designed four notification types and compared them in an eight-week in-situ study. We show that notifications displayed on smart home devices are preferred to those received on smartphones. Event-based notifications are unobtrusive, actionable and are preferred to persistent notifications. We derive guidelines that address the need of being in control, opportune locations for notification delivery at opportune moments, notification blindness, the importance of discretizing continuous information, and combining related notifications.
- Mark Altosaar, Roel Vertegaal, Changuk Sohn, and Daniel Cheng. 2006. AuraOrb: Using Social Awareness Cues in the Design of Progressive Notification Appliances. In Proceedings of the 18th Australia Conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments(Sydney, Australia) (OZCHI ’06). ACM, New York, NY, USA, 159–166. https://doi.org/10.1145/1228175.1228204Google Scholar
Digital Library
- Brian P. Bailey and Shamsi T. Iqbal. 2008. Understanding Changes in Mental Workload During Execution of Goal-directed Tasks and Its Application for Interruption Management. ACM Trans. Comput.-Hum. Interact. 14, 4, Article 21 (Jan. 2008), 28 pages. https://doi.org/10.1145/1314683.1314689Google ScholarDigital Library
- Björn Bittner, Ilhan Aslan, Chi Tai Dang, and Elisabeth André. 2019. Of Smarthomes, IoT Plants, and Implicit Interaction Design. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction(Tempe, Arizona, USA) (TEI ’19). ACM, New York, NY, USA, 145–154. https://doi.org/10.1145/3294109.3295618Google ScholarDigital Library
- Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI research: going behind the scenes. Synthesis Lectures on Human-Centered Informatics 9, 1(2016), 1–115.Google ScholarCross Ref
- Adam Bodnar, Richard Corbett, and Dmitry Nekrasovski. 2004. AROMA: Ambient Awareness Through Olfaction in a Messaging Application. In Proceedings of the 6th International Conference on Multimodal Interfaces (State College, PA, USA) (ICMI ’04). ACM, New York, NY, USA, 183–190. https://doi.org/10.1145/1027933.1027965Google ScholarDigital Library
- Susanne Boll, Wilko Heuten, Eike Michael Meyer, and Markus Meis. 2010. Development of a multimodal reminder system for older persons in their residential home. Informatics for health and Social Care 35, 3-4 (2010), 104–124.Google Scholar
- Jacky Bourgeois, Janet van der Linden, Gerd Kortuem, Blaine A. Price, and Christopher Rimmer. 2014. Conversations with My Washing Machine: An In-the-wild Study of Demand Shifting with Self-generated Energy. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp ’14). ACM, New York, NY, USA, 459–470. https://doi.org/10.1145/2632048.2632106Google ScholarDigital Library
- Stephen Brewster, David McGookin, and Christopher Miller. 2006. Olfoto: Designing a Smell-based Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). ACM, New York, NY, USA, 653–662. https://doi.org/10.1145/1124772.1124869Google ScholarDigital Library
- Yung-Ju Chang, Yi-Ju Chung, Yi-Hao Shih, Hsiu-Chi Chang, and Tzu-Hao Lin. 2017. What Do Smartphone Users Do when They Sense Phone Notifications?. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers(Maui, Hawaii) (UbiComp ’17). ACM, New York, NY, USA, 904–909. https://doi.org/10.1145/3123024.3124557Google ScholarDigital Library
- Andy Crabtree, Tom Rodden, Terry Hemmings, and Steve Benford. 2003. Finding a Place for UbiComp in the Home. In UbiComp 2003: Ubiquitous Computing, Anind K. Dey, Albrecht Schmidt, and Joseph F. McCarthy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 208–226.Google Scholar
- Mary Czerwinski, Ran Gilad-Bachrach, Shamsi Iqbal, and Gloria Mark. 2016. Challenges for Designing Notifications for Affective Computing Systems. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (Heidelberg, Germany) (UbiComp ’16). ACM, New York, NY, USA, 1554–1559. https://doi.org/10.1145/2968219.2968548Google ScholarDigital Library
- Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A Diary Study of Task Switching and Interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI ’04). ACM, New York, NY, USA, 175–182. https://doi.org/10.1145/985692.985715Google ScholarDigital Library
- K. Davis, E. B. Owusu, L. Marcenaro, L. Feijs, C. Regazzoni, and J. Hu. 2017. Effects of Ambient Lighting Displays on Peripheral Activity Awareness. IEEE Access 5(2017), 9318–9335. https://doi.org/10.1109/ACCESS.2017.2703866Google ScholarCross Ref
- Anja Exler, Christian Dinse, Zeynep Günes, Nadim Hammoud, Steffen Mattes, and Michael Beigl. 2017. Investigating the Perceptibility Different Notification Types on Smartphones Depending on the Smartphone Position. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (UbiComp ’17). ACM, New York, NY, USA, 970–976. https://doi.org/10.1145/3123024.3124560Google ScholarDigital Library
- Joel E. Fischer, Chris Greenhalgh, and Steve Benford. 2011. Investigating Episodes of Mobile Phone Activity As Indicators of Opportune Moments to Deliver Notifications. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI ’11). ACM, New York, NY, USA, 181–190. https://doi.org/10.1145/2037373.2037402Google ScholarDigital Library
- Joel E. Fischer, Chris Greenhalgh, and Steve Benford. 2011. Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI ’11 (2011), 181. https://doi.org/10.1145/2037373.2037402Google ScholarDigital Library
- Rebecca Hansson, Peter Ljungstrand, and Johan Redström. 2001. Subtle and public notification cues for mobile devices. In Ubicomp 2001: Ubiquitous Computing. Springer, 240–246.Google ScholarDigital Library
- Doris Hausen, Sebastian Boring, Clara Lueling, Simone Rodestock, and Andreas Butz. 2012. StaTube: Facilitating State Management in Instant Messaging Systems. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction(Kingston, Ontario, Canada) (TEI ’12). ACM, New York, NY, USA, 283–290. https://doi.org/10.1145/2148131.2148191Google ScholarDigital Library
- Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and Awareness: A Field Study of Alert Usage and Preferences. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (Savannah, Georgia, USA) (CSCW ’10). ACM, New York, NY, USA, 27–30. https://doi.org/10.1145/1718918.1718926Google ScholarDigital Library
- Sung Woo Kim, Min Chul Kim, Sang Hyun Park, Young Kyu Jin, and Woo Sik Choi. 2004. Gate Reminder: A Design Case of a Smart Reminder. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques(Cambridge, MA, USA) (DIS ’04). ACM, New York, NY, USA, 81–90. https://doi.org/10.1145/1013115.1013128Google ScholarDigital Library
- Jennifer Mankoff, Anind K. Dey, Gary Hsieh, Julie Kientz, Scott Lederer, and Morgan Ames. 2003. Heuristic Evaluation of Ambient Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). ACM, New York, NY, USA, 169–176. https://doi.org/10.1145/642611.642642Google ScholarDigital Library
- Gloria Mark, Mary Czerwinski, and Shamsi T. Iqbal. 2018. Effects of Individual Differences in Blocking Workplace Distractions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada) (CHI ’18). ACM, New York, NY, USA. https://www.microsoft.com/en-us/research/uploads/prod/2018/02/pn1612-markA.pdfGoogle ScholarDigital Library
- Gloria Mark, Stephen Voida, and Armand Cardello. 2012. ”A Pace Not Dictated by Electrons”: An Empirical Study of Work Without Email. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). ACM, New York, NY, USA, 555–564. https://doi.org/10.1145/2207676.2207754Google ScholarDigital Library
- Tara Matthews, Anind K. Dey, Jennifer Mankoff, Scott Carter, and Tye Rattenbury. 2004. A Toolkit for Managing User Attention in Peripheral Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST ’04). ACM, New York, NY, USA, 247–256. https://doi.org/10.1145/1029632.1029676Google ScholarDigital Library
- Andrii Matviienko, Vanessa Cobus, Heiko Müller, Jutta Fortmann, Andreas Löcken, Susanne Boll, Maria Rauschenberger, Janko Timmermann, Christoph Trappe, and Wilko Heuten. 2015. Deriving Design Guidelines for Ambient Light Systems. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia (Linz, Austria) (MUM ’15). ACM, New York, NY, USA, 267–277. https://doi.org/10.1145/2836041.2836069Google ScholarDigital Library
- Andrii Matviienko, Maria Rauschenberger, Vanessa Cobus, Janko Timmermann, Jutta Fortmann, Andreas Löcken, Heiko Müller, Christoph Trappe, Wilko Heuten, and Susanne Boll. 2015. Towards new ambient light systems: a close look at existing encodings of ambient light systems. Interaction Design and Architecture (s). 2015;(26): 10-24. (2015).Google Scholar
- M. McGee-Lennon, A. Smeaton, and S. Brewster. 2012. Designing home care reminder systems: Lessons learned through co-design with older users. In 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops. 49–56. https://doi.org/10.4108/icst.pervasivehealth.2012.248684Google Scholar
- Marilyn Rose McGee-Lennon, Maria Klara Wolters, and Stephen Brewster. 2011. User-centred Multimodal Reminders for Assistive Living. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 2105–2114. https://doi.org/10.1145/1978942.1979248Google ScholarDigital Library
- Heiko Müller, Anastasia Kazakova, Martin Pielot, Wilko Heuten, and Susanne Boll. 2013. Ambient Timer – Unobtrusively Reminding Users of Upcoming Tasks with Ambient Light. In Human-Computer Interaction – INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 211–228.Google ScholarCross Ref
- Jörg Müller, Dennis Wilmsmann, Juliane Exeler, Markus Buzeck, Albrecht Schmidt, Tim Jay, and Antonio Krüger. 2009. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. In Pervasive Computing, Hideyuki Tokuda, Michael Beigl, Adrian Friday, A. J. Bernheim Brush, and Yoshito Tobe(Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1–8.Google Scholar
- Jasmin Niess and Paweł W Woźniak. 2020. Embracing Companion Technologies. arXiv preprint arXiv:2004.07198(2020).Google Scholar
- T. Okoshi, J. Ramos, H. Nozaki, J. Nakazawa, A. K. Dey, and H. Tokuda. 2015. Attelia: Reducing user’s cognitive load due to interruptive notifications on smart phones. In 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom). 96–104. https://doi.org/10.1109/PERCOM.2015.7146515Google ScholarCross Ref
- Martin Pielot, Bruno Cardoso, Kleomenis Katevas, Joan Serrà, Aleksandar Matic, and Nuria Oliver. 2017. Beyond Interruptibility: Predicting Opportune Moments to Engage Mobile Phone Users. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 91 (Sept. 2017), 25 pages. https://doi.org/10.1145/3130956Google ScholarDigital Library
- Martin Pielot, Rodrigo de Oliveira, Haewoon Kwak, and Nuria Oliver. 2014. Didn’T You See My Message?: Predicting Attentiveness to Mobile Instant Messages. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). ACM, New York, NY, USA, 3319–3328. https://doi.org/10.1145/2556288.2556973Google ScholarDigital Library
- Martin Pielot and Luz Rello. 2017. Productive, Anxious, Lonely: 24 Hours Without Push Notifications. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI ’17). ACM, New York, NY, USA, Article 11, 11 pages. https://doi.org/10.1145/3098279.3098526Google ScholarDigital Library
- Ivan Poupyrev, Shigeaki Maruyama, and Jun Rekimoto. 2002. Ambient Touch: Designing Tactile Interfaces for Handheld Devices. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (Paris, France) (UIST ’02). ACM, New York, NY, USA, 51–60. https://doi.org/10.1145/571985.571993Google ScholarDigital Library
- Zachary Pousman and John Stasko. 2006. A Taxonomy of Ambient Information Systems: Four Patterns of Design. In Proceedings of the Working Conference on Advanced Visual Interfaces (Venezia, Italy) (AVI ’06). ACM, New York, NY, USA, 67–74. https://doi.org/10.1145/1133265.1133277Google ScholarDigital Library
- Thijs Roumen, Simon T. Perrault, and Shengdong Zhao. 2015. NotiRing: A Comparative Study of Notification Channels for Wearable Interactive Rings. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, New York, NY, USA, 2497–2500. https://doi.org/10.1145/2702123.2702350Google ScholarDigital Library
- Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale Assessment of Mobile Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). ACM, New York, NY, USA, 3055–3064. https://doi.org/10.1145/2556288.2557189Google ScholarDigital Library
- Ben Shneiderman. 2003. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In The Craft of Information Visualization, BENJAMIN B. BEDERSONand BEN SHNEIDERMAN (Eds.). Morgan Kaufmann, San Francisco, 364 – 371. https://doi.org/10.1016/B978-155860915-0/50046-9Google Scholar
- Ben Shneiderman. 2005. Shneiderman’s eight golden rules of interface design. Retrieved July 25(2005), 2009.Google Scholar
- Daniel Siewiorek, Asim Smailagic, Junichi Furukawa, Neema Moraveji, Kathryn Reiger, and Jeremy Shaffer. 2003. SenSay: A context-aware mobile phone. Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings. (2003), 248–249. https://doi.org/10.1109/ISWC.2003.1241422Google ScholarCross Ref
- Martin Tomitsch, Karin Kappel, Andreas Lehner, and Thomas Grechenig. 2007. Towards a Taxonomy for Ambient Information Systems.. In Ambient Information Systems.Google Scholar
- Martijn H. Vastenburg, David V. Keyson, and Huib de Ridder. 2007. Considerate home notification systems: a field study of acceptability of notifications in the home. Personal and Ubiquitous Computing 12, 8 (20 Jun 2007), 555. https://doi.org/10.1007/s00779-007-0176-xGoogle ScholarDigital Library
- Martijn H. Vastenburg, David V. Keyson, and Huib de Ridder. 2009. Considerate Home Notification Systems: A User Study of Acceptability of Notifications in a Living-room Laboratory. Int. J. Hum.-Comput. Stud. 67, 9 (Sept. 2009), 814–826. https://doi.org/10.1016/j.ijhcs.2009.06.002Google ScholarDigital Library
- Alexandra Voit, Tonja Machulla, Dominik Weber, Valentin Schwind, Stefan Schneegass, and Niels Henze. 2016. Exploring Notifications in Smart Home Environments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI ’16). ACM, New York, NY, USA, 942–947. https://doi.org/10.1145/2957265.2962661Google ScholarDigital Library
- Alexandra Voit, Sven Mayer, Valentin Schwind, and Niels Henze. 2019. Online, VR, AR, Lab, and In-Situ: Comparison of Research Methods to Evaluate Smart Artifacts. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 507, 12 pages. https://doi.org/10.1145/3290605.3300737Google ScholarDigital Library
- Alexandra Voit, Marie Olivia Salm, Miriam Beljaars, Stefan Kohn, and Stefan Schneegass. 2018. Demo of a Smart Plant System As an Exemplary Smart Home Application Supporting Non-urgent Notifications. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (Oslo, Norway) (NordiCHI ’18). ACM, New York, NY, USA, 936–939. https://doi.org/10.1145/3240167.3240231Google ScholarDigital Library
- Alexandra Voit, Dominik Weber, and Stefan Schneegass. 2016. Towards Notifications in the Era of the Internet of Things. In Proceedings of the 6th International Conference on the Internet of Things (Stuttgart, Germany) (IoT’16). ACM, New York, NY, USA, 173–174. https://doi.org/10.1145/2991561.2998472Google ScholarDigital Library
- Torben Wallbaum, Maria Rauschenberger, Janko Timmermann, Wilko Heuten, and Susanne C.J. Boll. 2018. Exploring Social Awareness: A Design Case Study in Minimal Communication. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). ACM, New York, NY, USA, Article CS08, 10 pages. https://doi.org/10.1145/3170427.3174365Google ScholarDigital Library
- David Warnock, Marilyn McGee-Lennon, and Stephen Brewster. 2011. The Role of Modality in Notification Performance. In Human-Computer Interaction – INTERACT 2011, Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler(Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 572–588.Google ScholarCross Ref
- David Warnock, Marilyn R. McGee-Lennon, and Stephen Brewster. 2011. The Impact of Unwanted Multimodal Notifications. In Proceedings of the 13th International Conference on Multimodal Interfaces (Alicante, Spain) (ICMI ’11). ACM, New York, NY, USA, 177–184. https://doi.org/10.1145/2070481.2070510Google ScholarDigital Library
- Dominik Weber, Alexandra Voit, Philipp Kratzer, and Niels Henze. 2016. In-situ Investigation of Notifications in Multi-device Environments. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany) (UbiComp ’16). ACM, New York, NY, USA, 1259–1264. https://doi.org/10.1145/2971648.2971732Google ScholarDigital Library
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963Google ScholarDigital Library
- Manuela Züger, Christopher Corley, André N. Meyer, Boyang Li, Thomas Fritz, David Shepherd, Vinay Augustine, Patrick Francis, Nicholas Kraft, and Will Snipes. 2017. Reducing Interruptions at Work: A Large-Scale Field Study of FlowLight. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 61–72. https://doi.org/10.1145/3025453.3025662Google ScholarDigital Library
Recommendations
Demo of a smart plant system as an exemplary smart home application supporting non-urgent notifications
NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer InteractionThe present work is a demonstration of a smart plant system that monitors the current water level of a plant. Since related work showed that users are already overwhelmed by notifications in their daily lives, how to design smart home applications that ...
The Attention Kitchen: Comparing Modalities for Smart Home Notifications in a Cooking Scenario
MUM '21: Proceedings of the 20th International Conference on Mobile and Ubiquitous MultimediaA steadily increasing number of notifications, auditory, visual or ambient, competes for the user’s attention. Frequent unsuitable notifications can lead to a breakdown in efficiency and increase error rates. This paper compares the effectiveness, ...
Exploring notifications in smart home environments
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctNotifications are a core mechanism of current smart devices. They inform about a variety of events including messages, social network comments, and application updates. While users appreciate the awareness that notifications provide, notifications cause ...
Comments