skip to main content
10.1145/3173574.3173980acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Evaluating the Disruptiveness of Mobile Interactions: A Mixed-Method Approach

Published: 21 April 2018 Publication History

Abstract

While the proliferation of mobile devices has rendered mobile notifications ubiquitous, researchers are only slowly beginning to understand how these technologies affect everyday social interactions. In particular, the negative social influence of mobile interruptions remains unexplored from a methodological perspective. This paper contributes a mixed-method evaluation procedure for assessing the disruptive impact of mobile interruptions in conversation. The approach combines quantitative eye tracking, qualitative analysis, and a simulated conversation environment to enable fast assessment of disruptiveness. It is intended to be used as a part of an iterative interaction design process. We describe our approach in detail, present an example of its use to study a new call declining technique, and reflect upon the pros and cons of our approach.

Supplementary Material

suppl.mov (pn3440-file5.mp4)
Supplemental video
MP4 File (pn3440.mp4)

References

[1]
Roman Bednarik, Shahram Eivazi, and Michal Hradis. 2012. Gaze and Conversational Engagement in Multiparty Video Conversation: An Annotation Scheme and Classification of High and Low Levels of Engagement. In Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction (Gaze-In '12). ACM, New York, NY, USA, Article 10, 6 pages.
[2]
Sven Bertel, Thomas Dressel, Tom Kohlberg, and Vanessa von Jan. 2017. Spatial Knowledge Acquired from Pedestrian Urban Navigation Systems. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 32, 6 pages.
[3]
Peter Bogunovich and Dario Salvucci. 2011. The Effects of Time Constraints on User Behavior for Deferrable Interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3123--3126.
[4]
Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2015. What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2971--2980.
[5]
LouAnne E. Boyd, Alejandro Rangel, Helen Tomimbang, Andrea Conejo-Toledo, Kanika Patel, Monica Tentori, and Gillian R. Hayes. 2016. SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4872--4883.
[6]
Barry Brown, Moira McGregor, and Donald McMillan. 2015. Searchable Objects: Search in Everyday Conversation. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 508--517.
[7]
Debaleena Chattopadhyay, Kenton O'Hara, Sean Rintel, and Roman Rädle. 2016. Office Social: Presentation Interactivity for Nearby Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2487--2491.
[8]
Daniel Chen and Roel Vertegaal. 2004. Using Mental Load for Managing Interruptions in Physiologically Attentive User Interfaces. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1513--1516.
[9]
Jay Chen and Azza Abouzied. 2016. One LED is Enough: Catalyzing Face-to-face Interactions at Conferences with a Gentle Nudge. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 172--183.
[10]
Laura Dabbish and Robert E. Kraut. 2004. Controlling Interruptions: Awareness Displays and Social Motivation for Coordination. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, New York, NY, USA, 182--191.
[11]
Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting Closer: An Empirical Investigation of the Proximity of User to Their Smart Phones. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp '11). ACM, New York, NY, USA, 163--172.
[12]
Mica R. Endsley and Debra G. Jones. 2001. Disruptions, Interruptions and Information Attack: Impact on Situation Awareness and Decision Making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45, 2 (2001), 63--67.
[13]
Cambridge ESOL. 2008. Speaking Test Preparation Pack for CAE Paperback with DVD. Cambridge University Press.
[14]
Marc Exposito, Vicky Zeamer, and Pattie Maes. 2017. Unobtrusive Note Taking: Enriching Digital Interpersonal Interactions Using Gestures. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion). ACM, New York, NY, USA, 167--170.
[15]
Joel E. Fischer, Stuart Reeves, Stuart Moran, Chris Greenhalgh, Steve Benford, and Stefan Rennick-Egglestone. 2013. Understanding Mobile Notification Management in Collocated Groups. In Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW 2013). Springer London, London, 21--44.
[16]
Morten Fjeld, Paweł Wo´ zniak, Josh Cowls, and Bonnie Nardi. 2015. Ad hoc encounters with big data: Engaging citizens in conversations around tabletops. First Monday 20, 2 (2015).
[17]
Charles Goodwin. 1980. Restarts, Pauses, and the Achievement of a State of Mutual Gaze at Turn-Beginning. Sociological Inquiry 50, 3--4 (1980), 272--302.
[18]
Nanna Gorm and Irina Shklovski. 2017. Participant Driven Photo Elicitation for Understanding Activity Tracking: Benefits and Limitations. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1350--1361.
[19]
Nitesh Goyal and Susan R. Fussell. 2016. Effects of Sensemaking Translucence on Distributed Collaborative Analysis. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 288--302.
[20]
Nitesh Goyal and Susan R. Fussell. 2017. Intelligent Interruption Management using Galvanic Skin Response based Physiological Sensor for Collaborative Sensemaking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3 (Sept. 2017).
[21]
Nitesh Goyal, Gilly Leshed, Dan Cosley, and Susan R. Fussell. 2014. Effects of Implicit Sharing in Collaborative Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 129--138.
[22]
Jonathan Grudin. 2017. From Tool to Partner: The Evolution of Human-Computer Interaction. Synthesis Lectures on Human-Centered Interaction 10, 1 (2017), i--183.
[23]
Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104.
[24]
Helen M. Hodgetts and Dylan M. Jones. 2003. Interruptions in the Tower of London Task: Can Preparation Minimise Disruption? Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47, 8 (2003), 1000--1004.
[25]
Scott E. Hudson and Ian Smith. 1996. Techniques for Addressing Fundamental Privacy and Disruption Tradeoffs in Awareness Support Systems. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (CSCW '96). ACM, New York, NY, USA, 248--257.
[26]
Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and Awareness: A Field Study of Alert Usage and Preferences. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 27--30.
[27]
Pradthana Jarusriboonchai, Sus Lundgren, Thomas Olsson, Joel Fischer, Nemanja Memarovic, Stuart Reeves, Paweł Wo´ zniak, and Olof Torgersson. 2014. Personal or Social?: Designing Mobile Interactions for Co-located Interaction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 829--832.
[28]
Pradthana Jarusriboonchai, Aris Malapaschas, and Thomas Olsson. 2016a. Design and Evaluation of a Multi-Player Mobile Game for Icebreaking Activity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4366--4377.
[29]
Pradthana Jarusriboonchai, Aris Malapaschas, Thomas Olsson, and Kaisa Väänänen. 2016b. Increasing Collocated People's Awareness of the Mobile User's Activities: A Field Trial of Social Displays. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1691--1702.
[30]
Kristiina Jokinen, Hirohisa Furukawa, Masafumi Nishida, and Seiichi Yamamoto. 2013. Gaze and Turn-taking Behavior in Casual Conversational Interactions. ACM Trans. Interact. Intell. Syst. 3, 2, Article 12 (Aug. 2013), 30 pages.
[31]
Arvid Karsvall. 2011. Intercreativity in Surgical Practice : A Dialogical Approach to Interaction & Technology. Ph.D. Dissertation. Linköping University, The Tema Institute, Faculty of Arts and Sciences.
[32]
Adam Kendon. 1967. Some functions of gaze-direction in social interaction. Acta Psychologica 26 (1967), 22--63.
[33]
Kostadin Kushlev, Jason Proulx, and Elizabeth W. Dunn. 2016. "Silence Your Phones": Smartphone Notifications Increase Inattention and Hyperactivity Symptoms. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1011--1020.
[34]
Luis Leiva, Matthias Böhmer, Sven Gehring, and Antonio Krüger. 2012. Back to the App: The Costs of Mobile Application Interruptions. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 291--294.
[35]
Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1787--1796.
[36]
Sus Lundgren and Olof Torgersson. 2013. Bursting the Mobile Bubble. In First International Workshop on Designing Mobile Face-to-Face Group Interactions, European Conference on Computer Supported Cooperative Work, ECSCW.
[37]
Donald McMillan, Barry Brown, Airi Lampinen, Moira McGregor, Eve Hoggan, and Stefania Pizza. 2017. Situating Wearables: Smartwatch Use in Context. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3582--3594.
[38]
Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My Phone and Me: Understanding People's Receptivity to Mobile Notifications. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1021--1032.
[39]
William Newman and Ethan L. Smith. 2006. Disruption of Meetings by Laptop Use: Is There a 10-second Solution?. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1145--1150.
[40]
Eyal Ofek, Shamsi T. Iqbal, and Karin Strauss. 2013. Reducing Disruption from Subtle Information Delivery During a Conversation: Mode and Bandwidth Investigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 3111--3120.
[41]
Dina G Okamoto, Lisa Slattery Rashotte, and Lynn Smith-Lovin. 2002. Measuring interruption: Syntactic and contextual methods of coding conversation. Social Psychology Quarterly 65, 1 (2002), 38--55.
[42]
Jeni Paay and Jesper Kjeldskov. 2008. Understanding Situated Social Interactions: A Case Study of Public Places in the City. Computer Supported Cooperative Work 17, 2 (2008), 275--290.
[43]
Shwetak N. Patel, Julie A. Kientz, Gillian R. Hayes, Sooraj Bhat, and Gregory D. Abowd. 2006. Farther Than You May Think: An Empirical Investigation of the Proximity of Users to Their Mobile Phones. Springer Berlin Heidelberg, Berlin, Heidelberg, 123--140.
[44]
Jennifer Pearson, Simon Robinson, and Matt Jones. 2015. It's About Time: Smartwatches As Public Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1257--1266.
[45]
Martin Pielot. 2014. Large-scale Evaluation of Call-availability Prediction. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 933--937.
[46]
Martin Pielot, Karen Church, and Rodrigo de Oliveira. 2014. An In-situ Study of Mobile Phone Notifications. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 233--242.
[47]
Martin Porcheron, Joel E. Fischer, and Sarah Sharples. 2016. Using Mobile Phones in Pub Talk. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1649--1661.
[48]
Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 887--896.
[49]
Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale Assessment of Mobile Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3055--3064.
[50]
Jeffrey S. Shell, Roel Vertegaal, and Alexander W. Skaburskis. 2003. EyePliances: Attention-seeking Devices That Respond to Visual Attention. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 770--771.
[51]
Norman Makoto Su and Lulu Wang. 2015. From Third to Surveilled Place: The Mobile in Irish Pubs. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1659--1668.
[52]
Dag Svanaes and Gry Seland. 2004. Putting the Users Center Stage: Role Playing and Low-fi Prototyping Enable End Users to Design Mobile Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 479--486.
[53]
Peter Tolmie, Andy Crabtree, Tom Rodden, and Steve Benford. 2008. "Are You Watching This Film or What?": Interruption and the Juggling of Cohorts. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA, 257--266.
[54]
Patricia Trbovich and Joanne L. Harbluk. 2003. Cell Phone Communication and Driver Visual Behavior: The Impact of Cognitive Distraction. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 728--729.
[55]
Roel Vertegaal, Robert Slagter, Gerrit van der Veer, and Anton Nijholt. 2001. Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 301--308.
[56]
Shari P. Walsh, Katherine M. White, and Ross McD. Young. 2009. The phone connection: A qualitative exploration of how belongingness and social identification relate to mobile phone use amongst Australian youth. Journal of Community & Applied Social Psychology 19, 3 (2009), 225--240.
[57]
Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 103--106.
[58]
Jason Wiese, T. Scott Saponas, and A.J. Bernheim Brush. 2013. Phoneprioception: Enabling Mobile Phones to Infer Where They Are Kept. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2157--2166.
[59]
Paweł Wo´ zniak, Kristina Knaving, Staffan Björk, and Morten Fjeld. 2015. RUFUS: Remote Supporter Feedback for Long-Distance Runners. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 115--124.

Cited By

View all
  • (2023)Supporting Complex Decision-Making: Evidence from an Eye Tracking Study on In-Person and Remote CollaborationACM Transactions on Computer-Human Interaction10.1145/358178730:5(1-27)Online publication date: 23-Sep-2023
  • (2023)ParaGlassMenu: Towards Social-Friendly Subtle Interactions in ConversationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581065(1-21)Online publication date: 19-Apr-2023
  • (2022)Paracentral and near-peripheral visualizations: Towards attention-maintaining secondary information presentation on OHMDs during in-person social interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502127(1-14)Online publication date: 29-Apr-2022
  • Show More Cited By

Index Terms

  1. Evaluating the Disruptiveness of Mobile Interactions: A Mixed-Method Approach

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    8489 pages
    ISBN:9781450356206
    DOI:10.1145/3173574
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 April 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. conversation
    2. mobile interaction
    3. research methods
    4. social disruptiveness

    Qualifiers

    • Research-article

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)60
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Supporting Complex Decision-Making: Evidence from an Eye Tracking Study on In-Person and Remote CollaborationACM Transactions on Computer-Human Interaction10.1145/358178730:5(1-27)Online publication date: 23-Sep-2023
    • (2023)ParaGlassMenu: Towards Social-Friendly Subtle Interactions in ConversationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581065(1-21)Online publication date: 19-Apr-2023
    • (2022)Paracentral and near-peripheral visualizations: Towards attention-maintaining secondary information presentation on OHMDs during in-person social interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502127(1-14)Online publication date: 29-Apr-2022
    • (2022)The effects of simulated interruptions on mobile search tasksJournal of the Association for Information Science and Technology10.1002/asi.2457973:6(777-796)Online publication date: 26-Apr-2022
    • (2021)ConAn: A Usable Tool for Multimodal Conversation AnalysisProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479886(341-351)Online publication date: 18-Oct-2021
    • (2021)Informed Choices, Progress Monitoring and Comparison with Peers: Features to Support the Autonomy, Competence and Relatedness Needs, as Suggested by the Self-Determination TheoryProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472039(1-14)Online publication date: 27-Sep-2021
    • (2021)“It's Like Being Gone For A Second”Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472026(1-17)Online publication date: 27-Sep-2021
    • (2020)Effects of Position and Alignment of Notifications on AR Glasses during Social InteractionProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420095(1-11)Online publication date: 25-Oct-2020
    • (2020)The Effect of Context on Small Screen and Wearable Device Users’ Performance - A Systematic ReviewACM Computing Surveys10.1145/338637053:3(1-44)Online publication date: 28-May-2020
    • (2019)Expressive WearablesInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.201910010111:4(1-15)Online publication date: Oct-2019
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media