Skip to main content
SpringerLink
Log in

Predicting time-sharing in mobile interaction

  • Original Paper
  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

The era of modern personal and ubiquitous computers is beset with the problem of fragmentation of the user’s time between multiple tasks. Several adaptations have been envisioned that would support the performance of the user in the dynamically changing contexts in which interactions with mobile devices take place. This paper assesses the feasibility of sensor-based prediction of time-sharing, operationalized in terms of the number of glances, the duration of the longest glance, and the total and average durations of the glances to the interaction task. The data used for constructing and validating the predictive models was acquired from a field study (N = 28), in which subjects performing mobile browsing tasks were observed for approximately 1 h in a variety of environments and situations. The predictive accuracy achieved in binary classification tasks was about 70% (about 20% above default), and the most informative sensors were related to the environment and interactions with the mobile device. Implications to the feasibility of different kinds of adaptations are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adamczyk, P.D., Bailey, B.P.: If not now, when? The effects of interruption at different moments within task execution. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2004), pp. 271–278. ACM Press, New york (2004)

  • Altmann, E.M., Trafton, J.G.: Task interruption: resumption lag and the role of cues. In: Proceedings of the 26th Annual Conference of the Cognitive Science Society, pp. 42–47. Lawrence Erlbaum Associates, Hillsdale, NJ (2004)

  • Begole, B., Tang, J., Hill, R.: Rhythm modeling, visualizations and applications. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, pp. 11–20. ACM Press, New York (2003)

  • Burgess P.W. (2000). Strategy application disorder: the role of the frontal lobes in human multitasking. Psychol. Res. 63: 279–288

    Article  Google Scholar 

  • Carberry S. (2001). Techniques for plan recognition. User Model. User-Adapt. Interact. 11(1–2): 31–48

    Article  MATH  Google Scholar 

  • Card, S.K., Henderson, A.: A multiple, virtual-workspace interface to support user task switching. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 1987), pp. 53–59. ACM Press, New York (1987)

  • Cutrell, E., Czerwinski, M., Horvitz, E.: Notification, disruption, and memory: effects of messaging interruptions on memory and performance. In: Proceedings of Interact 2001: IFIP Conference on Human-Computer Interaction, pp. 263–269. IOS Press, Amsterdam (2001)

  • Dourish, P., Bellotti, V.: Awareness and coordination in shared workspaces. In: Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW 1992), pp. 107–114. ACM Press, New York (1992)

  • Eng, K., Lewis, R.L., Tollinger, I., Chu, A., Howes, A., Vera, A.: Generating automated predictions of behavior strategically adapted to specific performance objectives. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2006), pp. 621–630. ACM Press, New York (2006)

  • Fischer G. (2001). User modeling in human-computer interaction. User Model. User-Adapt. Interact. 11(1): 65–86

    Article  MATH  Google Scholar 

  • Fogarty, J., Ko, A.J., Aung, H.H., Golden, E., Tang, K.P., Hudson, S.E.: Examining task engagement in sensor-based statistical models of human interruptibility. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2005), pp. 331–340. ACM Press, New York (2005)

  • Fogarty, J., Lai, J.: Examining the robustness of statistical models. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2004), pp. 207–214. ACM Press, New York (2004)

  • Fogarty J., Lai J. and Christensen J. (2004). Presence versus availability: the design and evaluation of a context-aware communication client. Int. J. Hum.-Comput. Stud. 61(3): 299–317

    Article  Google Scholar 

  • Fu W.T. and Gray W.D. (2004). Resolving the paradox of the active user: stable suboptimal performance in interactive tasks. Cogn. Sci. 28(6): 901–935

    Article  Google Scholar 

  • Glanzer M., Dorfman D. and Kaplan B. (1981). Short-term processing in the processing of text. J. Verbal Learn. Verbal Behav. 20: 656–670

    Article  Google Scholar 

  • González, V.M, Mark G.: Constant, constant, multi-tasking craziness: managing multiple working spheres. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2004), pp. 113–120. ACM Press, New York (2004)

  • Gray W.D. and Boehm-Davis D.A. (2000). Milliseconds matter: an introduction to microstrategies and to their use in describing and predicting interactive behavior. J. Exp. Psychol. Appl. 6(4): 322–335

    Article  Google Scholar 

  • Guyon I. and Elisseeff A. (2003). An introduction to variable and feature selection. J. Mach. Learn. Res. 3: 1157–1182

    Article  MATH  Google Scholar 

  • Hjorth J. (1994). Computer Intensive Statistical Methods: Validation, Model Selection and Bootstrap. Chapman & Hall, London

    MATH  Google Scholar 

  • Ho, J., Intille, S.S.: Using context-aware computing to reduce the perceived burden of interruptions from mobile devices. In: Proceedings the ACM Conference on Human Factors in Computing Systems (CHI 2005), pp. 909–918. ACM Press, New York (2005)

  • Horvitz, E.: Principles of mixed-initiative user interfaces. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 1999), pp. 159–166. ACM Press, New York (1999a)

  • Horvitz E. (1999). Uncertainty, action and interaction: in pursuit of mixed-initiative computing. IEEE Intell. Syst. 14(5): 17–20

    Google Scholar 

  • Horvitz, E., Apacible, J.: Learning and reasoning about interruption. In: Proceedings of the Fifth International Conference on Multimodal Interfaces (ICMI 2003), pp. 20–27. ACM Press, New York (2003)

  • Horvitz, E., Jacobs, A., Hovel, D.: Attention-sensitive alerting. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (UAI’99), pp. 305–313. Morgan Kaufmann, San Francisco, CA (1999)

  • Horvitz E., Kadie C.M., Paek T. and Hovel D. (2003). Models of attention in computing and communications: from principles to applications. Commun. ACM 46(3): 52–59

    Article  Google Scholar 

  • Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., Yang, J.: Predicting human interruptibility with sensors: a wizard of oz feasibility study. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2003), pp. 257–264. ACM Press, New York (2003)

  • Jameson, A., Kiefer, J., Mueller, C., Grossmann-Hutter, B., Wittig, F., Rummer, R.: Assessment of a user’s time pressure and cognitive load on the basis of features of speech. Technical report, German Research Institute for Artificial Intelligence, Saarbrücken, Germany (2006)

  • Jameson A. and Klöckner K. (2005). User multitasking with mobile multimodal systems. In: Minker, W., Bühler, D. and Dybkjær, L. (eds) Spoken Multimodal Human-Computer Dialogue in Mobile Environments, pp 349–377. Springer, Dordrecht

    Chapter  Google Scholar 

  • Jameson A., Schaefer R., Weis T., Berthold A. and Weyrath T. (1999). Making systems sensitive to the user’s changing resource limitations. Knowledge-Based Syst 12: 413–425

    Article  Google Scholar 

  • Kern, N., Antifakos, S., Schiele, B., Schwaninger, A.: A model for human interruptability: experimental evaluation and automatic estimation from wearable sensors. In: Proceedings of the Eighth International Symposium on Wearable Computers (ISWC’04), pp. 158–165. IEEE Computer Society, Washington, DC (2004)

  • Kern, N., Schiele B.: Context-aware notification for wearable computing. In: Proceedings of the 7th IEEE International Symposium on Wearable Computers (ISWC’03), pp. 223–230. IEEE Computer Society, Washington, DC (2003)

  • Kobsa A. (2001). Generic user modeling systems. User Model. User-Adap. Interact. 11(1–2): 49–63

    Article  MATH  Google Scholar 

  • Kohavi R. and John G. (1997). Wrappers for feature selection. Artif. Intell. 97(1–2): 273–324

    Article  MATH  Google Scholar 

  • Kushleyeva Y., Salvucci D. and Lee F.J. (2005). Deciding when to switch tasks in time-critical multitasking. Cogn. Syst. Res. 6: 41–49

    Article  Google Scholar 

  • Mäntyjärvi J. and Seppänen T. (2003). Adapting applications in handheld devices using fuzzy context information. Interact. Comput. 15(4): 521–538

    Article  Google Scholar 

  • McFarlane D.C. and Latorella K.A. (2002). The scope and importance of human interruption in human-computer interaction design. Hum. Comput. Interact. 17(1): 1–61

    Article  Google Scholar 

  • Miyata Y. and Norman D.A. (1986). Psychological issues in supporting multiple activities. In: Norman, D.A. and Draper, S.W (eds) User Centered Design: New Perspectives on Human-Computer Interaction, pp 266–284. Lawrence Erlbaum Associates, Hillsdale, NJ

    Google Scholar 

  • Monsell S. (2003). Task switching. Trends Cogn. Sci. 7(3): 134–140

    Article  Google Scholar 

  • Näätänen R. (1992). Attention and Brain Function. Lawrence Erlbaum Associates, Hillsdale, NJ

    Google Scholar 

  • Oulasvirta A., Petit R., Raento M. and Tiitta S. (2007). Interpreting and acting on mobile awareness cues. Hum.-Comput. Interact. 22(1&2): 97–135

    Google Scholar 

  • Oulasvirta, A., Tamminen, S., Roto, V., Kuorelahti, J.: Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2005), pp. 919–928, ACM Press, New York (2005)

  • Pashler H. (1993). Dual-task interference and elementary mental mechanisms. In: Meyer, D. and Kornblum, S. (eds) Attention and Performance XIV, pp 245–264. MIT Press, Cambridge, MA

    Google Scholar 

  • Russell S. and Norvig P. (2003). Artificial Intelligence: A Modern Approach (2nd edn). Pearson Education, Upper Saddle River, NJ

    Google Scholar 

  • Salovaara, A., Oulasvirta, A.: Six modes of proactive resource management. In: Proceedings of NordiCHI 2004, pp. 57–60. ACM Press, New York (2004)

  • Salvucci D. (2005). A multitasking general executive for compound continuous tasks. Cogn. Sci. 29: 257–292

    Google Scholar 

  • Simon H. (1971). Designing organizations for an information rich world. In: Greenberger, M. (eds) Computers, Communications and the Public Interest, pp 37–72. Johns Hopkins University Press, Baltimore, MD

    Google Scholar 

  • Tamminen S., Oulasvirta A., Toiskallio K. and Kankainen A. (2004). Understanding mobile contexts. Pers. Ubiquitous Comput. 8(2): 135–143

    Article  Google Scholar 

  • Vera, A., Howes, A., McCurdy, M., Lewis, R.L.: A constraint satisfaction approach to predicting skilled interactive cognition. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2004), pp. 121–128. ACM Press, New York (2004)

  • Vertegaal R. (2003). Attentive user interfaces. Commun. ACM 46(3): 31–33

    Article  Google Scholar 

  • Wickens C.D. (1984). Processing resources in attention. In: Parasuraman, R. and Davies, R. (eds) Varieties of Attention, pp 63–102. Academic Press, New York

    Google Scholar 

  • Wickens C.D. (2002). Multiple resources and performance prediction’. Theor. Issues Ergon. Sci. 3(2): 159–177

    Article  Google Scholar 

  • Wikman A.S., Nieminen T. and Summala H. (1998). Driving experience and time-sharing during in-car tasks on roads of different width. Ergonomics 41: 358–372

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Helsinki Institute for Information Technology (HIIT), University of Helsinki and Helsinki University of Technology, P.O. Box 9800, FIN-02015 TKK, Espoo, Finland

    Miikka Miettinen & Antti Oulasvirta

Authors
  1. Miikka Miettinen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Antti Oulasvirta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miikka Miettinen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Miettinen, M., Oulasvirta, A. Predicting time-sharing in mobile interaction. User Model User-Adap Inter 17, 475–510 (2007). https://doi.org/10.1007/s11257-007-9033-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-007-9033-x

Keywords

Search

Navigation