Skip to main content
SpringerLink
Log in

Cross-device task interaction framework between the smart watch and the smart phone

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Along with the increasing emergence of smart watch devices, new interaction techniques between these devices and smart phones have been proposed to leverage their availability. However, there are few existing studies on enhancing smart watches’ current functions: working as an information processing system for users’ phones in terms of both browsing and handling short information. In this work, we introduce a framework for handling tasks between the smart phone and the smart watch, including task delegation and task management, that enables the smart watch to temporarily handle lightweight jobs from the smart phone. By utilizing this framework, people can save valuable phone screen space for more complicated or important tasks. Moreover, considering users’ multi-tasking behaviors, we also provide some example situations where users use both their phone and smart watch to handle different kinds of tasks simultaneously. The user study illustrates that lightweight jobs can be efficiently handled by users on the watch.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Nielsen HS, Skov MB, Olsen MP, Kjeldskov J (2014) JuxtaPinch: an application for collocated multi-device photo sharing. In: Proceedings of the 16th international conference on human-computer interaction with mobile devices & services (MobileHCI’14), pp 417–420

  2. Melchior J, Vanderdonckt J, Van Roy P (2011) A model-based approach for distributed user interfaces. In: Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems (EICS ’11), pp 11–20

  3. Hamilton P, Wigdor£ DJ (2014) Conductor: enabling and understanding cross-device interaction. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’14), pp 2773–2782

  4. Dearman D, Pierce J (2008) It’s on my other computer: computing with multiple devices. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’08), pp 767–776

  5. Santosa S, Wigdor D (2013) A field study of multi-device workflows in distributed workspaces. In: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (UbiComp’13), pp 63–72

  6. Van Cauwenberge A, Schaap G, Van Roy R (2014) TV no longer commands our full attention: effects of second-screen viewing and task relevance on cognitive load and learning from news. Comput Hum Behav 38:100–109

    Article  Google Scholar 

  7. Apple (2017) Use continuity to connect your iPhone, iPad, iPod touch, and Mac. https://support.apple.com/en-us/HT204681

  8. McAdam C, Brewster S (2011) Using mobile phones to interact with tabletop computers. In: Proceedings of the ACM international conference on interactive tabletops and surfaces (ITS’11), pp 232–241

  9. Robertson S, Wharton C, Ashworth C, Franzke M (1996) Dual device user interface design: PDAs and interactive television. In: Tauber MJ (ed) Proceedings of the SIGCHI conference on human factors in computing systems (CHI’96), pp 79–86

  10. Cecchinato ME, Cox AL, Bird J (2015) Smartwatches: the good, the bad and the ugly?. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems (CHI EA ’15), pp 2133–2138

  11. Anstead E, Benford S, Houghton RJ (2014) Many-screen viewing: evaluating an olympics companion application. In: Proceedings of the 2014 ACM international conference on interactive experiences for TV and online video (TVX’14), pp 103–110

  12. Bailey BP, Konstan JA, Carlis JV (2000) Measuring the effects of interruptions on task performance in the user interface. IEEE Int Conf Sys Man Cyberbetics 2:757–762

    Article  Google Scholar 

  13. O’Conaill B, Frohlich D (1995) Timespace in the workplace: dealing with interruptions. In: Conference companion on human factors in computing systems (CHI’95), pp 262–263

  14. Schirra S, Bentley FR (2015) It’s kind of like an extra screen for my phone: understanding everyday uses of consumer smart watches. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems (CHI EA’15), pp 2151–2156

  15. Zhang Y, Rau P-LP (2015) Playing with multiple wearable devices. Comput Hum Behav 50(C):148–158

    Article  Google Scholar 

  16. Apple (2017) Apple watch: http://www.apple.com/watch/

  17. Laput G, Xiao R, Chen XA, Hudson SE, Harrison C (2014) Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors. In: Proceedings of the 27th annual ACM symposium on user interface software and technology (UIST’14). ACM, pp 389–394

  18. Perrault ST, Lecolinet E, Eagan J, Guiard Y (2013) Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’13)

  19. Oakley I, Lee D, Rasel I Md, Esteves A (2015) Beats: tapping gestures for smart watches. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI’15), pp 1237–1246

  20. Knibbe J, Martinez Plasencia D, Bainbridge C, Chan C-K, Wu J, Cable T, Munir H, Coyle D (2014) Extending interaction for smart watches: enabling bimanual around device control. In: Proceedings of the extended abstracts of the 32nd annual ACM conference on human factors in computing systems (CHI EA’14), pp 1891–1896

  21. Kim J, He J, Lyons K, Starner T (2007) The gesture watch: a wireless contact-free gesture based wrist interface. In: Proceedings of the 2007 11th IEEE international symposium on wearable computers (ISWC’07), pp 1–8

  22. Van Vlaenderen W, Brulmans J, Vermeulen J, Schoening J (2015) Watchme: a novel input method combining a smartwatch and bimanual interaction. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems (CHI EA’15), pp 2091–2095

  23. Ogata M, Imai M (2014) SkinWatch: skin gesture interaction for smart watch. In: Proceedings of the 6th augmented human international conference (AH ’15), pp 21–24

  24. Komninos A, Dunlop MD (2015) Using a smart-watch as a input device for text. IEEE Pervasive Comput 13:50–58

    Article  Google Scholar 

  25. Chen XA, Grossman T, Wigdor DJ, Fitzmaurice G (2014) Duet: exploring joint interactions on a smart phone and a smart watch. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’14), pp 159–168

  26. Houben S, Marquardt N (2015) Watchconnect: a toolkit for prototyping smartwatch-centric cross-device applications. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI ’15), pp 1247–1256

  27. von Zadow U, Büschel W, Langner R, Dachselt R (2014) Sleep: using a sleeve display to interact with touch-sensitive display walls. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces (ITS’14), pp 129–138

  28. Mayer S, Soros G (2014) User interface beaming – seamless interaction with smart things using personal wearable computers. In: Proceedings of the 2014 11th international conference on wearable and implantable body sensor networks workshops (BSNWORKSHOPS’14), pp 46–49

  29. Chi P-Y, Li Y (2015) Weave: scripting cross-device wearable interaction. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI’15), pp 3923–393

  30. Badam SK, Elmqvist N (2014) Polychrome: a cross-device framework for collaborative web visualization. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces (ITS ’14), pp 109–118

  31. Gillie T, Broadbent D (1989) What makes interruptions disruptive? A study of length, similarity, and complexity. Psychol Res 50(4):243–250

    Article  Google Scholar 

  32. Zijlstra FRH, Roe RA, Leonora AB, et al. (1999) Temporal factors in mental work: effects of interrupted activities [J]. J Occup Organ Psychol, 1999 72(2):163–185

    Article  Google Scholar 

Download references

Funding

This work has been partially supported by the National Key R&D Program of China under grant no. 2017YFB0203000, the National Natural Science Foundation of China under grant nos.61872223,61802187,61702311, the Young Scholars Program of Shandong University under grant no.2015WLJH41, the Special Funds of Taishan Scholar Construction Project.

Author information

Authors and Affiliations

  1. School of Software, Shandong University, Jinan, China

    Yajie Xu, Lu Wang, Yanning Xu & Xiangxu Meng

  2. Engineering Research Center of Digital Media Technology, Ministry of Education, Jinan, China

    Yajie Xu, Lu Wang, Yanning Xu & Xiangxu Meng

  3. New York University, New York, NY, USA

    Siyuan Qiu

  4. Shandong Experimental High School, Jinan, China

    Maopu Xu

Authors
  1. Yajie Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanning Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Siyuan Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maopu Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiangxu Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Lu Wang or Xiangxu Meng.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Y., Wang, L., Xu, Y. et al. Cross-device task interaction framework between the smart watch and the smart phone. Pers Ubiquit Comput 25, 1039–1049 (2021). https://doi.org/10.1007/s00779-019-01280-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-019-01280-7

Keywords

Search

Navigation