Abstract
Large interactive displays play an important role in multi-user collaboration scenarios, such as scheme discussion, situation plotting and brainstorming. Users in multi-user collaboration scenarios may have diverse task allocations and usage preferences. Moreover, users’ positions in the interaction process is not fixed and they may move back and forth, because of the larger display and interactive areas. In order to promote the working efficiency and interactive experience of multi-user collaboration for large interactive displays, we have designed and added trackable and personalized shortcut menus to the large multi-touch desktop system——consultation platform. We use a Kinect to capture the skeletal information of different people to achieve multi-user recognition and real-time motion tracking. “Trackable” means that the shortcut menu could track the hand positions of different users, and the users could wake up the shortcut menu with touch gestures from anywhere on the screen. “Personalized” means that the users can set their shortcut menu content according to their usage frequency and preference of common functions. After testing, the shortcut menu received good feedback, and users said that this design could well balance the “shareability” and “independence” of large desktop systems. Our attempt to combine motion tracking with touch interaction in the consultation platform can provide ideas for human-computer interaction design for multi-user collaboration.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
McGill, M., Williamson, J.H., Brewster, S.A.: A review of collocated multi-user TV. Pers. Ubiquit. Comput. 19(5–6), 743–759 (2015). https://doi.org/10.1007/s00779-015-0860-1
Miao, X., Xue, C., Guo, C., Zhou, X., Yang, L., Jia, L.: Method and realization of multiplayer collaborative control oriented to the consultation platform. In: Proceedings of the 2021 5th International Conference on Electronic Information Technology and Computer Engineering, pp. 850–855 (2021)
Isenberg, P., Fisher, D., Paul, S.A., Morris, M.R., Inkpen, K., Czerwinski, M.: Co-located collaborative visual analytics around a tabletop display. IEEE Trans. Visual Comput. Graphics 18(5), 689–702 (2011)
Madni, T.M., Nayan, Y.B., Sulaiman, S., Abro, A., Tahir, M.: Usability evaluation of orientation techniques for medical image analysis using tabletop system. In: 2016 3rd International Conference on Computer and Information Sciences (ICCOINS), pp. 477–482 (2016)
Forlines, C., Shen, C.: DTLens: multi-user tabletop spatial data exploration. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 119–122 (2005)
Ardito, C., Buono, P., Costabile, M.F., Desolda, G.: Interaction with large displays: a survey. ACM Comput. Surv. (CSUR) 47(3), 1–38 (2015)
Takeoka, Y., Miyaki, T., Rekimoto, J.: Z-touch: an infrastructure for 3D gesture interaction in the proximity of tabletop surfaces. In: ACM International Conference on Interactive Tabletops and Surfaces, pp. 91–94 (2010)
Pfeuffer, K., Alexander, J., Chong, M.K., Gellersen, H.: Gaze-touch: combining gaze with multi-touch for interaction on the same surface. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 509–518 (2014)
Shaeffer, D.K.: MEMS inertial sensors: a tutorial overview. IEEE Commun. Mag. 51(4), 100–109 (2013)
Lv, W.: Gesture recognition in somatosensory game via Kinect sensor. Internet Technol. Lett. e311 (2021)
Song, Y., Gu, Y., Wang, P., Liu, Y., Li, A.: A Kinect based gesture recognition algorithm using GMM and HMM. In: 2013 6th International Conference on Biomedical Engineering and Informatics, pp. 750–754 (2013)
Acknowledgments
This work was supported jointly by National Natural Science Foundation of China (No. 71901061).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Du, X., Jia, L., Zhou, X., Miao, X., Xiao, W., Xue, C. (2022). Trackable and Personalized Shortcut Menu Supporting Multi-user Collaboration. In: Kurosu, M. (eds) Human-Computer Interaction. Technological Innovation. HCII 2022. Lecture Notes in Computer Science, vol 13303. Springer, Cham. https://doi.org/10.1007/978-3-031-05409-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-05409-9_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05408-2
Online ISBN: 978-3-031-05409-9
eBook Packages: Computer ScienceComputer Science (R0)