Abstract
The arrival of 360° video to the everyday life creates the necessity of assessing both the audiovisual production and the playback environment offered to the final user. Leveraging the standard Experience API (xAPI), that considers collecting micro-interactions with e-learning content, we propose a platform to automatically collect the users’ interaction with applications based on interactive 360° multimedia. To validate the platform, we introduce an example of educational activities based on interactive 360° videos and the tools used to first, annotate these videos and convert them into interactive activities; second, to perform said activity and collect the users’ behavior via xAPI statements; and finally, to convert these statements to meaningful information in the form of user metrics and charts, both at individual level and also aggregated by activity, creating the possibility of finding singular and group behavior. This work concludes that the presented platform helps to analyze how users behave with omnidirectional interactive productions, with the aim of validating and improving its usability, ending with the discussion of future work ideas.
Similar content being viewed by others
Notes
References
ADL: GitHub - adlnet/xAPI-Spec, https://github.com/adlnet/xAPI-Spec
ADL: xAPI-Spec/xAPI-Communication.md at master · adlnet/xAPI-Spec · GitHub, https://github.com/adlnet/xAPI-Spec/blob/master/xAPI-Communication.md#stmtresget
Bakharia A xAPI Analytics - Stepping out of the LRS (Part 1), http://www.beyondlms.org/blog/27/07/2015/xAPISteppingOutoftheLRS/
Bakharia A, Kitto K, Pardo A, Gaševi D, Dawson S Recipe for Success — Lessons Learnt from Using xAPI within the Connected Learning Analytics Toolkit
Berning, M., Yonezawa, T., Riedel, T., Nakazawa, J., Beigl, M., Tokuda, H (2013) pARnorama. In: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication - UbiComp ‘13 Adjunct. ACM Press, New York, New York, USA, p 1471–1474
Bleumers L, Van den Broeck W, Lievens B, Pierson J (2012) Seeing the bigger picture. Proc 10th Eur Conf Interact tv video - EuroiTV 12:115
Chen Q, Chen Y, Liu D, Shi C, Wu Y, Qu H (2016) PeakVizor: Visual Analytics of Peaks in Video Clickstreams from Massive Open Online Courses. IEEE Trans Vis Comput Graph 22:2315–2330
Drachen A, Canossa A (2011) Evaluating motion: spatial user behaviour in virtual environments. Int J Arts Technol 4:294
Duhon R Why Reporting in the LRS?, http://blog.saltbox.com/blog/2015/09/23/why-reporting-in-the-lrs/
Fekete J-D, Van Wijk JJ, Stasko JT, North C (2008) The value of information visualization. Inf Vis 4950:1–18
Giannakos MN, Chorianopoulos K, Chrisochoides N (2015) Making sense of video analytics: Lessons learned from clickstream interactions, attitudes, and learning outcome in a video-assisted course. Int Rev Res Open Distrib Learn 16
Kasahara S, Nagai S, Rekimoto J (2017) JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera. IEEE Trans Vis Comput Graph 23:1222–1234
Kavanagh S, Luxton-Reilly A, Wüensche B, Plimmer B (2016) Creating 360° educational video. In: Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI ‘16. ACM Press, New York, New York, USA, p 34–39
Kitto K, Cross S, Waters Z, Lupton M (2015) Learning analytics beyond the LMS. In: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge - LAK ‘15. ACM Press, New York, New York, USA, p 11–15
Kuzyakov E, Chen S, Peng R Enhancing high-resolution 360 streaming with view prediction, https://code.facebook.com/posts/118926451990297/enhancing-high-resolution-360-streaming-with-view-prediction/
Lin C-H, Hu S-S, Lai H-Y, Chiang C-F, Tseng H-C, Cheng Y-C (2017) VisCa: A Dashboard System to Visualize Learning Activities from E-learning Platforms. Presented at the
Mizushina Y, Fujiwara W, Sudou T, Fernando CL, Minamizawa K, Tachi S (2015) Interactive Instant Replay: Sharing Sports Experience using 360-degrees Spherical Images and Haptic Sensation based on the Coupled Body Motion. Proc 6th Augment Hum Int Conf :227–228
Neng LAR, Chambel T (2010) Get around 360° hypervideo. In: Proceedings of the 14th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek ‘10. ACM Press, New York, New York, USA, p 119
Neumann U, Pintaric T, Rizzo A (2000) Immersive panoramic video. In: Proceedings of the eighth ACM international conference on Multimedia - MULTIMEDIA ‘00. ACM Press, New York, New York, USA, p 493–494
Paternò F, Schiavone AG, Pitardi P (2016) Timelines for Mobile Web Usability Evaluation. In: Proceedings of the International Working Conference on Advanced Visual Interfaces - AVI ‘16. ACM Press, New York, New York, USA, p 88–91
Petry B, Huber J (2015) Towards effective interaction with omnidirectional videos using immersive virtual reality headsets. Proc 6th Augment Hum Int Conf - AH 15:217–218
Shi C, Siwei F, Chen Q, Huamin Q (2015) VisMOOC: Visualizing video clickstream data from Massive Open Online Courses. In: 2015 I.E. Pacific Visualization Symposium (PacificVis). IEEE, p 159–166
Siemens G (2011) LAK ‘11 First International Conference on Learning Analytics and Knowledge 2011, https://tekri.athabascau.ca/analytics/
Wachtler J, Khalil M, Taraghi B, Ebner M On Using Learning Analytics to Track the Activity of Interactive MOOC Videos
Wallner G, Kriglstein S (2013) Visualization-based analysis of gameplay data - A review of literature
Williamson JR, Sundén D, Bradley J (2015) GlobalFestival: Evaluating Real World Interaction on a Spherical Display. Proc Jt Int Conf Pervasive Ubiquitous Comput Int Symp Wearable Comput :1251–1261
Zoric G, Barkhuus L, Engström A, Önnevall, E (2013) Panoramic video. In: Proceedings of the 11th european conference on Interactive TV and video - EuroITV ‘13. ACM Press, New York, New York, USA, p 153
Acknowledgements
A. Oliver was supported by a predoctoral contract with the Universitat de les Illes Balears (UIB).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bibiloni, T., Oliver, A. & del Molino, J. Automatic collection of user behavior in 360° multimedia. Multimed Tools Appl 77, 20597–20614 (2018). https://doi.org/10.1007/s11042-017-5510-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-5510-3