Skip to main content

Automatic collection of user behavior in 360° multimedia

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The arrival of 360° video to the everyday life creates the necessity of assessing both the audiovisual production and the playback environment offered to the final user. Leveraging the standard Experience API (xAPI), that considers collecting micro-interactions with e-learning content, we propose a platform to automatically collect the users’ interaction with applications based on interactive 360° multimedia. To validate the platform, we introduce an example of educational activities based on interactive 360° videos and the tools used to first, annotate these videos and convert them into interactive activities; second, to perform said activity and collect the users’ behavior via xAPI statements; and finally, to convert these statements to meaningful information in the form of user metrics and charts, both at individual level and also aggregated by activity, creating the possibility of finding singular and group behavior. This work concludes that the presented platform helps to analyze how users behave with omnidirectional interactive productions, with the aim of validating and improving its usability, ending with the discussion of future work ideas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://youtube-creators.googleblog.com/2015/03/a-new-way-to-see-and-share-your-world.html

  2. https://facebook360.fb.com/

  3. https://www.khronos.org/webgl/

  4. http://www.lxhive.com/

  5. https://learninglocker.net/

  6. https://www.youtube.com/analytics

  7. https://media.fb.com/2016/08/10/new-publisher-tools-for-360-video/

  8. https://wistia.com/

  9. http://www.finwe.mobi/main/liveheat/

  10. https://threejs.org/

  11. http://socket.io/

  12. https://nodejs.org/

  13. http://pandas.pydata.org/

  14. http://bokeh.pydata.org/

  15. http://xapi.vocab.pub/datasets/video/

  16. https://registry.tincanapi.com

References

  1. ADL: GitHub - adlnet/xAPI-Spec, https://github.com/adlnet/xAPI-Spec

  2. ADL: xAPI-Spec/xAPI-Communication.md at master · adlnet/xAPI-Spec · GitHub, https://github.com/adlnet/xAPI-Spec/blob/master/xAPI-Communication.md#stmtresget

  3. Bakharia A xAPI Analytics - Stepping out of the LRS (Part 1), http://www.beyondlms.org/blog/27/07/2015/xAPISteppingOutoftheLRS/

  4. Bakharia A, Kitto K, Pardo A, Gaševi D, Dawson S Recipe for Success — Lessons Learnt from Using xAPI within the Connected Learning Analytics Toolkit

  5. Berning, M., Yonezawa, T., Riedel, T., Nakazawa, J., Beigl, M., Tokuda, H (2013) pARnorama. In: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication - UbiComp ‘13 Adjunct. ACM Press, New York, New York, USA, p 1471–1474

  6. Bleumers L, Van den Broeck W, Lievens B, Pierson J (2012) Seeing the bigger picture. Proc 10th Eur Conf Interact tv video - EuroiTV 12:115

    Article  Google Scholar 

  7. Chen Q, Chen Y, Liu D, Shi C, Wu Y, Qu H (2016) PeakVizor: Visual Analytics of Peaks in Video Clickstreams from Massive Open Online Courses. IEEE Trans Vis Comput Graph 22:2315–2330

    Article  Google Scholar 

  8. Drachen A, Canossa A (2011) Evaluating motion: spatial user behaviour in virtual environments. Int J Arts Technol 4:294

    Article  Google Scholar 

  9. Duhon R Why Reporting in the LRS?, http://blog.saltbox.com/blog/2015/09/23/why-reporting-in-the-lrs/

  10. Fekete J-D, Van Wijk JJ, Stasko JT, North C (2008) The value of information visualization. Inf Vis 4950:1–18

    Google Scholar 

  11. Giannakos MN, Chorianopoulos K, Chrisochoides N (2015) Making sense of video analytics: Lessons learned from clickstream interactions, attitudes, and learning outcome in a video-assisted course. Int Rev Res Open Distrib Learn 16

  12. Kasahara S, Nagai S, Rekimoto J (2017) JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera. IEEE Trans Vis Comput Graph 23:1222–1234

    Article  Google Scholar 

  13. Kavanagh S, Luxton-Reilly A, Wüensche B, Plimmer B (2016) Creating 360° educational video. In: Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI ‘16. ACM Press, New York, New York, USA, p 34–39

  14. Kitto K, Cross S, Waters Z, Lupton M (2015) Learning analytics beyond the LMS. In: Proceedings of the Fifth International Conference on Learning Analytics And Knowledge - LAK ‘15. ACM Press, New York, New York, USA, p 11–15

  15. Kuzyakov E, Chen S, Peng R Enhancing high-resolution 360 streaming with view prediction, https://code.facebook.com/posts/118926451990297/enhancing-high-resolution-360-streaming-with-view-prediction/

  16. Lin C-H, Hu S-S, Lai H-Y, Chiang C-F, Tseng H-C, Cheng Y-C (2017) VisCa: A Dashboard System to Visualize Learning Activities from E-learning Platforms. Presented at the

  17. Mizushina Y, Fujiwara W, Sudou T, Fernando CL, Minamizawa K, Tachi S (2015) Interactive Instant Replay: Sharing Sports Experience using 360-degrees Spherical Images and Haptic Sensation based on the Coupled Body Motion. Proc 6th Augment Hum Int Conf :227–228

  18. Neng LAR, Chambel T (2010) Get around 360° hypervideo. In: Proceedings of the 14th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek ‘10. ACM Press, New York, New York, USA, p 119

  19. Neumann U, Pintaric T, Rizzo A (2000) Immersive panoramic video. In: Proceedings of the eighth ACM international conference on Multimedia - MULTIMEDIA ‘00. ACM Press, New York, New York, USA, p 493–494

  20. Paternò F, Schiavone AG, Pitardi P (2016) Timelines for Mobile Web Usability Evaluation. In: Proceedings of the International Working Conference on Advanced Visual Interfaces - AVI ‘16. ACM Press, New York, New York, USA, p 88–91

  21. Petry B, Huber J (2015) Towards effective interaction with omnidirectional videos using immersive virtual reality headsets. Proc 6th Augment Hum Int Conf - AH 15:217–218

    Article  Google Scholar 

  22. Shi C, Siwei F, Chen Q, Huamin Q (2015) VisMOOC: Visualizing video clickstream data from Massive Open Online Courses. In: 2015 I.E. Pacific Visualization Symposium (PacificVis). IEEE, p 159–166

  23. Siemens G (2011) LAK ‘11 First International Conference on Learning Analytics and Knowledge 2011, https://tekri.athabascau.ca/analytics/

  24. Wachtler J, Khalil M, Taraghi B, Ebner M On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

  25. Wallner G, Kriglstein S (2013) Visualization-based analysis of gameplay data - A review of literature

  26. Williamson JR, Sundén D, Bradley J (2015) GlobalFestival: Evaluating Real World Interaction on a Spherical Display. Proc Jt Int Conf Pervasive Ubiquitous Comput Int Symp Wearable Comput :1251–1261

  27. Zoric G, Barkhuus L, Engström A, Önnevall, E (2013) Panoramic video. In: Proceedings of the 11th european conference on Interactive TV and video - EuroITV ‘13. ACM Press, New York, New York, USA, p 153

Download references

Acknowledgements

A. Oliver was supported by a predoctoral contract with the Universitat de les Illes Balears (UIB).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Toni Bibiloni.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bibiloni, T., Oliver, A. & del Molino, J. Automatic collection of user behavior in 360° multimedia. Multimed Tools Appl 77, 20597–20614 (2018). https://doi.org/10.1007/s11042-017-5510-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5510-3

Keywords