Skip to main content
Springer Nature Link
Log in

Multimedia-supported virtual experiment for online user–system trust studies

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Ambient Intelligence environments detect and respond to users needs, actions, behaviors and feelings. In the presence of interaction conflicts, user trust plays an important role in accepting Ambient Intelligence environments for living, working, etc. In this paper, we propose a multimedia-supported virtual experiment for online user–system trust studies. We conduct web-based experiments to gather data from a large number of online participants. Subjects experience the environment through an intelligent environment web-based 3D simulator. Our proposed approach can be utilized to measure trust not only in the presence of interaction conflicts, but also in the presence of any other variability that is hypothesized to have an effect on user trust in such environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Godaddy homepage. https://godaddy.com. Accessed 10 Feb 2016

  2. Indeed homepage. http://www.indeed.com. Accessed 10 Feb 2016

  3. Unity3d homepage. http://www.unity3d.com. Accessed 22 Oct 2015

  4. Webcredible website. http://www.webcredible.com/usability-lab-hire. Accessed 10 Feb 2016

  5. Wikipedia. https://www.wikipedia.org/. Accessed 10 Feb 2016

  6. Aarts, E.: Ambient intelligence: a multimedia perspective. MultiM. IEEE 11(1), 12–19 (2004)

    Article  Google Scholar 

  7. Alhamid, M.F., Rawashdeh, M., Dong, H., Hossain, M.A., Alelaiwi, A., El Saddik, A.: Recam: a collaborative context-aware framework for multimedia recommendations in an ambient intelligence environment. Multim. Syst. 1–15 (2015). doi:10.1007/s00530-015-0469-2

  8. Antifakos, S., Kern, N., Schiele, B., Schwaninger, A.: Towards improving trust in context-aware systems by displaying system confidence. In: Proceedings of the 7th international conference on human computer interaction with mobile devices and services, ACM, pp 9–14 (2005)

  9. Augusto, J.C., McCullagh, P.: Ambient intelligence: concepts and applications. Comput. Sci. Inf. Syst. 4(1), 1–27 (2007)

    Article  Google Scholar 

  10. Bartlett, M.: Properties of sufficiency and statistical tests. In: Breakthroughs in statistics, pp. 113–126. Springer, NY (1992)

  11. Behrend, T.S., Sharek, D.J., Meade, A.W., Wiebe, E.N.: The viability of crowdsourcing for survey research. Behav. Res. Methods 43(3), 800–813 (2011)

    Article  Google Scholar 

  12. Brom, C., Šisler, V., Slavík, R.: Implementing digital game-based learning in schools: augmented learning environment of. Multim. Syst. 16(1), 23–41 (2010)

    Article  Google Scholar 

  13. Cronbach, L.J., Meehl, P.E.: Construct validity in psychological tests. Psychol. Bull. 52(4), 281 (1955)

    Article  Google Scholar 

  14. Dehais, F., Causse, M., Vachon, F., Tremblay, S.: Cognitive conflict in human–automation interactions: a psychophysiological study. Appl. Ergon. 43(3), 588–595 (2012)

    Article  Google Scholar 

  15. Fogg, B., Marshall, J., Kameda, T., Solomon, J., Rangnekar, A., Boyd, J., Brown, B.: Web credibility research: a method for online experiments and early study results. In: CHI’01 extended abstracts on human factors in computing systems, ACM, pp. 295–296 (2001)

  16. Goodman, E., Kuniavsky, M., Moed, A.: Observing the user experience, second edition: a practitioner’s guide to user research, 2nd edn. Morgan Kaufmann Publishers Inc., San Francisco (2012)

    Google Scholar 

  17. Grandison, T., Sloman, M.: A survey of trust in internet applications. Commun. Surv. Tutor. IEEE 3(4), 2–16 (2000)

    Article  Google Scholar 

  18. Greenberg, S., Carpendale, S., Marquardt, N., Buxton, B.: Sketching user experiences: the workbook. Elsevier, NY (2011)

  19. Gueorguieva, R., Krystal, J.H.: Move over anova: progress in analyzing repeated-measures data and its reflection in papers published in the archives of general psychiatry. Arch. Gen. Psychiatry 61(3), 310–317 (2004)

    Article  Google Scholar 

  20. Horvitz, E.J.: Reflections on challenges and promises of mixed-initiative interaction. AI Mag. 28(2), 3 (2007)

    Google Scholar 

  21. Hossain, M.A., Shirehjini, A.A.N., Alghamdi, A.S., El Saddik, A.: Adaptive interaction support in ambient-aware environments based on quality of context information. Multim. Tools Appl. 67(2), 409–432 (2013)

    Article  Google Scholar 

  22. Jian, J.Y., Bisantz, A.M., Drury, C.G.: Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4(1), 53–71 (2000)

    Article  Google Scholar 

  23. Kittur, A., Chi, E.H., Suh, B.: Crowdsourcing user studies with mechanical turk. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, pp. 453–456 (2008)

  24. Lee, J.W., Cho, S., Liu, S., Cho, K., Helal, S.: Persim 3d: Context-driven simulation and modeling of human activities in smart spaces. Autom. Sci. Eng. IEEE Trans. 12(4), 1243–1256 (2015)

    Article  Google Scholar 

  25. Leung, C., Salga, A.: Enabling webgl. In: Proceedings of the 19th international conference on world wide web, ACM, pp. 1369–1370 (2010)

  26. Liu, D., Bias, R.G., Lease, M., Kuipers, R.: Crowdsourcing for usability testing. Proce. Am. Soc. Inf. Sci. Technol. 49(1), 1–10 (2012)

    Google Scholar 

  27. Madsen, M., Gregor, S.: Measuring human–computer trust. In: Proceedings of eleventh australasian conference on information systems, Citeseer, pp. 6–8 (2000)

  28. Maggiorini, D., Quadri, C., Ripamonti, L.A.: Opportunistic mobile games using public transportation systems: a deployability study. Multim. Syst. 20(5), 545–562 (2014)

    Article  Google Scholar 

  29. McAllister, D.J.: Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations. Acad. Manag. J. 38(1), 24–59 (1995)

    Article  MathSciNet  Google Scholar 

  30. Merritt, S.M., Ilgen, D.R.: Not all trust is created equal: dispositional and history-based trust in human–automation interactions. Hum. Fact. J. Hum. Fact. Ergon. Soc. 50(2), 194–210 (2008)

    Article  Google Scholar 

  31. Muir, B.M.: Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37(11), 1905–1922 (1994)

    Article  Google Scholar 

  32. Nazari Shirehjini, A.A., Klar, F.: 3DSim: rapid prototyping ambient intelligence. In: Proceedings of the 2005 joint conference on smart objects and ambient intelligence: innovative context-aware services: usages and technologies, ACM, pp. 303–307 (2005)

  33. Nielsen, J.: Applying discount usability engineering. Softw. IEEE 12(1), 98–100 (1995)

    Article  Google Scholar 

  34. O’Neil, E., Klepal, M., Lewis, D., O’Donnell, T., O’Sullivan, D., Pesch, D.: A testbed for evaluating human interaction with ubiquitous computing environments. In: Testbeds and research infrastructures for the development of networks and communities, 2005. Tridentcom 2005. First International Conference on, IEEE, pp. 60–69 (2005)

  35. Sack, O., Röcker, C.: Privacy and security in technology-enhanced environments: Exploring users knowledge about technological processes of diverse user groups. Univ. J. Psychol. 1(2), 72–83 (2013)

    Google Scholar 

  36. Sack, O., Röcker, C.: Like a family member who takes care of me users anthropomorphic representations and trustworthiness of smart home environments. Int. J. Virtual Worlds Hum. Comput. Interact. 2(1), 28–36 (2014)

    Google Scholar 

  37. Shapiro, S.P.: The social control of impersonal trust. Am. J. Sociol. 93(3), 623–658 (1987)

    Article  Google Scholar 

  38. Sheridan, T.B.: Adaptive automation, level of automation, allocation authority, supervisory control, and adaptive control: Distinctions and modes of adaptation. Syst. Man. Cybernet. Part A Syst. Hum. IEEE Trans. 41(4), 662–667 (2011)

    Article  Google Scholar 

  39. Shin, C., Dey, A.K., Woo, W.: Mixed-initiative conflict resolution for context-aware applications. In: Proceedings of the 10th international conference on ubiquitous computing, ACM, pp. 262–271 (2008)

  40. Shirehjini, A.A.N.: Interaction in ambient intelligence: Konzeption eines intuitiven assistenten zur ganzheitlichen und konfliktfreien interaktion in adaptiven umgebungen. PhD thesis, Technische Universität Darmstadt (2008)

  41. Soltaninejad, F., Shirehjini, A.A.N., Saniee, G., Semsar, A.: Mental model development support using collaborative 3d virtual environments. doi:10.13140/RG.2.1.4616.1360 (2015)

  42. Tukey, J.W.: Comparing individual means in the analysis of variance. Biometrics 5(2), 99–114 (1949)

    Article  MathSciNet  Google Scholar 

  43. Turner, C.W., Lewis, J.R., Nielsen, J.: Determining usability test sample size. Int. Encycl. Ergon. Hum. Fact. 3, 3084–3088 (2006)

    Google Scholar 

  44. van der Veer, G. C., Melguizo, M. D. C. P.: Mental models. The Human–Computer Interaction Handbook, pp. 52–80 (2002)

  45. de Vries, P., Midden, C., Bouwhuis, D.: The effects of errors on system trust, self-confidence, and the allocation of control in route planning. Int. J. Hum. Comput. Stud. 58(6), 719–735 (2003)

    Article  Google Scholar 

  46. Yan Z, Kantola R, Zhang P (2011) A research model for human–computer trust interaction. In: Trust, Security and Privacy in Computing and Communications (TrustCom), 2011 IEEE 10th International Conference on, IEEE, pp 274–281

  47. Zoller, M., Shirehjini, A.AN.: Realization of a UPnP agent for controlling adaptive multimedia environments. Master’s thesis, Technische Universität Darmstadt, Darmstadt, Germany (2008)

Download references

Author information

Authors and Affiliations

  1. Computer Engineering Department, Sharif University of Technology, Tehran, Iran

    Azin Semsar & Ali Asghar Nazari Shirehjini

Authors
  1. Azin Semsar
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Ali Asghar Nazari Shirehjini
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ali Asghar Nazari Shirehjini.

Additional information

Communicated by L. Skorin-Kapov.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Semsar, A., Nazari Shirehjini, A.A. Multimedia-supported virtual experiment for online user–system trust studies. Multimedia Systems 23, 583–597 (2017). https://doi.org/10.1007/s00530-016-0519-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-016-0519-4

Keywords