Abstract
Focusing on an online survey in psychological research, we evaluated the usability of the device chosen to complete the survey and examined underlying reasons through a usability enquiry method. The participants were 149 undergraduate students who completed a questionnaire for assessing achievement emotions and motivation, with open-ended and closed-ended questions. They also evaluated the usability of the device chosen to complete the survey and reported underlying reasons. We analyzed the data with Generalized Linear Mixed Models. The devices chosen to complete the survey were perceived as highly usable, even if usability was lower for smartphones compared to other devices such as personal computers, notebooks, and tablets. The most relevant reasons regarded characteristics of the tools, followed by those of the tasks and then of users and environments. The findings are discussed taking into account their theoretical and applied relevance for monitoring and improving online psychological assessment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bates, D., Mächler, M., Bolker, B., Walker, S.: Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67(1), 1–48 (2015). https://doi.org/10.18637/jss.v067.i01
Bianchi, I., Savardi, U., Burro, R., Martelli, M.F.: Doing the opposite to what another person is doing. Acta Psychologica 151, 117–133 (2014). https://doi.org/10.1016/j.actpsy.2014.06.003
Branchini, E., Burro, R., Bianchi, I., Savardi, U.: Contraries as an effective strategy in geometrical problem solving. Think. Reason. 21(4), 397–430 (2015). https://doi.org/10.1080/13546783.2014.994035
Brondino, M., Raccanello, D., Pasini M.: Achievement goals as antecedents of achievement emotions: the 3 X 2 achievement goal model as a framework for learning environments design. In: Advances in Intelligent and Soft Computing, vol. 292, pp. 53–60. https://doi.org/10.1007/978-3-319-07698-0
Burro, R., Raccanello, D., Pasini, M., Brondino, M.: An estimation of a nonlinear dynamic process using Latent Class extended Mixed Models. Affect profiles after terrorist attacks. Nonlinear Dyn. Psychol. Life Sci. 22(1), 35–52 (2018)
Dombrowsky, U., Wagner, T.: Mental strain as field of action in the 4th industrial revolution. Procedia CIRP 17, 100–105 (2014)
Ham, D.H.: A model-based framework for classifying and diagnosing usability problems. Cogn. Technol. Work 16, 373–388 (2014). https://doi.org/10.1007/s10111-013-0267-6
Iwarsson, S., Stahl, A.: Accessibility, usability and universal design – positioning and definition of concepts describing person-environment relationships. Disabil. Rehabil. 25(2), 57–66 (2003)
Kenward, M.G., Roger, J.H.: An improved approximation to the precision of fixed effects from restricted maximum likelihood. Comput. Stat. Data Anal. 53, 2583–2595 (2009)
Lenth, R.V.: Least-squares means: the R package lsmeans. J. Stat. Softw. 69(1), 1–33 (2016). https://doi.org/10.18637/jss.v069.i01
Nolen, S.B.: Young children’s motivation to read and write: development in social contexts. Cogn. Instr. 25(2–3), 219–270 (2007). https://doi.org/10.1080/07370000701301174
Olivier, J., May, W.L., Bell, M.L.: Relative effect sizes for measures of risk. Commun. Stat. Theory Methods, 1–8 (2017). https://doi.org/10.1080/03610926.2015.1134575
Pasini, M., Brondino, M., Burro, R., Raccanello, D., Gallo, S. (2016). The use of different multiple devices for an ecological assessment in psychological research: an experience with a daily affect assessment. In: Advances in Intelligent and Soft Computing, vol. 478, pp. 121–129. https://doi.org/10.1007/978-3-319-40165-2_13
Raccanello, D.: Students’ expectations about interviewees’ and interviewers’ achievement emotions in job selection interviews. J. Employ. Couns. 52(2), 50–64 (2015). https://doi.org/10.1002/joec.12004
Raccanello, D., Brondino, M., Pasini, M.: Achievement emotions in technology enhanced learning: development and validation of self-report instruments in the Italian context. Interact. Des. Archit. J. IxD&A 23, 68–81 (2014)
Raccanello, D., Brondino, M., Pasini, M.: On-line assessment of pride and shame: relationships with cognitive dimensions in university students. Adv. Intell. Soft Comput. 374, 17–24 (2015). https://doi.org/10.1007/978-3-319-19632-9_3
Raccanello, D., Brondino, M., Pasini, M.: Two neglected moral emotions in university settings: Some preliminary data on pride and shame. J. Beliefs Values Stud. Relig. Educ. 36(2), 231–238 (2015). https://doi.org/10.1080/13617672.2015.1031535
Raccanello, D., Burro, R., Brondino, M., Pasini, M.: Relevance of terrorism for Italian students not directly exposed to it: the affective impact of the 2015 Paris and the 2016 Brussels attacks. Stress and Health 34, 338–343 (2017). https://doi.org/10.1002/smi.2793
Raccanello, D., Burro, R., Brondino, M., Pasini, M.: Use of internet and wellbeing: a mixed-device survey. In: Advances in Intelligent and Soft Computing, vol. 617, pp. 65–73 (2017). https://doi.org/10.1007/978-3-319-60819-8_8
Raccanello, D., Burro, R., Hall, R.: Children’s emotional experience two years after an earthquake: an exploration of knowledge of earthquakes and associated emotions. PLoS ONE 12(2), 1–21 (2017). https://doi.org/10.1371/journal.pone.0189633
Schmitz, C.: LimeSurvey: an open source survey tool. LimeSurvey Project Hamburg, Germany (2015). http://www.limesurvey.org
Shackel, B.: Usability – Context, framework, definition, design and evaluation. Interact. Comput. 21, 339–346 (2009). https://doi.org/10.1016/j.intcom.2009.04.007
Singmann, H., Bolker, B., Westfall, J., Aust, F.: Afex: analysis of factorial experiments (2016). https://CRAN.R-project.org/package=afex
Zhang, Z.: Overview of usability evaluation method (2011). https://www.usabilityhome.com
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Raccanello, D. et al. (2019). The Usability of Multiple Devices for Assessment in Psychological Research: Salience of Reasons Underlying Usability. In: Di Mascio, T., et al. Methodologies and Intelligent Systems for Technology Enhanced Learning, 8th International Conference. MIS4TEL 2018. Advances in Intelligent Systems and Computing, vol 804. Springer, Cham. https://doi.org/10.1007/978-3-319-98872-6_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-98872-6_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-98871-9
Online ISBN: 978-3-319-98872-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)