Abstract
During a two-day objective structured clinical examination (OSCE), we compared two types of checklists for student performance ratings: paper & pencil vs. digital checklists on iPads. Several subjective and objective measures from 10 examiners were collected and computed. Data showed that digital checklists were perceived as significantly more usable and less exertive and were also preferred in overall ratings. Assessments completed with digital checklists were found to have no missing items while assessments completed with paper checklists contained more than 8 blank items on average. Finally, checklist type did not influence assessment scores even though when using digital checklists more item-choice changes were produced.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Harden, R.M., Stevenson, M., Downie, W.W., Wilson, G.M.: Assessment of clinical competence using objective structured examination. Br. Med. J (Clin. Res. Ed.) 1, 447–451 (1975)
Barman, A.: Critiques on the objective structured clinical examination. Ann. Acad. Med. 34, 478–482 (2005)
Harden, R.M., Gleeson, F.A.: Assessment of clinical competence using an objective structured clinical examination (OSCE). Med. Educ. 13, 41–54 (1979)
Gupta, P., Dewan, P., Singh, T.: Objective Structured Clinical Examination (OSCE) Revisited. Indian Pediatr. 47, 911–920 (2010)
Serving Swiss Universities (SWITCH), http://www.switch.ch/aaa/projects/detail/FHO.2
Serving Swiss Universities (SWITCH), http://www.switch.ch/aaa/projects/detail/UNIBE.4
Schmidts, M.B., http://m3e.meduniwien.ac.at/resources/e_osce.pdf
Treadwell, I.: The usability of personal digital assistants (PDAs) for assessment of practival performance. Med. Educ. 9, 855–861 (2006)
Hatfield, C.L., Bragg, H.H.: Utilizing Electronic Objective Structured Clinical Exam (eOSCE) Stations for College-Wide Assessment Purposes. In: 109th Annual Meeting of the American Association of Colleges of Pharmacy, Chicago, Illinois, p. 81 (2008)
E-OSCE official Website, http://www.e-osce.ch
Holzinger, A.: Finger Instead of Mouse: Touch Screens as a Means of Enhancing Universal Access. In: Carbonell, N., Stephanidis, C. (eds.) UI4ALL 2002. LNCS, vol. 2615, pp. 387–397. Springer, Heidelberg (2003)
Holzinger, A., Hoeller, M., Schedlbauer, M., Urlesberger, B.: An Investigation of Finger versus Stylus Input in Medical Scenarios. In: ITI 30th International Conference on Information Technology Interfaces, pp. 433–438. IEEE Press, New York (2008)
Gaunt, K., Schmitz, F.M., Stolze, M.: Choose Popovers over Buttons for iPad Questionnaires. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part II. LNCS, vol. 6947, pp. 533–540. Springer, Heidelberg (2011)
Hudiburg, R.A.: Psychology of Computer Use.7. Measuring Technostress - Computer-Related Stress. Psychol. Rep. 64, 767–772 (1989)
Anderson, A.A.: Predictors of computer anxiety and performance in information systems. Computers in Human Behavior 12, 61–77 (1996)
Webster, J., Martocchio, J.J.: Microcomputer Playfulness - Development of a Measure with Workplace Implications. Mis. Quart. 16, 201–226 (1992)
Lewis, J.R.: Ibm Computer Usability Satisfaction Questionnaires - Psychometric Evaluation and Instructions for Use. Int. J. Hum.-Comput. Int. 7, 57–78 (1995)
Eilers, K., Nachreiner, F., Hänecke, K.: Entwicklung und Überprüfung einer Skala zur Erfassung subjektiv erlebter Anstrengung (The development and testing of a scale to validation for recording subjectively experienced effort). Zeitschrift für Arbeitswissenschaft 40, 215–224 (1986)
Zijlstra, F.R.H.: Efficiency in Work Behaviour; A Design Approach for Modern Tools. Delft University Press, Delft (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schmitz, F.M., Zimmermann, P.G., Gaunt, K., Stolze, M., Guttormsen Schär, S. (2011). Electronic Rating of Objective Structured Clinical Examinations: Mobile Digital Forms Beat Paper and Pencil Checklists in a Comparative Study. In: Holzinger, A., Simonic, KM. (eds) Information Quality in e-Health. USAB 2011. Lecture Notes in Computer Science, vol 7058. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25364-5_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-25364-5_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25363-8
Online ISBN: 978-3-642-25364-5
eBook Packages: Computer ScienceComputer Science (R0)