Skip to main content
Springer Nature Link
Log in

Pathways to Successful Online Testing: eExams with the “Secure Exam Environment” (SEE)

  • Conference paper
  • First Online:
Technology Enhanced Assessment (TEA 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 829))

Included in the following conference series:

Abstract

eExams can potentially improve didactics, efficiency, objectivity, flexibility, accessibility, and even sustainability compared to written exams. However, they also present great challenges such as security, reliability, integrity, as well as the availability of computer rooms of sufficient size. To conduct large-scale online exams, we implemented the “Secure Exam Environment” (SEE) in 2011. The SEE enables online testing in any lecture hall using students’ own devices – and loan devices if needed – while blocking access to unauthorized files or internet pages. After booting the SEE, assessment is conducted via Moodle and additional software (e.g. GeoGebra, Excel or Eclipse) can be used as well. To maintain quality of service, we developed a monitoring solution to control the technical infrastructure of the SEE. As of July 2018, we have conducted 1,605 such online exams with 57,607 students. Moreover, the SEE offers the possibility for slotted exams where students can choose freely the time of their exam within a week. Since technical solutions cannot solve all problems, the organization of eExams is vital to guarantee smooth operations as well as integrity. This paper offers a technical solution for the implementation of a secure and highly available exam environment with the various benefits of eExams, and provides organizational recommendations for the successful roll out of online exams as well as for overcoming technical challenges.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Biggs, J., Tang, C.: Teaching for Quality Learning at University. McGraw Hill, Berkshire (2011)

    Google Scholar 

  2. UK Quality Code for Higher Education: Part B: Assuring and Enhancing Academic Quality. Quality Assurance Agency of Higher Education (2001). http://www.qaa.ac.uk//en/quality-code/the-existing-uk-quality-code/part-b-assuring-and-enhancing-academic-quality. Accessed 13 July 2018

  3. Marriott, P.: Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. Br. J. Edu. Technol. 40(2), 237–254 (2009)

    Article  Google Scholar 

  4. Müller, F.H., Bayer, C.: Prüfungen: Vorbereitung - Durchführung - Bewertung. In: Hawelka, B., Hammerl, M., Gruber, H. (eds.) Förderung von Kompetenzen in der Hochschullehre, pp. 223–237. Asanger, Kröning (2007)

    Google Scholar 

  5. Sharpe, R., Oliver, M.: Designing courses for e-learning. In: Beetham, H., Sharpe, R. (eds.) Rethinking Pedagogy for a Digital Age. Designing and Delivering e-Learning. Routledge, London (2007)

    Google Scholar 

  6. Clarke-Midura, J., Code, J., Mayrath, M.C., Dede, C., Zap, N.: Thinking outside the bubble: virtual performance assessments for measuring complex learning. In: Technology-Based Assessments for 21st Century Skills, pp. 125–146 (2012)

    Google Scholar 

  7. Benkada, C., Moccozet, L.: Enriched interactive videos for teaching and learning. In: 8th International Workshop on Interactive Environments and Emerging Technologies for eLearning (IEETeL2017) and 21st International Conference on Information Visualisation, London (2017)

    Google Scholar 

  8. Põldoja, H., Väljataga, T., Laanpere, M., Tammets, K.: Web-based self- and peer assessment of teachers’ digital competencies. World Wide Web 17(2), 255–269 (2012)

    Article  Google Scholar 

  9. Howell, D.D., Tseng, D.C.Y., Colorado-Resa, J.T.: Fast assessments with digital tools using multiple-choice questions. Coll. Teach. 65(3), 145–147 (2017)

    Article  Google Scholar 

  10. Ardito, C., et al.: Usability of e-learning tools. In: AVI 2004 Proceedings of the Working Conferences Interfaces, pp. 80–84 (2004)

    Google Scholar 

  11. Frankl, G., Schartner, P., Jost, D.: The “Secure Exam Environment”: e-testing with students’ own devices. In: Tatnall, A., Webb, M. (eds.) WCCE 2017. IFIP AICT, vol. 515, pp. 179–188. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-74310-3_20

    Chapter  Google Scholar 

  12. Müller, A., Schmidt, B.: Prüfungen als Lernchance: Sinn, Ziele und Formen von Hochschulprüfungen. Zeitschrift für Hochschulentwicklung, vol. 4, no.1, pp. 23–45 (2009)

    Google Scholar 

  13. Price, M., Handley, K., Millar, J., O’Donovan, B.: Feedback: all that effort, but what is the effect? Assess. Eval. High. Educ. 35(3), 277–289 (2010)

    Article  Google Scholar 

  14. Anakwe, B.: Comparison of student performance in paper-based versus computer-based testing. J. Educ. Bus. 84(1), 13–18 (2008)

    Article  Google Scholar 

  15. Hewson, C.: Can online course-based assessment methods be fair and equitable? Relationships between students’ preferences and performance within online and offline assessments. J. Comput. Assist. Learn. 28(5), 488–498 (2012)

    Article  Google Scholar 

  16. Fluck, A.: eExaminations Strategic Project Final Report for Academic Senate, University of Tasmania (2011). (Meeting 1/2011, cited in Fluck, A., Hillier, M.: Innovative assessment with eExams. Paper presented at the Australian Council for Computers in Education (ACCE) conference, 29 September–2 October, Brisbane, Queensland (2016))

    Google Scholar 

  17. Fleming, N.D.: Biases in marking students’ written work: quality? In: Brown, S., Glaser, A. (eds.) Assessment Matters in Higher Education: Choosing and Using Diverse Approaches, pp. 83–92. McGraw-Hill Education, London (1999)

    Google Scholar 

  18. Sweedler-Brown, C.O.: Computers and assessment: the effect of typing versus handwriting on the holistic scoring of essays. Res. Teach. Dev. Educ. 8(1), 5–14 (1991)

    Google Scholar 

  19. Brown, S., Glaser, A.: Assessment Matters in Higher Education: Choosing and Using Diverse Approaches. McGraw-Hill Education, London (2003)

    Google Scholar 

  20. Bundeskanzleramt Österreich, Universitätsgesetz 2002, § 59 Abs. 1. Z 12. https://www.ris.bka.gv.at/Dokumente/Erv/ERV_2002_1_120/ERV_2002_1_120.pdf. Accessed 13 July 2018

  21. Frankl, G., Schartner, P., Zebeding, G.: The “Secure Exam Environment” for online testing at the Alpen-Adria-Universität Klagenfurt/Austria. In: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. Association for the Advancement of Computing in Education (AACE), Hawaii (2011)

    Google Scholar 

  22. Frankl, G., Schartner, P., Jost, D.: Guaranteeing high availability of the “Secure Exam Environment” (SEE). In: Proceedings of the 10th International Conference on Computer Supported Education, vol. 2, pp. 130–136 (2018)

    Google Scholar 

  23. Bundeskanzleramt Österreich, Universitätsgesetz 2002, §79 Abs. 3 and 4 and § 84 Abs. 1. https://www.ris.bka.gv.at/Dokumente/Erv/ERV_2002_1_120/ERV_2002_1_120.pdf. Accessed 13 July 2018

  24. SoftwareSecure. http://www.softwaresecure.com/. Accessed 16 Aug 2017

  25. Safe Exam Browser (SEB). http://www.safeexambrowser.org/news_en.html. Accessed 13 July 2018

  26. Virtual Box. http://www.virtualbox.org. Accessed 13 July 2018

  27. Frankl, G., Napetschnig, S.: Bring your own device to secure online exams. In: Technology Enhanced Assessment (in press)

    Google Scholar 

  28. Sasisekharan. R., Seshadri, V., Weiss, S.M.: Proactive network maintenance using machine learning. In: Workshop on Knowledge Discovery in Databases (KDD94), pp. 453–462 (1994)

    Google Scholar 

  29. Susto, G.A., Schirru, A., Pampuri, S., McLoone, S., Beghi, A.: Machine learning for predictive maintenance: a multiple classifier approach. IEEE Trans. Ind. Inform. 11(3), 812–820 (2015)

    Article  Google Scholar 

  30. Hashemian, H.M., Bean, W.C.: State-of-the-art predictive maintenance techniques. IEEE Trans. Instrum. Meas. 60(10), 3480–3492 (2011)

    Article  Google Scholar 

  31. General Electric Company: Beyond the break-fix model: predictive services to leverage GE’s record $229 billion backlog. GE Reports, 18 October 2003. http://www.gereports.com/beyond-the-break-fix-model. Accessed 17 Aug 2017

  32. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation - GDPR). https://publications.europa.eu/en/publication-detail/-/publication/3e485e15-11bd-11e6-ba9a-01aa75ed71a1/language-en. Accessed 13 July 2018

Download references

Author information

Authors and Affiliations

  1. Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria

    Gabriele Frankl, Sebastian Napetschnig & Peter Schartner

Authors
  1. Gabriele Frankl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sebastian Napetschnig
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Schartner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gabriele Frankl .

Editor information

Editors and Affiliations

  1. Luxembourg Institute of Science and Technology, Esch-sur-Alzette, Luxembourg

    Eric Ras

  2. Faculty of Computer Science, Multimedia and Telecommunications, Universitat Oberta de Catalunya, Barcelona, Barcelona, Spain

    Ana Elena Guerrero Roldán

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Frankl, G., Napetschnig, S., Schartner, P. (2018). Pathways to Successful Online Testing: eExams with the “Secure Exam Environment” (SEE). In: Ras, E., Guerrero Roldán, A. (eds) Technology Enhanced Assessment. TEA 2017. Communications in Computer and Information Science, vol 829. Springer, Cham. https://doi.org/10.1007/978-3-319-97807-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-97807-9_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-97806-2

  • Online ISBN: 978-3-319-97807-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics