skip to main content
10.1145/3492724.3492731acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmexihcConference Proceedingsconference-collections
short-paper

Designing an information visualization dashboard to proctor test-takers during language certification online testing

Published:13 January 2022Publication History

ABSTRACT

The learning mechanisms and the evaluation process have been moved to an online mode in order to maintain social distancing and reduce the spread of the COVID-19. E-learning initiatives (including assessment and proctoring) produce a large amount of data, so visualization mechanisms are required to support the decision-making process. This problem is addressed from a practical context of study: the English Language Certification Tests of a University in the southeast of Mexico. The conceptual design of four conceptual dashboards are presented using a mixed methodology: the UCD process and a conceptual model for a dashboard generator process. The four conceptual dashboards were evaluated by five experts. Although the design proposals were simple and reflected most initial user requirements, the experts suggested to include more elements in all the dashboards to provide the information needed for the intended users and improve the decision-making process.

References

  1. Gökhan Akçapınar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan, and Hiroaki Ogata. 2019. Developing an early-warning system for spotting at-risk students by using eBook interaction logs. Smart Learning Environments 6, 1 (2019). https://doi.org/10.1186/s40561-019-0083-4Google ScholarGoogle Scholar
  2. Muhammad Anshari, Yabit Alas, Nor’azmah Hj Mohd Yunus, Norakmarul Ihsan Pg Hj Sabtu, and Malai Hayati Sheikh Abdul Hamid. 2016. Online learning: Trends, issues, and challenges in the big data era. Journal of E-Learning and Knowledge Society 12, 1 (2016), 121–134. https://doi.org/10.20368/1971-8829/1003Google ScholarGoogle Scholar
  3. David Bañeres, M. Elena Rodríguez, Ana Elena Guerrero-Roldán, and Abdulkadir Karadeniz. 2020. An early warning system to detect at-risk students in online higher education. Applied Sciences (Switzerland) 10, 13 (2020). https://doi.org/10.3390/app10134427Google ScholarGoogle Scholar
  4. Robert Bodily and Katrien Verbert. 2017. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies 10, 4 (2017), 405–418. https://doi.org/10.1109/TLT.2017.2740172Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chen Chen, Zhang Ming, Chen Chong, and Sha Kun. 2021. The Existing Problems and Intelligent Improved Strategies in Online Teaching during the Outbreak of of COVID-19. (2021), 665–668. https://doi.org/10.1109/icbdie52740.2021.00157Google ScholarGoogle Scholar
  6. Camilla Forsell and Jimmy Johansson. 2010. An heuristic set for evaluation in information visualization. In Proceedings of the International Conference on Advanced Visual Interfaces. 199–206.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Isabel Guitart Hormigo, M. Elena Rodríguez, and Xavier Baró. 2020. Design and implementation of dashboards to support teachers decision-making process in e-assessment systems. Lecture Notes on Data Engineering and Communications Technologies 34 (2020), 109–132. https://doi.org/10.1007/978-3-030-29326-0_6Google ScholarGoogle ScholarCross RefCross Ref
  8. Dabbebi Ines, Iksal Sebastien, Gilliot Jean-Marie, May Madeth, and Garlatti Serge. 2017. Towards adaptive dashboards for learning analytic an approach for conceptual design and implementation. CSEDU 2017 - Proceedings of the 9th International Conference on Computer Supported Education 1 (2017), 120–131. https://doi.org/10.5220/0006325601200131Google ScholarGoogle ScholarCross RefCross Ref
  9. Peerumporn Jiranantanagorn;, Konlayut Tippayakulpiroj;, and Panuwat Saikaew. 2021. Designing an Interactive Online Learning Platform to Support a Practical Subject During COVID-19 Outbreak. 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (2021), 283. https://doi.org/10.1109/ECTI-CON51831.2021.9454820Google ScholarGoogle Scholar
  10. Jelena Jovanović, Mohammed Saqr, Srećko Joksimović, and Dragan Gašević. 2021. Students matter the most in learning analytics: The effects of internal and instructional conditions in predicting academic success. Computers and Education 172, October 2020 (2021), 1–13. https://doi.org/10.1016/j.compedu.2021.104251Google ScholarGoogle Scholar
  11. Mikel Labayen, Ricardo Vea, Julian Florez, Naiara Aginako, and Basilio Sierra. 2021. Online Student Authentication and Proctoring System Based on Multimodal Biometrics Technology. IEEE Access 9(2021), 72398–72411. https://doi.org/10.1109/ACCESS.2021.3079375Google ScholarGoogle ScholarCross RefCross Ref
  12. Riccardo Mazza. 2021. A visual method to identify and characterise students suspected of collaboration during remote quizzes submissions in Learning Environments. Proceedings of the 25th IEEE International Conference on Information Visualisation (2021).Google ScholarGoogle ScholarCross RefCross Ref
  13. Matthew Montebello. 2019. Assisting Education through RealTime Learner Analytics. Proceedings - Frontiers in Education Conference, FIE 2018-Octob (2019). https://doi.org/10.1109/FIE.2018.8659345Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Samantha Orlando, Elena Gaudioso, and Felix De La Paz. 2020. Supporting Teachers to Monitor Student’s Learning Progress in an Educational Environment with Robotics Activities. IEEE Access 8(2020), 48620–48631. https://doi.org/10.1109/ACCESS.2020.2978979Google ScholarGoogle ScholarCross RefCross Ref
  15. Julio Rojas-Mora, Oriel A. Herrera, Pedro Mirabal, and Marcos Levano. 2020. Methodological recommendations to face an online semester in a catastrophic situation: The case of a computer science program during the COVID-19 lockdown. Proceedings - International Conference of the Chilean Computer Science Society, SCCC 2020-Novem(2020). https://doi.org/10.1109/SCCC51225.2020.9281214Google ScholarGoogle ScholarCross RefCross Ref
  16. Aiman A. Turani, Jawad H. Alkhateeb, and Abdul Rahman A. Alsewari. 2020. Students Online Exam Proctoring: A Case Study Using 360 Degree Security Cameras. ETCCE 2020 - International Conference on Emerging Technology in Computing, Communication and Electronics(2020). https://doi.org/10.1109/ETCCE51779.2020.9350872Google ScholarGoogle ScholarCross RefCross Ref
  17. Usability.gov. 2017. User-Centered Design Basics. https://www.usability.gov/what-and-why/user-centered-design.htmlGoogle ScholarGoogle Scholar
  18. Maya Usher, Arnon Hershkovitz, and Alona Forkosh-Baruch. 2021. From data to actions: Instructors’ decision making based on learners’ data in online emergency remote teaching. British Journal of Educational TechnologyApril (2021), 1338–1356. https://doi.org/10.1111/bjet.13108Google ScholarGoogle Scholar
  19. Bart Valks, Monique Arkesteijn, Alexander Koutamanis, and Alexandra Den Heijer. 2021. Towards smart campus management: Defining information requirements for decision making through dashboard design. Buildings 11, 5 (2021). https://doi.org/10.3390/buildings11050201Google ScholarGoogle Scholar
  20. Trynke Keuning van Geel and Marieke. 2021. Systems and Teacher Dashboards : The Teacher Still Matters Most. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES 14, 2 (2021), 201–210.Google ScholarGoogle ScholarCross RefCross Ref
  21. Andrea Vázquez-Ingelmo, Francisco José García-Peñalvo, and Roberto Therón. 2019. Tailored information dashboards. (2019), 1–8. https://doi.org/10.1145/3335595.3335628Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Annika Wolff, Zdenek Zdrahal, Andriy Nikolov, and Michal Pantucek. 2013. Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment. In Proceedings of the third international conference on learning analytics and knowledge. 145–149.Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    MexIHC '21: Proceedings of the 8th Mexican Conference on Human-Computer Interaction
    December 2021
    47 pages
    ISBN:9781450387170
    DOI:10.1145/3492724

    Copyright © 2021 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 13 January 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • short-paper
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate20of40submissions,50%
  • Article Metrics

    • Downloads (Last 12 months)20
    • Downloads (Last 6 weeks)3

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format