loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Kai Petersen 1 ; 2 and Jefferson Seide Molléri 3

Affiliations: 1 Blekinge Institute of Technology, Karlskrona, Sweden ; 2 University of Applied Sciences, Flensburg, Germany ; 3 Simula Metropolitan Centre for Digital Engineering, Oslo, Norway

Keyword(s): Checklist, Survey, One-group Quasi-experiment, Students.

Abstract: Background: In order to judge evidence it is important to be able to assess study quality. Checklists are means to objectify the assessment. In an earlier study we proposed and evaluated a checklist for surveys, which was assessed by experts. Objective: (1) To assess whether the use of the checklist enables students with limited experience in research to consistently and accurately assess the quality of a research paper. (2) To elicit qualitative feedback to identify improvements to the checklist. Method: The students reviewed a survey in a one-group posttest-only quasi-experiment using the checklist. In total 13 students participated in the context of the course Evidence-based software engineering as part of the study program Information Systems at Flensburg University of Applied Sciences. Results: In total the students achieved 74% percent of agreement among each other. However, the Kappa values indicated mostly a poor level of agreement considering the classification by Fleiss. In addition, the students were quite inaccurate assessing the questions. Though, they performed well on questions for research objectives and the identification of population. Conclusion: Findings indicate that students do not assess reliably. However, further investigations are needed to substantiate the findings. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.224.147.211

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Petersen, K. and Molléri, J. (2021). Preliminary Evaluation of a Survey Checklist in the Context of Evidence-based Software Engineering Education. In Proceedings of the 16th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE; ISBN 978-989-758-508-1; ISSN 2184-4895, SciTePress, pages 437-444. DOI: 10.5220/0010496204370444

@conference{enase21,
author={Kai Petersen. and Jefferson Seide Molléri.},
title={Preliminary Evaluation of a Survey Checklist in the Context of Evidence-based Software Engineering Education},
booktitle={Proceedings of the 16th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE},
year={2021},
pages={437-444},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010496204370444},
isbn={978-989-758-508-1},
issn={2184-4895},
}

TY - CONF

JO - Proceedings of the 16th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE
TI - Preliminary Evaluation of a Survey Checklist in the Context of Evidence-based Software Engineering Education
SN - 978-989-758-508-1
IS - 2184-4895
AU - Petersen, K.
AU - Molléri, J.
PY - 2021
SP - 437
EP - 444
DO - 10.5220/0010496204370444
PB - SciTePress