skip to main content
10.1145/1095714.1095751acmconferencesArticle/Chapter ViewAbstractPublication PagesiteConference Proceedingsconference-collections
Article

Competency matrices for peer assessment of individuals in team projects

Published: 20 October 2005 Publication History

Abstract

Assessing individual contributions on team projects and promoting the maturation of team knowledge skills in students is difficult. Traditional assessment tools score an individual over a set of categories that are loosely defined and lack well-defined expectations. Further, for curriculum in which team-based learning is a primary component, the traditional approach to assessment fails to provide visibility to the students as to how their team-knowledge skills should mature as they progress. In this paper we present a competency matrix based approach that defines expected performance for required team knowledge skills, where assessment is performed relative to the expectations for the current level of the student. This competency matrix not only provides guidance and clarification for students learning these skills as they mature in their academic careers but also provides a foundation for self and peer assessments. A comparison survey was distributed to students at various levels within the curriculum currently using a traditional assessment instrument. While the students recognized that the competency-based approach was more involved and time consuming, the results of that survey demonstrate that students have a stronger preference for the competency matrix approach. We also include a discussion of the benefits and difficulties associated with this model and future work.

References

[1]
Fallows, S. and Chandramohan, B., "Multiple Approaches to Assessment: reflections on use of tutor, peer and self-assessment", Teaching in Higher Education, 6(2):229--246, 2001.
[2]
Freeman, S.A. and Dyrenfurth, M.J., "Using Peer Assessments in Team Activities", Journal of Industrial Technology, 20(1):1--8, November 2003.
[3]
Hayes, J.H., Lethbridge, T.C., Port, D., "Evaluating Individual Contribution Toward Group Software Engineering Projects", Proceedings of the 25th International Conference on Software Engineering, Portland, Oregon, May 2003, pp. 622--627.
[4]
Hilburn, T.B., "Teams Need a Process!", Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSE Conference on Innovation and technology in computer science education, Helsinki, Finland, July 2000, pp. 53 -- 56.
[5]
Kaufman, D. B, Felder, R. M., & Fuller, H., "Accounting for individual effort in cooperative learning teams", Journal of Engineering Education, 89(2): 133--140, 2000.
[6]
Rosen, Clive C.H., "Individual Assessment of Group Projects in Software Engineering: A Facilitated Peer Assessment Approach", Proceedings of the 9th Conference on Software Engineering Education (CSEE), 1996, pp. 68--77.
[7]
Sitthiworachart, J. and Joy, M., "Effective Peer Assessment for Learning Computer Programming", ACM SIGCSE Bulletin, Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education, 36(3):122--126, 2004.
[8]
Sluijsmans, D., Dochy, F., Moerkerke, G., "Creating a Learning Environment by Using Self-, Peer- and Co-Assessment, Learning Environments Research, 1, 293--319, 1999.
[9]
Smarkusky, D.L., Smith III, H.H., "Team Projects Throughout the Curriculum: Course Management, Teaching Initiatives and Outreach", Journal of Computing Sciences in Colleges, 19(5):119--129, May 2004.
[10]
Topping, K., Smith, E., Swanson, I., Elliot, A., "Formative Peer Assessment of Academic Writing Between Postgraduate Students", Assessment and Evaluation in Higher Education, 25(2):149--169, 2000.
[11]
Van Duzer, E., McMartin, F., "Methods to Improve the Validity and Sensitivity of a Self/Peer Assessment Instrument", IEEE Transactions on Education, 43(2):153--158, May 2000.

Cited By

View all
  • (2023)Evaluating Group Work in (too) Large CS Classes with (too) Few ResourcesProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569788(4-10)Online publication date: 2-Mar-2023
  • (2023)On the Impact of Grading on Teamwork Quality in a Software Engineering Capstone CourseIEEE Access10.1109/ACCESS.2023.326530211(36492-36503)Online publication date: 2023
  • (2023)A review of collaborative assessment strategies in online learningDistance Education10.1080/01587919.2022.215012744:3(522-543)Online publication date: 2-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGITE '05: Proceedings of the 6th conference on Information technology education
October 2005
402 pages
ISBN:1595932526
DOI:10.1145/1095714
  • General Chair:
  • Rob Friedman
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. competency matrix
  2. peer assessment
  3. problem-based learning
  4. project-based learning
  5. team process

Qualifiers

  • Article

Conference

SIGITE05
Sponsor:

Acceptance Rates

Overall Acceptance Rate 176 of 429 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)20
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Evaluating Group Work in (too) Large CS Classes with (too) Few ResourcesProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569788(4-10)Online publication date: 2-Mar-2023
  • (2023)On the Impact of Grading on Teamwork Quality in a Software Engineering Capstone CourseIEEE Access10.1109/ACCESS.2023.326530211(36492-36503)Online publication date: 2023
  • (2023)A review of collaborative assessment strategies in online learningDistance Education10.1080/01587919.2022.215012744:3(522-543)Online publication date: 2-Jan-2023
  • (2023)A systematic mapping study on group work research in computing education projectsJournal of Systems and Software10.1016/j.jss.2023.111795204:COnline publication date: 1-Oct-2023
  • (2020)PSASProceedings of the XXXIV Brazilian Symposium on Software Engineering10.1145/3422392.3422506(338-343)Online publication date: 21-Oct-2020
  • (2020)Project Education and Adams’ Theory of Equity2020 IEEE Frontiers in Education Conference (FIE)10.1109/FIE44824.2020.9274126(1-5)Online publication date: 21-Oct-2020
  • (2020)Competence-oriented project team planning – university case studyJournal of Information and Telecommunication10.1080/24751839.2020.1857039(1-24)Online publication date: 25-Dec-2020
  • (2020)Competence-Oriented Recruitment of a Project Team Robust to DisruptionsIntelligent Information and Database Systems10.1007/978-3-030-42058-1_2(13-25)Online publication date: 4-Mar-2020
  • (2019)A systemic approach to leveraging student engagement in collaborative learning to improve online engineering educationInternational Journal of Technology Enhanced Learning10.5555/3302810.330281111:1(1-19)Online publication date: 1-Jan-2019
  • (2019)Teamwork attitudes, interest and self-efficacy between online and face-to-face information technology studentsTeam Performance Management: An International Journal10.1108/TPM-05-2018-003525:5/6(253-278)Online publication date: 12-Aug-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media