skip to main content
10.1145/3545945.3569875acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article
Public Access

Do Intentions to Persist Predict Short-Term Computing Course Enrollments: A Scale Development, Validation, and Reliability Analysis

Published: 03 March 2023 Publication History

Abstract

A key goal of many computer science education efforts is to increase the number and diversity of students who persist in the field of computer science and into computing careers. Many interventions have been developed in computer science designed to increase students' persistence in computing. However, it is often difficult to measure the efficacy of such interventions, as measuring actual persistence by tracking student enrollments and career placements after an intervention is difficult and time-consuming, and sometimes even impossible. In the social sciences, attitudinal research is often used to solve this problem, as attitudes can be collected in survey form around the same time that interventions are introduced and are predictive of behavior. This can allow researchers to assess the potential efficacy of an intervention before devoting the time and energy to conduct a longitudinal analysis. In this paper, we develop and validate a scale to measure intentions to persist in computing, and demonstrate its use in predicting actual persistence as defined by enrolling in another computer science course within two semesters. We conduct two analyses to do this: First, we develop a computing persistence index and test whether our scale has high alpha reliability and whether our scale predicts actual persistence in computing using students' course enrollments. Second, we conduct analyses to reduce the number of items in the scale, to make the scale easy for others to include in their own research. This paper contributes to research on computing education by developing and validating a novel measure of intentions to persist in computing, which can be used by computer science educators to evaluate potential interventions. This paper also creates a short version of the index, to ease implementation.

References

[1]
Bita Akram et al. "Increasing Students' Persistence in Computer Science through a Lightweight Scalable Intervention". In: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1. 2022, pp. 526--532.
[2]
Lecia J Barker, Charlie McDowell, and Kimberly Kalahar. "Exploring factors that influence computer science introductory course students to persist in the major". In: ACM Sigcse Bulletin 41.1 (2009), pp. 153--157.
[3]
Trudy H Bers and Kerry E Smith. "Persistence of community college students: The influence of student intent and academic and social integration". In: Research in higher Education 32.5 (1991), pp. 539--556.
[4]
Godfred O Boateng et al. "Best practices for developing and validating scales for health, social, and behavioral research: a primer". In: Frontiers in public health 6 (2018), p. 149.
[5]
Broadening participation in computing (BPC). url: https:// www.nsf.gov/pubs/2021/nsf21571/nsf21571.htm.
[6]
J McGrath Cohoon. "Recruiting and retaining women in undergraduate computing majors". In: ACM SIGCSE Bulletin 34.2 (2002), pp. 48--52.
[7]
Shelley J Correll. "Constraints into preferences: Gender, status, and emerging career aspirations". In: American sociological review 69.1 (2004), pp. 93--113.
[8]
Lee J Cronbach. "Coefficient alpha and the internal structure of tests". In: psychometrika 16.3 (1951), pp. 297--334.
[9]
Robert F DeVellis and Carolyn T Thorpe. Scale development: Theory and applications. Sage publications, 2021.
[10]
Per Eisele. "The predictive validity of the team diagnostic survey: Testing a model with performance and satisfaction as output variables". In: Team Performance Management (2015).
[11]
Susan A Elkins, John M Braxton, and Glenn W James. "Tinto's separation stage and its influence on first-semester college student persistence". In: Research in higher education 41.2 (2000), pp. 251--268.
[12]
Martin Fishbein and Icek Ajzen. Predicting and changing behavior: The reasoned action approach. Psychology press, 2011.
[13]
Susan R Fisk et al. "Increasing Women's Persistence in Computer Science by Decreasing Gendered Self-Assessments of Computing Ability". In: Proceedings of the 26th ACM Con- ference on Innovation and Technology in Computer Science Education V. 1. 2021, pp. 464--470.
[14]
Floyd J Fowler Jr and Floyd J Fowler. Improving survey questions: Design and evaluation. Sage, 1995.
[15]
Mark J Graham et al. "Increasing persistence of college students in STEM". In: Science 341.6153 (2013), pp. 1455--1456.
[16]
Carolyn Hart. "Factors associated with student persistence in an online program of study: A review of the literature." In: Journal of Interactive Online Learning 11.1 (2012).
[17]
Leslie Hausmann, Janet Schofield, and Rochelle Woods. "Sense of Belonging as a Predictor of Intentions to Persist Among African American and White First-Year College Students." In: Research in Higher Education 48.7 (2007).
[18]
Joel Herche. "A note on the predictive validity of the CETSCALE". In: Journal of the Academy of Marketing Science 20.3 (1992), pp. 261--264.
[19]
Andrew Hoegh and Barbara M Moskal. "Examining science and engineering students' attitudes toward computer science". In: 2009 39th IEEE Frontiers in Education Conference. IEEE. 2009, pp. 1--6.
[20]
Sandra Katz et al. "Gender, achievement, and persistence in an undergraduate computer science program". In: ACM SIGMIS Database: the DATABASE for Advances in Information Systems 37.4 (2006), pp. 42--57.
[21]
Mary C Kernan and Geoffry S Howard. "Computer anxiety and computer attitudes: An investigation of construct and predictive validity issues". In: Educational and psychological measurement 50.3 (1990), pp. 681--690.
[22]
Daniel Kotz, Jamie Brown, and Robert West. "Predictive validity of the Motivation To Stop Scale (MTSS): a single-item measure of motivation to stop smoking". In: Drug and alcohol dependence 128.1-2 (2013), pp. 15--19.
[23]
Guan-Yu Lin. "Self-efficacy beliefs and their sources in undergraduate computing disciplines: An examination of gender and persistence". In: Journal of Educational Computing Re- search 53.4 (2016), pp. 540--561.
[24]
Alex Lishinski and Joshua Rosenberg. "All the Pieces Matter: The Relationship of Momentary Self-efficacy and Affective Experiences with CS1 Achievement and Interest in Computing". In: Proceedings of the 17th ACM Conference on International Computing Education Research. 2021, pp. 252--265.
[25]
D McFadden. "Quantitative methods for analyzing travel behavior of individuals: some recent 857 developments: Institute of Transportation Studies". In: University of California 858 (1977).
[26]
Daniel McFadden. "The measurement of urban travel demand". In: Journal of public economics 3.4 (1974), pp. 303--328.
[27]
David M Merolla et al. "Structural precursors to identity processes: The role of proximate social structures". In: Social Psychology Quarterly 75.2 (2012), pp. 149--172.
[28]
Barbara S Metzner and John P Bean. "The estimation of a conceptual model of nontraditional undergraduate student attrition". In: Research in higher education 27.1 (1987), pp. 15--38.
[29]
Martina Mittlböck and Michael Schemper. "Explained variation for logistic regression". In: Statistics in medicine 15.19 (1996), pp. 1987--1997.
[30]
Donald E Morisky, Lawrence W Green, and David M Levine. "Concurrent and predictive validity of a self-reported measure of medication adherence". In: Medical care (1986), pp. 67--74.
[31]
Donald E Morisky et al. "Predictive validity of a medication adherence measure in an outpatient setting". In: The journal of clinical hypertension 10.5 (2008), pp. 348--354.
[32]
Linda Ott, Briana Bettin, and Leo Ureel. "The impact of placement in introductory computer science courses on student persistence in a computing major". In: Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education. 2018, pp. 296--301.
[33]
Ilias O Pappas et al. "Assessing student behavior in computer science education with an fsQCA approach: The role of gains and barriers". In: ACM Transactions on Computing Education (TOCE) 17.2 (2017), pp. 1--23.
[34]
Paul R Pintrich et al. "Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire (MSLQ)". In: Educational and psychological measurement 53.3 (1993), pp. 801--813.
[35]
Rita Manco Powell. "Improving the persistence of first-year undergraduate women in computer science". In: ACM SIGCSE Bulletin 40.1 (2008), pp. 518--522.
[36]
Thomas N Robinson III. "Identity as a mediator of institutional integration variables in the prediction of undergraduate persistence intentions". In: Journal of Adolescent Research 18.1 (2003), pp. 3--24.
[37]
Hossein Shafizadeh-Moghadam. "Fully component selection: An efficient combination of feature selection and principal component analysis to increase model performance". In: Expert Systems with Applications 186 (2021), p. 115678.
[38]
Jan E Stets et al. "The science identity and entering a science occupation". In: Social science research 64 (2017), pp. 1--14.
[39]
Hamed Taherdoost. "Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research". In: How to test the validation of a question-naire/survey in a research (August 10, 2016) (2016).
[40]
Edmund R Thompson. "Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS)". In: Journal of cross-cultural psychology 38.2 (2007), pp. 227--242.
[41]
Mindi N Thompson, Michelle Johnson-Jennings, and Rachel S Nitzarim. "Native American undergraduate students' persistence intentions: A psychosociocultural perspective." In: Cultural Diversity and Ethnic Minority Psychology 19.2 (2013), p. 218.
[42]
Vincent Tinto. Leaving college: Rethinking the causes and cures of student attrition. ERIC, 1987.
[43]
Roger Tourangeau and Kenneth A Rasinski. "Cognitive processes underlying context effects in attitude measurement." In: Psychological bulletin 103.3 (1988), p. 299.
[44]
Michael T Willoughby et al. "The measurement of executive function at age 3 years: psychometric properties and criterion validity of a new battery of tasks." In: Psychological assessment 22.2 (2010), p. 306

Cited By

View all
  • (2023)Retaining Black Women in Computing: A Comparative Analysis of Interventions for Computing PersistenceACM Transactions on Computing Education10.1145/363531324:2(1-25)Online publication date: 22-Dec-2023

Index Terms

  1. Do Intentions to Persist Predict Short-Term Computing Course Enrollments: A Scale Development, Validation, and Reliability Analysis

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1
      March 2023
      1481 pages
      ISBN:9781450394314
      DOI:10.1145/3545945
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 03 March 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Best Paper

      Author Tags

      1. enrollment
      2. introductory computer science
      3. persistence
      4. validated scale

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      SIGCSE 2023
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,787 of 5,146 submissions, 35%

      Upcoming Conference

      SIGCSE TS 2025
      The 56th ACM Technical Symposium on Computer Science Education
      February 26 - March 1, 2025
      Pittsburgh , PA , USA

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)263
      • Downloads (Last 6 weeks)41
      Reflects downloads up to 20 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Retaining Black Women in Computing: A Comparative Analysis of Interventions for Computing PersistenceACM Transactions on Computing Education10.1145/363531324:2(1-25)Online publication date: 22-Dec-2023

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media