Skip to main content
Log in

A Systematic Review of the 2016 National Academy of Engineering Exemplary Ethics Programs: Revisions to a Coding Framework

  • Original Research/Scholarship
  • Published:
Science and Engineering Ethics Aims and scope Submit manuscript

Abstract

Engineering ethics is a required aspect of accredited ABET programs, but there is widespread variation in how ethics is taught, to what ends, and how those ends are assessed. This variation makes it challenging to identify practices for teaching ethics to engineers aligned with extant practices in the field. In this study, we revise a recent coding framework by reviewing exemplary engineering ethics programs recognized by the National Academy of Engineering in 2016, or what we refer to as “exemplars.” We pursue two primary objectives: (1) To apply and revise a prior coding framework to codify ethics learning objectives, instructional strategies, and assessment strategies in engineering education; and (2) To use the revised coding framework to identify trends in learning objectives, instructional strategies, and assessment strategies of NAE exemplars. We employ systemic review procedures to update the coding framework using 24 of 25 exemplars as a data source. The updated framework includes four primary categories associated with learning objectives, instructional strategies, assessment data collection strategies, and assessment design characteristics. Results indicate that ethical sensitivity or awareness was present in every exemplar as a learning objective, often alongside ethical reasoning-based learning objectives and the formation of professional skills. Exemplars employed numerous instructional strategies in tandem, as we coded eight out of 18 instructional strategies among at least half of the exemplars. Assignments/homework and summative reflections were the most oft-used sources of assessment data. Due to our challenges in coding assessment approaches, we offer practical suggestions for assessing engineering ethics instruction which are based on many of our coding discussions. We hope that this coding framework, the results classifying exemplary features of the NAE programs, and our practical suggestions can guide future instructors as they design, classify, assess, and report their approaches to engineering ethics education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Data Availability

The entirety of the data included herein is from online sources. The National Academies reports are available online for members. Primary sources referenced by exemplars (i.e., journal articles) may require fees to access.

Notes

  1. The authors required that retained literature included at least one explicitly defined learning goal or objective, sufficient clarity when describing an instructional strategy for it to be replicable, and some form of assessment.

  2. While we use the term assessment, many authors used both assessment and evaluation. Moreover, we recognize that many assessment strategies were both formative and summative in nature.

  3. While the NAE exemplars included a few studies from universities represented in the prior literature review, the programs or interventions were distinct. Thus, this dataset is completely unique, and these results thus provide insights into exemplary features of ethics programs.

  4. The prominence of sociotechnical integration in our review could also be because it was prioritized by the NAE solicitation and the selection committee.

  5. In the prior review, this code was framed as “individual written assignment,” whereas here we broadened to individual or team-based. Thus, it is possible that these numbers are closer in proximity.

  6. This code was generally used to capture stepwise ethical reasoning processes in the prior review. Yet, here we saw more instantiations of singular tools or processes (e.g., cost-benefit analysis, listening) for making ethical decisions.

  7. In this study, ‘real-world engagement’ encapsulates two codes from the prior review: (1) real-world exposure and (2) community engagement. In the prior review, these were each coded twice, but one article included both codes. Thus, these articles were coded in 3/26 articles analyzed in the prior review, or 12%.

  8. One primary reason for this shift may be the nature of the data in two studies. Journal articles might lend themselves to a more intensive analysis of a singular dataset, whereas the exemplars tended to share a broad overview of multiple assessment approaches.

References

  • ABET. (n.d.). Criteria for accrediting engineering programs, 2022–2023. Retrieved from https://www.abet.org/accreditation/accreditation-criteria/criteria-for-accrediting-engineering-programs-2022-2023/

  • Association of American Colleges and University. (n.d.). Ethical reasoning VALUE rubric. Retrieved from AAC&U.

  • Balakrishnan, B., Tochinai, F., & Kanemitsu, H. (2019). Engineering ethics education: A comparative study of Japan and Malaysia. Science and Engineering Ethics, 25(4), 1069–1083.

    Article  Google Scholar 

  • Beever, J., & Brightman, A. O. (2016). Reflexive principlism as an effective approach for developing ethical reasoning in engineering. Science and Engineering Ethics, 22(1), 275–291.

    Article  Google Scholar 

  • Biezad, D. (2016). Ethics as philosophical history for engineers. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 20–21). The National Academies Press.

  • Borenstein, J., Drake, M. J., Kirkman, R., & Swann (2010). The Engineering and Science Issues Test (ESIT): A discipline-specific approach to assessing moral judgment. Science & Engineering Ethics, 16(2), 387–407. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&db=aph&AN=50317165&site=ehost-live.

  • Borrego, M., Foster, M. J., & Froyd, J. E. (2014). Systematic literature reviews in engineering education and other developing interdisciplinary fields. Journal of Engineering Education, 103(1), 45–76. https://doi.org/10.1002/jee.20038

    Article  Google Scholar 

  • Boudreau, K., Robinson, L., Dodson, L., DiBiasio, D., Abel, C., Sullivan, J., & Carrier, A. (2016). Humanitarian engineering, past and present: A role-playing first-year course. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 9–10). The National Academies Press.

  • Brightman, A. O., Beever, J., Hess, J. L., Iliadis, A., Kisselburgh, L., Krane, M., & Zoltowski, C. B. (2016). PRIME ethics: Purdue’s reflective & interactive modules for engineering ethics. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 39–40). The National Academies Press.

  • Callahan, D. (1980). Goals in the teaching of ethics. In D. Callahan & S. Bok (eds.), Ethics teaching in higher education (pp. 61–80). Springer.

  • Canney, N. E., & Bielefeldt, A. R. (2016). Validity and reliability evidence of the engineering professional responsibility assessment tool. Journal of Engineering Education, 105(3), 452–477.

    Article  Google Scholar 

  • Celik, S., Kirjavainen, M. S., & Björklund, T. (2020). Educating future engineers: Student perceptions of the societal linkages of innovation opportunities, Paper presented at the ASEE Annual Conference, Virtual.

  • Clarkeburn, H. (2002). A test for ethical sensitivity in science. Journal of Moral Education, 31(4), 439–453.

    Article  Google Scholar 

  • Davis, M., & Feinerman, A. (2012). Assessing graduate student progress in engineering ethics. Science and Engineering Ethics, 18(2), 1–17.

    Article  Google Scholar 

  • Douglas, K. A., Rynearson, A., Purzer, S., & Strobel, J. (2016). Reliability, validity, and fairness: A content analysis of assessment development publications in major engineering education journals. The International Journal of Engineering Education, 32(5), 1960–1971.

    Google Scholar 

  • Eckelman, M., Bosso, C., Basl, J., & Isaacs, J. (2016). Case studies for engineering ethics across the product life cycle. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 15–16). The National Academies Press.

  • Eggleson, K., & Dempsey, J. (2016). Ethics when biocomplexity meets human complexity (role-play workshop) and Nanosilver Linings case. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 47–48). The National Academies Press.

  • Engineering Criteria 2000: Program self-study report. Retrieved from ABET, & Baltimore (2000). MD: http://www.abet.org/Linked%20Documents-UPDATE/Program%20Docs/abet-eac-criteria-2011-2012.pdf

  • Epstein, A., McGee, D., & Harvey, C. (2016). Terrascope. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 32–33). The National Academies Press.

  • Grossenbacher, L. (2016). Team ethics assignment: Based on engineering student co-op experience. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 28–29). The National Academies Press.

  • Hanks, C., Tate, J., Fazarro, D., Trybula, W., McClean, R., Dutta, S., & Alhoff, F. (2016). NanoTRA: Texas Regional Alliance to foster nanotechnology environment, health, and safety awareness in tomorrow’s engineering and technology leaders. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 41–42). The National Academies Press.

  • Hariharan, B., Sheppard, S., & Shariq, S. (2016). Global engineers’ education course. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 30–31). The National Academies Press.

  • Harris, C. E., Davis, M., Pritchard, M. S., & Rabins, M. J. (1996). Engineering ethics: What? Why? How? And when? Journal of Engineering Education, 85, 93–96.

    Article  Google Scholar 

  • Hashemian, G., & Loui, M. C. (2010). Can instruction in engineering ethics change students’ feelings about professional responsibility? Science and Engineering Ethics, 16(1), 201–215.

    Article  Google Scholar 

  • Haws, D. R. (2001). Ethics instruction in engineering education: A (mini) meta-analysis. Journal of Engineering Education, 90(2), 223–229.

    Article  Google Scholar 

  • Herkert, J. R. (2000). Engineering ethics education in the USA: Content, pedagogy and curriculum. European Journal of Engineering Education, 25(4), 303–313. https://doi.org/10.1080/03043790050200340

    Article  Google Scholar 

  • Herkert, J. R. (2005). Ways of thinking about and teaching ethical problem solving: Microethics and macroethics in engineering. Science and Engineering Ethics, 11, 373–385.

    Article  Google Scholar 

  • Hess, D. E., & McAvoy, P. (2014). The political classroom: Evidence and ethics in democratic education. New York, NY.

  • Hess, J. L., & Fore, G. A. (2018). A systematic literature review of US engineering ethics interventions. Science and Engineering Ethics, 24(2), 551–583. https://doi.org/10.1007/s11948-017-9910-6

    Article  Google Scholar 

  • Hitt, S. J., Holles, C., Burgess, O., Farca, P., Horan, A., Horan, J., & Woodson, S. (2016). Nature and human values course. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (p. 34). The National Academies Press.

  • Huff, C., & Frey, W. (2005). Moral pedagogy and practical ethics. Science and Engineering Ethics, 11(3), 389–408.

    Article  Google Scholar 

  • Jackson, H., Tarhini, K., Fleischmann, C., & Nakagawa, E. (2016). Ethics activities in the civil engineering curriculum at the United States Coast Guard Academy. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 35–36). The National Academies Press.

  • Johnson, D. G., & UVA STS Program Faculty. (2016). The University of Virginia SEAS senior thesis: A culminating activity. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 11–12). Washington, DC: The National Academies Press.

  • Katz, A. S. (2019). An inquiry into the nature and causes of the state of US engineering ethics education dissertation, Purdue University Graduate School.

  • Kirkman, R. (2016). Problem-based learning in a professional ethics course for undergraduate engineering students. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 12–13). The National Academies Press.

  • Lambrinidou, Y., Edwards, M., Heaney, E., & Newberry, R. (2016). Learning to listen: A tool for morally engaged engineering practice. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 7–8). The National Academies Press.

  • Leveson, N. (2016). Ethics and engineering for safety. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (p. 19). The National Academies Press.

  • Leydens, J. A., Lucena, J. C., & Johnson, K. (2016). Enacting macroethics: Making social justice visible in engineering education. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 44–45). The National Academies Press.

  • Litzinger, T., Tuana, N., & Tang, X. (2016). Creating a community of ethics educators in engineering. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 49–50). The National Academies Press.

  • Loui, M. C. (2016). Ethics sessions in a summer undergraduate research program. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 51–52). The National Academies Press.

  • Martin, D. A., Conlon, E., & Bowe, B. (2021a). A multi-level review of engineering ethics education: Towards a socio-technical orientation of engineering education for ethics. Science and Engineering Ethics, 27(5), 1–38.

    Article  Google Scholar 

  • Martin, D. A., Conlon, E., & Bowe, B. (2021b). Using case studies in engineering ethics education: The case for immersive scenarios through stakeholder engagement and real life data. Australasian Journal of Engineering Education, 1–17.

  • National Academy of Engineering. (2016). Infusing ethics into the development of engineers: Exemplary education activities and programs. The National Academies Press.

  • Parker, P. E., Fleming, P. D., Beyerlein, S., Apple, D., & Krumsieg, K. (2001). Differentiating assessment from evaluation as continuous improvement tools [for engineering education], Paper presented at the 31st annual frontiers in education conference. Impact on engineering and science education. Conference proceedings (Cat. No. 01CH37193).

  • Pinkus, R. L. (2016). Using student-authored case studies to teach bioengineering ethics. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 5–6). The National Academies Press.

  • Rest, J. R., Narvaez, D., Thoma, S. J., & Bebaue, M. J. (1999). DIT2: Devising and testing a revised instrument of moral judgment. Journal of Educational Psychology, 91(4), 644–659.

    Article  Google Scholar 

  • Rossmann, T. (2016). Engineering a catastrophe: Ethics for first-year STEM. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 22–23). The National Academies Press.

  • Saulnier, D., Tillman, B., & Lenihan, T. (2016). Multiyear engineering ethics case study approach. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 37–38). The National Academies Press.

  • Smith, J. (2016). Corporate social responsibility course. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 26–27). The National Academies Press.

  • Starrett, S. (2016). Responsibility of engineering: Codes and professionalism (3-hour university course). In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 3–4). The National Academies Press.

  • Subbian, V., Purdy, C., & Beyette, F. (2016). UnLecture on software engineering ethics. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 17–18). The National Academies Press.

  • Troesch, V. (2016). Phenomenological approach to engineering ethics pedagogy. In NAE (Ed.), Infusing ethics into the development of engineers: Exemplary education activities and programs (pp. 24–25). The National Academies Press.

  • Wang, Q., & Yan, P. (2019). Development of ethics education in science and technology in technical universities in China. Science and Engineering Ethics, 25(6), 1721–1733.

    Article  Google Scholar 

  • Zhu, Q., Zoltowski, C. B., Feister, M. K., Buzzanell, P. M., Oakes, W. C., & Mead, A. D. (2014). The development of an instrument for assessing individual ethical decision-making in project-based design teams: Integrating quantitative and qualitative methods. Paper presented at the American Society for Engineering Education, Indianapolis, IN.

Download references

Funding

This material is based upon work supported by the National Science Foundation under Grant No. 1737303. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Author information

Authors and Affiliations

Authors

Contributions

All authors participated in the development and implementation of the coding reported in this article.

Corresponding author

Correspondence to Justin L. Hess.

Ethics declarations

Conflict of Interest

The authors report no conflicts of interest exist associated with the publication of this work.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hess, J.L., Kerr, A.J., Lin, A. et al. A Systematic Review of the 2016 National Academy of Engineering Exemplary Ethics Programs: Revisions to a Coding Framework. Sci Eng Ethics 29, 36 (2023). https://doi.org/10.1007/s11948-023-00456-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11948-023-00456-y

Keywords

Navigation