skip to main content
10.1145/3494193.3494232acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicegovConference Proceedingsconference-collections
research-article

A machine learning approach for medical device classification

Published: 12 January 2022 Publication History

Abstract

The growth of medical device innovation over the last decades has necessitated the need for strong regulatory control in order to ensure the safety and performance of such devices. Medical devices are categorised according to the risk posed to the public. However, the legislation describing the classification rules are often dense and difficult to read. In order to facilitate device classification, the medical device regulator in Australia, the Therapeutic Goods Authority (TGA), provides online digital support tool for device classification. In this work, we (i) evaluate the online tool and (ii) make a further a proposal for using machine learning as means to provide more effective results. For the first part of this work, we asses whether the tool increases the readability of the legislative rules by evaluating the Flesch reading ease score of the legislation and the tool. While the online tool provides some degree of simplicity and readability over the legislation, we argue that the TGA can make more use of its data in order to provide more effective services. In the second part, we develop a proof-of-concept machine learning model to classify a device based on its stated purpose. The results of the experiment show a 82% weighted accuracy across four class labels, indicating that a more data-driven approach could be adopted by the authority.

References

[1]
2016. Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC). L 117, 5/5/2017, p. 1–175.
[2]
Ebenezer Agbozo and Kamen Spassov. 2018. Establishing Efficient Governance through Data-Driven e-Government. In Proceedings of the 11th International Conference on Theory and Practice of Electronic Governance(ICEGOV ’18). 662–664.
[3]
Michael J. Ahn and Yu-Che Chen. 2020. Artificial Intelligence in Government: Potentials, Challenges, and the Future. In The 21st Annual International Conference on Digital Government Research(dg.o ’20). 243–252.
[4]
Jeffrey K Aronson, Carl Heneghan, and Robin E Ferner. 2020. Medical devices: definition, classification, and regulatory implications. Drug Safety 43, 2 (2020), 83–93.
[5]
Australian Government. 2020. Therapeutic Goods (Medical Devices) Regulations 2002. https://www.legislation.gov.au/Details/F2021C00390. Federal Register of Legislation.
[6]
Paul Beninger. 2020. COVID-19: regulatory landscape of medicinal and medical device products for human use. Clinical Therapeutics 42, 8 (2020), 1444–1450.
[7]
José L Calderón, Leo S Morales, Honghu Liu, and Ron D Hays. 2006. Variation in the readability of items within surveys. American Journal of Medical Quality 21, 1 (2006), 49–56.
[8]
Yi-Jung Chen, Chi-Ming Chiou, Yu-Wen Huang, Pei-Weng Tu, Yung-Chuan Lee, and Chia-Hung Chien. 2018. A Comparative Study of Medical Device Regulations:: US, Europe, Canada, and Taiwan. Therapeutic Innovation & Regulatory Science 52, 1 (2018), 62–69. 29714608.
[9]
Weslei Gomes de Sousa, Elis Regina Pereira de Melo, Paulo Henrique De Souza Bermejo, Rafael Araújo Sousa Farias, and Adalmir Oliveira Gomes. 2019. How and where is artificial intelligence in the public sector going? A literature review and research agenda. Government Information Quarterly 36, 4 (2019), 101392.
[10]
Mera Kartika Delimayanti, Risna Sari, Mauldy Laya, M. Reza Faisal, Pahrul, and Rizqi Fitri Naryanto. 2020. The Effect of Pre-Processing on the Classification of Twitter’s Flood Disaster Messages Using Support Vector Machine Algorithm. In 2020 3rd International Conference on Applied Engineering (ICAE). 1–6.
[11]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4171–4186.
[12]
Rudolph Flesch. 1948. A new readability yardstick.Journal of Applied Psychology 32, 3 (1948), 221–233.
[13]
Food and Drug Administration. 2021. Product Classification. https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfPCD/PCDSimpleSearch.cfm.
[14]
James Hartley. 2016. Is time up for the Flesch measure of reading ease?Scientometrics 107, 3 (2016), 1523–1526.
[15]
Daniel B Kramer, Shuai Xu, and Aaron S Kesselheim. 2012. How does medical device regulation perform in the United States and the European Union? A systematic review. PLoS Medicine 9, 7 (2012), e1001276.
[16]
K Lavanya and C Deisy. 2017. Twitter sentiment analysis using multi-class SVM. In 2017 International Conference on Intelligent Computing and Control (I2C2). 1–6.
[17]
Yon Maley. 1987. The language of legislation. Language in Society 16, 1 (1987), 25–48.
[18]
Robert A Malkin. 2007. Barriers for medical devices for the developing world. Expert Review of Medical Devices 4, 6 (2007), 759–763.
[19]
Fang Miao, Pu Zhang, Libiao Jin, and Hongda Wu. 2018. Chinese News Text Classification Based on Machine Learning Algorithm. In 2018 10th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), Vol. 02. 48–51.
[20]
Gianluca Misuraca, Colin van Noordt, and Anys Boukli. 2020. The use of AI in public services: Results from a preliminary mapping across the EU. In Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance. 90–99.
[21]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
[22]
Matthias Ring and Bjoern M. Eskofier. 2016. An approximation of the Gaussian RBF kernel for efficient classification with SVMs. Pattern Recognition Letters 84 (2016), 107–113.
[23]
Therapeutic Goods Authority. 2021. Therapeutic Goods Authority website. https://www.tga.gov.au/.
[24]
Therapeutics Goods Authority. 2021. What classification is my medical device?https://www.tga.gov.au/sme-assist/what-classification-my-medical-device.
[25]
Roger van den Heuvel, Chris Stirling, Anuj Kapadia, and Jia Zhou. 2017. Medical devices 2030. https://assets.kpmg/content/dam/kpmg/xx/pdf/2017/12/medical-devices-2030.pdf.
[26]
Gail A. Van Norman. 2016. Drugs and devices: Comparison of European and US approval processes. JACC: Basic to Translational Science 1, 5 (2016), 399–412.
[27]
Sanjay Yadav and Sanyam Shukla. 2016. Analysis of k-Fold Cross-Validation over Hold-Out Validation on Colossal Datasets for Quality Classification. In 2016 IEEE 6th International Conference on Advanced Computing (IACC). 78–83.

Cited By

View all
  • (2024)Evaluation of large language models for the classification of medical device softwareBio-Design and Manufacturing10.1007/s42242-024-00307-07:5(819-822)Online publication date: 22-Jul-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICEGOV '21: Proceedings of the 14th International Conference on Theory and Practice of Electronic Governance
October 2021
557 pages
ISBN:9781450390118
DOI:10.1145/3494193
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 January 2022

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

ICEGOV 2021

Acceptance Rates

Overall Acceptance Rate 350 of 865 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)3
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Evaluation of large language models for the classification of medical device softwareBio-Design and Manufacturing10.1007/s42242-024-00307-07:5(819-822)Online publication date: 22-Jul-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media