skip to main content
10.1145/3647444.3647946acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicimmiConference Proceedingsconference-collections
research-article

SMER: A Novel Medical Entity Recognition Technique based on ScispaCy(BC5CDR) and Med7

Published: 13 May 2024 Publication History

Abstract

Named Entity Recognition (NER) is a stream of Natural language pro-cessing playing a pivotal role in the KDD process of data mining. The Last few years have seen a sudden surge in research about NER models, however, the scope of this research is often restricted to general text and speech. This paper thus talks about a specific stream the Medical NER. In the scope of this paper, a novel technique is proposed which utilizes a combination of two state-of-the-art NER models, Sciscapcy ( BC5CDR) and Med7 to achieve optimal results. Scis-pacy is a machine learning model trained on a sizeable biomedical corpus while Med7 is a rule-based system that specializes in detecting medical concepts by utilizing its large medical pattern vocabulary. The model is evaluated on bench-mark datasets and showcases better susceptibility to medical terms in a text. The model is able to distinguish between a wide range of medical entities including drug name, disease name, drug quantity, clinical procedures, and pathogen name. The paper highlights the potential of combining rule-based systems with machine learning models in developing robust models better suited for domain NER. By fetching strengths from both Scispacy(BC5CDR) and Med7, the paper proposes “SMER – ScispaCy – Med7 Entity Recogniser”, an adaptable solution that con-tributes to more accurate and comprehensive medical entity recognition model that can further be used in automatic medical record-keeping, patient medicine orders and facilitate medical practioners.

References

[1]
Selwal, Arvind &Raoof, Ifrah. (2020). A multi-layer perceptron based improved thyroid disease prediction system. Indonesian Journal of Electrical Engineering and Computer Science. 17. 524. 10.11591/ijeecs.v17.i1.pp524-532.
[2]
Hu, Min &Asami, Chikashi&Iwakura, Hiroshi & Nakajima, Yasuyo&Sema, Ryousuke& Kikuchi, Tsuyoshi & Miyata, Tsuyoshi &Sakamaki, Koji & Kudo, Takumi & Yamada, Masanobu &Akamizu, Takashi &Sakakibara, Yasubumi. (2022). Development and preliminary validation of a machine learning system for thyroid dysfunction diagnosis based on routine laboratory tests. Communications Medicine. 2. 10.1038/s43856-022-00071-1.
[3]
Yadav, Dhyan& Pal, Saurabh. (2020). Calculating Diagnose Odd Ratio for Thyroid Patients using Different Data Mining Classifiers and Ensemble Techniques. International Journal of Advanced Trends in Computer Science and Engineering. 9. 5463-70. 10.30534/ijatcse/2020/186942020.
[4]
Ur Rehman, Abbad& Lin, Chyi-Yeu& Mushtaq, Zohaib. (2020). Effective K-Nearest Neighbor Algorithms Performance Analysis of Thyroid Disease. Journal of the Chinese Institute of Engineers. 44. 1-11. 10.1080/02533839.2020.1831967.
[5]
Akhtar, Tehseen& Gilani, Syed & Mushtaq, Zohaib &Arif, Saad & Jamil, Mohsin & Ayaz, Yasar & Butt, Shahid &Waris, Muhammad. (2021). Effective Voting Ensemble of Homogenous Ensembling with Multiple Attribute-Selection Approaches for Improved Identification of Thyroid Disorder. Electronics. 10. 3026. 10.3390/electronics10233026.
[6]
Aversano, L. &Bernardi, Mario &Cimitile, Marta &Iammarino, Martina & Macchia, Paolo &Nettore, Immacolata&Verdone, Chiara. (2021). Thyroid Disease Treatment prediction with machine learning approaches. Procedia Computer Science. 192. 1031-1040. 10.1016/j.procs.2021.08.106.
[7]
M. Riajuliislam, K. Z. Rahim and A. Mahmud, "Prediction of Thyroid Disease(Hypothyroid) in Early Stage Using Feature Selection and Classification Techniques," 2021 International Conference on Information and Communication Technology for Sustainable Development (ICICT4SD), 2021, pp. 60-64.
[8]
Suman Pandey, AnshuTiwari, Akhilesh Kumar Shrivas and Vivek Sharma. (2015). Thyroid Classification using Ensemble Model with Feature Selection. International Journal of Computer Science and Information Technologies, Vol. 6 (3). pp. 2395-2398. ISSN: 0975-9646
[9]
Chen, Dan & Hu, Jun & Zhu, Mei & Tang, Niansheng& Yang, Yang & Feng, Yuran. (2020). Diagnosis of thyroid nodules for ultrasonographic characteristics indicative of malignancy using random forest. BioData Mining. 13. 14. 10.1186/s13040-020-00223-w.
[10]
Nandhinidevi, S. Poorani, P. GokilaBrindha (2020). Machine Learning Models for Relevant Feature Identification and Classification of Thyroid Data. International Journal of Innovative Technology and Exploring Engineering. ISSN: 2278-3075, Volume-9 Issue-5
[11]
TuranoğluBekar, Ebru &Ulutagay, Gozde&Kantarci, Suzan. (2016). Classification of Thyroid Disease by Using Data Mining Models: A Comparison of Decision Tree Algorithms,. Oxford Journal of Intelligent Decision and Data Science. 2. 13-28. 10.5899/2016/ojids-00002.
[12]
Salman, Khalid &Sonuç, Emrullah. (2021). Thyroid Disease Classification Using Machine Learning Algorithms. Journal of Physics: Conference Series. 1963. 012140. 10.1088/1742-6596/1963/1/012140.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICIMMI '23: Proceedings of the 5th International Conference on Information Management & Machine Intelligence
November 2023
1215 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Biomedical NLP
  2. Medical NER
  3. Named Entity Recognition
  4. Natural Language Processing

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICIMMI 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 21
    Total Downloads
  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)1
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media