Elsevier

Computers in Industry

Volume 64, Issue 9, December 2013, Pages 1355-1370
Computers in Industry

3D dental biometrics: Alignment and matching of dental casts for human identification

https://doi.org/10.1016/j.compind.2013.06.005Get rights and content

Abstract

A 3D dental biometrics framework and a pose invariant dental identification (PIDI) technique are proposed for human identification in this study. As best as we can tell, this study is the first attempt at 3D dental biometrics. Using 3D overcomes a number of key hurdles that plague 2D methods in dental identification. 60 Postmortem (PM) samples and 200 Ante mortem (AM) samples taken from multi ethnic Asian groups (Chinese, Indian and Malay) are used in this study. The PIDI technique includes algorithms for feature extraction, feature description and correspondence. The proposed feature extraction algorithm can extract the salient points from the scanned model of dental cast. The proposed feature description and the correspondence algorithm have been tested and shown to be more robust to rigid transformations compared with the related work. Preliminary experimental result achieves 94% rank-1 accuracy in a human-assisted process, while in an automated identification process, the rank-1 accuracy decreases to 80%. In addition, the developed methodology, as it is also feasible to be applied to identifying severely corrupted dental, could promptly provide a potential candidate list in mass disasters before expert investigation. The high accuracy, fast retrieval speed and the facilitated identification process suggest that the developed 3D framework is more suitable for practical use in dental biometrics applications in the future. The limitations and future work are also presented. It could be used adjunctively with the traditional 2D X-ray radiograph identification scheme to improve the efficiency of current identification process.

Introduction

Dental records have been well recognized as the best information for human identification purposes in severe conditions and mass disasters due to the survivability and diversity of dental structures [1]. According to the INTERPOL disaster victim identification protocol, dental records have been regarded as one of the primary identifiers [2]. In forensic dentistry, the dental remains allow identification of deceased individuals when other characteristics, such as face, fingerprint, iris etc., of victims are not available. Dental identification outperformed DNA identification in 11/9 case in 2001 and Asian tsunami in 2004 [3]. It is more efficient, less time consuming and less expensive than DNA comparison in disaster victim identification such as plane crash, war, explosion, earthquake and tsunami. Traditionally, the dental chart construction is a prerequisite and the first step of postmortem dental identification. In this dental chart, general identifiers of the deceased (e.g. gender, height, estimated age, hair color, skin color) are recorded. The distinctive features are marked for every individual tooth such as missing tooth, crown and root morphology, pathology and dental restorations [2]. Subsequently, the forensic experts make comprehensive comparison of every detail in dental charts and the X-ray radiographs to confirm victims’ identities. The potential identities of victims are confirmed or rejected based on the number of matches.

For the huge volume of cases, such as the 9/11 terrorist attack (2001), Asian Tsunami (2004) and Japan earthquake (2011), the traditional manual comparison scheme using the dental chart is labor-intensive and time-consuming. It took 40 months to identify the 2749 victims of 9/11 disaster [4], and 9 months for 2200 victims out of 190,000 (2200/190,000 = 1.1%) in 2004 Asian tsunami identification. Therefore, an efficient identification process is desired for economical and psychological reasons in disaster victim identification.

The X-ray radiograph comparison is a well-established method that provides evidence in court to serve in justice purpose. Several computer-aided post-mortem (PM) identification systems have been developed to assist in the identification process, such as the CAPMI [5], WinID [6] and DAVID [7]. These systems have primarily automated the text searching. However, the X-ray radiographs were still manually compared. During last decade, research teams from West Virginia University (WVU), Michigan State University (MSU) and University of Miami (UM) in coordination with the Criminal Justice Information Services Division (CJIS) of FBI developed a benchmark prototype of an automated dental identification system (ADIS) from 2D X-ray radiographs, which aimed to efficiently find a candidate list with identical or similar dental features to those of the Missing and Unidentified Person (MUP) [8]. The 2D identification framework mainly involves four steps [9]: image segmentation for tooth isolation [10], tooth contour and dental work contour feature extraction [10], [11], atlas registration for teeth classification [12], [13], and matching of tooth contours and dental work contours [14], [15]. However, unsolved problems and challenges limit the identification capability and accuracy of the 2D methodology, including:

  • (1)

    Time-consuming tooth isolation process and inaccurate contour extraction from blurred X-ray radiographs due to the low image quality. Chen et al. [16] reported that 14 out of the 25 (56%) subjects in their database could not be identified because of the image quality problem, variation of the dental structures, and insufficient number of AM radiographs.

  • (2)

    Since 2D radiographs are projections of 3D teeth, distortions in tooth contour shape arising from different imaging angles are often significant, resulting in incorrect matching.

  • (3)

    Most of the 2D techniques were developed for bitewing X-ray radiographs [10], [11], [12], [13], [14], [15], [17] which only contain two types of teeth: premolar and molar. However, techniques dealing with other types of radiographs like periapical and panoramic radiographs may be required for identification due to the conditions of the human remains. The partial teeth identification is still a challenge and has not been explored extensively. It is reported that in the 2D identification framework, the matching algorithm cannot properly align AM and PM radiographs if they do not contain the same number of teeth [18].

  • (4)

    Insufficient and distorted features in X-rays radiographs. The dental arch shape is considered to be unique among individuals [19]. However, the shape of dental arch is distorted in 2D radiographs, thus making it an inapplicable feature in 2D identification scheme [14], [16], [17].

  • (5)

    Identification efficiency is not high enough and human interaction is required in each processing step in the 2D framework. It takes about 1.7 h to retrieve one subject from 33 subjects with 72% rank-1 accuracy and it takes 7 h to retrieve one subjects from 133 subjects (PC with a 2.99 GHz Pentium 4 processor) with 66% rank-1 accuracy [18].

3D biometrics is receiving increasingly more attention than 2D biometrics. For instance, 3D face and ear recognition [20], [21] have shown promising identification capability and accuracy. With the development of real-time scanning and 3D reconstruction technologies, the acquisition of 3D models has become effortless and faster. The most recent powerful scanning technology could be used to obtain the 3D digital dental surface within 100 s [22]. In addition, there are some recent dental research work on computer-assisted 3D reconstruction of teeth from CT images for human identification [23], 3D automatic teeth segmentation for dental biometrics [24], and online 2D and 3D dental databases for dental identification [25]. While different parts of 3D dental biometrics system are being developed, none of the aforementioned studies have investigated the identification. Therefore, the present study aims to develop an automated 3D dental biometrics system with the identification methodologies and algorithms for retrieving digitized 3D dental casts to examine the identification validity and accuracy as an adjunctive mean for 2D dental biometrics.

Our previous study [26] showed that the identification novelty with a preliminary experimental result achieving 71.4% rank-1 accuracy and 100% rank-4 accuracy by matching 7 postmortem (PM) samples against 100 ante-mortem (AM) samples toward a fully automated 3D dental identification testing. The present study expands the sample size for both PM and AM database to include partial and noisy PM samples. Different shape descriptors (saliency, Gaussian curvature, integral volume) are proposed and compared with regard to pose invariant characteristics.

Section snippets

System approach overview

An overview of the 3D dental biometrics framework is shown in Fig. 1.

Sample acquisition

The available sample size is the major limitation of our previous study [26]. In this study, the post-mortem sample size has been increased from 7 to 60 subjects and the ante-mortem sample size has been enlarged from 100 to 200 subjects, comprising more than 2400 teeth. In addition, the samples have multi-race characteristics in Asian groups, including the Chinese, Indian, and Malay ethnic groups.

Ante-mortem (AM) sample acquisition

The ante-mortem sample

Preprocessing

To facilitate efficient and accurate matching of corresponding ante-mortem and post-mortem surface images, preprocessing of the digital images was required to reduce the size of the images and to eliminate unnecessary data such as the bottom part of a dental plaster. Preprocessing is a two-step process which involves the decimation and segmentation of the PM samples and AM samples. There are three operations in preprocessing: (1) decimation to 10% of the original points for all the AM and PM

Algorithm overview

The three main components in this 3D dental biometrics framework are feature extraction, shape descriptor definition and correspondence. Table 1 shows the main steps. The details are elaborated in the following sections.

Feature extraction

The feature extracted in this study is the geometric invariant and visually salient feature points. A multi-scale feature extraction algorithm is presented to extract feature points on digitized dental surfaces. Fig. 14 shows the differences between the existing work [30], [31] and this work. The main steps are given below.

  • Gaussian multi-scale representation The first step is to compute the bounding box to define a neighborhood for each vertex v on the dental surface. σi  {1ɛ, 2ɛ, 3ɛ, 4ɛ, 5ɛ, 6ɛ

Correspondence

Let P′ and Q′ be the feature points extracted from the PM dental surface and the AM dental surface respectively. For each feature point pi  P′ and qi  Q′, the respective descriptor values (saliency, Gaussian curvature, integral volume) S(pi) and S(qi) were already calculated. The following steps are for finding three feature points both in PM and AM samples with similar values and similar relative positions in Euclidean space for correspondence.

  • For any feature point p  P′, select the salient

Experiment I: identification accuracy comparison of complete samples

In Experiment I, the seven samples shown in Fig. 2(a) which were used in our previous study [26] are tested with an increased AM database. The comparison is shown in Table 2, Table 3. The first four ranks of the average errors are compared in Table 4 and Fig. 8. The average error is calculated as the arithmetic mean error of the corrected matched results at each rank. Comparing Table 2, Table 3, all the samples achieve rank-1 accuracy by using this work in contrast with only 5 out of 7 achieved

Conclusions and future work

A 3D dental biometrics framework and a pose invariant dental identification (PIDI) algorithm are proposed for human identification. The PIDI algorithm includes algorithms for feature extraction, feature description and correspondence. 60 postmortem samples and 200 ante mortem samples are used in this study. These 60 samples consist of the 7 complete genuine samples in previous study [26], in addition, 11 partial genuine samples, 32 noisy genuine samples and 10 imposter samples taken from

Glossary

Ante-mortem (AM) samples
samples acquired during the lifetime of individuals
Post-mortem (PM) samples
samples obtained of deceased individuals
Mandibular teeth
teeth in lower jaw
Genuine samples
paired AM and PM samples come from the same person
Imposter samples
AM and PM samples belong to different persons

Xin Zhong is a PhD student and research engineer in Mechanical Engineering Department, National University of Singapore. Her research interests include 3D dental biometrics, data mining, medical image processing, computer vision, pattern recognition, computational geometry and 3D measurement technology.

References (38)

  • R.M. Lorton L et al.

    The computer-assisted postmortem identification (CAPMI) system: a computer-based identification program

    Journal of Forensic Science

    (1988)
  • M. J, WinID3 Dental Identification System,...
  • G. Fahmy et al.

    Toward an automated dental identification system

    Journal of Electronic Imaging

    (2005)
  • H. Chen et al.

    Automatic Forensic Dental Identification Handbook of Biometrics

    (2008)
  • H. Chen et al.

    Tooth contour extraction for matching dental radiographs

    Proceedings of the 17th International Conference on Pattern Recognition

    (2004)
  • O. Nomir et al.

    Fusion of matching algorithms for human identification using dental X-ray radiographs

    IEEE Transactions on Information Forensics and Security

    (2008)
  • H. Chen et al.

    Dental biometrics: alignment matching of dental radiographs

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (2005)
  • H. Chen

    Automatic Forensic Identification Based on Dental Radiographs

    (2007)
  • J.A. Kieser et al.

    The uniqueness of the human anterior dentition: A geometric morphometric analysis

    Journal of Forensic Sciences

    (2007)
  • Cited by (19)

    • Artificial intelligence in forensic anthropology: State of the art and Skeleton-ID project

      2023, Methodological and Technological Advances in Death Investigations: Application and Case Studies
    • Automatic human identification from panoramic dental radiographs using the convolutional neural network

      2020, Forensic Science International
      Citation Excerpt :

      These systems consist of four main phases: the PM phase, recording and charting the dental features of the PM dental radiographs manually; the AM phase, recording and charting the dental features of the AM dental radiographs manually; the initial reconciliation phase, comparing and matching the PM and AM charts automatically; the detailed reconciliation phase, matching the potential AM and PM radiographs manually and generating the reconciliation report. Since feature extraction, coding, and recording were conducted manually [4–6], these systems were incompletely automatic, labor-intensive and time-consuming [6,7]. Meanwhile, these traditional systems require highly experienced experts to perform the coding and recording process, which may result in varied identification results between different radiologists or dentists [8].

    • Automated Identification from Dental Data (AutoIDD): A new development in digital forensics

      2020, Forensic Science International
      Citation Excerpt :

      Though, the study concluded that the human anterior dentition is unique and encouraged 3D approach, it required manual segmentation and lacked complete automation. Another study [35] presented an algorithm for automatic matching using scanned mandibular 3D models. The study was based on feature extraction and description points from the mandibular models and concluded that the accuracy was highest with manual-segmented models than auto-segmented PM models.

    • Efficient 3D dental identification via signed feature histogram and learning keypoint detection

      2016, Pattern Recognition
      Citation Excerpt :

      In this experiment, we investigate the performance of our proposed identification method on 20 complete PM dental models. The quantitative identification results are shown in Table 3, from which we see that our method outperforms [9] by achieving 100% Rank-1 accuracy for all 20 PM models. Such an excellent result is mainly due to the robust keypoint detection and the effective matching algorithm we have proposed.

    • 3D Dental Biometrics: Transformer-based Dental Arch Extraction and Matching

      2023, Proceedings - 2023 IEEE Conference on Artificial Intelligence, CAI 2023
    View all citing articles on Scopus

    Xin Zhong is a PhD student and research engineer in Mechanical Engineering Department, National University of Singapore. Her research interests include 3D dental biometrics, data mining, medical image processing, computer vision, pattern recognition, computational geometry and 3D measurement technology.

    Deping Yu is an associate professor at Sichuan University, China. He received PhD degree in mechanical engineering from National University of Singapore in 2012. His research interests include micro/nano manufacturing of 3D surfaces; ultra-precision machining and micromachining; mechatronics, dynamic modelling and control of mechanical systems; diagnostics and prognostics in system health monitoring systems; and 3D measurement technology.

    Yoke San Wong is a professor in Mechanical Engineering Department, National University of Singapore. His research interests include machining process characterization, simulation, monitoring & optimization; product data capture, design, prototyping & manufacture; and automated/integrated manufacturing system modelling, design and control.

    Terence Sim is an assistant professor in School of Computing, National University of Singapore. His research interests include face processing: analysis, recognition, modelling, animation, rendering; biometrics, pattern recognition, computational photography, computer vision and image processing.

    Wen Feng Lu is an associate professor in Mechanical Engineering Department, National University of Singapore. His research interests include computer-aided design; product lifecycle management; 3D CAD model matching and haptic integrated simulation.

    Kelvin Weng Chiong Foong is an associate professor in Faculty of Dentistry, National University of Singapore. His research interests include craniofacial imaging and visualisation; structural and biological effects of surgical treatment in cleft lip and palate anomalies.

    Ho-Lun Cheng is a senior lecturer in School of Computing, National University of Singapore. His research interests include computational geometry and topology, molecular modeling, meshing, parametric surfaces, and computer graphics.

    View full text