1. Introduction
Dental caries is a common chronic infectious condition that affects many children, young and adult individuals in the worldwide [
1,
2]. Although dental caries usually progress slowly, in the absence of appropriate early intervention, they can become a serious health issue causing pain, infection and tooth loss [
3]. In clinical dentistry, caries detection involves determination of treatment, assessment of the level of caries risk and application of preventive methods, and is very important in guiding clinical planning [
4]. Successful treatment requires timely and accurate diagnosis. Various diagnostic methods are used, including digital subtraction radiography (DSR), optical coherence tomography (OCT), electrical conductivity measurement (ECM), ultrasonic imaging, fibre-optic transillumination (FOTI), laser fluorescence and quantitative light-induced fluorescence (QLF)
5. The interpretation of the images acquired by these methods is limited by inter-rater disagreement, and no single method alone can diagnose caries on the entire tooth surface. The ideal method for diagnosing dental caries has not yet been found. In this quest, interest in caries detection with computer-aided image analysis is increasing.
The favour of panoramic radiography as an extraoral method has increased owing to its low radiation dose, less time necessity, ease of application, and more patient comfort [
6]. However, extraoral imaging methods are associated with distortion and magnification of images [
7]. Panoramic radiography singly is inferior to bitewing radiography in the diagnosis of caries [
6,
8]. However, with the technological developments in panoramic radiography devices, it has now become competitive with intraoral imaging in the diagnosis of caries in panoramic radiographs [
9]. Intraoral radiography necessitates more patient cooperation in comparison with extraoral techniques. Hence, pediatric, and handicapped patients would be advantageous greatly from an extraoral imaging system.
Artificial Intelligence (AI) methodologies, specifically, deep learning based convolutional neural networks (CNN), have shown good performance in computer communication including object, face and activity tracking, recognition, three-dimensional mapping and localisation [
10]. Image processing and image recognition procedures have been applied in medical image segmentation and diagnosis. The U-Net is a convolutional network architecture used for fast and precise segmentation of biomedical images, and the U-Net architecture has been reported to achieve successful results in medical image datasets. The U-Net architecture can run on a trained dataset with fewer images and provide precise segmentation. However, research on the application of deep CNN infrastructure and studies on caries diagnostic methods in dentistry has not yet reached a common conclusion. [
11]. This study was performed to evaluate the efficacy of an AI application developed using deep learning methods for dental caries diagnosis on panoramic radiographs of children in primary, mixed, and permanent dentition.
4. Discussion
If dental caries is not detected correctly and early, the lesion may gradually extend into the dentin, enamel and even the tooth pulp, resulting in severe pain and consequently the loss of dental function. Artificial intelligence-based systems are often used in dentistry for the design of automated software to facilitate diagnosis and data management [
13]. These are often clinical decision support systems that help and guide professionals to make better decisions. These systems have been used to improve diagnosis, treatment planning and prediction of prognosis [
14]. This study was performed to examine the success of an artificial intelligence application developed using deep learning in the diagnosis of dental caries on panoramic radiographs of primary, mixed and permanent dentition.
Various diagnostic methods are being developed and improved to overcome clinical and radiographic diagnostic limitations [
5]. The techniques now used in clinical settings include digital subtraction radiography (DSR), optical coherence tomography (OCT), laser fluorescence, electrical conductivity measurement (ECM), ultrasonic imaging methods, digital imaging fibre-optic transillumination (DIFOTI) and quantitative light-induced fluorescence (QLF) [
15,
16]. Takeshita et al. demonstrated that DSR had high sensitivity and specificity in diagnosing interproximal caries [
17]. In this method, however, it is important to acquire standard and good quality radiographs via film holders. The use of artificial intelligence has great potential for eliminating errors that may not be noticed or may be overlooked by the human eye [
18]. Laitala et al. evaluated the validity of the DIFOTI method by comparison with visual inspection and bitewing radiography, but found that the method had low sensitivity and was subjective [
19]. Subjectivity in a method prevents the application of a standard procedure for that method. In the present study, we reduced subjectivity through an artificial intelligence system developed using deep learning on standardised panoramic radiographs. DIAGNOdent Pen, a laser fluorescence (LF) device with no X-ray exposure, is used for caries detection [
20]. However, it has been reported that LF-derived scores are weakly associated with caries histology [
21]. In addition, this LF device can produce FP responses as it is affected by discolouration of the tooth surface and dental plaque [
22,
23]. Radiographs reflect structural changes in the tooth without being affected by discolouration or plaque. This feature can increase the reliability of the results achieved on panoramic images. The study by Mansour et al. using LF and OCT diagnostic methods established that LF could detect caries at restoration margins, but not underneath restorations [
24]. These differences among caries detection methods suggest that the reliability of a method alone is not sufficient [
25].
Panoramic radiography is one of the most preferred methods for patient evaluation in a routine pediatric examination, as it is well tolerated by children and gives an image area that dominates all mouth [
26]. Panoramic radiography can increase the accuracy and reliability of caries diagnosis through artificial intelligence applications compared to bitewings as these radiographs provide the data needed by deep learning methods as a whole.
A review by Schwendicke et al. reported that classification and segmentation could be performed using CNNs on periapical, bitewing, CBCT, and panoramic radiographs for detection of caries and anatomical structures and that the most used method was panoramic radiography [
27]. Although radiographic methods, such as bitewing radiography, are commonly used in caries detection, these methods only detect caries in a certain area and are therefore insufficient for assessment of caries for all teeth, as is the case with panoramic radiography [
28]. Vinayahalingam et. al.[
29], obtained demonstrable accuracy in their study named the classification of caries in third molars on panoramic radiographs using deep learning. The present study evaluated caries detection via application of artificial intelligence in panoramic radiography that provided information about all teeth for caries risk assessment.
In the area of machine learning and, especially, the problem of statistical category, the confusion matrix, also known as an error matrix, is a specific table layout that allows visualisation of the performance of an algorithm by summarising predicted and actual instances [
30]. Yasa et al. used a confusion matrix in their study, and evaluated the performance of a model using TP, FP and FN, but not true negative (TN), as metrics [
31]. The present study also employed the confusion matrix using TP, FP and FN to evaluate the performance for caries detection. TN could not to counted, because of the presented AI model was developed to segment caries lesion. Only decayed teeth were labelled on panoramic images. Healthy teeth were not labelled in any way. In future studies, AI models should be developed to classify teeth that have caries or not have caries. Cascade networks should be developed to classify teeth and segment caries lesion. U-Net is a convolutional network architecture used for fast and precise segmentation of biomedical images [
32]. Nishitani et al. reported that the U-Net deep learning algorithm is suitable for segmentation of teeth on panoramic images [
33]. Therefore, in the present study, the U-Net model, which has a high rate of success in medical image segmentation, was preferred for segmentation in the deep learning model.
Major deep learning libraries consist of layer-based frameworks, such as Caffe, and graph-based frameworks, such as PyTorch, TensorFlow and MXNet [
34]. Torch is an open source library developed to support deep learning and machine learning [
35]. This library is used frequently in image processing [
36] and has been shown to simplify complex operations [
37]. Therefore, the present study used the Python open-source programming language and PyTorch deep learning library, which were shown to be successful in the development of artificial intelligence models.
There are studies in the literature in which AI is used in the detection of dental caries. However, it is necessary to increase the number of these studies in order to reach a common conclusion. Lee et al. reported that dental caries could be detected with deep learning-based CNN applications on 3000 periapical images [
38]. They stated that the diagnostic accuracy was 82.0%, sensitivity 81.0%, specificity 83.0% in premolars and molars. Schwendicke et al. used DIAGNOcam and detected caries on 217 images by deep CNNs [
39]. Devito et al. applied a multilayer artificial neural network for proximal caries diagnosis on bitewing radiographs of 160 extracted teeth [
40]. The present study used 6057 panoramic images. This high number of images in our dataset increases the reliability of our results compared to previous studies.
In the present study, the sensitivity, precision and F1 score were high for primary and permanent dentition, while these scores were lower for mixed dentition. High scores for permanent and primary dentition may have resulted from a clearer reading of images due to the uniform dentition in permanent dentition and the smaller size of the permanent tooth germs in primary dentition compared to the germs in mixed dentition. In mixed dentition, developing permanent tooth germs and root resorption in primary teeth may have adversely affected the image clarity. This may explain the higher sensitivity rate for primary and permanent dentition than for mixed dentition.
This study had some limitations. Application of a method in clinical procedures requires achieving results of ≥ 90% [
41]. Our AI method needs to be improved to achieve such results. In addition, our findings were not compared with different radiographic caries detection methods. Therefore, the use of more cases to train deep learning-based CNN systems as well as more advanced algorithms will increase the success of caries detection on panoramic radiographs and ensure a place for these systems in routine clinical practice. Because of the lack of comparisons in AI applied in dentistry, comparative studies in the latter are required. In the presented study, cascade network was not developed. To remove the limitation, cascade AI networks should be developed to classify teeth and segment caries lesion in the future studies. Beside, histological confirmations of caries and further extension of labelled data are required, to tide over the model’s limits in the presented study. Again, comparing this study with a clinical caries detection method may provide clearer results.