1. Introduction
Cancer-associated pulmonary embolism (PE), constituting a substantial burden with increased cancer-related mortality, is dependent on the primary site of malignancy, the extent of the disease but also on the characteristics of patients with significant comorbidities [
1,
2]. At autopsy, up to 12,4% of cancer patients exhibited one or more PE events thus highlighting the high incidence of PE in this subset of patients [
3]. In comparison to non-cancer patients, patients with malignant tumors have 4-8 fold increase in the risk of mortality following an acute thrombotic event [
4,
5]. Moreover, the prevalence of venous thromboembolism events including PE in cancer patients is 12-fold higher than the general patients but also more significant when receiving active anti-cancer therapy (23-fold) [
6]. Therefore, a prompt diagnosis of PE is warranted in cancer patients to optimize their survival outcomes.
On the other hand, incidental pulmonary embolism (iPE) is commonly diagnosed during routine surveillance imaging with an incidence varying between 1% and 5% [
7]. Nevertheless, iPE is associated with respiratory symptoms that are mistakenly attributed to cancer itself. Therefore, iPE should not be considered a benign situation since it has been shown that the risk of recurrent events or PE-related events does not differ significantly from symptomatic PE. Chest computed tomography (CT) angiography remains the standard of care of imaging for the characterization of suspected PEs [
8,
9]. Current therapeutic strategies of iPE are similar to symptomatic PE requiring the rapid instauration of active anticoagulation to prevent serious outcomes [
10,
11].
With the advent of artificial intelligence (AI) into daily medical activities, there is an unmet need to revolutionize and support the work of radiologists in the rapid diagnosis and management of acute medical conditions [
12]. Improvement in the quality and technology of computed tomography (CT) scans has drastically changed the sensitivity in detecting PEs with better visualization of the pulmonary artery and spatial resolution [
13]. It is certain that AI, through the recognition of complex patterns in radiological data and the elaboration of a quantitative assessment of imaging features, would empower radiologists in their quest for enhanced accuracy and efficiency while minimizing the risks of diagnostic errors [
14]. With the increasing number of FDA (Food and Drug Administration)-approved AI algorithms, radiologists and AI should become partners, not competitors, to enhance their performance and accuracy [
15].
Therefore, numerous retrospective trials tried to assess the accuracy of AI-based models in detecting PEs [
16,
17,
18,
19,
20]. AI improved the efficacy in the diagnostic process of suspected PEs; consequently , its implementation in daily routine care would enhance the detection of iPEs in populations like cancer patients [
21]. In this study, with the aid of an AI-powered tool (CINA-PE Avicenna.AI), we hypothesized that the application of this model could support the radiologists in the diagnosis of iPE in an asymptomatic oncology population undergoing routine clinical CT scans, to improve the clinical outcomes and reduce the time to optimal therapeutic approach.
2. Methods and Materials
This study was approved by the Institutional Review Board of our hospital (no. : 2024-380). The need for written informed consent was waived. Avicenna.AI provided the PE-detection DL-based algorithm for this study. The study received no financial support. The authors had control of the data and the information submitted for publication at all time .
2.1. Study Design
The main objective of this study was to assess the role of AI in the accurate diagnosis of iPEs among cancer patients undergoing routine contrast-enhanced CT scans at Gustave Roussy Cancer Campus. The data was retrospectively and consecutively collected for a time period of 6 months, from December 2022 to June 2023 . All adult oncology patients who underwent a surveillance CT scan without suspected symptoms of PEs were included.
The patients included were being followed up for stage IV or metastatic neoplasia and had undergone an oncological evaluation CT scan with a thoraco-abdomino-pelvic CT scan with contrast.
Patients who had undergone thoracic angioscan or thoracoabdominal angioscan and scans performed as part of an emergency or complication were excluded, as were initial assessments of tumors without histology.
Demographic data of patients and their disease as well as information regarding the management of patients after detection of PEs were also included.
The date and time of the CT exam(image acquisition) and the date the report was validated by the secretaries and medical assistants after the radiological report by the junior radiologist and correction by the senior radiologist, was recorded.
The time and date of the patient’s admission to the emergency department for anticoagulant treatment was also recorded.
2.2. Imaging Feature and Analysis
2.2.1. CT Scan Data
The scanner data sets were provided by a clinical center and were distributed appropriately in terms of suppliers (GE Healthcare GE Optima CT660 is a 64-slice CT scanner , Siemens Healthineers SOMATOM® Force Dual Source CT system).
Two specialized radiologists (A.O. and S.A.) reviewed the positive results reported by the AI system and data were filtered between true PEs and false positives. The specific causes of FPs were also detailed in the results section.
Figure 1.
Summary of management without artificial intelligence and with artificial intelligence in the management of incidentally discovered pulmonary embolism in cancer patients.
Figure 1.
Summary of management without artificial intelligence and with artificial intelligence in the management of incidentally discovered pulmonary embolism in cancer patients.
2.1.2. AI System
The iPE deep learning (DL)-based algorithm consists of a series of Unets, a particular type of Convolutional Neural Networks (CNNs), trained to detect specific anatomical structures (refUNET). Unets, known for their effectiveness in handling biomedical images, implement an encoder-decoder framework. The encoder captures features at different levels of abstraction through a series of convolutional layers. The decoder then samples the abstract features to generate voxel-wise segmentation maps. This strategy allows the Unet to capture both high-level contextual information and fine-grained details of medical images, essential for accurate segmentation.
The detection of PEs is achieved by leveraging multiple stages, beginning with the preprocessing of medical images to enhance relevant features and normalize intensity levels. The preprocessed images are then fed into the Unet models, which generate voxel-wise segmentation maps of key anatomical landmarks and potential PE regions.
This DL-based tool was trained on 7630 CT scans and validated on 381 CT scans from 39 different CT scans models. The algorithm achieved a sensitivity of 87.8% (95% CI: 82.2% - 92.2%) and a specificity of 92.0% (87.3% - 95.4%).
2.3. Statistical Analysis
On a per patient level, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV), for the detection of PE were calculated. The 95% confidence intervals (95% CI) were calculated using the exact binomial distribution (Clopper-Pearson) (ref CP). To further investigate the potential impact on clinical workflow, the mean time between the exam and the physician’s interpretation was calculated. The number of patients that were discharged (patients that left the hospital) due to the missing PE diagnostics and then rehospitalized once the diagnosis was established was evaluated. Furthermore, we analyzed the number of patients that needed hospitalization and that initiated active anticoagulation treatment once the PE was detected. All the statistical analyses were performed using MedCalc Statistical Software (v20.015, MedCalc Software Ltd.).
3. Results
A total of 3050 patients were included in the analysis in whom the prevalence of iPEs was 1.3% (39 patients). The most common primary site of malignancy among patients with iPE was digestive (9 out of 33 with available clinical data; 27.27%), followed by thoracic (8 patients; 24.2%) and gynecological neoplasms (5 patients; 15.2%).
Table 1.
In the first version of the model, out of 3049 evaluated patients, 233 alerts for suspicious iPE were detected while 2816 tests were found to be negative. Out of the 233 patients, 39 patients had confirmed iPE on their routine CT scans while 194 patients had false positive (FP) results. Therefore, the sensitivity and specificity of the AI model were 100% (95%CI: 90.97%-100%) and 93.55% (95%CI: 92.62%-94.41%), respectively while the positive predictive value (PPV) and negative predictive value (NPV) reached 16.74% and 100%. In the FP analysis, the most common causes were an artifact (80 cases, 41.2%), an FP (36 cases, 18.6%), and lymph nodes (21 cases, 10.8%).
The mean time of delay between the exam and the interpretation by the physician to detect the PE reached 8.13 hours with a standard deviation of 15.48 hours (95%CI: 3.21-13.05). Following the test interpretation, there was a delay in the initial management in 5 out of 32 patients (15.6%) (Patients left the hospital after the tests). Five patients (15.6%) needed hospitalization following iPE detection for surveillance and instauration of therapeutic anticoagulation while two patients (6.25%) had serious complications. Active anticoagulation with low molecular weight heparin was initiated in those with newly diagnosed PE (25 patients).
In an effort to improve the performance, the model was revised and a second set of data was performed. Two patients from the first set of patients were not included in the second analysis due to processing issues.
In the second set of analysis, out of 3047 patients, 104 alerts were detected for iPE while 2942 had negative findings. 36 of the 104 patients had confirmed PE while 68 alerts were false negatives. In this set of analyses, only one patient reported as negative by CINA-iPE was deemed to have a PE by the radiologist. The sensitivity and specificity of the second version of the AI model were 97.3% (95%CI: 85.84%-99.93%) and 97.74% (95%CI: 97.14%-98.24%) while the PPV and NPV were 34.62% and 99.97% respectively. In the FP analysis, the most common causes were an artifact (22 cases, 32.3%), an FP (17 cases, 25%), and lymph nodes (11 cases, 16.2%). Table 2.
4. Discussion
The purpose of this paper was to assess the value of adding CINA-iPE, an AI system for the detection of unsuspected PEs on chest CT scans, in the routine oncology care outside urgent medical conditions. With a reported prevalence of 1.3% of PEs, the sensitivity and sensitivity reached 97.3% and 97.7% respectively. The AI tool detected all the reported clinical PEs except one case while no cases of missed PEs were noted. These data with two datasets that showed reduced FPs in the second dataset, support the fact that ML is a continuous process that would ultimately lead to an optimal AI system in support of radiologists.
An AI medical tool, to be considered a valuable diagnostic solution , must be fast and cheap with a significant impact on survival outcomes. Earlier data showed that AI tools used for the detection of intracranial hemorrhage (ICH) on non-contrast CT scans can reduce both image wait and turnaround times through ML algorithms thus potentially improving the diagnosis and management of patients [
22]. Therefore, with the knowledge that cancer patients have an increased risk of thrombotic events including PEs, there is an unmet need to optimize the diagnosis and treatment of PEs with the aid of AI. However, the vast majority of the published data assessed the role of AI tools in detecting PEs on CT pulmonary angiography (CTPA) in an emergency setting. In fact, a recent meta-analysis evaluated the actual role of DL in PEs on a total of 36,847 CTPA scans in seven studies, in a retrospective fashion, which led to a pooled sensitivity and specificity of 88% and 86% respectively. With an acceptable rate of FPs, DL models performance was considered satisfactory despite the retrospective nature of these works [
23]. Moreover, the implementation of a validated commercialized AI algorithm in 1202 patients with suspected PE has led to increased sensitivity (92.6%) and negative predictive value (NPV) thus increasing the self-confidence of radiologists in their final diagnosis [
21]. This AI tool detected a number of missed diagnoses in the emergency setting which would have significant better outcomes in cancer patients [
21].
Figure 2
Nevertheless, in the oncology field, iPEs are common with an increased risk of morbidity when missed with a delayed diagnosis, most particularly in patients undergoing multiple routine surveillance CT scans in both primary and secondary care. In a meta-analysis by Meyer et al., the occurrence of iPE among oncology patients reached 3.36% (963 out of 2826 screened patients) with the highest prevalence among prostate cancer patients followed by hepato-biliairy carcinoma and pancreatic tumors [
24]. On the other hand, the sensitivity for PE diagnosis by the radiologists is commonly low, ranging between 67-87% with a high specificity between 89-99% [
25,
26]. In specialized cancer centers, radiologists are commonly overwhelmed by the overflow of CT scans thus highlighting the need for validated support in their routine daily activities. Several AI companies operating in the healthcare industry have gained FDA (Food and Drug Administration) clearances in various indications including iPEs. AIDOC medical, the only AI model used in the published retrospective trials for iPE detection, gained FDA clearance for triage of iPE in October 2020 [
27]. In March 2024, Avicenna.AI, a medical imaging AI company, received clearance from the FDA forCINA-iPE, an AI tool for the detection of iPE on routine CT scans in different health conditions thus reducing the risk of PE-related morbidity and mortality [
29]. To the best of our knowledge, this is the first study evaluating CINA-iPE in the characterization of iPE in an oncology population undergoing routine surveillance imaging.
Several retrospective analyses with distinct population and CT scan models were designed to address the dilemma of iPE in both the general and oncology populations [
16,
17,
18,
19,
20] (
Table 1). First, Wildman-Tobriner et al. implemented an AI model for reporting iPE in a total of 11,913 CT examinations in all comers including oncology patients (both chest, abdominal, and pelvic (CAP) CT scans and abdominal and pelvic CT scans) and reported a rate of 0.47% and 0.34% of FNs on CAP scans and AP scans, respectively. Demonstrating a significant agreement with radiologists, this AI tool was capable of detecting 49 missed iPEs [0.41%] thus constituting around 38% of missed PEs by radiologists (49 out of 128 PEs) [
19]. It is worth mentioning that assessing iPE in the general population might undermine the value of AI where the risk of thrombotic events is lower in comparison to oncology patients. Moreover, the high risk of missed PEs in this study in comparison to our paper (0%) highlights the difference in the qualifications of radiologists between centers, an issue that was not addressed in these different trials. In a similar fashion, Batra et al. performed a retrospective analysis on 2555 patients, with or without a cancer diagnosis, to detect iPE on conventional CT scans with AI (Briefcase for PE detection by AIDOC). The frequency of iPE reached 1.3% (40 patients) with seven cases only detected by the radiologists while four were only detected by AI thus highlighting the importance of the synergistic work between physicians and AI. The specificity and sensitivity were estimated at 99.8% and 86.3%, both significantly lower than clinical results, and there were no subgroup differences in terms of Se and Sp despite a small sample size but there was also no difference in terms of NPV and PPV. Reported false positives were attributed to lymph nodes and pulmonary venous filling defects while FNs were due to altered anatomy [
16]. More recent data from Langius-Wiffen and colleagues demonstrated a 2.2% of acute iPE (67 out of 3089 patients) with routine portal venous contrast-enhanced chest CT scans (37.1% of oncology patients)) with an additional 25 missed cases (37.3%) thus increasing the sensitivity of the AI-tool (AIDOC Medical). However, the AI tool had a lower PPV due to a high rate of reported FPs, most commonly related to suboptimal pulmonary artery opacification [
18]. The low PPV, also in line with our data, should not be considered a limitation in diagnostic tests with high sensitivity and specificity, most particularly when these issues can be rapidly overcome by the fast adaptation and deep learning of ML models.
Two other retrospective analyses were conducted on oncology patients. In an analysis by Wiklund et al. on 1069 cancer patients undergoing an elective CT, the prevalence of iPE was 4% with a sensitivity and specificity reaching 90.7% and 99.8% respectively after the application of a DL cloud-based AI algorithm (AIDOC Medical) with a confirmed shorter turnaround time. A total of 59 initially missed PEs were detected but it should be noted that all included CT images were reviewed by a radiologist which would not reflect the daily routine care [
20]. In addition, Topff et al. applied the same AI-model on 6447 oncology patients, which found a prevalence of iPE of 1.2% in the overall population and achieved a sensitivity and specificity of 91.6% and 99.7% respectively. Interestingly the missed PE diagnosis dropped significantly from 44.8% to 2.6% with the AI algorithm [
17]. The most common causes of FNs were a flow artifact (41.9%) followed by an abnormality adjacent to a pulmonary artery (29%) and technical artifact (22.6%). With a median process time of 3 minutes, almost all of the studies were available for analysis at the opening of the study but the number of FPs reached 18.8%. An interesting finding worth of debate in this trial is the detection of a majority of segmental and subsegmental PEs (83.3%), which can suggest an overdiagnosis of a medical condition with no impact on survival but nevertheless, data so far support an active anticoagulation in this setting [
11,
17]. Also, data analysis and retrieval might constitute a limitation for AI software with the risk of delaying the reporting of the results (7.3% of non-analyzed exams) [
17]. The SAFE-SSPE is a non-inferiority trial testing clinical surveillance in comparison to active anticoagulation in patients with low risk subsegmental PE which would help physicians on the value of reporting these missed PEs by the AI system [
30]. Table 3.
Implementation of AI models has tremendous advantages in terms of increased diagnostic accuracy but also, represents several limitations which would implicate the necessity for a leading role for the radiologists to guide its optimal use in the clinical setting. One optimal approach was conducted by Vallee et al. who evaluated the value of adding a DL-algorithm to the clinical performance of radiologists in the detection of PEs on CT angiographies, using the already validated AI tool, CINA-iPE . A total of 15.8% of PEs were detected and the good classification performance was higher with the human-AI combination (p<0.0001). Interestingly, the sensitivity of the combo increased to 92.5% in the detection of PEs in comparison to 81.7% when physicians worked alone but also enhanced the diagnosis agreement between residents with better concordance [
31]. This finding is a clear message that the current flow of trials should address the harmony of work between radiologists and AI models and not trying to compare their performances alone. Therefore, we believe that our paper has several strengths. First, CINA-iPE successfully matched the clinical results reported by the radiologists with optimal agreement between both counterparts. Second, the evaluation of the clinical impact in those suffering from iPEs was also reported with the initiation of an optimal anticoagulation and the hospitalization of those suffering from severe consequences. Third, highlighting the wide difference in the prevalence of missed PEs between the different trials thus confirming the major role of the human factor in the diagnosis of PE. Nevertheless, there are relative limitations to our study such as a limited generalizability of the outcomes since the population is constituted by cancer patients only (high risk of thrombotic events); however, some might consider it as an advantage for AI where its implementation in the general population can be a matter of debate with the low incidence of PEs. Also, the high rate of FPs resulting in a low PPV might affect the work hours of radiologists, but these models are continuously trained and optimized to enhance their diagnostic accuracy. Another common challenge between all trials including ours is that some iPEs might be missed by both physicians and AI since AI-negative findings are not routinely reviewed by physicians. Moreover, the low prevalence of iPEs might be attributed to the fact that all patients admitted to our hospital are offered prophylactic anticoagulation to reduce the occurrence of this complication in a vulnerable population.
That said, two clinical approaches can be proposed for an optimal alliance between AI and radiologists: first, AI can serve as a second reader to catch those PEs missed by radiologists while the second strategy is that the radiologists review the red alarms detected by the AI tools to detect additional PEs, at the expanse of missing FNs of the AI system. Nevertheless, both options might pose a serious issue of time-consuming given the high rate of FPs reported in numerous trials such as our paper. Therefore, a minimization of FPs reported by the AI algorithms is a must to increase the efficiency but also, reduce the risk of burnout among physicians. These triage models can be extremely helpful in reducing the time to diagnose and treat PEs among patients undergoing CT scans during weekends but also exams analyzed by teleradiology, a flourishing medical field mainly during the COVID period, therefore optimizing the quality of care [
32]. With the absence of prospective studies in a clinical setting, there will be a need to assess the performance of these AI tools with a direct comparison of two clinical settings, the performance of radiologists with and without the aid of AI. In the near future, radiologists will have the privilege of time with emphasis on complex cases while AI will take care of filtering normal CT scans.
In conclusion, this paper demonstrated the efficacy of CINA-iPE , an AI tool approved for detecting iPEs on chest CT scans in oncology patients with a high sensitivity and specificity thus reducing the time for reporting positive findings. In the era of AI euphoria, the conception of an AI-radiologist alliance is a must for optimal outcomes in the healthcare universe.
Our results demonstrated the good performance of this AI-based algorithm, opening the way for its use to help radiologists by highlighting the positive exams for PE in the worklist, thereby accelerating the diagnosis and communication workflow.
Samy Ammari1 2 and Astrid Orfali Camez1 , Angela Ayobi3, Sarah Quenet3, Amir zemmouri1, Elmehdi MNIAI1, Yasmina Chaibi3, Angelo Franciosini3, Louis Clavel3, Francois Bidault Nahalie 1 2 ,Lassau1 2, Corinne balleyguier1 2, Tarek Assi 4*
Author Contributions
Conceptualization, S.A ,A.O , T.A , S.Q, N.L, A.Z , A.A, A.Z, E.M, Y.C , A.F, L.C , F.B ,N.L , C.B S.M D.L., B.S-H, M.N-C., A.M., and K.S.G.; methodology, S.A ,A.O , T.A , S.Q, , A.Z , A.A validation, T.A , S.Q, , A.Z.; formal analysis, A.A, A.Z, E.M, Y.C , A.F, L.C , F.B ,N.L , C.B.; investigation, A.A, A.Z, E.M, Y.C , A.F, L.C , F.B ,N.L , C.B; resources, A.A, A.Z, E.M, Y.C , A.F, L.C , F.B ,N.L , C.B data curation, A.A, A.Z, E.M, Y.C , A.F, L.C , F.B ,N.L , C.B; writing—original draft preparation, .A ,A.O , T.A , S.Q, N.L, A.Z , A.A; writing—review and editing .A ,A.O , T.A , S.Q, N.L, A.Z , A.A,; visualization, .A ,A.O , T.A , S.Q, N.L, A.Z , A.A,.; supervision, .A ,A.O , T.A , S.Q, N.L, A.Z , A.A,.; project administration, .SA ,A.O , T.A , S.Q, ; funding acquisition, SA ,A.O , T.A , S.Q, All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki and was approved by the Bioethics Committee of the Medical University of Silesia in Katowice (protocol code PCN/CBN/0022/KB1/68/21 on 15 May 2021 and PCN/CBN/0052/KB1/68/1/21/22 on 29 March 2022). Informed Consent Statement: Informed consent was obtained from all subjects involved in the study.
Conflicts of Interest
Angela Ayobi, Sarah Quenet, Yasmina Chaibi, Angelo Franciosini, Louis Clavel : employees at Avicenna.AI.
References
- Hasenberg, U.; Paul, T.; Feuersenger, A.; Goyen, M.; Kröger, K. Cancer patients and characteristics of pulmonary embolism. European journal of radiology. 2009, 69, 478–482. [Google Scholar] [CrossRef] [PubMed]
- Kearon, C. Natural History of Venous Thromboembolism. Circulation [Internet]. 17 juin 2003 [cité 21 mars 2024];107(23_suppl_1). Disponible sur: https://www.ahajournals.org/doi/10.1161/01.CIR.0000078464.82671.78.
- Gimbel, I.A.; Mulder, F.I.; Bosch, F.T.M.; Freund, J.E.; Guman, N.; van Es, N.; et al. Pulmonary embolism at autopsy in cancer patients. Journal of Thrombosis and Haemostasis. 2021, 19, 1228–1235. [Google Scholar] [CrossRef] [PubMed]
- Prandoni, P. The Long-Term Clinical Course of Acute Deep Venous Thrombosis. Ann Intern Med. 1996, 125, 1. [Google Scholar] [CrossRef] [PubMed]
- Carson, J.L.; Kelley, M.A.; Duff, A.; Weg, J.G.; Fulkerson, W.J.; Palevsky, H.I.; et al. The Clinical Course of Pulmonary Embolism. N Engl J Med. 1992, 326, 1240–1245. [Google Scholar] [CrossRef] [PubMed]
- Mulder, F.I.; Horvàth-Puhó, E.; van Es, N.; Van Laarhoven, H.W.M.; Pedersen, L.; Moik, F.; et al. Venous thromboembolism in cancer patients: A population-based cohort study. Blood, The Journal of the American Society of Hematology. 2021, 137, 1959–1969. [Google Scholar] [CrossRef] [PubMed]
- van Es, N.; Bleker, S.M.; Di Nisio, M. Cancer-associated unsuspected pulmonary embolism. Thrombosis Research. 2014, 133, S172–S178. [Google Scholar] [CrossRef]
- Schoepf, U.J.; Costello, P. CT Angiography for Diagnosis of Pulmonary Embolism: State of the Art. Radiology. févr 2004, 230, 329–337. [Google Scholar] [CrossRef]
- Albrecht, M.H.; Bickford, M.W.; Nance, J.W.; Zhang, L.; De Cecco, C.N.; Wichmann, J.L.; et al. State-of-the-Art Pulmonary CT Angiography for Acute Pulmonary Embolism. American Journal of Roentgenology 2017, 208, 495–504. [Google Scholar] [CrossRef]
- Van Es, N.; Bleker, S.M.; Di Nisio, M. Cancer-associated unsuspected pulmonary embolism. Thrombosis research. 2014, 133, S172–S178. [Google Scholar] [CrossRef]
- Smith, S.B.; Geske, J.B.; Maguire, J.M.; Zane, N.A.; Carter, R.E.; Morgenthaler, T.I. Early anticoagulation is associated with reduced mortality for acute pulmonary embolism. Chest. 2010, 137, 1382–1390. [Google Scholar] [CrossRef]
- Barragán-Montero, A.; Javaid, U.; Valdés, G.; Nguyen, D.; Desbordes, P.; Macq, B.; et al. Artificial intelligence and machine learning for medical imaging: A technology review. Physica Medica. 2021, 83, 242–256. [Google Scholar] [CrossRef] [PubMed]
- Patel, S.; Kazerooni, E.A.; Cascade, P.N. Pulmonary Embolism: Optimization of Small Pulmonary Artery Visualization at Multi–Detector Row CT. Radiology. 2003, 227, 455–460. [Google Scholar] [CrossRef] [PubMed]
- Hosny, A.; Parmar, C.; Quackenbush, J.; Schwartz, L.H.; Aerts, H.J. Artificial intelligence in radiology. Nature Reviews Cancer. 2018, 18, 500–510. [Google Scholar] [CrossRef] [PubMed]
- Cacciamani, G.E.; Sanford, D.I.; Chu, T.N.; Kaneko, M.; De Castro Abreu, A.L.; Duddalwar, V.; et al. Is Artificial Intelligence Replacing Our Radiology Stars? Not Yet! European Urology Open Science. 2023, 48, 14–16. [Google Scholar] [CrossRef]
- Batra, K.; Xi, Y.; Al-Hreish, K.M.; Kay, F.U.; Browning, T.; Baker, C.; et al. Detection of Incidental Pulmonary Embolism on Conventional Contrast-Enhanced Chest CT: Comparison of an Artificial Intelligence Algorithm and Clinical Reports. American Journal of Roentgenology. 2022, 219, 895–902. [Google Scholar] [CrossRef]
- Topff, L.; Ranschaert, E.R.; Bartels-Rutten, A.; Negoita, A.; Menezes, R.; Beets-Tan, R.G.H.; et al. Artificial Intelligence Tool for Detection and Worklist Prioritization Reduces Time to Diagnosis of Incidental Pulmonary Embolism at CT. Radiology: Cardiothoracic Imaging. 2023, 5, e220163. [Google Scholar] [CrossRef]
- Langius-Wiffen, E.; de Jong, P.A.; Mohamed Hoesein, F.A.; Dekker, L.; van den Hoven, A.F.; Nijholt, I.M.; et al. Added value of an artificial intelligence algorithm in reducing the number of missed incidental acute pulmonary embolism in routine portal venous phase chest CT. Eur Radiol. 2024, 34, 367–373. [Google Scholar] [CrossRef]
- Wildman-Tobriner, B.; Ngo, L.; Mammarappallil, J.G.; Konkel, B.; Johnson, J.M.; Bashir, M.R. Missed Incidental Pulmonary Embolism: Harnessing Artificial Intelligence to Assess Prevalence and Improve Quality Improvement Opportunities. Journal of the American College of Radiology. 2021, 18, 992–999. [Google Scholar] [CrossRef]
- Wiklund, P.; Medson, K.; Elf, J. Incidental pulmonary embolism in patients with cancer: Prevalence, underdiagnosis and evaluation of an AI algorithm for automatic detection of pulmonary embolism. Eur Radiol. 2023, 33, 1185–1193. [Google Scholar] [CrossRef]
- Cheikh, A.B.; Gorincour, G.; Nivet, H.; May, J.; Seux, M.; Calame, P.; et al. How artificial intelligence improves radiological interpretation in suspected pulmonary embolism. Eur Radiol. 2022, 32, 5831–5842. [Google Scholar] [CrossRef]
- O’Neill, T.J.; Xi, Y.; Stehel, E.; Browning, T.; Ng, Y.S.; Baker, C.; et al. Active Reprioritization of the Reading Worklist Using Artificial Intelligence Has a Beneficial Effect on the Turnaround Time for Interpretation of Head CT with Intracranial Hemorrhage. Radiology: Artificial Intelligence. 2021, 3, e200024. [Google Scholar] [CrossRef] [PubMed]
- Soffer, S.; Klang, E.; Shimon, O.; Barash, Y.; Cahan, N.; Greenspana, H.; et al. Deep learning for pulmonary embolism detection on computed tomography pulmonary angiogram: A systematic review and meta-analysis. Sci Rep. 2021, 11, 15814. [Google Scholar] [CrossRef] [PubMed]
- Meyer, H.J.; Wienke, A.; Surov, A. Incidental pulmonary embolism in oncologic patients-a systematic review and meta-analysis. Support Care Cancer. 2021, 29, 1293–1302. [Google Scholar] [CrossRef]
- Eng, J.; Krishnan, J.A.; Segal, J.B.; Bolger, D.T.; Tamariz, L.J.; Streiff, M.B.; et al. Accuracy of CT in the Diagnosis of Pulmonary Embolism: A Systematic Literature Review. American Journal of Roentgenology. 2004, 183, 1819–1827. [Google Scholar] [CrossRef] [PubMed]
- Kligerman, S.J.; Mitchell, J.W.; Sechrist, J.W.; Meeks, A.K.; Galvin, J.R.; White, C.S. Radiologist performance in the detection of pulmonary embolism: Features that favor correct interpretation and risk factors for errors. Journal of thoracic imaging. 2018, 33, 350–357. [Google Scholar] [CrossRef] [PubMed]
- Healthcare AI | Aidoc Always-on AI [Internet]. [cité 1 avr 2024]. Aidoc’s 6th FDA clearance for AI Solution. Disponible sur: https://www.aidoc.com/about/news/fda-incidental-pulmonary-embolism/.
- Menon, B.K.; Puetz, V.; Kochar, P.; Demchuk, A.M. ASPECTS and other neuroimaging scores in the triage and prediction of outcome in acute stroke patients. Neuroimaging Clinics. 2011, 21, 407–423. [Google Scholar] [CrossRef]
- Avicenna.AI - Avicenna.AI Secures FDA Clearance For Two Healthcare AI Solutions [Internet]. 2024 [cité 31 mars 2024]. Disponible sur: https://avicenna.ai/fda-clearances-aspects-and-ipe/.
- Baumgartner, C.; Klok, F.A.; Carrier, M.; Limacher, A.; Moor, J.; Righini, M.; et al. Clinical Surveillance vs. Anticoagulation For low-risk patiEnts with isolated SubSegmental Pulmonary Embolism: Protocol for a multicentre randomised placebo-controlled non-inferiority trial (SAFE-SSPE). BMJ open. 2020, 10, e040151. [Google Scholar] [CrossRef]
- Vallée, A.; Quint, R.; Brun, A.L.; Mellot, F.; Grenier, P.A. A deep learning-based algorithm improves radiology residents’ diagnoses of acute pulmonary embolism on CT pulmonary angiograms. European Journal of Radiology. 2024, 171, 111324. [Google Scholar] [CrossRef]
- Hanna, T.N.; Steenburg, S.D.; Rosenkrantz, A.B.; Pyatt, R.S.; Duszak, R.; Friedberg, E.B. Emerging Challenges and Opportunities in the Evolution of Teleradiology. American Journal of Roentgenology. 2020, 215, 1411–1416. [Google Scholar] [CrossRef]
- Clopper, C.J.; Pearson, E.S. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 1934, 26, 404–413. [Google Scholar] [CrossRef]
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).