2. Diagnostic Errors in Obstetrics and Selected Research Methods
Diagnostic errors in medicine are the failure to establish an accurate and timely explanation of a patient’s health problem or to communicate that explanation to the patient [
6]. When dangerous obstetric conditions are under- or misdiagnosed these errors represent a significant patient safety threat; it is impossible provide the correct treatment without the correct diagnosis. Research in general medicine estimates the incidence of diagnostic errors is 10 to 15%, with studies of hospital autopsies reporting major error rates of 8 to 24% [
7,
8,
9]. This translates to over 12 million Americans estimated to be affected by diagnostic errors each year [
10]. Among malpractice claims, diagnostic errors are the most common, most costly, and most dangerous medical mistakes [
11]. With regards to the impact of diagnostic errors on patients, the first nationwide estimate of morbidity and mortality due to diagnostic errors was published in 2024 and estimates 795,000 annual serious harms or deaths related to diagnostic errors [
12]. In addition, diagnostic errors are costly, estimated to total more than
$100 billion per year [
13].
While the traditional notion of medical diagnosis conjures an internal process in a single doctor’s mind, today’s means of arriving at a diagnosis is a multistep, interdisciplinary process and collaboration between providers, patients, and the health environment and system. Medical diagnosis is a complex, inexact science with an inherent and variable measure of uncertainty. Thus, diagnostic errors often refer not to a provider’s lack of medical knowledge or error in judgment, but rather to failures and opportunities in health systems [
14].
Frameworks such as the Safer Dx model highlight the systems approach to diagnostic errors. The Safer Dx model utilizes the Donabedian structure-process outcome model in which the structure is the complex adaptive sociotechnical system in which the diagnosis takes place [
15]. It defines the sociotechnical dimensions of diagnostic error including team members, clinical context, workflow and communications, technology, organizational features, and the regulatory environment. It also clearly defines the components of the diagnostic process such as the patient-provider encounter, the performance and interpretation of diagnostic tests, follow up of diagnostic information, referrals, and patient-related factors. These factors lead to the intermediate outcome of safe diagnoses and the ultimate goal of improved patient outcomes.
Specific to obstetrics, prior studies suggest provider-level factors contribute to a large proportion of harm during and after pregnancy [
5]. Thus, a focus on the contribution of diagnostic errors in obstetrics has the potential to significantly reduce morbidity and mortality. Following the structure, process, and outcomes of diagnostic errors yields many opportunities for investigation; however, research on diagnostic errors in our field of obstetrics is extremely limited. To date, there are no nationwide estimates of diagnostic errors and harms in the field of obstetrics and existing smaller studies are limited and largely international. There are many approaches to estimate the rate and impact of diagnostic errors. Selected methods for obtaining diagnostic error rates and harm burdens are detailed here, with examples of each (
Table 1).
- 1)
Clinicopathologic autopsy research
First, retrospective clinicopathologic studies using autopsy data can provide information on diagnostic errors for obstetric mortality. This approach can capitalize on objective pathologic evidence to corroborate or dispel the working cause of death and therefore provide concrete information on diagnostic errors.
Published literature on obstetric diagnostic errors from clinicopathologic studies is scarce. To provide an example of this method: a retrospective study of clinicopathologic discrepancies in obstetric mortality in Mozambique studied 91 obstetric-related deaths and complete diagnostic autopsies were used as the gold standard to determine the cause of death. These were compared to the clinical diagnosis and discrepancies were classified as major and minor diagnostic errors. False negative diagnoses were discrepancies for which the autopsy diagnosis was in the assessed diagnostic category, but the clinical diagnosis was in another diagnostic category. False positive diagnoses were classified as discrepancies for which the clinical diagnosis was in the diagnostic category but not the autopsy diagnosis. The authors found 38% had a clinicopathologic discrepancy. By category, the sensitivity for eclampsia was 100% but the positive predictive value only 33%. The sensitivity for peripartum infections was 17% and the positive predictive value 50%. For obstetric hemorrhage, the sensitivity was 62% with a positive predictive value of 95% [
16].
The use of autopsy data to identify obstetric diagnostic errors is limited by the flaws inherent in the autopsy process and by the fact that only cases referred to and accepted by a medical examiner will be included. There may be bias in which cases are referred. In addition, this method provides diagnostic error rates for pregnancy-related mortality but does not include morbidity.
- 2)
Retrospective chart review of clinical criteria
Another approach to discerning obstetric diagnostic errors is to screen patient charts for clinical evidence of morbidity that does not have an associated documented diagnosis. For example, a retrospective review of 5517 vaginal deliveries at a single hospital in France screened for a ten-point fall in hematocrit from predelivery, corresponding to a one-liter blood loss, in charts that did not have a diagnosis of postpartum hemorrhage. These patients were compared to those who were diagnosed with hemorrhage. Among screened patients, 90, or 1.63%, met criteria for a ten-point hematocrit drop, suggesting the majority of hemorrhage leading to significant anemia was recognized. Missed diagnosis was related to the use of visual or estimated blood loss instead of quantitative blood loss [
17].
The process of chart review for clinical evidence of an obstetric diagnosis creates an objective framework to discern diagnostic errors. Taking postpartum hemorrhage as an example, in addition to laboratory evidence of anemia it can be utilized for quantitative blood loss. It can also be applied to other measures such as sepsis and hypertension criteria. One benefit of this process is that once implemented at an institution or across a health system, it is easily replicable. Moving from the idea of identification of diagnostic errors to prevention, chart review for missed diagnoses in the electronic medical record holds great potential to be converted from a retrospective review process to real-time clinical decision support and, even further, to prospective predictive modeling.
- 3)
Obstetric simulation and standardized patients
Another approach is to use simulation to study the misdiagnosis of obstetric conditions. For example, a cross-sectional study in birthing facilities in the Philippines crafted identical simulated case for 103 obstetrics providers for cephalopelvic disproportion, postpartum hemorrhage, and preeclampsia. The overall rate of misdiagnosis was 29.8%. The most common scenarios included, cephalopelvic disproportion (in 25% of cases), postpartum hemorrhage (in 33% of cases), and preeclampsia (in 31% of cases) [
18].
Simulation-based approaches to diagnostic errors have several benefits. They have the immediate advantage of allowing providers to receive real-time feedback on their diagnostic process. They can identify which obstetric conditions have the highest rates of diagnostic errors among providers undergoing simulation to prioritize ongoing education efforts and performance improvement strategies. Knowledge gaps and systems issues brought to the surface via simulation can generate diagnostic tools such as clinical algorithms, checklists, and electronic health record clinical decision support. Through these approaches, lessons learned from simulation can be broadly disseminated to multidisciplinary teams, even if not present for the simulation, and built into provider workflows.
Simulations for diagnostic errors do not typically yield information on real patient cases and rates of diagnostic errors. However, a unique aspect of this study was linkage to real patient data at the providers’ health facilities. Medical charts of patients with obstetric complications at each participating provider’s facility were reviewed for diagnostic errors and patient interviews were conducted for information on health outcomes and costs. The authors found an association between provider misdiagnosis in simulation and the presence of patient complications (OR 2.97, 95% CI 1.41, 3.32), worse outcomes, delays in referrals, and increased out-of-pocket patient costs. This novel method of linking simulation data to health system data and qualitative patient interviews may offer more robust information on which to build quality, patient safety and performance improvement initiatives.
- 4)
Pregnancy-related or -associated morbidity and mortality case reviews
Pregnancy-related or -associated cases of severe morbidity and mortality are typically reviewed at an institutional or health system level via incident reporting systems and mortality at the state or city level by maternal mortality review committees. The goal of these reviews is to seek and analyze comprehensive data from the case, determine whether the harm was associated with pregnancy, and develop recommendations to prevent similar harm in the future.
As a state-specific example, in a New York State Department of Public Health publication of the 117 pregnancy-related deaths (within one year of delivery) in 2018, 78% were deemed preventable. By category of obstetric cause of death, 100% of deaths due to hemorrhage, cardiomyopathy, and mental health were determined to be preventable. In examining the factors contributing to obstetric deaths in New York State, provider-level aspects including medical knowledge, clinical assessment, skill, quality of care, care coordination and continuity, and delay in care were contributory in 36.8% of cases. In 21.9%, facility level issues played a role, including clinical skill, quality of care, care coordination and continuity, policies and procedures, and equipment and technology. In 19.4% of cases, system level factors were at play, such as knowledge, clinical skill, quality of care, and structural racism [
5].
Maternal mortality review committees and institutional level severe obstetric morbidity reviews and root cause analyses offer thorough individualized case reviews that can identify diagnostic errors and offer potential solutions to prevent future instances. They can also situate diagnostic errors within the complex provider and system errors that contribute to pregnancy-related harm. Case reviews, however, rely on deaths or adverse outcomes to be referred for incident review or to a state or local review committee. Thus, an underlying and comprehensive referral infrastructure must be in place. While institution-level adverse event reporting and review captures pregnancy-related morbidity, maternal mortality review committees focus on deaths and thus do not capture non-fatal diagnostic errors.
- 5)
Malpractice and administrative claims databases
A fifth opportunity to identify diagnostic error rates and harms is the use of malpractice claims databases. For example, a study by Gupta et al. queried the US National Practitioner Database for malpractice claims and utilized multivariable logistic regression to identify patient and provider factors associated with inpatient diagnosis-related paid claims [
19]. Approximately 22% of all claims were diagnosis-related, associated with
$5.7 billion in payments over the study period. The also reported patient and provider characteristics associated with diagnosis-related claims, such as patient age and physician level of training.
To our knowledge there have not been similar studies in obstetrics. The major disadvantage of this method is the lack of detail regarding the clinical case and surrounding health systems processes that contributed to the diagnostic error and harm. However, the use of malpractice databases to identify diagnostic errors in obstetrics presents an opportunity for high-level understanding of diagnostic error rates by obstetric condition, patient and provider factors associated with diagnostic errors, and estimates of the financial impact of these harms.
3. Challenges in Ascertaining Diagnostic Error and Harm Rates
In any of these research methods, ascertaining diagnostic error rates and associated harms can be challenging. Diagnostic errors are tricky: they are rarely recognized in real-time. Instead, the majority surface in retrospective review by other clinicians, or adverse event reporting. In this sense, they can remain elusive. Measuring and studying diagnostic errors in obstetrics can also be challenging due to the unique and varied landscape of care. Obstetrics comprises the ambulatory, emergency, and inpatient settings, with labor and delivery representing a distinctive type, but not the only type, of inpatient care. Each of these environments may lend to a different way to monitor and study diagnostic errors. The transitions between these care environments present their own opportunities for diagnostic errors. Moreover, pregnancy represents a time-limited episode of care, and many patients transition after pregnancy to other providers and care models, back to their primary care or specialty care, general emergency department use, or no care at all. As pregnancy-related harm attempts to capture morbidity and mortality within one year of pregnancy, the study of diagnostic errors in obstetrics must include the care transitions beyond the fourth trimester, or the critical period of the twelve weeks following birth.
In addition, diagnostic errors, particularly in obstetrics, are not well defined. Without standardized definitions, quality improvement initiatives and research studies are difficult to aggregate and compare. It is helpful to return to the National Academy of Sciences definition of diagnostic errors as the failure to establish an accurate and timely explanation of the patient’s health problem or to communicate that explanation to the patient [
6]. This is a thorough but complex definition that captures accuracy of diagnosis, the time to diagnosis, and the communication of the diagnosis to the patient. Metrics for obstetric diagnostic errors should consider all three of these facets.
4. Promoting Diagnostic Excellence in Obstetrics
To reduce diagnostic errors and strive for diagnostic excellence in obstetrics, we must answer two questions: How often are we getting the obstetric diagnosis right? And, when we get it wrong, why? To this end, we suggest several goals to pursue diagnostic excellence in the obstetric community (
Figure 1).
First, we must define and capture diagnostic errors. Metrics for diagnostic errors should target both mortality and morbidity. One category of metrics is to compare diagnoses, for example autopsy diagnosis compared to death certificate diagnosis, inpatient obstetric admission versus discharge diagnoses, inpatient readmission diagnoses compared to discharge diagnoses, and admission diagnoses within close proximity to an outpatient visit compared to outpatient visit diagnoses. A second category of communication of the diagnosis to patients and patient understanding of their diagnosis relies upon patient feedback regarding their care and care team communication. While some patient metrics may be captured in existing patient experience surveys, the creation of a standardized patient and family feedback form for significant cases of morbidity and mortality flagged via incident review may assist in understanding this important component of diagnostic error.
Second, bias in diagnostic errors must be targeted. Bias identification and prevention training should be standard in all obstetric practices. Specific to case review of errors, screening for socioeconomic determinants and intentionally reviewing whether bias played a role in the error should be formalized in all retrospective case reviews for both institutional quality and safety committees and state maternal mortality review boards.
Third, a diagnostic error lens should be built into health system quality and safety frameworks. Obstetric simulation should incorporate arriving at a diagnosis and clear feedback when cases are misdiagnosed. Implementation of obstetric safety bundles such as those by the Alliance for Innovation on Maternal Health and the Safe Motherhood Initiative provide structured processes for management of obstetric care, but are often crafted around a diagnosis, meaning they are clinically applied after arriving at a diagnosis for a patient, for example severe hypertension or postpartum hemorrhage. Adding diagnostic care pathways to safety bundles to flag patients early in a workup that should ultimately fall into a safety bundle process represents an important step of successful safety bundle implementation. The Safe Motherhood Initiative Maternal Early Warning System’s overarching algorithm triggered by abnormal vital signs combined with an individual patient’s clinical presentation, risk factors, and additional diagnostic tests provides a likely diagnosis by safety bundle (sepsis, hemorrhage, hypertension, or venous thromboembolism) and represents a step toward diagnostic pathways for obstetric emergencies [
20]. Special attention should be paid to the frequent transitions of care in obstetrics, as highlighted in the Alliance for Innovation on Maternal Health’s Postpartum Discharge Transition Bundle. This bundle outlines readiness, recognition and prevention, response, reporting and systems learning, and respectful, equitable and supportive care for the critical immediate postpartum period from hospital discharge to outpatient obstetrical care [
21]. Diagnostic errors during postpartum visits and readmissions can cause significant harm and deserve particular attention.
Fourth, health technology should be leveraged to flag and discover missed diagnostic errors. Electronic health records can be used to help screen for diagnostic errors via the implementation of electronic triggers, or pre-programmed tools to identify signals of a likely error or adverse event. Electronic triggers have been used successfully to identify other errors such as wrong-patient orders and medication errors [
22]. Triggers can also be applied to screen for diagnostic errors. In obstetrics, potential electronic triggers of diagnostic errors could include a drop in hematocrit not already associated with a diagnosis of postpartum hemorrhage, such as in the study example above. As with event reporting systems, to best strive for diagnostic excellence, triggers flagging potential diagnostic errors should be built into electronic health record and patient monitoring workflows and dashboards from the outset.
The promise of health technology to improve obstetric diagnosis lies in the potential for prospective healthcare team alerts. In obstetrics, electronic triggers for early warning signs such as for hypertension have shown significant benefit in promoting early evaluation to avoid significant adverse outcomes. Artificial intelligence (AI) continues to disrupt the healthcare landscape and utilizing AI in the diagnostic errors space provides promising ways to predict errors and reduce harm. By bringing together information for providers from electronic fetal monitoring signals to vital signs to laboratory results, AI could greatly improve diagnostic accuracy in real time.
Lastly, there is a dearth of literature on diagnostic errors in obstetrics. Sharing innovative approaches to detect, study, and prevent obstetric errors via publication in journals will be essential to moving the needle in diagnostic excellence. Maternal mortality review committees should also be encouraged to publish their findings not only in reports but in the literature and convenings of these committees at national meetings should directly address strategies for identification of diagnostic errors. Journals should recognize the importance of publishing studies that seek to promote diagnostic excellence in obstetrics.
In conclusion, despite valiant efforts across the obstetric community, we remain in an obstetric morbidity and mortality crisis. Behind the rates and cases of adverse obstetric outcomes are birthing people, newborns, and their families and support networks. We must continue to learn from their experiences. As we continue to iterate on processes to review cases of morbidity and mortality, provider-level factors have emerged as a significant contributor and thus an opportunity for improvement. Within provider-level factors and intersecting closely with systems issues lie obstetric diagnostic errors, underrecognized and under researched. The research methods and error reduction strategies outlined above have the potential to move our field towards diagnostic excellence and improved patient care and outcomes.