1. Introduction
One of the targets of World Health Organization (WHO)’s Millennium Development Goal (MDG) is the reduction of the under-five years of age mortality by two thirds [
1]. Neonatal mortality represents a significant part of under-five mortality, reducing neonatal mortality rate is a key factor for reaching the MGD goal as a recent WHO report underlines that neonatal mortality rate, both globally and in Romania, did not show a similar significant decline as global child mortality from 2015 to 2019 [
2].
Neonatal mortality rate is an important indicator of health and economical status of a nation [
3]. Most neonatal deaths occur within the first 7 days of life. Delayed neonatal transportation and inefficient care during transfer are significant risk factors for neonatal mortality [
4,
5,
6]. Neonatal transportation of sick newborns is a major predictor of outcome. This fact is often neglected in low- and middle-income countries [
6,
7], as it is in Romania. In utero transportation of high-risk pregnancies according to regionalization of the maternal and neonatal care is the safest option for both maternal and neonatal outcomes [
8,
9,
10,
11]. Unfortunately, preterm delivery and delivery of sick neonates are not always easy to anticipate and will continue to occur at lower level institutions and even at home. Efforts to improve neonatal stabilization pre-transport, neonatal care during transport, and the neonatal transport system itself - organization, training, equipment - are challenging in many countries. Outborn neonates are facing significantly higher morbidity and mortality rates [
8,
11,
12].
Early recognition of sick neonates, optimal resuscitation if needed, prompt recognition and immediate competent interventions are needed to treat hypoglycaemia, seizures, and respiratory distress, prevention and treatment of hypothermia, hypoxia, hypotension, adequate monitoring before and during neonatal transport, and rapid transfer are extremely important for optimization of neonatal outcome [
5,
8,
9,
13,
14,
15,
16]. A regionalized, specialized neonatal transport system may reduce neonatal complications and improve survival rates [
11,
14,
17,
18]. For many years now, clinicians have tried to evaluate the outborn infants at admission in order to identify and promptly address all complications that may impact their prognosis as the severity of the disease was described as an important prediction factor for mortality in newborn infants [
19,
20,
21]. Severity scores were developed accordingly, including clinical and laboratory parameters, with different utilities and results in predicting mortality and morbidity rates [
22]. Also, not all these scores can be applied in resource-limited areas. However, an optimal score has not yet been identified, and it may still be challenging to do so. This is because the validation of these scores has not shown the same level of sensitivity and specificity across various neonatal populations, regions, countries, and units. Additionally, there are many organizational differences between national maternal and neonatal care, regionalization, and neonatal transport systems [
5,
23,
24,
25]. An ideal score – or predictive model for the severity of the disease - should be easy, applicable early after admission, needing a minimum of invasive procedures, reproducible, with a good ability to predict mortality and specific morbidities and to discriminate between neonates with different outcomes [
9,
21,
22,
25,
26,
27,
28]. Also, these predictions allow better planning and usage of resources of care, improvements of neonatal care before and during transport, cost analysis, evaluation of the care quality, comparisons between neonatal units, research, and parental counselling [
22,
25,
26,
27,
28,
29].
Organization of the Romanian neonatal transport system started in 2004, immediately after regionalization of the maternal and neonatal care in 2002, but still lacks, in many parts of the country, trained, specialized staff and special equipment. Considering the improved rates of survival at lower gestational ages, and insufficient number of beds in neonatal intensive care units (NICU), we face a continuous need for better critical neonatal care as survival is not anymore the ultimate goal of NICU care. Based on a prospective cohort, using the sick neonatal score (SNS) [
14,
30], and statistical models, the aim of our study was to identify a rapid and easy to perform score predictive for neonatal mortality in newborns submitted to our unit after delivery.
4. Discussion
One of the objectives of the World Health Organization's (WHO) Millennium Development Goal (MDG) is to reduce under-five mortality by two-thirds. This includes a significant reduction in neonatal mortality, as it accounts for a large portion of under-five mortality. Despite the fact that global child mortality rates decreased by almost 50% between 2000 and 2019, the neonatal mortality rates did not decline as much, according to a recent report. In Romania, the neonatal deaths declined from 884 (815-953) in 2015 to 690 (556-842) in 2019, the neonatal mortality rate reported in 2019 being 3.98 while the goal for 2030 is set at 3.17 [
2]. Neonatal mortality is a serious concern as it reflects the health and economic status of a nation [
3].
Regionalization of maternal and neonatal care and in-utero transportation of high-risk pregnancies to neonatal units with adequate resources and experience is the safest option for the best outcome both for mothers and newborns [
6,
7,
8,
9,
10,
11]. However, preterm births and delivery of sick infants are not always predictable and these situations will continue to occur worldwide at lower-level institutions and even at home. It is estimated that in 50% of the high-risk pregnancies in utero transportation is practically impossible [
1]. On the other hand, 40% of neonatal deaths occur in the first day of life [
30] and 75% in the first 7 days of life [
27,
31]. Delayed neonatal transfer, inadequate stabilization before transport, and deficient care during transportation are recognized as important risk factors for neonatal mortality and morbidity [
5,
6,
32]. Experts consider neonatal transport between medical institutions as part of neonatal intensive care and a major outcome predictor for sick neonates [
33]. Early recognition of sick neonates, optimal resuscitation if needed, prompt recognition and treatment of hypoglycaemia, seizures, and respiratory distress, prevention of hypothermia, hypoxia, hypotension, adequate monitoring before and during neonatal transport, rapid transfer are often challenging but extremely important for optimization of neonatal outcomes [
5,
8,
9,
13,
14,
15,
16,
30,
34]. Efforts to improve neonatal stabilization pretransport, neonatal care during transport, and the neonatal transport system itself - organization, training, equipment - are challenging in many countries but mandatory for decreasing neonatal morbidity and mortality rates as data in the literature shows that outborn neonates are facing significantly higher morbidity and mortality rates [
8,
11,
12]. Also, the regionalized, specialized neonatal transport system can reduce neonatal complications and improve survival rates [
11,
14,
17,
18]. However, neonatal transport of sick neonates is often neglected in low- and middle-income countries [
7], as it is in Romania.
Regionalization of maternal and neonatal care started in Romania in 2002 with a first normative act establishing the criteria differentiating between level I, II, and III (the highest) maternity hospitals [
35,
36]. In 2004, the Romanian Ministry of Health issued another order for experimental organization of three specialized neonatal transportation units [
36,
37]. Criteria for regionalization of maternal and neonatal care were changed through normative governmental normative acts in 2009, and 2011, and another change is pending final approval by the end of this year [
38]. For the future, five levels of maternity hospitals have been proposed. Neonatal transport has been neglected, so a new norm has been implemented stating that each level III unit may have a special neonatal ambulance. This comes with special financial support from the National Recovery and Resilience Plan. In 2011, the Romanian Association of Neonatology developed a national guideline for pre-transport stabilization and transport of newborns [
36]. According to current regulations, level I neonatal units must transfer all infants with a birth weight less than 2500g, even healthy ones and all sick infants, to higher levels. Level II units can care for infants with a birth weight greater than 1500g and/or a gestational age greater than 32 weeks, as long as they do not require mechanical ventilation or other invasive procedures. All other newborns must be transferred to level III units [
35,
39]. Our study group included 403 neonates after the exclusion of 15 infants submitted for severe congenital abnormalities, a rather large group of patients compared to most of the studies searching or evaluating a scoring system for the severity of the disease [
20,
26,
27,
28,
29,
30,
40,
41,
42,
43]. Out of the 403 infants in the study group, 217 were preterm infants (53.8%); 20 of the infants died, the fatality rate being 4.96%. Our maternity unit, part of an emergency county hospital, has been a level III regional maternal-neonatal unit since 2002, receiving between 70-90 outborn infants/year from one level II maternity hospital, 6 level I units, and after-delivery at home. The furthest inferior level I canter is situated at 161 km, a trip of around 2 and a half hour by car. As shown in
Figure 1, a significant drop in the number of submissions occurred after 2017, mostly due to an increased number of in-utero transfers. Increased awareness of high-risk pregnancies and its potential effects on maternal and neonatal outcomes leading to increased addressability of pregnant women directly to our center is another possible explanation. Covid-19 restrictions may have been added in 2020 and 2021.
Many authors [
22,
30,
43,
44,
45,
46] evaluated scoring systems separately for term and preterm infants, as gestational age and birth weight are recognized factors with significant impact on neonatal mortality. We had done the same, performing all the analysis on the entire group and in two subgroups based on gestational age – preterm and term infants. Some similarities and differences were noted starting the analysis of the baseline characteristics (
Table 2): boys were slightly overrepresented in all three groups (over 50%), the proportions of infants with Apgar score <3 at 1 minute were almost equal in the groups, and most of the infants from each category were transferred from level I units. A subsequent diagnosis of early-onset sepsis was more often seen in term infants as compared to preterm ones (40.3% vs. 17.1%), preterm infants were more rapidly transferred as compared to term infants (mean duration 17.3±65.0 vs. 27.0±32.4 hours), and death occurred more often in preterm infants (6.5% vs. 3.2%)(
Table 2). Based on the regionalization of maternal and neonatal care, it is common for preterm infants to be taken to higher-level neonatal units. Since many of these infants face challenges transitioning to life outside the womb, this outcome is not surprising. Additionally, the delayed appearance of sepsis symptoms in term infants may be another explanation (also for delayed referral of term infants) but we did not collect data on transfer reasons and why term infants were transferred later than preterm infants.
Starting the 1990s, clinicians have struggled to find an objective, rapid tool to evaluate the severity of the disease in newborns, especially in outborn infants, as the severity of the disease was described as an important factor for neonatal morbidity and mortality [
19,
20,
21,
22] and neonatal transfer after delivery was found as a risk factor for increased morbidity and mortality in outborn infants as compared to inborn infants [
12,
32,
47,
48,
49,
50,
51,
52]. Many severity system scorings were developed, some based on clinical knowledge, some based on strong statistical associations between different clinical and laboratory variables and outcomes. A number of problems have been cited related to almost all the scoring systems existing at this moment in relation to what is expected from an ideal severity score. A perfect severity score, or predictive model for the severity of a disease, should be easily defined and applicable soon after admission. It should require minimal invasive procedures, be reproducible, and have a solid ability to predict mortality and specific morbidities. Additionally, it should be able to distinguish between neonates with varying outcomes [
21,
22,
25,
26,
27,
28,
34]. All such scoring systems need accurate validation in reasonably large data sets, calibration, tests for their discrimination capacity (scores with AUC >0.8 are useful in practice), reproducibility, and capacity to avoid biases [
25]. Scores such as CRIB, CRIB II, SNAP, SNAP-PE, SNAP II, SNAPPE II, TISS and NTISS, NICHHD, NMPI, NBRS, TOPS, TRIPS, MINT, Prem or Berlin score, Sinkin score are complex scores, with different power to predict mortality, either comprising multiple parameters, either designed for a specific population (eg. preterm infants) or special situation [
3,
9,
11,
19,
20,
22,
25,
35,
36,
43,
44,
45,
46,
50,
51,
52,
53,
54,
55]. We had chosen the sick neonate score (SNS) score, a score initially developed by Hermansen in 1994 [
42] and modified by Rathod et al [
30] since this score was validated both in high-income countries and in a resource-limited countries [
30,
42] and, after exclusion of pH and partial oxygen pressure from Hermansen score, didn’t need any invasive procedure. Also, in many studies a SNS score ≤8 has been validated as a cut-off value for predicting mortality [
29,
30,
56]. We calculated the SNS score (
Table 2) using rectal temperature instead of axillary temperature since it is more accurate. The mean values of SNS score were comparable between study groups (10.0±2.6 in preterm infants, 11.8±2.2 in term infants, and 10.8±2.6 in the whole group). Significantly lower SNS scores were found when we compared the survivors and non-survivors in all study groups (comparison of median (IQR) values in
Table 4; all p<0.05) but the SNS cut-off value ≤8 was associated with death only in preterm infants and the entire study groups (
Table 5). We believe that the nonsignificant association of this cut-off value in term infants is due to the low number of term infants who died.
The next step was finding new variables easy to use for the SNS score in order to improve its ability to predict mortality in all neonatal populations. Lower gestational age and birth weight were repeatedly demonstrated as associated with an increased risk of death, therefore we used them for the development of a new scoring system, the same as other authors [
5,
26,
27,
28,
57]. Gender, early onset sepsis diagnosis, and asphyxia (defined as an Apgar score <3/1 minute) showed no association with mortality (p>0.05) in statistics (
Table 4 and
Table 5). A clinical observation during the years was that infants submitted rapidly after delivery have a better course, therefore we tried to statistically analyse the prediction power of time to admission upon the mortality rate and the statistical analysis confirmed: time to admission was significantly associated with mortality in preterm infants and in the whole group (
Table 4) and a duration of 6.5 hours between birth and admission into our unit had an AUC of 0.664, p 0.013, the sensitivity of 85% and specificity of 54% in predicting mortality (
Figure 2). Mori et al. found that neonatal transport duration over 90 minutes is associated with a two times higher risk of death [
58]. A new scoring model was designed (
Table 6) using the SNS score and new variables; gestational age, birth weight, and time to admission, and we named it MSNS-AT. Evaluation of MSNS-AT scores in our study groups was encouraging. MSNS-AT score ≤10 demonstrated a statistically significant association with risk of death in the subgroups and in the entire group, was found in 21 survivors (10.3%) vs. 14 non-survivors (100%) in the preterm infants (p<0.001); in 3 survivors (1.7%) vs 1 non-survivor (16.7%) in the term infants group (p = 0.003; OR 9.1 [95% CI 1.25-61.13]), and in 24 survivors (6.3%) and 15 non-survivors (75%) in all patients (p<0.001, OR 28.0 [95% CI 10.7-72.89]). The results are comparable with those using MSNS to predict mortality. Padar et al [
26] found that a cut-off value of 10 predicted mortality with a sensitivity of 88.24%, and sensibility of 92.5% in 248 neonates evaluated at birth and at 24 hours of life. A mean score of 9.11 was found in non-survivors as compared to 12.9 survivors in a group of 71 newborns of which 80% were term infants in a study published by Reddy et al [
27]. A bigger study performed by Mansoor et al [
57], including 585 neonates, both inborn and outborn infants, found a mean score of 8.2±2.96 in deceased newborns vs. 13.1±2.4 in survivors, while the cut-off value of 10 had 90% sensitivity and 88% specificity for predicting mortality. The same cut-off value predicted death with 85.9% sensitivity and 51.1% specificity in another recent study of 355 neonates but identified that better prediction of mortality can be done using a cut-off value of 8 [
28]. Adding time to admission to our score, we expected that the mean MSNS-AT would be higher compared to MSNS but we still found significant differences in the score between survivors and non-survivors in preterm infants and for the entire group; 14.0±2.9 vs. 7.2±2.0; p <0.001 and 15.3±3.0 vs. 9.5±4.1; p <0.001 respectively. Limited significance was found in term infants (16.8±2.4 vs. 14.8± 2.5; p = 0.050), probably because most term infants arrived significantly later at our unit.
Finally, MSNS-AT score was tested for accuracy in all the study groups, adjusting for gestational age, birth weight, Apgar score <3, and early onset sepsis rate, and in comparison with SNS score (
Table 7,
Figure 3 and
Figure 4) and we found that this new score has the better performance in predicting mortality vs. SNS score in the whole group, irrespective of gestational age (AUC 0.735 vs. 0.775) and performed even better in preterm infants (AUC 0.885 vs. 0.810). A lower accuracy was found in term infants (MSNS-AT AUC 0.765 vs. SNS AUC 0.809). Another analysis has shown that a cut-off value ≤7 accurately predicted death in 58.1% of the infants in the study group while only 1.4% of infants with values >16 have died.
Severity scores were developed accordingly, including clinical and laboratory parameters, with different utilities and results in predicting mortality and morbidity rates [
22]. Also, not all these scores can be applied in resource-limited areas. Still, an ideal score was not identified and this may be difficult even now since validation of various scores hasn’t demonstrated the same sensibility and specificity in different neonatal populations, from different regions, countries, and neonatal units, with so many organizational differences between national maternal and neonatal care regionalization and neonatal transport systems [
5,
23,
25]. Currently, no unique mathematical formula can completely capture the complex clinical neonatal process, regardless of the accuracy of the scoring system, according to some experts [
5].
But these predictions allow better planning and usage of resources of care, improvements of neonatal care before and during transport, cost analysis, evaluation of the care quality, comparisons between neonatal units, research, and even parental counselling [
8,
22,
25,
26,
27,
28,
29,
53]. Therefore, clinicians, like us, will continue searching for the ideal scoring system, ideal at least for the population they have to care. We made efforts to find the best – in terms of accuracy - and easiest-to-apply scoring system for our population, based on our experience that preterm infants have to be considered and analyzed separately from term infants.
We acknowledge some limitations of our study. We didn’t evaluate the individual components of the SNS score as this was not the goal of our study. Instead, we plan to do so in a future study in which we plan to compare SNS scores before transfer and at arrival in our unit in order to evaluate pretransport stabilization and the quality of care during neonatal transport. Also, probably a higher number of patients would give increased statistical power to some of our comparisons and associations. The study period was quite long – 7 years – and protocols for stabilization and transport have been changed during this period, influencing the neonatal status at arrival in some of the newborns included in the study. We didn’t perform the yearly comparative analysis of the severity scores.
Author Contributions
Conceptualization, M.L.O., I.C.M., R.G., and M.C; methodology, M.L.O., B.C., S.B.T, C.I. and A.G.B; software, D.A.T., I.A.R., S.B.T, and C.I.; formal analysis, M.L.O, A.G.B, R.G., and M.C.; investigation, B.C., D.A.T., I.A.R., and I.C.M; validation: B.C., D.A.T., I.A.R., S.B.T., C.I., I.C.M., A.G.B., M.C. and M.L.O.; resources, I.A.R.; data curation, M.L.O.; writing—original draft preparation, M.L.O., B.C., D.A.T., and I.A.R.; writing—review and editing, M.L.O., C.I., S.B.T., A.G.B, R.G.; supervision, M.O.L. All authors have read and agreed to the published version of the manuscript.