Introduction
Maternity is a normal process that causes several anatomical and physiological changes during the prenatal, intrapartum, and postpartum periods [
1,
2]. Every period would be a positive experience in terms of assumptions, confirming that mothers and newborns attain their maximum potential for health and welfare [
3,
4]. However, it may contain unexpected complications that expose the women and their fetuses to dangers and related morbidities and mortalities [
5]. These complications are manifest as obstetric danger signs (ODS) [
6,
7,
8].
Basic ODS are distinguished by women and categorized into three categories based on the time of occurrence. Vaginal bleeding, blurring of vision, high-grade fever, severe headaches, high blood pressure, and swelling of the hands and face are common ODS during pregnancy. The basic ODS during labor and childbirth are severe vaginal bleeding, convulsions, retained placenta > 30 minutes, and prolonged labor > 12 hours. The danger signs during the postpartum period include severe vaginal bleeding, high-grade fever, high blood pressure, severe headaches, and foul-smelling vaginal discharge [
6,
7,
8].
According to the World Health Organization (WHO) 2022 report, direct obstetric complications are the leading cause of maternal death, with bleeding being the first cause globally and accounting for nearly 28% of all deaths [
1,
2]. Studies also reported that hemorrhaging and eclampsia are the main causes of maternal death in Africa [
9,
10]. Nevertheless, many of these complications are preventable if the women are aware of them and are identified early, adequately treated, and managed [
2]. However, most women have poor knowledge of ODS, particularly in developing countries [
1].
The fundamental cause of maternal mortality in many low-income countries during prenatal, intrapartum, and postpartum periods is described in terms of the three critical delays model. These include delays in identifying life-threatening ODS and deciding to seek health care, delaying arrival at the health facility, and delaying receiving timely, sufficient, and effective care at the health facility [
11]. Due to poor knowledge of ODS, women postpone seeking obstetric treatment, contributing to high maternal morbidity and mortality in developing countries [
12,
13]. Studies from Ethiopia also reported that women had poor knowledge of ODS, contributing to high maternal mortality in the country and very high mortality in rural settings [
14,
15,
16].
During pregnancy, pregnant women and their families must prepare to welcome a newborn and potentially overcome any unpredicted obstetric complications. This practice is known as the birth preparedness and complication readiness (BPCR) plan and includes the following components: finding and communicating with a skilled birth attendant (SBA); identifying a close proper health facility (HF); saving money and material resources; preparing for transportation to a proper HF; and identifying and fixing compatible blood group donors [
6,
17]. The BPCR plan is a method to encourage the timely utilization of skilled care, particularly during childbirth, according to the notion that preparing for delivery decreases delays in accessing this care [
18]. In developing countries, the proportion of women preparing for birth and its obstetric complications is low (35%) [
19]. Only 32% of pregnant women in Ethiopia had a birth preparedness and complications readiness plan [
20]. The figure is much inferior in southern Ethiopia (18.3%) [
18].
The Ethiopian government has designed different strategies and initiatives to increase mothers' knowledge of ODS and BPCR plans, which is very important to promote women's health and improve their survival [
21,
22]. Among these, focused antenatal care (ANC) aims to provide deep counseling to all pregnant women attending ANC clinics, improve early detection of ODS, increase BPCR plans, and decrease the delay in seeking care [
23]. The national reproductive strategy of Ethiopia aims to empower women, families, and communities to identify pregnancy-related ODS and create a conducive environment to support safe motherhood and decrease maternal mortality [
21]. Further, Ethiopia's growth and transformation plan (GTP) comprises the training and deployment of health extension workers (HEWs) and health care providers (HCPs), particularly midwives, in rural areas to provide community-based maternal and child health services, whereas restructured community engagement using the Women Development Army (WDA) and a pregnant women forum, is vital to teach about ODS and the BPCR plan [
22].
Regardless of the Ethiopian government's strategies and initiatives, mothers' knowledge of ODS and the BPCR practice remains low at the country level and very low in rural settings [
14,
15,
18,
20]. Hence, health education is one of the approaches to increasing mother's knowledge of ODS and the BPCR practice. It is a method focused on education and communication to develop the desired behavior change [
24,
25]. However, the effect of a health education intervention on women's knowledge regarding ODS and the BPCR practice has not been comprehensively studied, and the evidence is weak to design effective and efficient strategies. Studies conducted in Sokoto State, Nigeria [
26], Korogwe district of rural Tanzania [
27], Mundri East County, South Sudan [
28], and Lagos State, Nigeria [
29] showed positive effects of HEI. However, the strength of the evidence these studies delivered is weak due to epidemiological and statistical limitations. For example, one of the studies used a purposive sampling method, lacked randomization, and had inadequate power, as evidenced by a small sample size (only 70 women) [
30]. Another study utilized a convenient sampling method with a small sample size (only 120 participants) and subsequent low power [
31]. Besides, these studies were quasi-experimental and lacked one or more true experimental study elements, such as random allocation of subjects to study groups, which frequently led to confounding and made it difficult to establish causality. It also has lower internal validity because other variables may account for the results, and it is not easy to know if all confounding variables have been included [
32]
Furthermore, there is a scarcity of cluster-randomized controlled trial (cRCT) studies evaluating the effect of community-based HEIs on ODS knowledge and BPCR practice in developing countries, including Ethiopia. Using a cRCT permits the research to provide strong evidence of whether or not an HEI has the intended causal effect on outcomes. Therefore, we aimed to assess the effect of health education on the knowledge of mothers regarding ODS and BPCR practice in southern Ethiopia. The research question to be answered by the present trial is, in pregnant women in the Sidama region of southern Ethiopia, how does a community-based health education intervention facilitated by women’s groups compare to the routine health education in improving knowledge of obstetric danger signs and increasing the practice of birth preparedness and complication readiness?
Methods
Study area
This study was conducted in the Northern Zone of Ethiopia's Sidama Region. Sidama Region was established on June 18, 2020. It is the country's second-smallest regional state by geographical area, after Harari, and the fifth-most populous [
33]. It is situated in southern Ethiopia and is divided into four zones, namely the Southern, Northern, Central, and Eastern zones, as well as one city administration [
34]. The northern zone is 273 kilometers south of Addis Ababa. It is divided into eight districts and two town administrations. The zone contains 162
kebeles (Ethiopia's bottom administrative units). According to the Sidama Region Health Bureau, the zone has a population of 1.29 million people. Women of reproductive age (WRA) account for 23.3% of the population. The zone has 144 health posts, 36 health centers, one general hospital, and four primary hospitals. The zone's potential health service coverage by public HFs is 70% [
35].
Study design and population
A community-based, parallel-group, two-arm cRCT was implemented from January 10 to August 1, 2023, among pregnant women in the Northern Zone of Sidama Region, Ethiopia. In this study,
kebeles, which are subsets of districts, were considered clusters. We included all pregnant women whose gestational age was less than or equal to 12 weeks and who lived in the zone for at least six months. Pregnant mothers who planned to change residence during the implementation of the intervention had not voluntarily provided consent or had severe illnesses were excluded from this study. Severe maternal illness in the context of this study includes severe chronic diseases, mental illness, and severe hyperperemsis gravidarum that need strict hospital follow-up. We identified 1,126 pregnancies using the existing women's development team (WDT) and HEW structures. They surveyed all the eligible households to check for the presence of pregnant women in the household. Pregnant women were identified using a two-stage screening procedure. First, women were asked about the symptoms and signs of pregnancy. If women reported symptoms and signs of pregnancy, they were subjected to the second screening process using a urine human chorionic gonadotropin (HCG) test. A urine test was performed on women who had missed their menstrual cyclic period for six weeks or longer. Women were recruited for the study if the urine HCG test results were positive. This study was designed to detect and enroll pregnant women before 12 weeks of pregnancy via home-to-home visits. WDTs and HEWs visits confirmed the women's pregnancy, screened for eligibility, and obtained written informed consent before randomization. The recruitment period lasted from November 1st to December 31st, 2022. We reported this study based on the CONSORT 2010 statement: extension to cluster randomized trials guideline, and the filled-in checklist is provided as
supporting information (S1 file).
Sample size calculation
The minimum required sample size was calculated using OpenEpi version 3.01 based on the following considerations. Due to the lack of a previous cRCT on the same topic, assumptions on the proportion of women with knowledge of ODS in the control and intervention arms were taken from a previous quasi-experimental study [
30]. The proportion before the intervention was taken as the proportion in the control arm, and the proportion after the intervention was taken as the proportion in the intervention arm. Accordingly, P1 = 45.7% (proportion of women's knowledge regarding ODS during pregnancy) in the control group, and P2 = 62.9% (proportion of women's knowledge regarding ODS during pregnancy in the intervention arm) [
30]. A confidence level of 95% and a power of 80% were also considered. Accordingly, the estimated effective sample size for individual-based randomization was 286 for both groups.
We used the cluster randomization method to assign study participants into the intervention and control arms due to the nature of the intervention which is more applicable at the group level. This design decreases the intervention's spillover effect and provides logistical simplicity. However, it requires taking into account the effect of clustering in sample size calculation by calculating a variance inflation factor (VIF) that helps to increase the statistical power of the study [
36,
37]. The minimum required number of clusters was computed by multiplying both groups' effective sample size and interclass correlation coefficient (ICC) factors [
38]. We received the typical value of the ICC factor of 0.05 from the range of values (0.01 to 0.05) based on the recommendations [
38,
39,
40]. Consequently, the minimum needed cluster number was 286*0.05 = 3.29 for both groups. Nevertheless, to maintain the cluster's sufficiency and adequate power [
36,
37], 24 clusters were included in this study. To account for the effect of the cluster, the effective sample size was multiplied by a variance inflation factor of 1.55. The VIF was calculated assuming an equal cluster size of 12 study subjects from 24 clusters. We used an ICC value of 0.05 (VIF = 1+ [(n-1) ICC]), where 'n' is the average cluster size [
38,
39,
40]. Thus, the final estimated sample size was 444 (222 in the intervention arm and 222 in the control arm).
We also calculated the minimum sample size needed to evaluate the effect of HEI on BPCR practice. In this case, P1 = 3.0% (proportion of women who practice BPCR in the control group) and P2 = 15.5% (proportion of women who practice BPCR in the intervention group) [
41]. The level of confidence was taken to be 95% and power 80%. Based on these considerations, the final estimated sample size was 342 for both groups (171 for the intervention group and 171 for the control group). However, this study was part of a larger project, and the sample size calculated for another study, designed to evaluate the effect of the intervention on maternal health service utilization (MHSU), was 1,126 (i.e., more prominent). Hence, the sample size of 1,126 obtained for the other study was utilized as well, as it would suffice for both studies.
Randomization
Randomization was done after securing consent and enrolling all study participants.
Stratified by place of residence, kebeles were allocated by simple random assignment to either the HEI or control group. A cluster in our study was the
kebeles (lowest administrative units in Ethiopia) of each district, which offered logistical simplicity and reduced the intervention spillover into the control arm. The study consisted of 24
kebeles from four randomly selected districts. These
kebeles were stratified into two strata based on the place of residence: rural and urban
kebeles. Stratification based on location reduces stratum variation and helps to balance the baseline covariates between the two arms [
36,
37]. Also, it helps to balance the rural/urban disparity of maternal knowledge of ODS and BPCR practice. Similar clusters from each stratum were allocated to both groups to increase the resemblance between the two arms. Hence, three urban
kebeles from the four districts were allocated to each group using an SPSS random number generator (in total, six
kebeles). Similarly, nine rural
kebeles from the four districts were allocated to each arm (in total, 18
kebeles). Finally, we included 47 pregnant women from each cluster.
Study variables
We assessed the effect of a HEI on two different outcomes. This study is focused on mothers' knowledge regarding ODS and BPCR practices, while another paper is focused on three skilled MHSU-related variables: ANC, health facility delivery (HFD), and postnatal care (PNC) use. Each outcome variable has a binary outcome and was assessed using self-reported data from women. Maternal knowledge regarding ODS was measured using 30 questions during three phases, namely antepartum (9 questions), intrapartum (12 questions), and postpartum (9 questions). The correct answers were assigned a score of 1, while the incorrect answers were assigned a score of 0. The total knowledge scores range from 0 to 30. The study respondents who spontaneously mentioned at least 3 ODS during each phase were classified as having "good knowledge," and those who spontaneously mentioned two or fewer ODS were classified as having "poor knowledge" [
42]. Spontaneous knowledge is defined as the knowledge of study participants who can name or call an ODS without being read the name of that sign by data collectors. Merely true ODS spontaneously mentioned by study participants were recorded during the interview [
43]. BPCR practice was measured using a questionnaire having five components as to whether or not the woman planned for her index pregnancy, such as identifying a closer proper HF for childbirth; finding and communicating an SBA; saving money; preparing material resources for childbirth and preparing for other associated costs; preparing or arranging transportation to a proper HF in case of childbirth and obstetric emergency; and identifying and fixing compatible blood group givers in case of blood requirements. If a woman prearranged at least two components out of 5, she was considered as having "well prepared" and otherwise considered "poorly prepared" [
44,
45]. The intervention or exposure variable was health education. The intervention group received routine plus pre-recorded audio-based HEI augmented by posters in a small community meeting twice a month for six months, while the comparator group received the routine health education package until delivery as per the Ethiopian guideline [
46] (see below for a more detailed description of the intervention).
We categorized the covariates into individual and cluster-level covariates. The individual-level covariates were women's and their husband's age, educational status of the women and their spouses, occupational status of the women and their spouses, household wealth index, and exposure to mass media; obstetric characteristics like gravidity, parity, stillbirth, women's age at marriage, and pregnancy status. The cluster-level covariates were community-level women's literacy, community-level poverty, community-level social media use, and distance from the nearest HF.
Table 1 of Supplementary File 2 contains information on how the variables were measured for this study.
Blinding
Because of the nature of the intervention, neither the research team members nor the study participants could be blinded (open-label). However, the data collectors (outcome assessors) were masked or unaware of the subject's group allocation.
HEI procedure
WDT leaders who can read and write the Sidaamu Afoo language and are willing to do the intervention were recruited to deliver it. Following the recruitment, intensive training was given for three days on topics such as normal pregnancy and childbirth, ODS during pregnancy, delivery, and the postpartum period, the practice of BPCR; and maternal health service utilization (MHSU). The training also included intervention delivery strategies like properly handling pre-recorded audio material and posters, ethical considerations, and who to contact with specific concerns related to the study intervention. The HEI was facilitated by WDT leaders at a small community meeting place using pre-recorded audio-based messages twice per month. The principal investigator developed the health education messages, which the research team members reviewed. Also, it was reviewed by a health education expert from Hawassa University. Then, the final version of health education messages was developed after several revisions. Subsequently, a female midwife and media experts were provided training about the audio-recording of the HEI. The midwife, a bachelor's degree holder in midwifery, narrated the developed script several times until all messages and sounds conveyed the intended messages in the context of the local language and culture. Then, the final version of the pre-recorded audio-based health education lecture was recorded. The audio-recording was done by experts at a local media network studio (Sidama Media Network). Portable Bluetooth devices (Gepps's) were used to play the pre-recorded audio messages at every health education session.
The HEI was delivered for six months, twice a month; one session took one hour, and 12 sessions were held. One health education session consisted of key messages on normal pregnancy and childbirth, ODS during pregnancy, delivery, and the postpartum period, the practice of BPCR; and the benefits of MHSU. The other actions executed by WDT leaders were motivating mothers and their families to attend HEI sessions. One hour was allocated for each session; 20 minutes were allowed for the pre-recorded audio-based lecture, and the remaining 40 minutes were used for questions and answers (discussion).
After each session, some women were selected to perform a role play, a basic way to demonstrate important messages and share experiences. This was done to repeat the information, enabling them to internalize the key message. The women were also exposed to posters to strengthen the session message or cover the missed information during the audio lecture. Any questions, confusions, or misunderstandings during the session were recorded and reported to the midwife through HEWs if they could not explain adequately. HEWs residing in particular clusters were responsible for clarifying questions once per month. We recruited a midwife to provide a more detailed explanation if the issues raised were beyond the capacity of HEWs. The midwife, located outside the study area, was actively involved in clarifying the issues for HEWs and mothers via mobile phone during the next meeting at the end of the session for all women who attended the session. During the study period, a supervisor was assigned to each district to supervise the health education sessions monthly or more frequently if any potential problems were indicated for quality monitoring. Supervisors reported any concerns encountered by the principal investigator, like absences or disagreements between group members and WDT leaders. The principal investigator smoothly discussed and fixed the problems with group members, WDT leaders, HEWs, and.
The present intervention differs from the routine intervention in several ways [
47,
48,
49]. Among these, the community-based nature of the present intervention includes all pregnant women in
Kebeles organized into small women's groups, each containing 15 pregnant women. The WDT leaders led 15 pregnant women and facilitated the intervention. A total of 38 groups of pregnant women were formed. Thus, the intervention included pregnant women from hard-to-reach areas in the
kebele (decentralized in principle). The routine intervention is health post-based and provides health education for those pregnant women who attend health post and does not consider the pregnant women at home and in hard-to-reach areas. Second, our HEI was delivered twice a month, while the routine intervention was only once. The hypothesis is that frequent teaching will lead to increased knowledge and a birth preparedness plan. Third, our HEI is simple, straightforward, detailed in content, and supported by pre-recorded audio teaching material compared to the routine intervention (only lecture method). This audio-device-assisted health education is expected to provide standard or uniform information for all clusters to create a similar level of understanding. Fourth, this intervention detects pregnant women (before 12 weeks of pregnancy) via home-to-home visits and enrolls them. The routine intervention delivers health education to pregnant women regardless of gestational age (more likely at greater than 16 weeks). Thus, our method will likely increase the probability of women going through the continuum of care.
Data collection procedures
We used a pre-tested and structured questionnaire to collect data. It was adopted from earlier research of a similar nature [
42,
44,
45]. The questionnaire was initially developed in English and translated into the
Sidaamu Afoo language (primarily spoken in the study area). The questionnaire was translated back to English to ensure its consistency and originality. Two translators, English experts, and fluent
Sidaamu Afoo speakers carried out the forward and backward translations. The translated questionnaire was reviewed by the principal investigator (PI) and a third individual who was likewise fluent in both languages. Then, based on the issues identified during the evaluation, any inaccuracy or inconsistency between the two versions was addressed.
The PI trained the data collectors and supervisors for two days before data collection on the significance of the study, data collection processes, aims, methodologies, and ethical considerations. Before data collection, the tool was pre-tested on 5% of the sample in the Dale district of the Sidama region and revised prior to actual data collection. The data were collected after seven weeks of delivery (end of the postnatal period). The health professionals with bachelor's degrees who were blinded about the intervention status collected the data through a face-to-face interviewer-administered questionnaire at the women's homes utilizing the Open Data Kit (ODK) smartphone application (see
S3 file). At the end of interventions, women's compliance with HEI sessions was evaluated based on their attendance sheets and the monthly reports of the WDT facilitators.
To minimize the risk of bias, maximum efforts were exerted to maximize response and follow-up rates, data collectors and supervisors were intensively trained, outcomes assessors were masked to the intervention assignment, and randomization was applied. To decrease the loss of follow-up, study participants were reminded by WDT facilitators two days before the HEI session date. The randomization was done by an autonomous, blinded statistician using an SPSS random number generator. We collected data on all clusters from August 28-September 22, 2023. Daily, data was archived and uploaded to the Kobo Toolbox server. Every day, the data was checked for completeness and consistency. Data was exported from ODK to Stata version 17 and SPSS version 26 for additional processing and analysis. Before the significant analyses, the exported data was thoroughly cleaned, coded, and categorized.
Data analysis technique
All required data preparations, such as recoding, computations, and categorizations, were done prior to doing the primary analysis. We reported absolute frequencies and percentages for categorical variables as summary measures. The mean with standard deviation (SD) was reported as a descriptive measure for numerical variables after the distribution was checked for normality. The wealth index was derived using principal component analysis (PCA) as a combined indicator of life standards based on 44 questions relating to ownership of carefully chosen household assets and basic amenities, such as ownership of a house, building materials used, the number of rooms in a house, the size of agricultural land, the presence of herd or farm animals and livestock, types of fuel used for cooking, and ownership of improved sanitary and water facilities [
50,
51].
Table 2 of Supplementary File 2 describes this study's wealth index calculation process.
We used intention-to-treat analysis (ITA), which means we analyzed women included in the trial at the beginning and had the outcomes measured. We randomly allocated the intervention at the cluster level but evaluated the outcome at the individual level. A chi-square test was used to assess the effect of HEI on mothers' knowledge regarding ODS and BPCR practice in an unadjusted analysis.
A modified Poisson regression with robust standard error was used to calculate the risk ratios with 95% confidence intervals (CIs) for the effect of intervention on outcomes. It is better to analyze data with binary outcomes than logistic regression when the prevalence of outcomes of interest is greater than 20% [
52,
53,
54] because the risk ratio is easier to understand and express to non-epidemiologists than the odds ratio [
53]. Besides, the odds ratio can overestimate the risk ratio, and for the two measures, adjusting for confounding is not equal [
54]. We first performed a mixed effect-multilevel logistic regression with a random intercept model to determine whether a multi-level analysis was necessary. This model provides information on ICC, which is used to decide whether or not a multi-level model is necessary [
55,
56]. The multi-level analysis model must be considered if the random intercept variance is significant or the ICC value exceeds 5%. We created a multi-level model because the hierarchical nature of our data reduces the possibility of using the ordinary regression model with understated standard errors [
57]. A multi-level model offers reliable standard error estimate [
58].
Four models were evaluated: Model 1 was the empty model, Model 2 included the intervention variable and other individual-level covariates, Model 3 contained only community-level covariates and Model 4 contained the intervention variable and individual and community-level covariates. The random effect model was evaluated using the ICC value [
59]. The ICC value was used to determine the proportion of variability in ODS knowledge and BPCR practice due to the clustering variable. The Akaike's information criterion (AIC), Bayesian information criterion (BIC), and log-likelihood with likelihood ratio test were used to determine which model best suited the data. The best-fitting model can be indicated by the lowest value of these criteria or a significant likelihood ratio test [
60].
A multivariable regression model included the intervention variable, covariates with p-values < 0.25 on bi-variable analysis, and other covariates known to have practical significance with relevant support from the medical literature [
61]. Effect modification was evaluated by entering interaction terms into the multivariable analysis model one at a time. Multicollinearity among the independent variables was also evaluated using a multiple linear regression model. We declared that the effect of multicollinearity would be less likely when the variance inflation factor was less than 5 for all variables [
62].
Statistical significance was set at a p-value of < 0.05 for this analysis. This statistical significance level was adjusted to account for type I error inflation, which can result from the effect of multiple comparisons or testing problems in a single study. We adjusted it using the Bonferroni correction method. The adjusted significance level was computed by dividing the preset significance level by the number of statistical tests conducted (outcome variables). In our case, the adjusted level of significance was 0.05/5 = 0.01. Thus, a statistically significant association was declared when the p-value was less than 0.01 [
63,
64]. ARRs with 99% CIs were utilized to assess whether a statistically significant association existed and its strength. A statistically significant association between the exposures and outcome variables was validated when the 99% CIs of the ARRs did not contain 1.
Ethics statement
The ethical approval of this study was obtained from the institutional review board (IRB) at the College of Medicine and Health Sciences of Hawassa University with reference number IRB/076/15. A support letter was obtained from the School of Public Health of Hawassa University, Sidama Region Health Bureau, district health offices, and kebele administrators.
Two levels of consent were obtained before conducting the actual study. First, community leaders approved on behalf of the community before randomization. Second, written informed consent was received from all study participants who met inclusion criteria before enrollment. Before signing informed written consent, study participants were informed about the purpose of the study, data collection techniques, voluntary participation, privacy, potential benefits, and dangers. All data collection methods and intervention techniques were carried out with confidentiality. During the data collection and storage, the confidentiality of the data was assured. After obtaining ethical approval, we registered the trial protocol at ClinicalTrials.gov with registration number NCT05865873. There was no risk or harm in participating in this study, except for 2 hours spent attending the HEI per month. There may be a slight discomfort associated with sharing some personal information. However, we did not wish this to happen, and the participants were granted the full right to refuse to answer any of the questions if they felt uncomfortable.
Discussion
We evaluated the effect of community-based health education intervention facilitated by women's groups (women's development team) on mothers' knowledge regarding ODS and BPCR practice in the Sidama region of southern Ethiopia. Severe vaginal bleeding was the most common ODS mentioned by women during pregnancy, childbirth, and postpartum periods in both study arms. Saving money and materials was the most frequently mentioned BPCR practice in both study groups. The HEI significantly improved women's knowledge of ODS and BPCR practices.
The finding that severe vaginal bleeding was reported to be the most commonly mentioned ODS in both study arms during pregnancy, childbirth, and the postpartum period is similar to other findings from Ethiopia [
43,
65,
66] and elsewhere [
19,
67]. This might be because facility-based ANC counseling by HCPs often focuses on the commonest ODS like severe bleeding, reduced or absent fetal movement, and mal-presentation, which might increase the mother's recall of severe vaginal bleeding signs due to frequent information obtained from HCPs [
68]. The other reason might be that the community-based pregnant women forum also mainly focuses on a few common ODS during their meetings, and HEWs allow the women to discuss the commonly occurring ODS in their local setting [
46]. Even if our HEI provided balanced information about all danger signs because all are equally important in our study, the most common one was severe vaginal bleeding, which might be an eco-effect from facility-based ANC counseling by HCPs and the community-based pregnant women forum.
Saving money and materials was the most frequently mentioned BPCR practice in both study groups. Similar findings were reported from earlier studies in the North Shewa zone [
69], Northwest Ethiopia [
70], and rural Uganda [
19]. This might be the reason that most of the time, the preparation of money and materials such as towels, cups for newborns, butter, and porridge flour is a common custom in rural societies, which also became commonest in our study even though we provided equal emphasis to all components during HEI due to the eco-effect of this custom.
Community-based HEI increased the likelihood of women's knowledge regarding ODS. Consistent results were reported from the studies done in Sokoto State, Nigeria [
71], rural Egypt [
72], Lagos State, Nigeria [
73], Zagazig University Hospitals [
74], Nicaragua [
75], and Cairo University Hospitals [
76]. The reason could be that most earlier studies revealed that advanced levels of education were linked to enhanced cognitive skills, improved information processing abilities, and better values, which help to increase knowledge [
77,
78,
79].
The current finding has a significant advantage because it considers the effects of community-based HEI as opposed to a variety of intervention packages provided by those previously conducted studies [
80,
81,
82,
83,
84]. The evidence shows the effectiveness of HEI in increasing mothers' knowledge of ODS in this study. Ideally, the women's ability to identify ODS should minimize the delay in receiving basic emergency obstetric care, leading to higher rates of MHSU. However, evidence is lacking to comprehensively assess the effects of knowledge learned from HEI on MHSU. Thus, our studies in another paper evaluated whether this knowledge of ODS obtained from HEI might be changed into an increase in MHSU in a study setting similar to those observed following intervention in Nigeria [
71], Egypt [
72], and Nicaragua [
75]. Thus, HEI could be a beneficial supplement to women's education in rural areas, increasing the utilization of MHS and preventing delays in emergency obstetric care. Promoting community-based health education in rural areas could be an effective way to increase MHSU in areas with low levels of education.
Community-based HEI increased the likelihood of women's BPCR practice. This result agreed with previous studies conducted in the Korogwe district of rural Tanzania [
27], Zaria Metropolis [
85], Mirzapur of Bangladesh [
84], and Mundri East County, South Sudan [
28]. This result was in agreement with the theory of reasoned action, which states that a person's intention determines whether they do a specific behavior, and it is a function of one's attitude and the effect of the social environment, which can be positive or negative for a particular behavior [
86,
87]. Thus, the women believe that practicing BPCR will lead to a whole-positive outcome (i.e., HFD use), and then they will hold a positive attitude toward executing that behavior (BPCR practice). Our result inferred that women's exposure to six months of community-based HEI has predisposed, modified, influenced, and changed their attitude toward BPCR practice. The other reason might be that well-prepared women have better knowledge of ODS and good communication with HCPs.
Consequently, they may have organized all the required prearrangements efficiently and effectively. Other researchers argued that women with good knowledge of ODS are more likely to be birth-prepared and have complications readiness practice [
45,
88,
89]. Moreover, the community-based HEI might reach a broader audience of women and their families who may not access regular prenatal care at the HF level, and the content of HEIs may also reach male listeners, who have an influential role in health care decision-making and this may thus lead to an increase in BPCR practice.
It is relevant to note that community-based HEI significantly affects women's knowledge of ODS and BPCR practice among women in our study setting. To ensure the sustainability of knowledge obtained during HEI sessions and maintain the BPCR practice of women accessing MHS, the regional health bureau and district office must reinforce women's health-seeking behaviors in the community of the study setting by using an already established structure. This reinforcement will help decrease maternal morbidity and mortality rates among women. The best way to deal with the first delays is to raise knowledge of ODS and BPCR practices with improved transportation networks. Meanwhile, their influence depends on the availability of high-quality health services at health facilities. Thus, focusing on both the demand and supply sides is crucial, even though they are only somewhat related (confidence in the quality of healthcare services increases demand) [
90].
cRCT design is appropriate for interventions delivered at the group level and utilized when individual-level randomization is unlikely or intervention is logically applicable to an entire group or naturally-existing clusters like schools, clinical practices, villages,
Kebeles, and enumeration areas (EAs) where the study subjects are school children, patients, villages, and inhabitants of
Kebeles [
91,
92]. When allocating identifiable groups, cRCT is regarded as the strongest design in public health research intervention [
93]. Based on the CONSORT 2010 statements, extension to cluster randomized trials, cRCTs are preferred when there is a risk of inadvertent spillover of intervention effects from one group to another (contamination) [
94].
However, cross-contamination can happen in our study when women from one cluster contact women from others. In rural communities (relatives, friends, and neighbors), there are several chances for social mixing or interaction via migration or travel between control and intervention clusters. Likewise, there may be direct involvement or participation of dwellers from control clusters in intervention undertakings or, more probably, an informal dialogue of thoughts arising from intervention undertakings. Due to this, the control cluster dwellers may gain or obtain some basic information from hearing health messages provided for the intervention clusters. The most common problem with this type of cross-contamination may be the dilution of the effect of intervention differences between two arms [
91,
92]. To prevent information cross-contamination between the two arms, we considered several measures. One such measure was the creation of a buffer zone, established by using at least four kebeles between the control and intervention clusters. This was achieved using a map of each district. We assigned a midwife to clarify any issues and concerns from outside the study area regarding the HEI procedure during the intervention period, and HEWs from a particular cluster made cRCT feasible and appropriate to prevent such contamination. We faced some challenges during the implementation of the intervention components. During the early stages of pregnancy, due to cultural taboos, women were unwilling to notify their pregnancy status and underwent an HCG test. However, this has had no significant influence on our research findings.
Randomization is frequently assumed to eliminate selection bias and create groups that are similar with regard to both measurable and unmeasurable confounders. This assumption, however, may not hold true in cluster trials, especially when there are a limited number of clusters available. When there are a limited number of clusters available, the risk of a baseline imbalance between the two arms can be significant [
36,
37]. In this case, accounting for the effect of baseline covariates using multivariable analysis and assessing the covariates for intervention effect modification is frequently suggested [
62,
95]. So, cognizant of this, we have accounted for the measured sources of confounders and assessed effect modification in our analysis. Most of the individual and community-level covariates were comparable between the intervention and control arms. However, some of them showed a significant imbalance between two arms like women's occupation, husband's occupation, mass media use, wealth index, women's pregnancy planned status, model family training, cluster-level distance to reach the nearest health facility, cluster-level mass media use, place of residence, and cluster-level mass media, and these variables were adjusted for in the multivariable analysis. We also evaluated if any of the aforementioned covariates modifies the effect of the intervention. It was found that there was no significant effect modification because none of the interaction terms were statistically significant. Thus, our findings were not affected by covariates effect modification and were solely due to intervention effect because we ruled out threat of internal validity [
62].
The ICC value revealed that membership in
kebeles explained 27.46% of the variability in ODS knowledge and 38.78% of the variability in BPCR practice. This result is an indication to consider multi-level analysis because the ICC value is greater than 5%, which we considered [
55,
56]. The units of analysis are treated as independent observations in traditional methods of ordinary regression. Regression coefficient standard errors will be underestimated if hierarchical structures are not recognized, which could result in an overestimation of statistical significance. Ignoring the clustering effect will most likely affect the coefficients of higher-level determinants or standard errors. The effects of group-level determinants are confounded with the effects of group dummies in a fixed-effects ordinary model, so it is impossible to distinguish between effects due to unobserved and observed group characteristics. The effects of both types of variables can be estimated in a multilevel (random effects) model [
57].
The gold standard of randomized trials is determined by two qualities, namely randomization and double blinding [
95]. We were unable to blind study participants and the research team due to the nature of the intervention, but we masked data collectors (outcome assessors). However, this wouldn’t preclude the occurrence of bias, which might lead to an underestimation or overestimation of the intervention effect. Also, information bias could influence our results because the intervention was open-label and the data were obtained from the women's self-report. Although difficult to quantify, women's knowledge of their exposure status (whether they received the intervention) likely influenced their self-reported responses to the knowledge and practice questions, thus leading to information bias. There is a potential for deliberately misreporting personally related variables like saving money and materials, preparing or arranging transportation to a proper HF in childbirth and obstetric emergencies, and identifying and fixing compatible blood group givers in case of blood requirements (social desirability bias). Therefore, the extent of these variables might have been overvalued, and as such, the association of the intervention with the magnitude of BPCR practice might have been overestimated. Regardless of these limitations, the results of this trial are sufficiently valid to develop appropriate intervention strategies and inform policy or program development.
Another limitation involves the retention of women's knowledge of ODS. In this study, women's knowledge was measured immediately after the intervention. Future studies should measure the long-term retention of knowledge of ODS gained through HEIs at later intervals and with repeat exposure and the impact on the use of obstetric care services and maternal morbidity and mortality. We only had one follow-up period (i.e., six months), and we cannot conclude if knowledge and practice were maintained over more extended periods, especially in the intervention group. Also, the residual effect of the HEI is not evaluated via a post-project study after a few years of project completion to ensure persistent effects of the intervention in the study setting.
Furthermore, we were unable to assess the outcomes of all enrolled women during the data collection period for different reasons, including 24 mothers changing residence, 17 having abortions, 13 having stillbirths, and 2 having maternal deaths. This resulted in missing outcome data, which goes against the randomization principle. Randomization guarantees the comparability of two arms, meaning that they are balanced for HEI and unknown and known confounders only in the manner in which they were initially randomized. The missing women in the two arms can no longer be considered balanced when some members of either or both groups are eliminated. This bias might lead to an underestimation or overestimation of the intervention effect. Also, this situation decreases the sample size and compromises the study's statistical power, making it unable to detect the true effect of the intervention or more susceptible to type II error (a high false negative result) [
95]. However, this is minimal in our case because the percentage of women lost to follow-up in both groups was similar (4.98% in the intervention group vs. 5.87% in the control group). Also, we lost only 4.8% of randomized women, which is in line with the culture of less than 5% loss to follow-up, considered a low risk of bias in cRCTs that does not significantly affect ITTA results [
95]. Moreover, we conducted a post-hoc analysis of power and obtained a statistical power of 100% for both ODS knowledge and BPCR practice, which is strong enough to detect intervention effects.
This trial has several strengths. From these, we registered the trial protocol at ClinicalTrials.gov with registration number NCT05865873 after obtaining ethical approval to avoid duplication. We used a cRCT study design comprising interventional and comparator groups to ascertain the temporal relationship, an essential epidemiological design to establish causality between intervention and outcome. Our sample size was large, which means it is adequate to identify the effects of HEI on outcomes. Hence, the findings are generalizable to all women of reproductive age in study settings and vital to developing applicable policy strategies for efficient and effective promotion of women's knowledge of ODS and BPCR practice in the Sidama region and other parts of the country with similar context. In fact, a study from Sudan [
28] and Tanzania [
27] also found consistent results, suggesting that this inference may also apply to developing countries at comparable stages of socioeconomic development, culture, and health service access.
In the current study, women had significantly higher knowledge of ODS and BPCR practice after six months of HEI. In another paper, we comprehensively investigated the link between increased knowledge of ODS and BPCR practice and changes in women's behaviors that promote MHSU.