3.1. Limited Efficacy Testing
Descriptive statistics (
Table 1) from baseline showed that food pantry clients (n = 24) enrolled in the study were an average age of 35.9 (SD = 15.1) years old, and a majority of participants were female (66.7%), Hispanic-Latino (41.7%), had an annual income of less than
$25,000 (75%), and reported high school being their highest completed education (50%).
Results from the bivariate logistic regression and linear regression analyses that assessed the impact of participant attrition on primary study outcomes revealed a non-significant relationship between attrition and study group status (B = -0.267, SE = 0.21; p = 0.22), food pantry utilization (B = 0.11, SE = 0.21; p = 0.61), and food security scores (B = 1.33, SE = 1.05; p = 0.22). No significant differences were detected between participants with full data (n = 15) and participants with missing data (n = 9) concerning study group status, food pantry utilization, and food security scores. Similar bivariate regression analyses were not conducted for the primary study outcomes of SNAP registration and food security status, as all participants at baseline were food insecure and not enrolled in SNAP.
Effect size estimates and mean differences (
Table 2) using Cohen’s d for mean differences or Cohen’s h for proportion differences display the primary study outcomes of food pantry utilization, SNAP enrollment, and food security at one month (mid-intervention time point 2) and at two months (post-intervention time point 3).
At baseline, 33 percent of the intervention group (n = 12) and 44 percent of the control group (n = 12) had previously utilized a food pantry. Then, at one month, participants who reported no visits to the food pantry comprised 10 percent of the intervention group and 16.7 percent of the control group, participants who reported one visit to a food pantry comprised 30 percent of the intervention group and 16.7 percent of the control group, and participants who reported two visits to a food pantry comprised of 60 percent of the intervention group and 66.6 percent of the control group. It was determined that the intervention had a small effect on food pantry utilization from baseline to time point two (h = 0.21). At two months, participants who reported no visits to the food pantry comprised 22.2 percent of the intervention group and 14.7 percent of the control group, participants who reported one visit to a food pantry comprised 11.1 percent of the intervention group and 14.7 percent of the control group, and participants who reported two visits to a food pantry comprised of 66.7 percent of the intervention group and 70.6 percent of the control group. It was estimated that the intervention maintained a small effect on food pantry utilization from baseline to two months (h = 0.18).
Since no participants were registered for SNAP at baseline, effect size calculations to estimate the effect of the intervention on SNAP registration were only conducted for outcomes at time points 2 and 3. At one month, no intervention group participants were registered for SNAP, while 17 percent of the control group was registered for SNAP. A large intervention effect on SNAP registration at one month was estimated (Cohen’s h = 0.85), but the effect was in the opposite direction of what was intended, as SNAP registration was greater in the control group than the intervention group. The two months SNAP registration rate remained at zero for the intervention group and increased to 29 percent of the control group. A very large intervention effect on SNAP registration was estimated at two months (Cohen’s h = 1.14), which remained in the unintended direction of less intervention group participants registering for SNAP than control group participants.
Mean food security scores (
Figure 2) at baseline were 7.92 (SD = 2.43) for the intervention group (n = 12) and 8.42 (SD = 2.71) for the control group (n = 12). At one month, mean food security scores were 6.60 (SD = 3.17) for the intervention group (n = 10) and 7.67 (SD = 2.86) for the control group (n = 6). A medium intervention effect on food security scores was estimated at one month (Cohen’s d = 0.35). At two months, the mean food security score was 5.56 (SD = 3.97) for the intervention group (n = 9) and 8.00 (SD = 2.77) for the control group (n = 7). A large intervention effect on food security scores was estimated at two months (Cohen’s d = 0.71). Since all participants were classified as food insecure at baseline, bivariate analyses to determine between-group differences in food security status were only conducted for time points 2 and 3. At one month, 80 percent of the intervention group was food insecure, and 100 percent of the control group was food insecure. A very large intervention effect on food security status was estimated at one month (Cohen’s h = 0.93). At two months, 56 percent of the intervention group was food insecure, while 100 percent of the control group was food insecure. Similarly, a very large intervention effect on food security status was estimated again at two months (Cohen’s h = 1.45).
Independent samples t-scores and group differences in study outcome means or proportions were estimated with bivariate and multivariable regression models (
Table 3), which compared results for food pantry utilization, SNAP registration, and food security between the intervention group and control group at one month and two months. Food pantry utilization results suggested that no significant between-groups differences existed for food pantry utilization at one month (
t = 0,
p = 1; D = 0, SE = 0.39, 95% CI = -0.84, 0.84), and these findings stayed consistent after adjusting for covariates (
t = -0.32,
p = 0.76; D = 0.24, SE = 0.32, 95% CI = -0.49, 0.97). Further food pantry utilization findings indicated that no significant differences existed between study groups at two months (
t = -0.29,
p = 0.77; D = 0.13, SE = 0.43, 95% CI = -1.04, 0.78), which continued after adjusting for covariates (
t = -0.40,
p = 0.70; D = 0.11, SE = 0.54, 95% CI = -1.12, 1.35). Therefore, study aim 1 was not achieved.
SNAP registration outcomes implied that no significant differences were present between study groups at one month (t = -1.00, p = 0.36; D = -0.17, SE = 0.17, 95% CI = -0.56, 0.26). After adjusting for covariates, a significant difference in SNAP registration was detected between the intervention group and the control group (t = -2.63, p = 0.02; D = -0.34, SE = 0.15, 95% CI = -0.66, -0.10), which underscored how a greater proportion of control group participants registered for SNAP than intervention participants. Additional SNAP registration results suggested no significant between-groups differences in SNAP registration at two months (t = -1.56, p = 0.17; D = -0.29, SE = 0.18, 95% CI = -0.74, 0.17), and these non-significant findings persisted after adjusting for covariates (t = -2.12, p = 0.05; D = -0.41, SE = 0.22, 95% CI = -0.91, 0.09). Therefore, study aim 2 was not achieved.
Food security score findings indicated that no significant differences existed between study groups at one month (t = -0.67, p = 0.51; D = -1.07, SE = 1.58, 95% CI = -4.46, 2.33), and non-significant outcomes remained after adjusting for covariates (t = -0.40, p = 0.69; D = -1.50, SE = 0.96, 95% CI = -3.71, 0.70). Further food security score outcomes revealed no significant between-groups differences at two months (t = -1.45, p = 0.17; D = -2.44, SE = 1.69, 95% CI = -6.07, 1.18), which continued to be non-significant after adjusting for covariates (t = -0.81, p = 0.43; D = -1.21, SE = 1.32, 95% CI = -4.25, 1.84).
Results for food security status specified no significant differences between study groups at one month (t = -1.15, p = 0.27; D = -0.20, SE = 0.18, 95% CI = 0.57, -0.17), which stayed consistent after adjusting for covariates (t = -0.71, p = 0.48; D = -0.18, SE = 0.29, 95% CI = -0.48, 0.84). Further findings highlighted a significant difference in food security status between the intervention group and the control group at two months (t = -2.21, p = 0.04; D = -0.44, SE = 0.20, 95% CI = -0.85, -0.01). Non-significant between-groups differences in food security status at two months were then detected after adjusting for covariates (t = -1.28, p = 0.21; D = -0.19, SE = 0.26, 95% CI = -0.77, 0.40). Given these results for food security score and food security status, study aim 3 was achieved.
3.2. Intervention Acceptability
Of the initial 12 participants who were randomly assigned to the intervention group, nine participants (n = 9) completed the study and answered four questions about their perceived acceptability of the text messages used as informational nudges for the food insecurity intervention. The first question asked participants, “Did you read the text messages that you had received during the Food Assistance Information Study?” Eight participants indicated “Yes” to this question, while one participant responded with “No”. The second question asked, “Were the text messages that you had received during the Food Assistance Information Study easy to understand?” Similarly, eight participants reported “Yes” to this question, and the same one participant responded with “No”. The third question then asked, “Were the text messages that you had received during the Food Assistance Information Study helpful?” Again, eight participants indicated “Yes” to this question, and the same one participant responded with “No”. The fourth and final question that intervention group participants responded to involving their perceived acceptability of the intervention was an open-ended query that asked, “In a few words, what do you think of the text messages that you had received during the Food Assistance Information Study?” Four themes emerged as a result of participant responses. The qualitative themes derived from responses to the open-ended question were the following: 1) Unread, 2) Friendly, 3) Helpful, and 4) Informative.
The Unread theme was established from a single response by Participant 4. The response by Participant 4 stated, “I did not read any texts regarding the food study. I didn’t have time. Sorry.” Likewise, the Friendly theme was informed by a single response by Participant 3. The response by Participant 3 stated, “UX (user experience) friendly.” The Helpful theme was produced by responses from the three following participants: Participant 6, Participant 8, and Participant 23. In reference to the perception of the intervention text messages, Participant 6 concisely stated, “Very helpful.” Participant 8 added by commenting, “It was very helpful to help me understand everything I need to know for for (sic) this program.” Participant 23 simply remarked, “Helpful.” The Informative theme was constructed from responses provided by the four following participants: Participant 12, Participant 13, Participant 15, and Participant 17. Regarding the perception of the intervention text messages, Participant 12 stated, “I think they were very informative.” Participant 13 mentioned, "Similar responses were provided by participants 15 and 17, as Participant 15 remarked, “It is very informative,” while Participant 17 commented, “Very informative.” The most frequent theme that occurred throughout the qualitative data collection process was the Informative theme (n = 4), which was closely followed by the Helpful them (n = 3). The Unread (n = 1) and Friendly (n =1) themes were established as outlier themes with no other comparable qualitative data to group them with.