Preprint
Article

Validation of an Italian Questionnaire of Adherence to the Ketogenic Dietary Therapies: iKetoCheck

Submitted:

13 June 2023

Posted:

14 June 2023

You are already at the latest version

A peer-reviewed article of this preprint also exists.

Abstract
Ketogenic dietary therapies (KDTs) are an effective and safe non-pharmacological treatment for drug-resistant epilepsy, but adherence can be challenging for both patients and caregivers. In Europe, there are no adequate tools to measure it other than monitoring ketosis. This study aimed to adapt and validate the Brazilian adherence questionnaire, Keto-check, into the Italian version: iKetoCheck. Using the Delphi technique, 12 judges validated the contents through agreement rate and the Content Validity Index (CVI). The iKetocheck was self-completed electronically by drug-resistant epilepsy or GLUT1 deficiency patients within an interval of 15 days to measure its reproducibility. Test-retest reliability was evaluated using Pearson correlation and relative significance test. Exploratory and confirmatory factorial analyses were made using Factor software. The final tool, iKetoCheck, consists of 10 questions with 5-point Likert scale answers. It evaluates various aspects such as informing caregivers about the diet, organization of meals, measurement of ketosis, weighing food consumed, diet negligence, use of carbohydrate-free medications, attending follow-up visits, reading food labels, consulting an expert for dietary concerns, and cooking at home. The factorial analysis resulted in three factors: "attention," "organization," and "precision," with satisfactory results for indices in exploratory and confirmatory analyses. Although higher mean values of ketonemia measurement were observed in patients with a higher adherence score, these values were not statistically significant (p=0.284). In conclusion, iKetoCheck is a valid tool for evaluating KDTs' adherence in Italian drug-resistant epilepsy or GLUT1 deficiency patients. It can provide valuable information to improve patient management and optimize the effectiveness of KDTs.
Keywords: 
Subject: 
Medicine and Pharmacology  -   Dietetics and Nutrition

1. Introduction

Ketogenic dietary therapies (KDTs) are effective and safe non-pharmacological treatments for drug-resistant epilepsy in both pediatric and adult patients [1]. KDTs are also considered the gold standard therapy for type I glucose transporter deficiency syndrome (GLUT1 DS) [2]. According to international guidelines, KDTs should be continued for at least three months to determine their effectiveness [3] and can be continued for years if effective [4].
There are currently four different KDT protocols in use: the Classic Ketogenic Diet (CKD), Modified Atkins Diet (MAD), Medium Chain Triglyceride (MCT) diet, and Low Glycemic Index Therapy (LGIT). These hyperlipidic (65-90% of daily energy) and hypo-glucidic regimens induce a state of ketosis similar to the one that occurs after prolonged fasting. Medical nutritional monitoring is necessary to maintain their effectiveness over time and to reduce the risk of short- and long-term side effects [3].
Several hypotheses have been proposed to explain the mechanism of action of KDTs in controlling epilepsy, including molecular targets, mitochondria, neurotransmitter systems, and ketone bodies. However, no single theory has been identified [5].
CKD is the most commonly used treatment for GLUT1-DS and drug-resistant epilepsy, especially in infants, preschool children, and epileptic encephalopathies [3]. It is characterized by 80-90% of energy from fats, a normal intake of proteins (about 7-10% of energy, with a minimum of 1g/kg/day), and a low content of carbohydrates (3-7% of energy). This treatment is rigorously individualized, minimally calculated, and based on the energy needs of each individual. All foods are weighed on a scale. Of all the protocols available, CKD promotes the highest levels of ketosis [6], but is also the most restrictive and less palatable [7], which can lead to lower adherence to the dietary treatment.
The World Health Organization (WHO) defines adherence as the degree to which a person’s behavior matches health care practitioners’ recommendations regarding medication, dieting, or lifestyle changes [8]. Compliance, concordance and persistence are other terms generally used in the same context. However, according to some authors, they have different meanings. Jimmy and Jose (2011) referred to compliance as “the extent to which a patient’s behavior matches the prescriber’s advice and implies obedience to the physician’s authority” [9]. On the other hand, adherence is less paternalistic, since “patient and physician collaborate to improve the patient’s health” [9,10]. In agreement with this, the term concordance is introduced implying that the prescriber and the patient should come to an agreement about the regimen that the patient will take [11]. Persistence could be defined as “time from initiation of a chronic therapy to discontinuation of therapy” [12].
Long-term adherence to treatment with KDTs is often difficult for the patient and caregivers [13,14,15]. The results of a meta-analysis including 11 studies with KDTs in adults revealed combined compliance rates of 45%, 38%, and 56% for all types of KDTs, classical ketogenic diet and a modified Atkins KDT, respectively [16]. Failure is mainly attributed to dietary side effects, psychosocial factors, or the dietary restriction itself [16]. Non-adherence to treatment (KDT and anti-seizure medication) is the main cause of treatment failure in patients with epilepsy and represents one of the most concerns for clinicians [17,18]. Non-adherence is also associated with health consequences, cost of visits, access to the ED, lack of seizure control, reduction in quality of life, etc. [19,20,21]. It is essential to educate the patient to adherence [22]. Patients with chronic pathologies are at risk of non-adherence, however identifying patients with low adherence and the barriers to adherence appear fundamental for clinical outcome.
To date, adherence to KDTs has been evaluated both in literature and clinical practice only through ketosis measurement (in urinary or blood samples). Usually, clinicians ask parents and patients to share the food diary to check the calorie intake, the ketogenic ratio, and the nutritional composition of the diet. A ‘Keto-check’ questionnaire was recently developed and validated in Brazil [23], aiming to provide a tool to measure adherence to the KDT. There are several advantages of using the questionnaire: low-cost, easy, fast, well accepted by the patient, valid and with easily reproducible questions. This questionnaire is currently validated only in Portuguese Brazilian language, and its items do not completely adapt to the Italian clinical practice. Thus, a re-arrangement of the Keto-check is necessary to create a quality tool validated by experts on a large population, allowing for a more solid assessment of adherence to treatment. Moreover, this instrument would facilitate Italian clinicians in interpreting efficacy results and implementing an early intervention to adjust therapy. Therefore, the objective of this study was to adapt and validate the Brazilian tool Keto-check into the Italian version: iKetoCheck.

2. Materials and Methods

This is a prospective observational study approved by the Ethical Committee (IRCCS San Matteo: number 0014551/22) and registered on ClinicalTrials.gov (NCT number: NCT05377762).
The process of validation was conducted in several phases: (i) the original questionnaire (Keto-check) [13] was initially adapted by the authors and underwent a Delphi technique for validation; (ii) reproducibility was tested in a sample of Italian patients; (iii) reliability was confirmed by factorial analysis; (iv) authors proposed a graphical representation of factors involved in adherence based on the factorial analysis.

2.1. Adaptation of the Brazilian questionnaire

The questionnaire was initially translated from Portuguese into Italian by two registered dietitian specialists in KDTs, one being a native Portuguese speaker and the other a native Italian speaker. The translation was validated by a third-party Portuguese native speaker who subsequently arranged for the translation from Italian into Portuguese to verify the correctness of the previous translation.
The questionnaire consists of 10 questions relating to indicators about adherence to the ketogenic diet therapy, which include informing caregivers about the diet, organizing meals, measuring ketosis, weighing food consumed, diet negligence, using carbohydrate-free medications, attending follow-up visits, reading food labels, consulting an expert for dietary concerns, and cooking at home. This questionnaire can be addressed directly to the patients or to their caregivers, who will have to answer about the diet followed by the patient if the patient is a child, adolescent, or non-independent adult.
The interviewee should indicate the level of agreement with the statement on a 5-point Likert scale: (1) Strongly disagree, (2) Partly disagree, (3) Don’t know how to answer, (4) Partly agree, (5) Strongly agree. Each answer was subsequently assigned a score, and the sum of all the answers corresponded to the final score (minimum value 10, maximum 50). The higher the score, the better the adherence to the treatment.

2.2. Delphi technique

To validate the tool, the Delphi technique was used [24]. The tool was analyzed by a group of experts (members of the Italian Chapter of the International League against Epilepsy - LICE) acting as judges, composed of 12 professionals. Professionals were selected based on specific criteria and were invited to participate by email. They received a short text explaining the research and an informed consent form for participation. Next, the new KDT adherence verification tool was provided with questions regarding each statement used regarding relevance and ease of understanding. The answers were presented on a Likert scale with a score from 1 to 3: 1 = no; 2 = maybe; and 3 = yes. At the end of each question, a suggestion field was provided, so that the judges could give feedback on the questions and enrich the content.
For the validation of the content, the agreement rate and the Content Validity Index (CVI) were calculated to represent the consensus among judges, as it measures agreement on each aspect assessed. The agreement rate was calculated by dividing the number of positive responses by the total number of responses. The CVI was calculated following four steps: (i) based on the judges’ scores (1 to 3), the average score for each entry was calculated. (ii) On the basis of the average, the initial CVI was calculated for each item by dividing it by the maximum value that the question could receive for relevance or clarity. (iii) The error of each entry was calculated to avoid any bias by the judges. The following formula was used to calculate the error: Error = (1 ÷ number of judges) x number of judges. (iv) The final CVI of each element was calculated by subtracting the starting CVI from the error. The acceptable consensus rate in this study for each item analyzed was considered valid if it was greater than 90% or 0.9.
The validation of the content of the tool passed through two cycles, as necessary until the specialists reached the minimum value of the CVI for all questions. The answers obtained were organized in an Excel spreadsheet, with the numerical and subjective information compiled by the judges. After each cycle, the tool was reformulated based on the outcome of the discussion between the researchers. The modified instrument was sent again to all judges and discussed again until a consensus was reached.

2.3. Reproducibility

The questionnaire was completed electronically by patients via the Google Forms platform within a 15-day interval to measure its reproducibility. The test-retest reliability was evaluated using the Pearson correlation coefficient and relative significance test.

2.4. Study Population

2.4.1. Judge Inclusion Criteria

Judges were selected based on the inclusion criteria outlined above and recruited from at least three national KDT application centers. The questionnaire was presented to judges in electronic form via the Google Forms platform to reach those who do not work in the same center. The inclusion criteria were: (1) to be a physician, dietician/nutritionist with a specialist, master’s, or PhD degree; (2) work in the fields of assistance, management, or teaching and research in KD therapy, with over 5 years of training and professional experience.

2.4.2. Patient Inclusion Criteria

Patients were recruited voluntarily from the Center for Childhood and Adolescent Epileptology of the Mondino Foundation in Pavia and the Italian GLUT1 Family Association. At the time of enrollment, subjects were adequately informed about the project and the study objective. The privacy policy was provided, and informed consent was obtained from the participants. For patients under 18 years of age, the questionnaire and related informed consent were provided by their parents or legal guardians. The inclusion criteria were: (i) KDT (all protocols) longer than 3 months; (ii) all genders; (iii) route of administration of the diet totally or partially oral; (iv) diagnosis of drug-resistant epilepsy or GLUT1 deficiency; (v) informed consent of the patient and/or authorized caregiver/legal representative consent. Exclusion criteria included: (i) KDT duration less than 3 months; (ii) route of administration of the diet exclusively enteral or parenteral diet; (iii) illiteracy.

2.5. Statistical Analysis

For the calculation of the sample size, a minimum of 5 subjects per item is recommended for the validation phase [25]. Taking into account the “rule of thumb,” a minimum of 100 participants (10 per item) was established. Considering a drop-out rate of 5%, a minimum of 105 patients were invited. For the reproducibility analysis, a subgroup of 50 subjects was considered representative as a minimum number, as recommended in the literature.
Reliability was verified through internal consistency using Cronbach’s Alpha coefficient, which can be classified as follows: values greater than 0.8 are considered “almost perfect,” 0.61 to 0.8 is “substantial,” 0.41 to 0.6 is “moderate,” 0.21 to 0.4 is “reasonable,” and less than 0.21 is “small” consistency [26]. These tests were performed using SPSS version 25, and the significance level was set at 5%.
To ensure data quality, data were excluded from the reproducibility analysis if the difference between the compilations of iKetoCheck by the same patient was greater than two standard deviations.

2.6. Factorial Analysis

Factorial analysis was conducted using Factor software [27] for both exploratory and confirmatory analyses. Optimal implementation of parallel analysis (PA) [28] was used to determine the number of dimensions in the exploratory analysis. All data were initially tabulated in an Excel spreadsheet and then transferred to Factor software [28] for parallel exploratory factor analysis [29]. Factor is a user-friendly program that is free and complete for conducting exploratory factor analysis and semi-confirmatory analysis models. It has been continually updated with recent proposals for factor analysis since its development more than 10 years ago [27].

2.6.1. Exploratory Factor Analysis

Polychoric correlation was used to generate univariate descriptive results. This method is recommended when the univariate distributions of ordinal items are asymmetric or have excess kurtosis. Hot-deck multiple imputation was used to handle missing values in the exploratory factor analysis [30]. The adequacy of the polychoric correlation matrix was tested using Bartlett’s Test of Sphericity, where a significant value indicates that the correlation matrix is not an identity matrix and is suitable for factor analysis [31]. Kaiser-Meyer-Olkin (KMO) was also performed, where values above 0.6 are considered adequate for factor analysis [32].
Parallel exploratory factor analysis was conducted using a matrix of data collected and a matrix of data generated by chance through artificial intelligence tools. A sample of 500 data matrices (bootstrap samples with 95% confidence intervals) was generated to estimate the variance matrix. Optimal implementation of parallel analysis [33] was used to determine the number of dimensions. Robust Diagonally Weighted Least Squares (RDWLS) was used for factor extraction. The closeness to Unidimensionality was assessed using three tests: Unidimensional congruence (UniCo), where values larger than 0.95 are desirable; Explained Common Variance (ECV), where values larger than 0.85 are desirable; and Mean of Item Residual Absolute Loadings (MIREAL), where values lower than 0.300 suggest that the data can be treated as essentially unidimensional [34].

2.6.2. Confirmatory Factor Analysis

After conducting exploratory factor analysis, confirmatory factor analysis was performed using the same sample, and the software Factor was used to check the robust goodness of fit statistics. The software performed all indices with a bootstrap of 95% confidence interval:
  • Root Mean Square Error of Approximation (RMSEA), where values below 0.08 indicate good model fit [35].
  • NCP (estimated non-centrality parameter), a measure used in statistical power analysis for hypothesis testing. It was adjusted with 26 degrees of freedom, and the test of approximate fit considered the null hypothesis RMSEA < 0.05 [36].
  • NNFI (non-normed fit index), also known as the Tucker-Lewis Index (TLI), is a goodness-of-fit index used in structural equation modeling (SEM). The NNFI is a relative fit index that compares the fit of a hypothesized model to a baseline model. It is calculated as the difference in the chi-square values of the hypothesized model and the baseline model, divided by the degrees of freedom of the hypothesized model [37]. A NNFI value of 1 indicates perfect fit, while values closer to 0 indicate poorer fit.
  • Comparative Fit Index (CFI), where values above 0.95 indicate good model fit [38].
  • GFI (goodness of fit index), first proposed by Jöreskog and Sörbom (1981), generally, a GFI value of 0.90 or higher is considered indicative of good fit, although this threshold may vary depending on the specific research context [39].

3. Results

3.1. Adaptation of the questionnaire

After the process of translation and back-translation (from Portuguese to Italian), the final questionnaire was approved as being similar to the Brazilian version. Following the creation of the final version (supplementary material - Table 1), some adjustments were made to reflect the Italian ketogenic treatment reality based on the authors’ perceptions. Specifically, the first two questions were modified and the standard of answers (Likert scale) was simplified according to the frequency of behavior (ranging from “I never do” to “I always do”).

3.2. Delphi technique

Fifteen judges were invited, but only 12 answered the first cycle; the general characteristics of the judges were in Table 1. For the second cycle remained the same group of judges that answered before.
Table 2 presents all results of CVI and percentage of agreement between judges about relevance and clarity of each question from iKetoCheck, on the first and second cycle of Delphi technique.

3.3. Reproducibility

Characteristics of the sample are shown on Table 3. The internal consistency of the full questionnaire showed a Cronbach’s Alpha of 0.704, which is considered substantial.
Twelve patients were excluded because their delta between compilations was greater than 2 standard deviations. The test-retest reliability, performed with 61 patients, showed an adequate Pearson’s correlation for each item, as displayed in Table 4.

3.4. Factor Analysis

The exploratory factor analysis resulted in three factors, as shown in the rotated loading matrix in Table 5. Bartlett’s statistic was 575.5 (df=45, p=0.00001), and the KMO test yielded a value of 0.684, indicating moderate sampling adequacy. The data were found to be not essentially unidimensional, with UniCo of 0.841 (95% confidence interval 0.728-0.932), ECV of 0.695 (95% confidence interval 0.616-0.782), and MIREAL of 0.372 (95% confidence interval 0.289-0.432) [34]. The covariance matrix (polychoric correlation) of iKetocheck can be found in Supplementary Material Table 2.
The confirmatory factor analysis showed good results, with robust goodness-of-fit statistics after Losefer correction (RMSEA: 0.091, NCP p=0.788; NNFI: 0.923, 95% confidence interval 0.845-0.952; CFI: 0.969, 95% confidence interval 0.938-0.98; GFI: 0.984, 95% confidence interval 0.950-0.990) [40].
The authors created a graphical presentation to illustrate the inter-relationships between factors and items, based on all the analyses performed (Figure 1). The graphic representation shows three factors and all the questionnaire items. The authors proposed the names of the factors as follows: factor 1, “attention,” which is mainly related to item 5 (avoiding eating foods not prescribed); factor 2, “organization,” which is mainly related to items 1, 2, and 7 (reporting the therapy to all family, preparing meals that allow you to follow the diet even when away from home, and attending appointments); and factor 3, “precision,” which is related to items 3 and 8 (measuring ketosis and filling out food and seizure diaries).
In order to compare with the Brazilian Keto-check, the same cut-off values were used, as can be seen on Table 6, notwithstanding this present questionnaire does not recommend any cut-off values. Although higher mean referred values of ketonemia measurement are observed in patients with a higher adherence score, these values are not statistically significant (ANOVA: F=1.27, p=0.28; Pearson correlation: 0.185), as shown on Table 6.

4. Discussion

The KDT is considered the gold standard for the treatment of some rare neurometabolic diseases such as GLUT-1 deficiency and is a highly effective therapy for refractory epilepsy [2,3]. However, adequate adherence is essential to ensure its efficacy [3]. The validation of this questionnaire makes a practical non-invasive assessment of adherence possible, which could be applied periodically during interventions to monitor improvements in adherence to treatment.
The present study provides an innovative perception of KDT adherence. According to the analysis of grouped items by factors, three main factors were found: attention, organization, and precision. Attention could be correlated with the care of the basic informed therapy that allows the treatment to be considered adequate, with associated items such as avoiding not allowed food, reading food labels, and following instructions to weigh food. Organization permits a wider perception of the therapy, involving items such as informing all family members about the therapy, organizing meals outside the home, and attending all appointments. Precision is a factor that could make self-monitoring possible with ketosis assessment and monitoring diaries.
The concept of adherence is still unsettled in scientific literature. Terms analogous are used as synonyms, such as compliance or concordance, despite some studies reinforcing an existing difference between these terms [10]. There is no gold standard tool for the assessment of adherence in KDTs. Some studies measure it by parental report of ongoing urinary or blood ketosis [41,42,43,44,45,46]. Some studies reported adherence as time on the diet [47,48]. Others report the reasons for discontinuation or duration of therapy and the difficulties referred to by patients [49,50,51,52,53,54,55,56,57,58,59]. Therefore, it is important to obtain a validated instrument to monitor adherence in a non-invasive manner.
It is essential to identify patients at risk of low adherence, identifying barriers to adherence and the need for interventions aimed at increasing it [60]. Adherence plays a crucial role in clinical outcome and it is very important to consider adherence and develop specific interventions to improve it [60]. Literature reinforce some efforts to assist patients to adhere to the advice of health care providers, such as visual reminders, organizational strategies, behavioral strategies (e.g., simplification of the dosing regimen, the combination of step-by-step instructions with counseling, increasing follow-up, and using self-monitoring), and problem-solving around adherence barrier (group motivational sessions and psychological therapy). The review also suggested that education, counseling and behavioral interventions were effective strategies in patients with epilepsy [60].
Some limitations of this paper must be considered. Besides the limitation of sample number, it is possible that by recruiting a self-answered questionnaire sample, the results could be biased towards a more adherent population. Otherwise, to improve adherence, it is important to provide adequate parental counseling because KDT parent information is considered a key factor in maintaining long-term adherence and consequently crucial role in clinical outcome, so it is very important to take adherence into consideration and develop specific interventions to improve it [60,61].
Future prospects could involve developing psychoeducation courses to increase adherence. Therefore it is important to create tools to measure KDTs efficacy and other aspects such as knowledge of the characteristics of the treatment and dedicated side effects questionnaires.

5. Conclusions

The present study validated an indirect tool to measure adherence in KDTs in Italian patients. Interpretation of the factors related to adherence, named as attention, organization, and precision, enables monitoring of care points during an intervention and implementation of early intervention to adjust the therapy.

Supplementary Materials

The following supporting information can be downloaded at the website of this paper posted on Preprints.org. Table S1: Covariance matrix (polychromic correlation) of iKetocheck; Table S2: iKetoCheck: Assessment tool of adherence to the ketogenic diet therapy.

Author Contributions

Conceptualization, L.C.L.N. and A.T.; methodology, L.C.L.N. and C.F.; validation, L.C.L.N., M.G., V.G., L.P., M.P.Z., C.T., E.B., S.G., C.F. and A.T.; formal analysis, L.C.L.N., E.B., S.G. and M.G.; investigation, L.C.L.N., M.G., V.G., L.P.; resources, V.G. and A.T.; data curation, L.C.L.N. and M.G.; writing—original draft preparation, L.C.L.N., C.F. and M.G.; writing—review and editing, L.C.L.N., M.G., V.G., L.P., M.P.Z., C.T., E.B., S.G., C.F. and A.T.; supervision, A.T. and C.F.; project administration, A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The iKetoCheck created can be found on Supplementary materials.

Acknowledgments

The authors thank the judges Prof. Simona Bertoli, Prof. Pierangelo Veggiotti, Prof. Francesca Darra, Dr. Costanza Varesio, Dr. Ramona De Amicis, Dr. Claudia Marazzi, Dr. Lilia Volpi, Dr. Riccardo Garbo, Dr. Francesca Operto, Dr. Barbara Mustacchi and Dr. Giorgia Gugelmo for the helpful contributions and all patients answering the iKetocheck and members of the GLUT1 Italian Association by supporting the questionnaires’ dissemination. We also acknowledge Leticia Pereira Sampaio. The authors also acknowledge ERN EPicare and Mondino’s ongoing research team 2022-2023.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Martin-McGill, K.J.; Jackson, C.F.; Bresnahan, R.; Levy, R.G.; Cooper, P.N. Ketogenic diets for drug-resistant epilepsy. Cochrane Database Syst. Rev. 2018, 11, CD001903. [Google Scholar] [CrossRef]
  2. Pong, A.W.; Geary, B.R.; Engelstad, K.M.; Natarajan, A.; Yang, H.; De Vivo, D.C. Glucose transporter type I deficiency syndrome: Epilepsy phenotypes and outcomes. Epilepsia 2012, 53, 1503–1510. [Google Scholar] [CrossRef]
  3. Kossoff, E.H.; Zupec-Kania, B.A.; Auvin, S.; Ballaban-Gil, K.R.; Christina Bergqvist, A.G.; Blackford, R.; Buchhalter, J.R.; Caraballo, R.H.; Cross, J.H.; Dahlin, M.G.; et al. Practice Committee of the Child Neurology Society Optimal clinical management of children receiving dietary therapies for epilepsy: Updated recommendations of the International Ketogenic Diet Study Group. Epilepsia Open 2018, 3, 175–192. [Google Scholar] [CrossRef]
  4. Veggiotti, P.; De Giorgis, V. Dietary treatments and new therapeutic perspective in GLUT1 deficiency syndrome. Curr. Treat. Options Neurol. 2014, 16, 291. [Google Scholar] [CrossRef]
  5. Boison, D. New insights into the mechanisms of the ketogenic diet. Curr. Opin. Neurol. 2017, 30, 187–192. [Google Scholar] [CrossRef] [PubMed]
  6. Freeman, J.M.; Vining, E.P.G.; Kossoff, E.H.; Pyzik, P.L.; Ye, X.; Goodman, S.N. A blinded, crossover study of the efficacy of the ketogenic diet. Epilepsia 2009, 50, 322–325. [Google Scholar] [CrossRef] [PubMed]
  7. Klepper, J.; Leiendecker, B. Glut1 deficiency syndrome and novel ketogenic diets. J. Child Neurol. 2013, 28, 1045–1048. [Google Scholar] [CrossRef] [PubMed]
  8. Sabate, E. Adherence to Long-Term Therapies: Evidence for Action; World Health Organization: Geneva, Switzerland, 2003. [Google Scholar]
  9. Jimmy, B.; Jose, J. Patient medication adherence: Measures in daily practice. Oman Med. J. 2011, 26, 155–159. [Google Scholar] [CrossRef] [PubMed]
  10. Fawcett, J. Thoughts about meanings of compliance, adherence, and concordance. Nurs. Sci. Q. 2020, 33, 358–360. [Google Scholar] [CrossRef] [PubMed]
  11. Aronson, J.K. Compliance, concordance, adherence. Br. J. Clin. Pharmacol. 2007, 63, 383–384. [Google Scholar] [CrossRef] [PubMed]
  12. Cramer, J.A.; Roy, A.; Burrell, A.; Fairchild, C.J.; Fuldeore, M.J.; Ollendorf, D.A.; Wong, P.K. Medication compliance and persistence: Terminology and definitions. Value Health 2008, 11, 44–47. [Google Scholar] [CrossRef]
  13. Ferraris, C.; Guglielmetti, M.; Tamagni, E.; Trentani, C.; De Giorgis, V.; Pasca, L.; Varesio, C.; Ferraro, O.E.; Tagliabue, A. Use of Remote Monitoring by E-mail for Long-Term Management of the Classic Ketogenic Diet. Nutrients 2020, 12, 1833. [Google Scholar] [CrossRef]
  14. Erkent, I.; Ilgaz, F.; Dericioglu, N. Difficulties in the implementation of the ketogenic diet in adult patients with refractory epilepsy. Epilepsy Behav. 2023, 144, 109234. [Google Scholar] [CrossRef]
  15. Armeno, M.; Verini, A.; Caballero, E.; Cresta, A.; Valenzuela, G.R.; Caraballo, R. Long-term effectiveness and adverse effects of ketogenic diet therapy in infants with drug-resistant epilepsy treated at a single center in Argentina. Epilepsy Res. 2021, 178, 106793. [Google Scholar] [CrossRef]
  16. Ye, F.; Li, X.-J.; Jiang, W.-L.; Sun, H.-B.; Liu, J. Efficacy of and patient compliance with a ketogenic diet in adults with intractable epilepsy: A meta-analysis. J. Clin. Neurol. 2015, 11, 26–31. [Google Scholar] [CrossRef]
  17. Gutierrez-Colina, A.M.; Smith, A.W.; Mara, C.A.; Modi, A.C. Adherence barriers in pediatric epilepsy: From toddlers to young adults. Epilepsy Behav. 2018, 80, 229–234. [Google Scholar] [CrossRef]
  18. Chen, J.W.Y.; Wasterlain, C.G. Status epilepticus: Pathophysiology and management in adults. Lancet Neurol. 2006, 5, 246–256. [Google Scholar] [CrossRef] [PubMed]
  19. Davis, K.L.; Candrilli, S.D.; Edin, H.M. Prevalence and cost of nonadherence with antiepileptic drugs in an adult managed care population. Epilepsia 2008, 49, 446–454. [Google Scholar] [CrossRef] [PubMed]
  20. Modi, A.C.; Wu, Y.P.; Rausch, J.R.; Peugh, J.L.; Glauser, T.A. Antiepileptic drug nonadherence predicts pediatric epilepsy seizure outcomes. Neurology 2014, 83, 2085–2090. [Google Scholar] [CrossRef] [PubMed]
  21. Wu, Y.P.; Follansbee-Junger, K.; Rausch, J.; Modi, A. Parent and family stress factors predict health-related quality in pediatric patients with new-onset epilepsy. Epilepsia 2014, 55, 866–877. [Google Scholar] [CrossRef] [PubMed]
  22. DiIorio, C.; Shafer, P.O.; Letz, R.; Henry, T.R.; Schomer, D.L.; Yeager, K. Project EASE study group Project EASE: A study to test a psychosocial model of epilepsy medication managment. Epilepsy Behav. 2004, 5, 926–936. [Google Scholar] [CrossRef]
  23. Neri, L.D.C.L.; Sampaio, L.P.D.B. Validation of ketogenic diet adherence questionnaire: Keto-check. Arq Neuropsiquiatr 2022, 80, 794–801. [Google Scholar] [CrossRef]
  24. Revorêdo, L.D.S.; Maia, R.S.; Torres, G.D.V.; Chaves Maia, E.M. O uso da técnica delphi em saúde: Uma revisão integrativa de estudos brasileiros. RACS 2015, 22, 16. [Google Scholar] [CrossRef]
  25. Tsang, S.; Royse, C.F.; Terkawi, A.S. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J. Anaesth. 2017, 11, S80–S89. [Google Scholar] [CrossRef] [PubMed]
  26. Silvino, R.C.D.A.S.; Trida, V.C.; Castro, A.D.R.V.; Neri, L.D.C.L. Construction and validation of the neonatal nutritional risk screening tool. Rev. Paul. Pediatr. 2020, 39, e2020026. [Google Scholar] [CrossRef] [PubMed]
  27. Ferrando, P.J.; Lorenzo-Seva, U. Program FACTOR at 10: Origins, development and future directions. Psicothema 2017, 29, 236–240. [Google Scholar] [CrossRef] [PubMed]
  28. Lorenzo-Seva, U.; Ferrando, P.J. Factor Analysis; Universitat Rovira i Virgili: Tarragona, Spain, 2022. [Google Scholar]
  29. Lorenzo-Seva, U.; Ferrando, P.J. FACTOR: A computer program to fit the exploratory factor analysis model. Behav. Res. Methods 2006, 38, 88–91. [Google Scholar] [CrossRef] [PubMed]
  30. Lorenzo-Seva, U.; Van Ginkel, J.R. Multiple Imputation of missing values in exploratory factor analysis of multidimensional scales: Estimating latent trait scores. Analesps 2016, 32, 596. [Google Scholar] [CrossRef]
  31. Bartlett, M.S. A note on the multiplying factors for various chi square approximations. J. R. Stat. Soc. Ser. B 1954, 296–298. [Google Scholar]
  32. KAISER, H. An index of factorial simplicity. Psychometrika 1974, 39, 31–36. [Google Scholar] [CrossRef]
  33. Timmerman, M.E.; Lorenzo-Seva, U. Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol. Methods 2011, 16, 209–220. [Google Scholar] [CrossRef] [PubMed]
  34. Ferrando, P.J.; Lorenzo-Seva, U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ. Psychol. Meas. 2018, 78, 762–780. [Google Scholar] [CrossRef] [PubMed]
  35. Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newcastle upon Tyne, UK, 1993; pp. 136–162. [Google Scholar]
  36. Cohen, J. Statistical Power Analysis for the Behavioral Sciences; 2nd ed.; Lawrence Erlbaum Associates, 1988.
  37. Tucker, L.; Lewis, C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika 1973, 38, 1–10. [Google Scholar] [CrossRef]
  38. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  39. Jöreskog, K.G. LISREL: Analysis of linear structural relationships by maximum likelihood, instrumental variables, and least squares methods. . In Advances in Factor Analysis and Structural Equation Models; Jöreskog, K.G., Sörbom, D., Eds.; Abt Books, 1981; pp. 23–51.
  40. Lorenzo-Seva, U.; Ferrando, P.J. A simulation-based scaled test statistic for assessing model-data fit in least-squares unrestricted factor-analysis solutions.; Universitat Rovira i Virgili., 2022.
  41. Kinsman, S.L.; Vining, E.P.; Quaskey, S.A.; Mellits, D.; Freeman, J.M. Efficacy of the ketogenic diet for intractable seizure disorders: Review of 58 cases. Epilepsia 1992, 33, 1132–1136. [Google Scholar] [CrossRef] [PubMed]
  42. Hosain, S.A.; La Vega-Talbott, M.; Solomon, G.E. Ketogenic diet in pediatric epilepsy patients with gastrostomy feeding. Pediatr. Neurol. 2005, 32, 81–83. [Google Scholar] [CrossRef] [PubMed]
  43. Klein, P.; Janousek, J.; Barber, A.; Weissberger, R. Ketogenic diet treatment in adults with refractory epilepsy. Epilepsy Behav. 2010, 19, 575–579. [Google Scholar] [CrossRef] [PubMed]
  44. Kverneland, M.; Selmer, K.K.; Nakken, K.O.; Iversen, P.O.; Taubøll, E. A prospective study of the modified Atkins diet for adults with idiopathic generalized epilepsy. Epilepsy Behav. 2015, 53, 197–201. [Google Scholar] [CrossRef]
  45. Silvino, R.C.D.A.S.; Trida, V.C., Castro; Neri, L.D.C.L. The use of a formula-based ketogenic diet in children with refractory epilepsy. Arq Neuropsiquiatr 2017, 75, 234–237. [Google Scholar] [CrossRef]
  46. Cabrera, A.M.; Fain, H.; Fain, B.; Muniategui, J.; Buiras, V.M.; Galicchio, S.; Cacchia, P.A.; Retamero, M.; Ocampo, R.P.; Porto, M.B. Treatment of refractory epilepsy. A comparison between classic ketogenic diet and modified Atkins diet in terms of efficacy, adherence, and undesirable effects. Nutr. Hosp. 2021, 38, 1144–1148. [Google Scholar] [CrossRef]
  47. Santiworakul, C.; Chomtho, K.; Chomtho, S. Growth and nutritional status of pediatric patients treated with the ketogenic diet. Asia Pac. J. Clin. Nutr. 2021, 30, 231–237. [Google Scholar] [CrossRef] [PubMed]
  48. Green, S.F.; Nguyen, P.; Kaalund-Hansen, K.; Rajakulendran, S.; Murphy, E. Effectiveness, retention, and safety of modified ketogenic diet in adults with epilepsy at a tertiary-care centre in the UK. J. Neurol. 2020, 267, 1171–1178. [Google Scholar] [CrossRef] [PubMed]
  49. Mady, M.A.; Kossoff, E.H.; McGregor, A.L.; Wheless, J.W.; Pyzik, P.L.; Freeman, J.M. The ketogenic diet: Adolescents can do it, too. Epilepsia 2003, 44, 847–851. [Google Scholar] [CrossRef] [PubMed]
  50. Wibisono, C.; Rowe, N.; Beavis, E.; Kepreotes, H.; Mackie, F.E.; Lawson, J.A.; Cardamone, M. Ten-year single-center experience of the ketogenic diet: Factors influencing efficacy, tolerability, and compliance. J. Pediatr. 2015, 166, 1030–1036.e1. [Google Scholar] [CrossRef]
  51. McDonald, T.J.W.; Henry-Barron, B.J.; Felton, E.A.; Gutierrez, E.G.; Barnett, J.; Fisher, R.; Lwin, M.; Jan, A.; Vizthum, D.; Kossoff, E.H.; et al. Improving compliance in adults with epilepsy on a modified Atkins diet: A randomized trial. Seizure 2018, 60, 132–138. [Google Scholar] [CrossRef] [PubMed]
  52. Pasca, L.; Caraballo, R.H.; De Giorgis, V.; Reyes, J.G.; Macasaet, J.A.; Masnada, S.; Armeno, M.; Musicco, M.; Tagliabue, A.; Veggiotti, P. Ketogenic diet use in children with intractable epilepsy secondary to malformations of cortical development: A two- centre experience. Seizure 2018, 57, 34–37. [Google Scholar] [CrossRef] [PubMed]
  53. Baby, N.; Vinayan, K.P.; Pavithran, N.; Grace Roy, A. A pragmatic study on efficacy, tolerability and long term acceptance of ketogenic diet therapy in 74 South Indian children with pharmacoresistant epilepsy. Seizure 2018, 58, 41–46. [Google Scholar] [CrossRef] [PubMed]
  54. Bekker, Y.A.C.; Lambrechts, D.A.; Verhoeven, J.S.; van Boxtel, J.; Troost, C.; Kamsteeg, E.-J.; Willemsen, M.A.; Braakman, H.M.H. Failure of ketogenic diet therapy in GLUT1 deficiency syndrome. Eur. J. Paediatr. Neurol. 2019, 23, 404–409. [Google Scholar] [CrossRef]
  55. Kossoff, E.H.; Henry, B.J.; Cervenka, M.C. Efficacy of dietary therapy for juvenile myoclonic epilepsy. Epilepsy Behav. 2013, 26, 162–164. [Google Scholar] [CrossRef]
  56. Chomtho, K.; Suteerojntrakool, O.; Chomtho, S. Effectiveness of Medium Chain Triglyceride Ketogenic Diet in Thai Children with Intractable Epilepsy. J. Med. Assoc. Thai. 2016, 99, 159–165. [Google Scholar]
  57. Lee, H.-F.; Chi, C.-S.; Liao, J.-H. Use of cooking oils in a 2:1 ratio classical ketogenic diet for intractable pediatric epilepsy: Long-term effectiveness and tolerability. Epilepsy Res. 2018, 147, 75–79. [Google Scholar] [CrossRef] [PubMed]
  58. Alencastro Veiga Domingues Carneiro, R.; Dos Santos Lunardi, M.; Matheus Uberna Giacomini, F.; Kurrle Rieger, D.; Dubois Moreira, J.; Carina Ribeiro da Silva, L.; Pereira Brito Sampaio, L.; Lin, K. Challenges faced by people with epilepsy on ketogenic diet therapy and their caregivers during the COVID-19 pandemic in Brazil. Epilepsy Behav. 2021, 122, 108193. [Google Scholar] [CrossRef] [PubMed]
  59. Poorshiri, B.; Barzegar, M.; Tahmasebi, S.; Shiva, S.; Raeisi, S.; Ebadi, Z. The efficacy comparison of classic ketogenic diet and modified Atkins diet in children with refractory epilepsy: A clinical trial. Acta Neurol. Belg. 2021, 121, 483–487. [Google Scholar] [CrossRef] [PubMed]
  60. Michaelis, R.; Tang, V.; Wagner, J.L.; Modi, A.C.; LaFrance, W.C.; Goldstein, L.H.; Lundgren, T.; Reuber, M. Cochrane systematic review and meta-analysis of the impact of psychological treatments for people with epilepsy on health-related quality of life. Epilepsia 2018, 59, 315–332. [Google Scholar] [CrossRef]
  61. Operto, F.F.; Labate, A.; Aiello, S.; Perillo, C.; de Simone, V.; Rinaldi, R.; Coppola, G.; Pastorino, G.M.G. The Ketogenic Diet in Children with Epilepsy: A Focus on Parental Stress and Family Compliance. Nutrients 2023, 15, 58. [Google Scholar] [CrossRef]
Figure 1. Graphical representation of 3 factors of adherence and related items.
Figure 1. Graphical representation of 3 factors of adherence and related items.
Preprints 76506 g001
Table 1. Characterization of the judges who participated in the validation of the instrument’s content.
Table 1. Characterization of the judges who participated in the validation of the instrument’s content.
Characteristics n (%)
Gender
Female
Male

10 (83.3)
2 (16.7)
Italian Region of professional activity
Lombardia
Veneto
Emilia Romagna
Friuli Venezia Giulia
Campania

5 (41.7)
3 (25)
2 (16.7)
1 (8.3)
1 (8.3)
Area of expertise
Neurologist
Dietitian
Nutritionist (MD)

7 (58.3)
3 (25)
2 (16.7)
Professional practice area
Assistance
Teaching and Research
Both

2 (16.7)
0 (0)
10 (83.3)
Table 2. Results of Content Validity Index (CVI) and percentage of agreement between judges by Delphi technique of iKetoCheck for relevance and clarity, 2022.
Table 2. Results of Content Validity Index (CVI) and percentage of agreement between judges by Delphi technique of iKetoCheck for relevance and clarity, 2022.
Question Relevance Clarity
First round Second round First round Second round
1 CVI 0,92 1 0,83 1
% Agreement 83% 100% 67% 100%
2 CVI 0,94 1 0,83 1
% Agreement 92% 100% 67% 100%
3 CVI 0,92 1 0,83 1
% Agreement 83% 100% 67% 100%
4 CVI 0,94 1 0,86 1
% Agreement 92% 100% 67% 100%
5 CVI 0,94 1 0,78 0,97
% Agreement 92% 100% 50% 92%
6 CVI 0,94 1 0,86 0,94
% Agreement 92% 100% 75% 92%
7 CVI 0,97 1 0,92 0,97
% Agreement 92% 100% 83% 92%
8 CVI 0,97 1 0,89 0,97
% Agreement 92% 100% 75% 92%
9 CVI 1,00 1 0,86 1
% Agreement 100% 100% 67% 100%
10 CVI 0,94 0,97 0,89 0,97
% Agreement 83% 92% 75% 92%
Final Score First round Second round
CVI 0,94 0,97
% Agreement 83% 92%
Table 3. Characteristics of the patients who answered the iKetocheck.
Table 3. Characteristics of the patients who answered the iKetocheck.
Characteristics n (%)
Age (yrs)
0-2 9 (7,9)
3-12 66 (57,9)
13-20 29 (25,4)
>20 10 (8,8)
Total 114 (100,0)
Diagnosis
Glut 1 Syndrome 64 (56,1)
Drug-resistant epilepsy 35 (30,7)
Migraine 1 (0,9)
Others 14 (12,3)
Total 114 (100,0)
Diet duration (months)
<6 8 (7,3)
6-12 16 (14,5)
12-24 22 (20,0)
<24 64 (58,2)
Total 110 (100,0)
Type of KDT
cKDT 93 (81,6)
MCT 16 (14,0)
MAD 4 (3,5)
LGIT 1 (0,9)
Total 114 (100,0)
Mean ketonemia referred by patients (mmol/dL)
<2 29 (26,4)
2-5 80 (72,7)
>5 1 (0,9)
Total 110 (100,0)
Perceived efficacy on symptoms (%)
0-25 4 (3,5)
25-50 13 (11,4)
50-75 46 (40,4)
75-100 51 (44,7)
Total 114 (100,0)
Table 4. Test of reproducibility according to Pearson correlation (n= 61).
Table 4. Test of reproducibility according to Pearson correlation (n= 61).
Question 1_a 2_a 3_a 4_a 5_a 6_a 7_a 8_a 9_a 10_a Score_1
1_b 0,660*
2_b 0,655*
3_b 0,764*
4_b 0,708*
5_b 0,535*
6_b 0,486*
7_b 0,710*
8_b 0,738*
9_b 0,337*
10_b 0,736*
Score_2 0,849*
* Pearson correlation test.
Table 5. Rotated loading matrix of questions of iKetoCheck.
Table 5. Rotated loading matrix of questions of iKetoCheck.
Question Factor 1 Factor 2 Factor 3
q1 -0.080 0.997 -0.050
q2 0.087 0.692 -0.045
q3 -0.207 0.293 0.659
q4 0.336 0.321 0.103
q5 1.044 -0.062 -0.078
q6 0.033 0.010 0.356
q7 0.341 0.506 -0.075
q8 0.078 -0.058 0.993
q9 0.388 0.164 0.194
q10 0.122 0.041 0.419
Table 6. Referred mean ketonemia values according Ketocheck’s categorization.
Table 6. Referred mean ketonemia values according Ketocheck’s categorization.
iKetocheck adherence’s categorization* n Mean Standard deviation 95% Confidence interval
Insufficient
Good
Excellent
12 2,19 1,09 (1,50-2,88)
56 2,38 0,91 (2,13-2,62)
45 2,64 1,16 (2,29-2,99)
Total 114 2,46 1,04 2,27-2,65)
* Considering scores equal or less than 35 as “insufficient”, from 36 to 44 as “good”, and higher than 45 as “excellent”.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Alerts
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2025 MDPI (Basel, Switzerland) unless otherwise stated