2. Materials and Methods
Participants
One hundred (100) healthy adults, aged from 20 to 49 years old (44.4% male and 55.6% female), participated in this study voluntarily, anonymously, after giving their written consent. The mean age was 32.81 years with mean education (as years of schooling) 14.73 years. To collect the sample, a data sample from the wider area of North and Central Greece was used; especially, participants were university students from the University of Western Macedonia and Aristotle University of Thessaloniki, as well as other adults from the same area, who were recruited from towns, villages and islands of this area representatively.
All participants met the inclusion criteria: age from 20 to 49 years and Greek as their native language. Exclusion criteria were the following; presence of previous addictive disorder, psychosis and major depression, concurrent history of neurologic disease known to affect cognitive functioning, auditory functioning no sufficient to understanding normal conversational speech, and visual acuity non-normal or non-corrected to anticipate visual stimuli.
Description of the D-KEFS Tests
Verbal Fluency Test (VTF)
VFT measures initiation, auditory attention, speed of processing verbal and vocabulary knowledge spelling ability, as well as retrieval of lexical items, Both phonemic and categorical fluency assess language functions such as vocabulary and naming, response speed, organization, retrieval strategies etc. [
49,
50]. Additionally, according to Diamond (2013) [
51] verbal fluency tasks are assumed as useful tools for assessing cognitive flexibility. The ability to recall requires executive control, because participants must have access to their mental vocabulary, concentration and avoid word repetitions [
50]. Concerning the switching categories’ fluency, the speed of retrieval from the semantic vocabulary as well as cognitive flexibility in switching between two semantic categories are measured.
D-KEFS VFT includes three conditions: phonological fluency (the production of words starting from a specific letter of the alphabet) which requires initiation, simultaneous processing, speed of processing, vocabulary knowledge, spelling, attention and retrieval of phonemically similar lexical items, categorical fluency (the production of words included from specific categories; animals and boys’ names) which requires vocabulary knowledge, rapid retrieval of lexical items, retrieval of multiple words from a high-frequency semantic category, semantic memory, naming, and the switching categories fluency (the production of words through the switching of different categories as well as the number of correct switches; fruits and furniture) which measures cognitive flexibility, retrieval from semantic knowledge, switching and shifting. According to D-KEFS authors, other than neurostructural factors, for example anxiety, pain, mood, medications and/or inconsistent effort may produce atypical patterns of performance across all D-KEFS tests.
In each subtest the participant was given one minute to produce as many words as possible per each condition. For the Greek version of the D-KEFS, the letters in the phonological condition are the same as in the original version; Άλφα (A), Φι (Φ) and Σίγµα (Σ) for A, F, and S respectively. In the semantic fluency condition, the examinee is asked to name as many words as he/she could from a specific conceptual category, regardless of the letter with which the word begins. The semantic categories of this condition are 'animals' and 'boys' names'. In the category switching fluency condition the examinee is asked to produce words from different categories, alternately. The categories are "fruit" and "furniture". For all conditions, the instruction is given not to repeat the same words, not to use grammatical variants of words (unless it changed the meaning of the word) and not to mention proper names, while the time to complete all conditions is 60 seconds.
As regards the semantic condition, words representing broader characteristics of a sub- category (e.g., for animals, the word "carnivore") are considered incorrect. In the last condition, the words belonging to the category "fruit" and "furniture" are considered correct, as well as the correct number of substitutions made by the examinee, while repetitions and superimposed meanings of the same words are marked as errors. Finally, lexicon characteristics of the sample, such as reading style or letter processing speed, which may affect participant’s performance in visual-mental tracing and verbal search in verbal fluency, are not be taken into account. The variables attributable to the VFT are the following; Letter Fluency: Total Correct; Category Fluency: Total Correct; Category Switching: Total Correct: Category Switching: Total Switching Accuracy).
Design Fluency Test (DFT)
DFT evaluates basic visual attention, planning, initiation motor speed, visual perceptual skills, constructional skills, processing, non-verbal creativity and cognitive flexibility primary in research as well as clinical settings. Additionally, it assesses a participant’s ability to generate geometric patterns, and therefore is thought to measure executive functions. DFT was originally developed by Jones-Gotman and Milner (1977) [
52] as the nonverbal counterpart of verbal fluency [
33,
53], and is based on the coordination of multiple executive functions in the initiation, visuospatial and constructional domains, including fluid productivity, monitoring and planning [
54], problem solving, motor speed and creativity in drawing new patterns. Additionally, the scoring system provides qualitative as well as quantitative information such as the number of novel designs, complexity of designs, variations in designs, and concrete, frankly perseverative, and scribbled responses. Additionally, although Delis and colleagues (2001) [
3] argued that graphomotor speed and visual scanning were significantly correlated with participants' performance in the first two DFT conditions, in the study by Suchy et al. (2010) [
14] graphomotor skills had minimal impact on performance, accounting for less than 5% of the variance. The only exception was found in individuals with significant graphomotor deficits.
According to the instructions, examinees are asked to connect dots using continuous four-line patterns, and therefore draw as many different drawings as possible in one minute, avoiding repetition of previous drawings and connecting four lines in a series of dot arrays. In more specific, DFT includes three conditions; in the first condition (Filled Dots), the participant is given a sheet including stimulus boxes all of them containing five filled dots, so that the examinee can use any of the dots to draw designs. In the second condition (Empty Dots), the stimulus boxes include five filled dots and five empty dots, whereas the participant must connect only empty dots while filled dots function as visual distractors. Conditions 1 and 2 are quite similar because participants must focus on one type of dots (filled or empty) in order to produce designs, therefore, they require visual attention, motor speed to nonverbal creativity, simultaneous processing, initiation in problem solving, productivity and monitoring. The third condition (Dot Switching condition) represents a new clinical task, which is identical with the Empty Dots layout, but the examinee must alternate between filled and empty dots in each box. The term “switching” refers to the flexible transition from one set of rules to another in response to changing environmental contingencies [
55]. It measures nonverbal creativity and cognitive shifting skills.
Due to the fact that each pattern requires only four lines, the pattern production rate in the D-KEFS DFT appears significantly reduced relative to the production rate of other versions of the same test, and is further reduced in the switching condition [
57]. Good performance in DFT conditions requires from the participants to shift their attention between response production and response monitoring [
58]. In particular, these two prerequisites of the test are associated with conflicting demands, because when the participant shifts the attention from producing drawings to monitor his/her progress the possibilities to sacrifice production speed are increasing [
58]. To sum, the first condition could be considered as the "pure" flow process [
33], the second requires the ability to suspend inhibition and control, and the third involves ability to switch. The variables attributable to the DFT are the following; Design Fluency Test (Filled Dots: Total Correct; Empty Dots Only: Total Correct; Switching: Total Correct).
Ethics
Before the start of data collection, consent was obtained from the Ethics Committee of the University of Western Macedonia, in order to approve the processing of the participants' personal data. Demographic information, such as age, gender, and education, was collected, adhering to the law of the European Union since 28 May 2018, which allows the use of sensitive personal data for research purposes. Participants were told and consented to that, upon a written request, their data could be removed from the online database. The study was aligned with the principles outlined in the Helsinki Declaration (World Medical Association, 1997).
Procedure
First, a pilot study was conducted to evaluate the two tests of the D-KEFS, which have been administered to 15 participants, most of whom were students of the Psychology department of the University of Macedonia. Before their inclusion to the study, participants read the information sheet, which stipulated that the researchers could use their data for research purposes. Additionally, they were told that they would be able to withdraw from the study whenever they wanted without facing any consequences or having to give any explanation. Before the completion of the consent form, the participants were told that their records would be coded and anonymized for future research purposes.
After signing consent to participate in the research, a short, structured interview followed to collect demographic information, including the participant's gender, age, and education level. These data were accompanied by a code, which included the initial letters of the participant's name in combination with the number of the series of administration (e.g. PM54), to preserve anonymity, but also to facilitate the identification process of the participants in the statistical database. D-KEFS tests’ administration was conducted in a quiet environment at the University premises, mainly during morning hours, to perform better without external interference.
The neuropsychological assessment lasted about half an hour maximum and involved a face-to-face assessment. In specific, the instruction sheet of each condition was presented in front of the participants, before each test’s administration. Especially for the VFT a smart phone was used to record participants’ responses and then the answers were transcribed in the corresponding reference booklet. The D-KEFS tests were counterbalanced across participants.
Statistical Analyses
At first, Kolmogorov–Smirnov test for normality have been conducted to check whether the dependent variables were normally distributed. Therefore parametric tests were further employed. Moreover, Pearson correlations were computed for continuous variables such as age and education, and Chi Square test was conducted to examine whether there was any relationship between gender with the two D-KEFS tests.
Despite that D-KEFS tests’ raw scores are otherwise converted to scaled scores having a mean of 10 as well as a standard deviation of 3, in the current analyses we provide only raw scores to identify participants’ performance. Inferential cut off scores were also calculated to select the score under which the possibility for an individual to belong to the normal population was below 10% and therefore would be assumed as low performance.
Finally, after calculating raw scores, they have been transformed into scaled scores, to compare Greek norms with the American norms, D-KEFS provides primary and optional variables; in specific, primary measures give scores reflecting overall performance, and therefore provide global scores, whereas optional scores give a more detailed assessment of executive functions to allow researchers and clinicians have a more comprehensive knowledge about examinees’ performance. An alpha value of .05 (two-tailed) was used. The statistical analyses were performed using the SPSS software v 27 (IBM Corp. Released 2020. IBM SPSS Statistics for Macintosh, Version 27.0. Armonk, NY: IBM Corp).
3. Results
Demographic distribution is shown in
Table 1.
In order to extract the Greek norms, all participants were divided into three age classes, a typical separation in normative data studies (age range 20–29; 30–39, and 40–49 years), and three educational classes (Secondary school graduates (10-12 years), Diploma degree or Bachelor degree (13-16 years) and Master Degree to Doctorate studies (16< years) in line with the USA classification [
4]. Pearson test showed that the total number of correct words in the phonological fluency (p< .01), semantic fluency (p< .01), category Switching (p= .004) and category switching- switching accuracy (p= .004) was significantly related to education. The higher score indicates the production of more correct words, thus higher performance. Due to the absence of participants in the age group of 20-29, with education level less than 10-12 years, the following category was not included in the relative tables.
VFT norms were not stratified by age and gender, because no differences were observed between men and women, as well as between the three age classes regarding VFT performance. On the contrary, DFT performance was strongly dependent on age, according to Pearson test, and therefore, different age-related norms have been extracted in its three conditions: Filled Dots (p< .05), Empty Dots (p< .05), and Switching (p< .01). The higher score indicates the production of more correct designs, thus higher performance.
Norms were established using percentiles scores (
Table 2,
Table 3,
Table 4 and
Table 5). Specifically, we calculated the raw mean scores, per age and education for DFT and VFT respectively (as well as for both age and education in the case of VFT), and their mean and standard deviation. Afterwards, we converted the raw scores into percentile scores. Inferential cut off scores were then calculated to extract those under the lowest 10%, assumed to be low performance [
59]. Scores above the 95% of the population were regarded as superior performance.
4. Discussion
In the current paper, norms have been established for two D-KEFS tests; VFT and DFT, in Greek adult population for further use in research as well as for clinical use/purposes. This endeavor is crucial due to lack of relevant studies in this population. Additionally, given the importance of using standardized data that could help determine impaired performance of Greek adults with psychiatric and neurological diseases, extracting normative data for widely used tests measuring executive functions can help clinical neuropsychologists better differentiate impaired from normal performance in adult population. Despite that DFT has not been previously adapted in Greek adult population and therefore this is the normative data study, however the verbal fluency task is available for people between 18-79 years old in the study of Kosmidis et al. (2004) [
36]. However, in their study, they calculated norms for people with 1-9 years of education, in comparison to our study which did not extracted normative data for this educational range due to lack of participants 20 years after the first study conducted in Greek population. Additionally, Kosmidis et al. (2004) [
36] used a version of a verbal fluency test which does not include switching, and therefore, this is the main gap which the current study aims to fill. Despite that they adapted in Greek the initial verbal fluency task using the letters Chi (Χ), Sigma (S), Alpha (A) rather that F, A, S which are typically used in the English version. Actually according to the F, A, S test, letters have been initially chosen, because A has wide use as an initial letter, S has moderate use and F has little, but not very little, use in English language [
60]. Since there are not official data concerning the actual equivalence between the above letters’ frequency with specific Greeks, in the current study we used links speciliazed to the Greek letters frequency to identify letters with similar frequency [
61] with the initial English letters. Hence, Greek letters Chi (X) and Fi (F) do not differ by means of frequency in Greek alphabet with those in English alphabet, despite that till now there are no official data which directly correspond to the English letters’ frequency with the Greeks. Therefore, no changes have been made in the D-KEFS VFT as regards letters selection.
Regarding the VFT, the results showed that higher educational level was positively related to word production, but no statistically significant correlation was found with age. Similar studies [
32,
36,
62,
63,
64,
65,
66], using different verbal fluency test’s versions, showed the same results highlighting the significant impact of educational level on participants’ performance. Nevertheless, some studies reported that younger people perform higher in all test’s conditions [
32,
36,
62,
63], while others reported that age affects performance in some VFT conditions [
64,
65]. However, in the current research, results showed that age does not affect word production in either semantic or phonological fluency, and therefore no statistically significant differences were found between the three age groups. Of course, we do not know if there will be revealed such differences when more age-classes will be added to the Greek sample. At the theoretical level, Elgamal et al. (2011) [
67] reported that age is not considered an important factor in phonological fluency performance because older adults can produce more words and possibly perform better in the condition. However, due to reduced processing speed and working memory impairment, they do not perform as well and therefore their performance offsets with that of younger individuals [
67]. Our results are also in line with previous studies [
68,
69], which showed that a higher level of education is solely responsible to produce more words among people of the same age. Moreover, similar studies that has recently been carried out in Greece [
70,
71], found that education contributed more to the VFT performance, as compared to age, and especially in the research of Alexiadou (2021) [
70], age affected only semantic fluency. The following conclusion is particularly important, if we consider that their research was carried out in a Greek population and their results coincide quite well with the findings of the current study. In this case, it is necessary in future research to take into account other factors, such as processing speed per age group, as well as cultural factors and cognitive reserve, which can justify age differences observed in the results across different studies (64; 71). In conclusion, the results regarding VFT, and especially for the education factor, coincide with the results of research both abroad and in Greece [
36,
63,
65,
70,
71]. However, all these studies used different versions of the test [
64]. Furthermore, although the Greek literature offers some data on the VFT, heterogeneity was found in the instructions and the conditions applied [
36,
70,
74]. Therefore, the comparison of the results does not show homogeneity in terms of the linguistic and verbal features used, although they coincide significantly (64; 65; 70; 71]. In any case, we decided to present data related to age-classes and education-classes too, having in the mind that when our sample will be completed they may be revealed useful.
Regarding gender, no differences in both fluency tests’ performance were found between men and women. The following conclusion agrees with similar studies (32; 65; 72]. However, some research has observed that gender affected performance in some conditions, but not overall across the entire D-KEFS test [
63,
66]. In most studies, the heterogeneity of results by means of gender is not reported as a significant indication, as these differences may be due to cultural, linguistic, geographical differences as well as unweighted factors, and therefore they are not generalizable [
64,
73]. In specific, educational background between men and women is often observed to be non-homogeneous in data samples [
73].
Regarding DFT, results showed that age influences participants’ performance mainly in the Cond, in terms of both the number of correct and incorrect drawings as well as their repetitions. This result is consistent with the findings of Sanders & Schmitter-Edgecombe (2012) [
74], according to which age was found to negatively affect the performance of a healthy sample in the Cond. 3 of the test, comparing scores between young adults (18–33 years) and older adults (60-94 ετών). In the present study, we found a negative correlation of age as exact years of life with the production of correct drawings. Additionally, the study by Wecker et al. (2005) [
38] as well as Zhao et al. (2020) [
37] identified age as the only predictor of the reduction in the number of correct designs in the Cond. 3, accounting for 17.6% at the 0.01 α level, in a healthy American adult population [
38]. Moreover, recent findings by García-Escobar et al. (2021) [
39], found negative correlation between age and the total number of correct drawings, but only for adults over 50 years old. In detail, age was positively related with wrong drawings in the Cond. 3 (r = .214, n = 100, p < .005) as well as with decreased sum score of the design accuracy (r = .228, n = 100, p < .005). In fact, it is worth underlining that the 40-50 age group scored twice the number of incorrect plans in the Cond. 3 compared to younger age groups. On the contrary, the study of Woods et al. (2016) who used a digital version of DFT found that the number of unique drawings produced over 90 seconds by participants between 18 to 82 years was significantly correlated with age, education, and daily computer-use. However, our results are not totally comparable with this study, because they used a design fluency test other than D-KEFS DFT, whereas their data sample included participants in a larger age range. Furthermore, in our study a pencil and paper version of DFT was administered. Additionally, in the digital version of the design fluency test used in the study of Woods et al. (2016) [
57] each pattern disappears after being drawn (Woods et al., 2016). As a result, participants need to remember previous patterns to avoid repetitions, which increases the difficulty levels in relation to memory capacity.
In conclusion, the current study is the first attempt to evaluate executive functions, measured by verbal and design fluency tests in Greek adult population, since it is regarded as integral part of neuropsychological testing, whereas there are limited data for these age groups. Therefore, the adaptation of the D-KEFS VFT and DFT is crucial for their use in neuropsychological evaluation and the subsequent treatment of people who have neurological and also psychiatric conditions, when needed. Finally, having more accurate data regarding performance of the Greek older adult population on these two fluency tests, a researcher as well as a clinician can better differentiate impaired from non-impaired performance, and determine in a more efficient way the functional level of Greek adults on each condition. To conclude, the findings of the current study (in combination with other data) could contribute to the diagnosis and help the clinician setting tailored treatment goals and developing structured cognitive rehabilitation programs. Hence, the current study can be regarded as a significant addition to the relevant literature and therefore can be used in both research and clinical practice.