Measurement instrument for TQM practices
Although many studies have examined total quality management, we found that no measurement instrument has validity and reliability of all components of TQM that we describe here. To fill this gap, we did not use a measurement instrument from any single study, but preferred to create a unique one.
To construct the measurement instrument, we applied the methodology to develop measurement scales in social sciences [
62]. In general, the procedure that allows one to move from the concept to its measurement requires a four-stage process: 1) literary definition of the concept, 2) specification of dimensions, 3) selection of observed indicators, and 4) synthesis of indicators or elaboration of indexes.
TQM practices that were determined as management leadership, decision making, process management, continuous improvement, employee involvement, supplier relations and customer focus were derived from the quality management principles based on the ISO 9001:2000 quality assurance system.
To measure these TQM practices, items were generated based on the literature and interview with people from the healthcare industry. In determining questionnaire items from the literature, some questions were not applicable to implementing TQM for hospitals, as they were used in research for industrial context. Therefore, a group consisting of doctors, nurses, and administrative employees of hospitals brainstormed ways in which the questions could be integrated into the hospital context. Their experiences and notions contributed to the process of preparing the questionnaire.
Management leadership factor items were customized from the studies of Cua, McKone and Schroeder [
63]; decision-making factor items were adapted from Cua et al. [
63], Fuentes-Fuentes et al. [
64], Saraph, Benson and Schroeder [
65]; process management factor items were taken from the studies of Cua et al. [
63], Kaynak [
49]; continuous improvement factor items were drawn from the studies of Kaynak [
49], Rahman and Bullock [
66], Fuentes-Fuentes et al. [
64]; employee involvement factor items were adapted from the studies of Cua et al. [
63], Rahman and Bullock [
66], Fuentes-Fuentes et al. [
64]; supplier relations factor items were drawn from the studies of Kannan and Tan [
47], Rahman and Bullock [
66] and customer focus factor items were adapted from the studies of Rahman and Bullock [
66], Fuentes-Fuentes et al. [
64], Chong and Rundus [
67].
Effects of TQM practices on performance was evaluated in two dimensions as operational performance and financial performance. Operational performance factor items were adapted from the studies of Kaynak [
49] and Fuentes-Fuentes et al. [
64], whereas financial performance factor items were taken from the studies of Fuentes-Fuentes et al. [
64]. Fifty items were assessed using a 5-point Likert scale. Respondents indicated their disagreement (1 = strongly disagree) or agreement (5 = strongly agree) on TQM practices, operational and financial performance of hospitals.
Sample demographics
The sample of this study includes administrative and medical employees of hospitals. The cross-sectional survey methodology was implemented in 32 hospitals. To increase the response rate, the confidentiality of the responses was guaranteed. A total of 1,069 questionnaires were correctly completed and collected from 26 public and 6 private hospitals.
Among these, 69,1% (739) of the employees were from the public hospitals, and 30,9% (330) of the employees were from private hospitals. The size of these hospitals ranged from 50-2,300 employees. Approximately 71,6% (765) of the respondents were positioned in hospitals that employed 200-1,100 employees. These hospitals served in both regional (35,5%) and national (63,3%) areas.
Statistical analysis
For analysis, we used the statistic software program AMOS 5.0. First, all of the 50 items were included in the analysis to form a scale of TQM practices, financial, performance, and operational performance. We referred to Cronbach’s alpha to assure reliability of variables. As a result of the analysis, the Cronbach’s alpha value was high at 0,925. Second, we looked at the corrected inter-item correlation. It was found that the resulting values were 0,500 and above, except for one item (0,418), CF5 (“Managers and supervisors encourage patient satisfaction development activities”). According to these findings, variable CF5 was removed from the scale.
The specified structural validity of TQM practices, financial performance and operational performance instrument consisted of 49 items in nine basic components as a result of the principal component analysis. In the data reduction procedure, items having eigen-values greater than 1 were used to determine the number of factors in the data set. Principal component analysis was applied with promax rotation to identify key TQM practices, financial performance, and operational performance factors. Factor loadings of these variables that we took into account were 0,500 and above (0,630-0,964). According to the principal component analysis, the Kaiser-Meyer-Olkin measurement of sampling adequacy is 0,964.
Table 1.
Model Purification Process.
Table 1.
Model Purification Process.
Factor name |
Reason for Elimination |
CMIN/df |
GFI |
AGFI |
NFI |
IFI |
TLI |
CFI |
RMSEA |
CF5 |
Eliminated in EFA |
3,937 |
,848 |
,829 |
,888 |
,914 |
,907 |
,914 |
,052 |
PM6 |
SR |
3,800 |
,859 |
,841 |
,894 |
,920 |
,913 |
,914 |
,051 |
PM7 |
SR |
3,743 |
,863 |
,845 |
,898 |
,923 |
,916 |
,923 |
,051 |
RS1 |
SR |
3,738 |
,865 |
,847 |
,900 |
,925 |
,918 |
,925 |
,051 |
OQP1 |
MI; SR |
3,503 |
,877 |
,861 |
,908 |
,932 |
,926 |
,932 |
,048 |
OQP7 |
MI; SR |
3,374 |
,884 |
,867 |
,912 |
,936 |
,930 |
,936 |
,047 |
EI1 |
MI; SR |
3,298 |
,889 |
,873 |
,915 |
,939 |
,933 |
,939 |
,046 |
DM1 |
MI; SR |
3,230 |
,895 |
,879 |
,919 |
,943 |
,937 |
,943 |
,046 |
OQP2 |
MI; SR |
3,072 |
,902 |
,886 |
,924 |
,948 |
,942 |
,948 |
,044 |
L1 |
MI; SR |
2,979 |
,907 |
,891 |
,929 |
,952 |
,946 |
,951 |
,043 |
DM2 |
MI |
2,975 |
,910 |
,894 |
,931 |
,953 |
,948 |
,953 |
,043 |
OQP9 |
SR |
2,950 |
,913 |
,897 |
,934 |
,955 |
,950 |
,955 |
,043 |
CF 1 |
MI; SR |
2,886 |
,918 |
,937 |
,957 |
,958 |
,952 |
,958 |
,042 |
To assess the validity and reliability of the scale developed for this study, the following analyses suggested by Bagozzi and Philips [
68] were used: content validity, unidimensionality, reliability, convergent validity, discriminant validity, and predictive validity.
Confirmatory factor analysis (CFA) was used to test model fitness. CFA is the most well-known statistical procedure used to test the structures with factorial component generated by establishing hypotheses. Model fitness was evaluated based on multiple fit indexes. In the framework of the CFA procedure, the chi-square statistic is the most popular index to evaluate goodness of fit between the specified and actual models. Wheaton et al. [
69] suggested that the researcher also compute a relative chi-square (χ
2/df). They suggested a ratio of approximately five or less as reasonable. This ratio indicates that the null model and data are appropriate with one another [
70]. In our experience, however, the ratio of chi-square (χ
2 ) to degrees of freedom (df) fell in the range of 2 to 1 or 3 to 1 indicated an acceptable fit between the hypothetical model and the sample data [
71].
Because of the sensitivity of the chi-square test to the sample size, however, insufficient sample size makes it difficult to find existing differences between the groups and deviations from multiple variables normality. We therefore used multiple fit indexes to reduce measurement errors.
Goodness of fit indexes (GFI) were used determine the model fit when measuring the fitness of the entire model. The GFI indicates the relative quantity of variance and covariance described in common. The adjusted goodness of fit index (AGFI) differs from GFI. AGFI adjusts to the number of degrees of freedom (df) in the model. AGFI and GFI values measured between 0,80 and 0,89, indicating a moderate fit, whereas values measured above 0,90 indicated a good fit [
72].
The comparative fit index (CFI) indicates the fitness of the tested model and assumed model with one another [
73]. The normal fit index (NFI) and incremental fit index (IFI) evaluate the degree of the freedom of the evaluated model relative to the initial model [
74]. An IFI value close to 1 indicates a very good fit [
75]. The typical range for TLI lies between 0 and 1, but is not limited to that range. A TLI value close to 1 indicates a very good fit.
The following findings were obtained as a result of the fitness analysis of the initial and last model as a result of principal component analysis is displayed in (
Table 2).
To assess the reliability, Cronbach’s alpha coefficient and composite reliability scores were calculated (
Table 2). According to critical levels indicated by Fornell and Larcker [
76] and Nunnaly [
77], scales showed acceptable levels of reliability because the Cronbach’s alpha coefficient and composite reliability scores were greater than ,70. Factor loadings shown in (
Table 2) are large and all significant (
p < 0,01) providing evidence for convergent validity. Shared variance between pairs of latent factors in the structural measurement model were compared with AVE scores that were calculated for each component of pairs to evaluate the discriminant validity [
76]. Average variance extracted was found to be greater, signaling the discriminant validity.
Inter-correlations among variables are represented in (
Table 3) with means and standard deviations (SD). The highest mean is 3,94, which reflects customer focus; the lowest mean is 3,20, which reflects employee involvement. The standard deviations of all variables are higher than ,70. Pearson correlations are indicated in
Table 3. Notably, Cronbach’s alpha values are higher than Pearson correlation coefficients for all variables. This is important for construct validity, which evaluates how each item is measured on the scale. Thus, the instrument has convergent and discriminates validities, satisfying construct validity [
49]. On the other hand, we also consider that the instrument has content validity too. This is because they were incorporated based on quality management principles of ISO 9001:2008 quality management system, and the scale items were gathered from a literature review.
We tried to find the best fitting model based on structural equation modeling. Relationships among the variables are represented in (
Figure 2). Among the seven TQM practices, management leadership, decision making, continuous improvement, customer focus, and supplier relations were significantly related to operational performance. On the other hand, only customer focus and process management were significantly related to financial performance.