3.2.1. Graphical Methods
Two-variable scatterplots are useful to identify and illustrate the interactions of two input parameters.
Figure 6 shows two-variable scatterplots of the computed heads in 3 monitoring wells s (outputs ST1C
t2, PS19B
t2 and SPN1
t2) and the aquifer/reservoir flow (Q
t2) at time t2 corresponding the peak reservoir water level. The outputs are plotted versus the vertical conductivity of the aquitard (K
Vs1). These plots correspond to the 16 384 runs of the Sobol sequence. The clouds of plots are shown for the following three ranges of percentiles, p, of the specific storage coefficient (S
S): 1) p < 30%; 2) 30% < p < 70% and 3) p > 70%.
The scatterplots show that the computed heads and the aquifer/reservoir flow at time t2 depend on SS. Generally, the computed piezometric heads in wells ST1C and SPN1 at t2 are low for large SS (p > 70%). However, simulations corresponding to extreme values of other input parameters result in high piezometric heads even for high values of SS. On the other hand, the computed heads are higher when SS is in the lower percentile (p < 30%). It should be noticed that the well PS19B is located further away from the reservoir, and thus, its piezometric head is less affected by the interaction between KVs1 and SS.
The scatterplot of Qt2 shows three branches. The most negative flows, which correspond to aquifer discharge into the reservoir, at time t2 are associated with low values of SS (p < 30%) while the largest positive water flows (flow from the reservoir into the aquifer) occur for high SS values (p > 70%). The water flow oscillates from positive (aquifer recharge) to negative (aquifer discharge) for intermediate values of SS (30% < p < 70%). The amplitude of the oscillations of the piezometric heads in the aquifer, Ah, is inversely proportional to the value of the specific storage of the aquifer. When SS is low, Ah is large and the piezometric heads in the alluvial increase quickly and may rise above the reservoir water level, thus leading to groundwater discharge to the reservoir. On the other hand, when SS is large, Ah is small and the piezometric heads increase slowly. Here, piezometric heads can hardly rise above the reservoir water level during the events of rise of the reservoir water level, Then, the reservoir recharges the aquifer.
Figure 7 and
Figure 8 show CUSUNORO curves for computed heads in wells ST1C, PS19B and SPN1 at times t1, t2 and t3 and MAEg, NRMSEg, NSEg, Q
t1, Q
t2, Q
t3 and q
av.
From the CUSUNORO curves above, parameters K3 (green), Q2 (red), and K2 (orange) consistently exhibit the highest maximum absolute values across all hydraulic head plots, except for the hydraulic head at well SPN1, where parameters αr (yellow), KVs1 (brown) and Ss (purple) are more influential. Q6 (blue) and K1 (blue) typically show the lowest maximum absolute values. The most influential parameters across all performance metrics (MAEg, NRMSEg and NSEg) are K3, Q2, K2 and αr. Q6 and Ss exhibit lower values. Parameters αr, KVs1 and Q2 have the largest influence on the aquifer/reservoir fluxes except at time t2, Qt2. At time t2, Ss is the most influential parameter. Again, Q6 and K1 consistently show the smallest influences.
Q2, K3 and K2 have the highest influence on the average groundwater Darcy velocity modulus near well PS16C, while Q6 and Ss are the least influential parameters for this output.
Most of the CUSUNOTO curves do no show crossings of the x-axis. This attests the expected monotonicity of the outputs versus the input parameters. Some crossings of the x-axis are found in the curves of the least influential parameters, especially for Q6 and K1 (not shown here).
3.2.2. VARS Results
Figure 9 and
Figure 10 show the IVARS
50 indexes for the global mean absolute error (MAEg), and the average groundwater Darcy velocity modulus (q
av) as a function of the number of star centers. They also show the ranking of the input parameters and the robustness of ranking. It should be noticed that IVARS
50 achieves stable values after just 50 star centers, which amounts to 7700 runs. The largest sensitivity indexes for MAEg correspond to the aquifer hydraulic conductivity in material zone 3 (K3), the boundary inflow Q
2 which corresponds to groundwater flow coming from the Sardas landfill, the vertical conductivity of the silts (K
Vs1) and the aquifer/river conductance (α
r). IVARS
50 of the Darcy velocity, q
av, is largest for Q
2, K3 and K2. The rest of the parameters have much smaller indexes.
The robustness of ranking of input parameters K2, K3, SS, ru, and Q7 for both outputs is greater than 90% after 50 stars. However, for the rest of the input parameters, the robustness is smaller than 80 %, and, sometimes, not stable even after 200 stars. Input parameters αr and KVs1 are very influential for MAEg, but they show a robustness measure that ranges from 50 to 70 % after 100 star centers. Robustness does not directly increase with the number of star centers for some input parameters. This could be caused by interactions among SS, aquitard vertical conductivity KVs1 and aquifer/river conductance αr at some water level rise events. Another reason for the lack of stability of the robustness of rankings is that the least relevant input variables interfere with the calculation of sensitivity indexes of the most relevant parameters. However, the rankings of the most and the least significant input parameters are stable with just 50 star centers (7700 runs). Input parameters with intermediate influence are also well identified, despite not being ranked reliably.
Sample variograms along the directions of the 17 input parameters were computed for the piezometric heads in wells ST1C, PS19B and SPN1 at times t1, t2 and t3, the calibration metrics, the aquifer/reservoir fluxes at times t1, t2 and t3 and the average groundwater Darcy velocity modulus near well PS16C. Only a limited number of parameters are relevant for each output variance.
Figure 11 and
Figure 12 show the sample variograms along the directions of the 5 most influential parameters. VARS-TO, IVARS
50 and VARS-ABE metrics are computed from the variograms.
Figure 13 and
Figure 14 show the VARS-ABE, IVARS
50 and VARS-TO indexes for each output considering all the input parameters.
The most influential parameters for the computed head in well ST1C at times t1, t2 and t3 are K3 and Q2, followed by KVs1, αr and K2. The ranking in well PS19B is similar to the ranking in well ST1C. However, the sensitivity indexes of K3, K2 and Q2 in well ST1C are much larger than those of well PS19B. K3 is much more relevant than K2 in well ST1C while K2 and K3 have almost similar sensitivity indexes in well PS19B. The sensitivity indexes of the hydraulic conductivities depend on the location of the wells. Material zone 3 is the largest zone of the Sardas site. Material zone 2 is located between material zones 1 and 3. Material zone 1 is much smaller than the other two and is located just downstream the Sardas landfill. KVs1 is more influential for the head in well ST1C than for the well PS19B. ST1C is located right next to the reservoir maximum flood area and PS19B is located 135 m to the east of the reservoir. Tidal effects on the aquifer depend on the duration of the high reservoir level, its amplitude, and the distance to the reservoir. Likewise, the head in well PS19B is most sensitive to Q2 because this well is near the boundary just downstream the Sardas landfill.
The sensitivity indexes for the computed heads in well SPN1 differ from those of other monitoring wells because well SPN1 is near the Gállego riverbed. αr is the most influential parameter in well SPN1 followed by KVs1.
Despite not being an influential input, the relevance of SS for the computed heads in the monitoring wells increases from time t1 (low level) to time t2 (peak reservoir water level). The sensitivity indexes of SS decrease when the reservoir water level descends at time t3. The time change of the sensitivity of SS in well SPN1 is more significant than in wells ST1C and PS19B.
The most influential parameters for the calibration metrics (MAEg, NRMSEg and NSEg) are K3, K2 and Q2, followed by KVs1 and αr. Most of the monitoring wells are located in material zones 2 and 3 and near the boundary zone corresponding to Q2. Aquifer/reservoir and aquifer/river interactions affect the computed head gradient, tR and Ah. SS only affects the temporal variability of computed heads and not their average values. Since calibration metrics evaluate the average fit of the computed heads in the monitoring wells, the relevance of SS for the calibration metrics is very low compared to its relevance on the computed heads at specific times. SS is especially relevant during events of sudden rise of the reservoir water level.
To facilitate the interpretation of the sensitivities of reservoir/aquifer fluxes (Qt1, Qt2, Qt3), one should recall that the silting sediments (KVs1 and KVs2) are more permeable than alluvial silts (KVs3). Groundwater discharges mainly through the former course of the Gállego river, where only silting sediments confine the aquifer (KVs1). If the aquifer is less connected to the Gállego river (lower values of αr), groundwater discharges to the reservoir. On the other hand, if the aquifer and the river are more connected (higher values of αr), groundwater discharges to the reservoir and the river. As expected, the greater the inflow of water from the landfill (Q2), the more groundwater discharge to the reservoir.
The aquifer/reservoir groundwater flow changes with time due to the reservoir tidal effect. The most influential parameters for the aquifer/reservoir groundwater flow are also time dependent. K
Vs1 is the parameter with the largest sensitivity index at time t1 when the reservoir water level is low. The second influential parameter is the aquifer/river leakage coefficient, α
r. The boundary inflow Q
2 is the third most relevant parameter. However, when the reservoir water level rises suddenly rises at time t2, the parameter sensitivities change. The most influential parameter becomes S
S followed by K
Vs1. We recall that in the model reference run [
38], there is flow from the reservoir into the aquifer when the reservoir water level rises above the piezometric head in the aquifer. If the specific storage of the aquifer is high, a larger part of the flow coming from the reservoir is stored in the aquifer, which results in a smaller rise of the piezometric head in the aquifer.
The reservoir flood area depends on its water level, so when the water level rises at time t2, the area where the alluvial silts confine the aquifer underneath the reservoir increases. The areas of the reservoir away from the former course of the Gállego river are assumed to be confined by both silting sediments (KVs2) and alluvial silts (KVs3). The relevance of KVs3 increases slightly when the reservoir floods more parts of the alluvial, but its relevance is still much smaller than those of KVs1 and SS. When the water level of the reservoir descends at time t3, the parameter sensitivities tend to be similar to those of Qt1. For Qt3, the sensitivity of KVs1 is much larger than those of αr and Q2. The sensitivity of SS remains, but it is much less relevant than for Qt2,
The most influential parameters for the average modulus of the Darcy velocity (qav) near well PS16C are Q2, K3 and K2. K1 is slightly relevant, and the contribution of the rest of the parameters is negligible. Darcy velocity in the aquifer mainly depends on the boundary inflow Q2 because this well is located in material zone 3 and near the boundary downstream the Sardas landfill.
The sensitivity indexes of S
S are time dependent for the computed heads in the wells, and the aquifer/reservoir fluxes (
Figure 15). When the reservoir water level rises above the piezometric head in the aquifer at time t2, the reservoir starts recharging the aquifer, and the piezometric head in the alluvial starts rising. If the specific storage is small, the amplitude of the oscillation of the piezometric head increases. This affects especially the aquifer/reservoir fluxes (Q
t1, Q
t2 and Q
t3). The sensitivities of the computed head in well SPN1, located near the Gállego river, are largest for α
r and K
Vs1 and S
S at time t2.
On the other hand, well ST1C is closest to the reservoir and further away from the Gállego river. In this well the sensitivity index of SS is smaller than in well SPN1. Finally, the sensitivity of the head in well PS19B to SS is irrelevant because the well is far away from the Gállego river and the reservoir flood area.
The IVARS
50 sensitivity indexes for calibration metrics, MAEg, NRMSEg and NSEg are very similar (
Figure 16). The most influential parameters are the same for all the metrics. The rankings show some slight differences. Input ranking for the MAEg is K3, Q
2, α
r, K2 and K
Vs1, while α
r and K2 switch places for NRMSEg and NSEg. NRMSEg and NSEg are more prone to the presence of outliers because their formulas include squared residuals.
Sensitivity indexes are large for K3, Q2, αr, K2 and KVs1. Some input variables have very small sensitivity indexes.
3.2.3. HDMR Results and Analysis of Interactions for the Sobol Sequence
Tables S1 to S23 in the SM show the values of the first order (main effects), S
i, and 2
nd order effects, S
ij, calculated with SALib [
63] and GUI-HDMR [
64] and the parameter ranking for: (1) The computed piezometric heads in wells PS19B, SPN1 and ST1C at times t1, t2 and t3; (2) The global mean absolute error (MAEg); (3) The global Nash–Sutcliffe index (NSEg); (4) The global normalized root mean squared error (NRMSEg); (5) The average groundwater Darcy velocity modulus near well PS16C (q
av); and (6) The computed aquifer/reservoir fluxes at times t1, t2 and t3 (Q
t1, Q
t2 and Q
t3) by using 16 384 runs.
HDMR lower bound estimates for the total effects, (Si + Sij), are compared to the VARS intervals of the total effects for each parameter. SALib and GUI-HDMR indexes generally agree, although they show some small differences. The analysis of the interactions among parameters is an important part of the global sensitivity analysis. Interactions represent the joint influence of parameters on the model outputs. Usually, interactions are revealed when the sum of the Sobol’s 1st order indexes are significantly smaller than 1.
In the next paragraphs the Sobol based lower bound estimates for the total effects will be denoted simply as “total effects” to shorten the presentation of the HDMR results. The largest main effect S
i for the piezometric head in well ST1C at time t1 is equal to 0.242 and corresponds to K3 (see
Table S1 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.644. The total effects of the piezometric head in well ST1C at time t1 are slightly larger than 1 (see
Table S1 in SM). Second order effects for this output are important especially due to the interaction between K3 and K2. Interactions of smaller relevance occur between Q
2 and K3, between K
Vs1 and α
r, and between Q
2 and K2. Sobol total effects S
Ti are typically larger and fall outside the ranges of the VARS total effects.
The largest main effect S
i of the piezometric head in well ST1C at time t2 is equal to 0.194 and corresponds to K3 (see
Table S2 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.628. The total effects of the piezometric head in well ST1C at time t2 are slightly larger than 1 (see
Table S2 in SM). Second order effects here are relevant especially due to the interaction between Q
2 and K3. There are also interactions of smaller relevance between K3 and K2, between K
Vs1 and α
r, and between Q
2 and K2. Sobol total effects S
Ti and those of VARS generally agree, although they show some discrepancies especially for the K1 and r
u.
The largest main effects S
i for the piezometric head in well ST1C at time t3 correspond to K3 and Q
2 (see
Table S3 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.644. The total effects of the piezometric head in well ST1C at time t3 are equal to 1.223 (see
Table S3 in SM). Second order effects for this output are relevant due to interactions of K3 with K2 and Q
2, and K
Vs1 with α
r. The Sobol total effects S
Ti generally fall within the intervals of VARS total effects.
The largest main effects S
i for the piezometric head in well PS19B at time t1 correspond to Q
2, K3 and K2 (see
Table S4 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.71. The total effects S
Ti for the piezometric head in well PS19B at time t1 are slightly greater than 1 (see
Table S4 in SM). Second order effects here are relevant especially due to the interactions among Q
2, K3 and K2. The total effects S
Ti fall within the intervals of VARS total effects.
The largest main effects S
i for the piezometric head in well PS19B at time t2 correspond to Q
2, K2, and K3 (see
Table S5 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.699. The total effects S
Ti for the piezometric head in well PS19B at time t2 are slightly greater than 1 (see
Table S5 in SM). Second order effects for this output are important especially due to the interaction between Q
2 and K2. There are also interactions of smaller relevance between Q
2 and K3, between K3 and K2, and between α
r and K
Vs1. The Sobol total effects S
Ti are typically larger and fall outside the ranges of the VARS total effects.
The largest main effect S
i for the piezometric head in well PS19B at time t3 corresponds to Q
2. K2 and K3 are in second and third position (see
Table S6 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.703. Second order effects for this output are important especially due to the interaction between Q
2 and K2. There are also interactions of smaller relevance between Q
2 and K3, between K3 and K2, and between α
r and K
Vs1. The Sobol total effects S
Ti are generally larger and out of the intervals of the VARS estimates.
α
r shows the largest main effect S
i for the piezometric head in well SPN1 at time t1 which is equal to 0.394. The second largest effect corresponds to K
Vs1 (see
Table S7 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.69. The total effects of the piezometric head in well SPN1 at time t1 are close to 1 (see
Table S7 in SM). Second order effects for this output are relevant especially due to the interaction between Q
2 and K3. The Sobol total effects S
Ti are overall higher and beyond the limits of the VARS estimates.
The largest main effects S
i for the piezometric head in well SPN1 at time t2 correspond to α
r and S
S (see
Table S8 in SM). The sum of the Sobol’s 1
st order indexes is equal to 0.655. The total effects of the piezometric head in well SPN1 at time t2 are slightly larger than 1 (see
Table S8 in SM). Second order effects for this output are relevant especially due to the interaction between α
r and K
Vs1. There are also smaller interactions of Q
2 with K3 and with α
r. The Sobol total effects are generally larger and out of the intervals of the VARS estimates.
The largest main effects S
i for the piezometric head in well SPN1 at time t3 correspond to α
r and K3 (see
Table S9 in SM). The sum of the Sobol 1
st order indexes is equal to 0.679. The total effects of the piezometric head in well SPN1 t3 are close to 1 (see
Table S9 in SM). Second order effects are relevant mainly due to the interaction between α
r and K
Vs1, and to a lower extent to the interactions of Q
2 with K3 and α
r. The Sobol total effects are generally larger and out of the intervals of the VARS estimates.
The largest main effects S
i for the global mean absolute error correspond to K3, Q
2 and α
r (see
Tables S10 and S11 in SM). The sums of Sobol’s 1
st order indexes calculated with SALib and GUI-HDMR are equal to 0.682 and 0.734, respectively. The total effect of the global mean absolute error computed with SALib is equal to that of GUI-HDMR (see
Tables S10 and S11 in SM). Second order effects for this output are important especially due to the interactions between Q
2 and K3 and between K3 and K2. There are also interactions of smaller relevance between α
r and K
Vs1, and between Q
2 and K2. The SALib total effects S
Ti fall within the intervals of VARS estimates or are slightly larger than VARS total effects.
K3 shows the largest main effect S
i for the global normalized root mean squared error which is equal to 0.245 (SALib). The second largest effect corresponds to Q
2 (see
Tables S12 and S13 in SM). The sums of the Sobol’s 1
st order indexes calculated with SALib and GUI-HDMR are equal to 0.675 and 0.731, respectively. The total effects of the global normalized root mean squared error are close to 1 (see
Tables S12 and S13 in SM). Second order effects for this output are relevant especially due to the interaction between K3 and K2, and between Q
2 and K3. The total effects S
Ti from SALib are either within the ranges of VARS estimates or slightly exceed the VARS total effects.
The largest main effect S
i for the global Nash–Sutcliffe index corresponds to K3. Q
2 and K2 are in second and third position (see
Tables S14 and S15 in SM). The sums of the Sobol’s 1
st order indexes calculated with SALib and GUI-HDMR are equal to 0.411 and 0.477, respectively. The total effect of the global Nash–Sutcliffe index computed with SALib is smaller than that of GUI-HDMR (see
Tables S14 and S15 in SM). Second order effects for this output are important especially due to the interaction between Q
2 and K3. There are also interactions of smaller relevance between K3 and K2, between Q
2 and K2, and between α
r and K
Vs1. The SALib total effects S
Ti fall within the intervals of VARS estimates or are slightly larger than VARS total effects.
The largest main effects S
i for the computed aquifer/reservoir flux at time t1 correspond to K
Vs1 and α
r (see
Tables S16 and S17 in SM). The sums of the Sobol’s 1
st order indexes calculated with SALib and GUI-HDMR are equal to 0.716 and 0.746, respectively. The total effects of the computed aquifer/reservoir flux at time t1 are close to 1 (see
Tables S16 and S17 in SM). The second order effects for this output are significant, particularly because of the interactions of K
Vs1 with α
r, Ss, Q
2 and K3. Additionally, there are less significant interactions between α
r and K3, and between α
d and K4. The Sobol total effects S
Ti calculated by SALib are overall higher than the VARS estimates.
The largest main effect S
i for the computed aquifer/reservoir flux at time t2 is equal to 0.362 (SALib) and corresponds to S
S (see
Table S18 in SM). The sums of the Sobol’s 1st order indexes calculated with SALib and GUI-HDMR are equal to 0.514 and 0.469, respectively. The total effects of the computed aquifer/reservoir flux at time t2 are greater than 1 (see
Tables S18 and S19 in SM). For this output, the second order effects are notable, mainly due to the interaction between S
S and K
Vs1. Sobol total effects S
Ti and those of VARS estimates show clear discrepancies, especially for K1, K2 and Q
7.
The largest main effect S
i of the computed aquifer/reservoir flux at time t3 is equal to 0.626 (SALib) and corresponds to K
Vs1 (see
Table S20 in SM). The sums of the Sobol’s 1st order indexes calculated with SALib and GUI-HDMR are 0.812 and 0.819, respectively. The total effects of the computed aquifer/reservoir flux at time t3 are close to 1 (see
Tables S20 and S21 in SM). Second order effects for this output are relevant to the interactions of K
Vs1 with α
r, Ss, Q
2, K
Vs3, K4 and K3. The Sobol total effects S
Ti are generally larger and out of the intervals of the VARS estimates.
The largest main effects S
i for the average modulus of the Darcy velocity near well PS16C correspond to Q
2 and K3 (see
Tables S22 and S23 in SM). The sums of the Sobol’s 1
st order indexes calculated with SALib and GUI-HDMR are equal to 0.855 and 0.861, respectively. The total effects of the average modulus of Darcy velocity are slightly larger than 1 (see
Tables S22 and S23 in SM). Second order effects for this output are relevant to the interaction between Q
2 and K3. There are also smaller interactions between Q
2 and K2, and between K3 and K2. The Sobol total effects S
Ti are generally slightly larger and out of the intervals of the VARS total effects.
The 1
st and 2
nd order interactions among input parameters can also be presented visually through heatmaps.
Figure S1 in SM shows the heatmaps of the 1
st and 2
nd order HDMR Sobol effects for all the outputs. The analysis of the heatmaps confirms that: (1) The largest components correspond to the main effects (which have been conveniently located along the diagonal of each of the maps); and (2) Off-diagonal terms corresponding to the 2
nd order effects are important for all input variables, especially the global Nash–Sutcliffe index and groundwater flow between aquifer and reservoir at time t2 due to the interactions between Q
2 and K3 and between Ss and K
Vs1.