To address the question whether there is evidence that drinking water in general or mineral water in particular is effective in preventing diabetes; we performed a literature search of randomized controlled trials (PubMed). The search resulted in very few trials (N = 9) investigating this topic: one trial investigates the effect of increasing water consumption on glycemic control in diabetic patients; two trials investigate the effect of drinking water with a meal in diabetic patients; while six trials compare the effect of mineral rich water with that of low mineralized water on glucose metabolism in healthy subjects. There is evidence that increasing water consumption can improve glucose metabolism and randomized controlled trials with mineral water suggest that waters containing relevant amounts of magnesium can exert an additional effect. The role of bicarbonate; which is present in all the mineral waters used in the trials; will be discussed. Future research needs to investigate the effect of mineral water in prediabetic individuals or individuals with impaired glycemic control.