The new WHO Environmental Noise Guidelines for the European Region have recommendations for limiting noise exposure associated with adverse health effects. The limits are said to be based on a systematic review of existing evidence. This paper gives a systematic assessment of the presented evidence with respect to aircraft noise annoyance and demonstrates that the new guidelines are based on an arbitrary selection of existing studies comprising an imperfect and faulty set of data not representative for the general airport population.