Grazing exclusion (GE) and rest grazing (RG) are important management to restore grassland ecosystems. In order to evaluate the effects and mechanisms of different grazing management on species diversity, vegetation community indices and soil variables were determined in the plots of Qilian Mountains in Gansu Province. The results showed that diversity effects and their regulating mechanisms had space-scale dependence under different grazing management. Species richness and species diversity indices of RG in grassland were significantly higher than that of GE at the regional scale. Additionally, three grazing management in mountain meadows had only a significant effect on species richness, but different management in mountain meadows and temperate steppes had a significantly different effect on species diversity indices. Meanwhile, soil variables only influenced species diversity at the regional scale. Most of community and soil variables at each scale had positive effects on species diversity, except that the direction of biodiversity effects was negative for species coverage, mean plant height, soil porosity (SK) and bulk density (BD) under two contrasting grazing management. In conclusion, choosing RG at the regional scale and select grazing management according to different grassland types at the local scale to restore degraded grassland vegetation.