Woody vegetation in farmland acts as a carbon sink and provides ecosystem services for local people, but no macro-scale assessments of the impact of management and climate on woody cover exists for drylands. Here we make use of very high spatial resolution satellite imagery to derive wall-to-wall woody cover patterns in tropical West African drylands. In arid and semi-arid Sahel, areas of more people are associated with more trees: mean woody cover is greater in farmlands (12%) than in savannas (6%), and likewise it is higher close to villages than further away. In sub-humid savannas of West Africa, woody cover is generally above 20% and decreases with increasing population density, but remains around 15% in farmlands, independent of rainfall. In the region as a whole, rainfall, terrain and soil are the most important (80%) determinants of woody cover, while management factors play a smaller (20%) role. We conclude that agricultural expansion cannot generally be claimed to cause woody cover losses, and that observations in Sahel contradict simplistic ideas of a high negative correlation between population density and woody cover.