With the development of society and the economy, the unified planning of architectural style has become a difficult problem in the competition between urban expansion and the protection of tra-ditional buildings in villages and towns. At the same time, it also allows people to re-examine the appearance and quality of life of traditional village buildings. In this paper, the Conditional Gen-erative Adversarial Network (CGAN) is used to construct a method of building facade generation in villages and towns, so as to gradually realize the governance of the style of villages and towns. At the same time, it has also reduced the restoration of the facades of villages and towns and the graphic design of rural tourism products, showing its application value and potential in the field of planning and design. In the research, taking villages and towns in the Wuyishan area of China as an example, the method is used to carry out model training, image generation, and comparison of the derivation results of different assumed building contours and product contours. The research shows that: (1) CGAN can be used to derive and design the facades of conventional civil buildings in villages and towns. (2) In terms of product graphic design, especially the common tourist cultural products fans and water cups, show significant potential. (3) The construction of this method is not only applicable to villages and towns under the World Heritage City, but can be further promoted and used in the future for cities and villages that have a demand for architectural style consistency.