To improve the effect of multi-point stretch forming of sheet metal, it is proposed in this paper to replace fixed ball head with swinging ball head. According to the multi-point dies with different arrangements, this research establishes the finite element models of the following stretch forming, i.e. fixed ball heads with conventional arrangement, swinging ball heads with conventional arrangement, swinging ball heads with declining staggered arrangement, and swinging ball heads with parallel staggered arrangement and then numerical simulation is performed. The simulation results show that by replacing fixed ball head with swinging ball head, the surface indentation of the formed part was effectively suppressed, the stress and tension strain distribution of the formed part was improved and the forming quality was improved; that the thickness of the elastic pad was reduced, the springback was reduced and the forming accuracy was improved; and that when the ball head was applied to multi-point die with staggered arrangement, better forming result was achieved, where the best forming result was achieved in combining the swinging ball heads with the multi-point die with parallel staggered arrangement. The forming experiments were carried out, and the experimental results were consistent with the trend of numerical simulation results, which verified the correctness of the numerical simulation.