In table tennis competitions the rule violation judgment with the greatest controversy is the height of the ball serve. This is because inaccuracy in the ball height judgment, which results in erroneous judgment, is unavoidable. Thus, we designed an automatic image judgment auxiliary system for table tennis ball height during service in this study. We used a high-speed camera to record the ball toss in the table tennis service. The designed algorithm architecture can automatically search for the ball and the position of the hand action under low light source conditions. The algorithm is mainly divided into hue-saturation-value color space processing and morphology processing using Hough transform to search for the circular ball. Experiment result shows that color segmentation can successfully and accurately determine the ball position under low light conditions. The morphology method can find the position of the hand and help determine the moment when the ball leaves the hand during the service ball toss. Finally, the actual size of the target is used to estimate the actual distance unit represented by the image pixel.