The rapid development of multicopters has led to many security problems. In order to prevent multicopters from invading restricted areas or famous buildings, an Anti-UAV Defense System (AUDS) has been developed and become a research topic of interest. Topics under research in relation to this include electromagnetic interference guns for unmanned aerial vehicles (UAVs), high-energy laser guns, US military net warheads, and AUDSs with net guns. However, these AUDSs use either manual aiming or expensive radar to track UAVs. This paper proposes a dual-axis rotary platform with UAV automatic tracking. The tracking platform uses visual image processing technology to track and lock the dynamic displacement of a UAV. When a target UAV is locked, the system uses a nine-axis attitude meter and laser rangefinders to measure its flight altitude and calculates its longitude and latitude coordinates through sphere coordinates to provide UAV monitoring for further defense or attack missions. Tracking tests of UAV flights in the air were carried out using a DJI MAVIC UAV at a height of 30 meters to 100 meters. It was set up for UAV image capture and visual recognition for tracking under various weather conditions by a thermal imager and a full-color camera respectively. When there was no cloud during the daytime, the images captured by the thermal imager and full-color camera provide a high-quality image recognition result. However, under dark weather, black clouds will emit radiant energy and seriously affect the capture of images by a thermal imager. When there is no cloud at night, the thermal imager performs well in UAV image capture. When the UAV is tracked and locked, the system can effectively obtain the flight altitude and longitude and latitude coordinate values.