Beginning with navigation system design, this paper presents a comprehensive strategy for enhancing the search and rescue capabilities of agile mobile robots. Towards this, the autonomous ground vehicle (AGV) utilizes surface classification to determine and prioritize the terrain it is traversing. Our developed system design incorporates real-time terrain data with task objectives at a high level, ensuring that the robot can effectively navigate complex and ever-changing environments. This design, in conjunction with the introduction of a novel lightweight surface classification model, forms the basis of our adaptive terrain perception and decision-making systems, enabling robots such as Jackal to adapt rapidly and make the decisions necessary to complete the task. Subsequently, we exhaustively validated these systems through a series of extensive experiments in a variety of terrains, including normal and mixed terrains, demonstrating their robustness and efficacy in real-life situations.