Developing efficient Artificial Intelligence (AI)-enabled system to substitute human role in non-destructive testing is an emerging topic of considerable interest. In this study, we propose a novel impact-echo analysis system using online machine learning, which aims at achieving near-human performance for assessment of concrete structures. Current computerized impact-echo systems commonly employ lab-scale data to validate the models. In practice, however, the echo patterns can be far more complicated due to varying geometric shapes and materials of structures. To deal with a large variety of unseen data, we propose a sequential treatment for echo characterization. More specifically, the proposed system can adaptively update itself to approaching human performance in impact-echo data interpretation. To this end, a two-stage framework has been introduced, including echo feature extraction and the model updating scheme. Various state-of-the-art online learning algorithms have been reviewed and evaluated for the task. To conduct experimental validation, we collected 10,940 echo instances from multiple inspection sites with each sample had been annotated by human experts with healthy/defective condition labels. The results demonstrated that the proposed scheme achieved favorable echo pattern classification accuracy with high efficiency and low computation load.