Article
Version 1
Preserved in Portico This version is not peer-reviewed
Combining KAN with CNN: KonvNeXt's Performance in Remote Sensing and Patent Insights
Version 1
: Received: 8 July 2024 / Approved: 8 July 2024 / Online: 9 July 2024 (13:05:07 CEST)
How to cite: Cheon, M.; Mun, C. Combining KAN with CNN: KonvNeXt's Performance in Remote Sensing and Patent Insights. Preprints 2024, 2024070663. https://doi.org/10.20944/preprints202407.0663.v1 Cheon, M.; Mun, C. Combining KAN with CNN: KonvNeXt's Performance in Remote Sensing and Patent Insights. Preprints 2024, 2024070663. https://doi.org/10.20944/preprints202407.0663.v1
Abstract
The rapid advancements in satellite technology have led to a significant increase in high-resolution remote sensing (RS) images, necessitating advanced processing methods. Additionally, a patent analysis revealed a significant increase in deep learning and machine learning applications in remote sensing, highlighting the growing importance of these technologies. Therefore, this paper introduces the Kolmogorov-Arnold Network (KAN) model to remote sensing, aiming to enhance efficiency and performance in RS applications. We conducted several experiments to validate KAN's applicability, starting with the EuroSAT dataset, where we combined the KAN layer with multiple pretrained CNN models. The optimal performance was achieved with ConvNeXt, leading to the development of the KonvNeXt model. KonvNeXt was evaluated on the Optimal-31, AID, and Merced datasets for validation, and it achieved accuracies of 90.59%, 94.1%, and 98.1%, respectively. The model also showed fast processing speed, with the Optimal-31 and Merced datasets completed in 107.63 seconds each, while the bigger and more complicated AID dataset took 545.91 seconds. This result is meaningful since it achieved faster speeds and comparable accuracy compared to the existing study which utilized VIT and proved KonvNeXt's applicability for remote sensing classification tasks. Furthermore, we investigated the model's interpretability by utilizing Occlusion Sensitivity and by displaying the influential regions, it validated its potential use in a variety of domains including medical imaging and weather forecasting. This paper is meaningful in that it is the first use of KAN in remote sensing classification, proving its adaptability and efficiency.
Keywords
ConvNeXt; Kolmogorov-Arnold Network (KAN); KonvNeXt; Occlusion Sensitivity; Remote Sensing, Satellite Technology
Subject
Computer Science and Mathematics, Computer Vision and Graphics
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment
