Preprint Article Version 1 This version is not peer-reviewed

FFA: Foreground Feature Approximation Digitally Against Remote Sensing Object Detection

Version 1 : Received: 15 July 2024 / Approved: 15 July 2024 / Online: 16 July 2024 (03:11:43 CEST)

How to cite: Zhu, R.; Ma, S.; He, L.; Ge, W. FFA: Foreground Feature Approximation Digitally Against Remote Sensing Object Detection. Preprints 2024, 2024071195. https://doi.org/10.20944/preprints202407.1195.v1 Zhu, R.; Ma, S.; He, L.; Ge, W. FFA: Foreground Feature Approximation Digitally Against Remote Sensing Object Detection. Preprints 2024, 2024071195. https://doi.org/10.20944/preprints202407.1195.v1

Abstract

In recent years, research on adversarial attack techniques for remote sensing object detection (RSOD) has made great progress. Still, most of the research nowadays is on end-to-end attacks, which mainly design adversarial perturbations based on the prediction information of the object detectors (ODs) to achieve the attack. These methods do not discover the common vulnerabilities of the ODs and thus the transferability is weak. Based on this, this paper proposes a foreground feature approximation (FFA) method to generate adversarial examples (AEs) that discover the common vulnerabilities of the ODs by changing the feature information carried by the image itself to implement the attack. Specifically, firstly, the high-quality predictions are filtered as attacked objects using the detector, after which a hybrid image without any target is made, and the hybrid foreground is created based on the attacked targets. The images' shallow features are extracted using the backbone network, and the features of the input foreground are approximated towards the hybrid foreground to implement the attack. In contrast, the model predictions are used to assist in realizing the attack. In addition, we have found the effectiveness of FFA for targeted attacks, and replacing the hybrid foreground with the targeted foreground can realize targeted attacks. Extensive experiments with seven rotating ODs on the RSOD datasets DOTA and UCAS-AOD show that FFA achieves both targetless and targeted attacks with a high success rate and transferability.

Keywords

adversarial attack; feature approximation; remote sensing; object detection

Subject

Computer Science and Mathematics, Computer Vision and Graphics

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.