Învățarea cu eșantioane adversariale pentru imagini satelitare multispectrale / Learning with adversarial samples for Earth observation multi-spectral images

Thanks to the impressive computational capabilities of deep learning (DL), it offers numerous advantages and delivers outstanding results in the realm of earth observation (EO) image processing. Given the intricate nature and high dimensionality of remote sensing (RS) images, attempting to analyze this data without the aid of DL becomes an insurmountable challenge. Nonetheless, leveraging DL for EO images comes with its fair share of challenges. This study proposes novel solutions for mitigating the adversarial sample issue in RS image classification. Four strategies are introduced: Active Learning, Query-by- Example, Physics-aware deep models, and Synthetic data via Generative Adversarial Networks (GANs). Active Learning strategically selects informative samples to enhance the model’s performance. This approach allows the model to learn from data that it is uncertain about, thus improving decision-making. Query-by-Example aims to find the most similar image to a given query and optimize the network’s weights to separate adversarial samples from the query image in the latent space. This approach results in the model focusing on normal samples while identifying adversarial ones as outliers. Another noteworthy approach gaining popularity in RS research is Physics- aware deep models. These models incorporate the physical properties of EO data, guiding deep neural networks to better cluster and understand the data. By leveraging physical knowledge during the learning process, the model becomes more trustworthy and resilient against adversarial attacks. The final approach involves the use of GANs for generating synthetic satellite images to make the classifier robust against adversarial. GANs address the adversarial issue by training two sub-models in an adversarial learning framework.