AutoMergeNet: AutoML-Based M-Source Satellite Data Fusion Evaluated With Atmospheric Case Studies
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 18, pp. 26613–26625
Abstract
Accurate detection of anomalous phenomena in satellite data often requires data layers containing complementary information (e.g., data from different sensors, auxiliary features such as land cover maps, and metadata regarding data quality). However, existing highly specialised approaches to fuse multiple data layers cannot be transferred to other related problems, as they rely on expert-selected features and manual pipeline design. In this work, we proposeAutoMergeNet, a framework for satellite image data fusion based on Neural Architecture Search (NAS). AutoMergeNet generates neural networks that fuse any number of raster data layers. Consequently, it can address different classification problems based on satellite images without manual pipeline design. We designed the search space of AutoMergeNet by identifying relevant design choices from the image classification and data fusion literature. AutoMergeNet automatically transforms image classification networks into multi-branch networks by optimising critical architectural and training hyperparameters. Since the high dimensionality of multimodal image data poses a challenge for data fusion problems with limited labels, we use an auxiliary unimodal classifier combined with AutoMergeNet. We evaluate AutoMergeNet on a methane plume detection dataset from the literature and our newly created carbon monoxide plume detection dataset. AutoMergeNet performs strongly and consistently on these two multimodal classification problems, outperforming six baseline methods selected from state-of-the-art image classification approaches. Finally, we demonstrate the usability of our framework with a realistic methane plume detection use case, which shows that AutoMergeNet can be used as a highly specialised, state-of-the-art approach.
Authors 8
-
Affiliation as printed
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Leiden, The Netherlands
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Netherlands
-
Space Research Organisation Netherlands
Affiliation as printed
SRON Space Research Organisation Netherlands, Leiden, The Netherlands
SRON Space Research Organisation Netherlands, Netherlands
-
Space Research Organisation Netherlands
Affiliation as printed
SRON Space Research Organisation Netherlands, Leiden, The Netherlands
SRON Space Research Organisation Netherlands, Netherlands
-
Space Research Organisation Netherlands
Affiliation as printed
SRON Space Research Organisation Netherlands, Leiden, The Netherlands
SRON Space Research Organisation Netherlands, Netherlands
-
Space Research Organisation Netherlands
Affiliation as printed
SRON Space Research Organisation Netherlands, Leiden, The Netherlands
SRON Space Research Organisation Netherlands, Netherlands
-
European Space Agency · European Space Research Institute
Affiliation as printed
Φ-Lab, ESA-ESRIN, Frascati, Italy
Π-Lab, ESAESRIN, Netherlands
-
Affiliation as printed
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Leiden, The Netherlands
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Netherlands
-
Affiliation as printed
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Leiden, The Netherlands
Leiden Institute for Advanced Computer Science (LIACS), Leiden University, Netherlands
Cited by 0 stored of 0
No patents citing this paper on Lens.org (checked 2026-10-11).