Remote Sensing Change Detection (Segmentation) using Denoising Diffusion Probabilistic Models
Human civilization has an increasingly powerful influence on the earth
system, and earth observations are an invaluable tool for assessing and
mitigating the negative impacts. To this end, observing precisely defined
changes on Earth's surface is essential, and we propose an effective way to
achieve this goal. Notably, our change detection (CD)/ segmentation method
proposes a novel way to incorporate the millions of off-the-shelf, unlabeled,
remote sensing images available through different earth observation programs
into the training process through denoising diffusion probabilistic models. We
first leverage the information from these off-the-shelf, uncurated, and
unlabeled remote sensing images by using a pre-trained denoising diffusion
probabilistic model and then employ the multi-scale feature representations
from the diffusion model decoder to train a lightweight CD classifier to detect
precise changes. The experiments performed on four publically available CD
datasets show that the proposed approach achieves remarkably better results
than the state-of-the-art methods in F1, IoU, and overall accuracy. Code and
pre-trained models are available at: https://github.com/wgcban/ddpm-cd