Semantic segmentation of historical photographs of the Antarctica peninsula

Research output: Contribution to journalConference articleScientificpeer-review

14 Downloads (Pure)

Abstract

A huge archive of historical images of the Antarctica taken by the US Navy between 1940 and 2000 is publicly available. These images have not yet been used for large-scale computer-driven analysis as they were captured with analog cameras. They were only later digitized and contain no semantic information. Most modern deep-learning based semantic segmentation algorithms are trained on modern images and fail on these scanned historical images, due to varying image quality, lack of color information, and most crucially, due to artifacts in both imaging as well as scanning (e.g. Newton's rings). The analysis of such historic data can give a view on Antarctica's glaciers predating modern satellite imagery and provide a unique insight into the long-term impact of changing climate conditions with essential validation data for climate modelling. An important first step for analysis of such data is the extraction and localization of semantic information, e.g. where in the image is water, rocks, or snow. In this work we present the first deep-learning based method to perform semantic segmentation on historical imagery archives of the Antarctic Peninsula. Our results show that our method can handle very challenging images even after being trained with only a low number of training data and catch the general semantic meaning of a scene. For eight test images we achieve an accuracy of 74%, where the majority of errors can be explained by the classification of ice as snow.

Original languageEnglish
Pages (from-to)237-244
Number of pages8
JournalISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Volume5
Issue number2
DOIs
Publication statusPublished - 2022
Event2022 24th ISPRS Congress on Imaging Today, Foreseeing Tomorrow, Commission II - Nice, France
Duration: 6 Jun 202211 Jun 2022

Keywords

  • Antarctica
  • Cryospheric Images
  • Historic images
  • Machine Learning
  • Semantic Segmentation
  • U-Net

Fingerprint

Dive into the research topics of 'Semantic segmentation of historical photographs of the Antarctica peninsula'. Together they form a unique fingerprint.

Cite this