CoPR: Toward Accurate Visual Localization With Continuous Place-Descriptor Regression

Research output: Contribution to journalArticleScientificpeer-review

29 Downloads (Pure)

Abstract

Visual place recognition (VPR) is an image-based localization method that estimates the camera location of a query image by retrieving the most similar reference image from a map of geo-tagged reference images. In this work, we look into two fundamental bottlenecks for its localization accuracy: 1) reference map sparseness and 2) viewpoint invariance. First, the reference images for VPR are only available at sparse poses in a map, which enforces an upper bound on the maximum achievable localization accuracy through VPR. We, therefore, propose Continuous Place-descriptor Regression (CoPR) to densify the map and improve localization accuracy. We study various interpolation and extrapolation models to regress additional VPR feature descriptors from only the existing references. Second, we compare different feature encoders and show that CoPR presents value for all of them. We evaluate our models on three existing public datasets and report on average around 30% improvement in VPR-based localization accuracy using CoPR, on top of the 15% increase by using a viewpoint-variant loss for the feature encoder. The complementary relation between CoPR and relative pose estimation is also discussed.
Original languageEnglish
Pages (from-to)2825-2841
JournalIEEE Transactions on Robotics
Volume39
Issue number4
DOIs
Publication statusPublished - 2023

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • Continuous Place-descriptor Regression (CoPR)
  • pose estimation
  • visual localization (VL)
  • visual place recognition (VPR)

Fingerprint

Dive into the research topics of 'CoPR: Toward Accurate Visual Localization With Continuous Place-Descriptor Regression'. Together they form a unique fingerprint.

Cite this