Camera-and LiDAR-based Person Re-Identification

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

In this paper, we introduce a novel method for creating appearance embeddings to identify individual persons using an object re-identification (ReID) framework. We present CLFormer (Camera LiDAR Transformer), a transformer-based architecture that incorporates multi-modal data from both camera and LiDAR sensors. We introduce the 3D Cuboid-Inclusive Point Embedding (3D-CIPE), which leverages rich data from LiDAR point clouds and 3D cuboids to add a learnable embedding into the transformer structure. Additionally, through ablation studies, we explore and analyze various strategies for the early and late fusion of multi-modal input data. To evaluate our proposed CLFormer, we reinterpret the nuScenes dataset [1] for ReID purposes and use it for our experiments. Our method demonstrates a significant improvement in performance, outperforming the image-only baseline with an increase of 2.3 in mean Average Precision (mAP).
Original languageEnglish
Title of host publicationProceedings od the 36th IEEE Intelligent Vehicles Symposium, IV 2025
PublisherIEEE
Pages1408-1414
Number of pages7
ISBN (Electronic)979-8-3315-3803-3
DOIs
Publication statusPublished - 2025
Event36th IEEE Intelligent Vehicles Symposium, IV 2025 - Cluj-Napoca, Romania
Duration: 22 Jun 202525 Jun 2025

Publication series

NameIEEE Intelligent Vehicles Symposium, Proceedings
ISSN (Print)1931-0587
ISSN (Electronic)2642-7214

Conference

Conference36th IEEE Intelligent Vehicles Symposium, IV 2025
Country/TerritoryRomania
CityCluj-Napoca
Period22/06/2525/06/25

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/publishing/publisher-deals
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Fingerprint

Dive into the research topics of 'Camera-and LiDAR-based Person Re-Identification'. Together they form a unique fingerprint.

Cite this