Detecting darting out pedestrians with occlusion aware sensor fusion of radar and stereo camera

Research output: Contribution to journalArticleScientificpeer-review

7 Citations (Scopus)
65 Downloads (Pure)


Early and accurate detection of crossing pedestrians is crucial in automated driving in order to perform timely emergency manoeuvres. However, this is a difficult task in urban scenarios where pedestrians are often occluded (not visible) behind objects, e.g., other parked vehicles. We propose an occlusion aware fusion of stereo camera and radar sensors to address scenarios with crossing pedestrians behind such parked vehicles. Our proposed method adapts both the expected rate and properties of detections in different areas according to the visibility of the sensors. In our experiments on a real-world dataset, we show that the proposed occlusion aware fusion of radar and stereo camera detects the crossing pedestrians on average 0.26 seconds earlier than using the camera alone, and 0.15 seconds earlier than fusing the sensors without occlusion information. Our dataset containing 501 relevant recordings of pedestrians behind vehicles will be publicly available on our website for non-commercial, scientific use.

Original languageEnglish
Pages (from-to)1459-1472
JournalIEEE Transactions on Intelligent Vehicles
Issue number2
Publication statusPublished - 2023

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.


  • Automobiles
  • Cameras
  • Intelligent vehicles
  • Laser radar
  • Radar
  • Radar detection
  • Radar tracking


Dive into the research topics of 'Detecting darting out pedestrians with occlusion aware sensor fusion of radar and stereo camera'. Together they form a unique fingerprint.

Cite this