Radar and video multimodal learning for human activity classification

Richard J. de Jong, Faruk Uysal, Matijs J.C. Heiligers, Jacco de Wit

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

5 Downloads (Pure)

Abstract

Camera systems are widely used for surveillance in the security and defense domains. The main advantages of camera systems are their high resolution, their ease of use, and the fact that optical imagery is easy to interpret for human operators. However, particularly when considering application in the defense domain, cameras have some disadvantages. In poor lighting conditions, dust or smoke the image quality degrades and, additionally, cameras cannot provide range information. These issues may be alleviated by exploiting the strongpoints of radar. Radar performance is largely preserved during nighttime, in varying weather conditions and in dust and smoke. Furthermore, radar provides range information of detected objects. Since their qualities appear to be complementary, can radar and camera systems learn from each other? In the current study, the potential of radar/video multimodal learning is assessed for the classification of human activity.
Original languageEnglish
Title of host publication2019 International Radar Conference (RADAR)
PublisherIEEE
Pages1-6
Number of pages6
ISBN (Electronic)978-1-7281-2660-9
ISBN (Print)978-1-7281-3785-8
DOIs
Publication statusPublished - 2020
Event2019 International Radar Conference - Toulon, France
Duration: 23 Sep 201927 Sep 2019
https://www.radar2019.org/

Conference

Conference2019 International Radar Conference
Abbreviated titleRadar-2019
CountryFrance
CityToulon
Period23/09/1927/09/19
Internet address

Keywords

  • human activity classification
  • micro-Doppler
  • multimodal learning
  • radar
  • video

Fingerprint Dive into the research topics of 'Radar and video multimodal learning for human activity classification'. Together they form a unique fingerprint.

Cite this