Multipath Exploitation for Human Activity Recognition using a Radar Network

In this study, the problem of multipath in radar sensor networks for human activity recognition (HAR) has been examined. Traditionally considered as a source of additional clutter, the multipath is being investigated for its potential to be exploited through the creation of virtual radar nodes. These virtual nodes are conceptualized to observe targets from aspect angles that differ from those of physically existing radars. To realize this idea, an innovative processing pipeline is proposed that extracts information from multipath signals to improve HAR. The pipeline isolates and tracks the line-of-sight (LOS) and multipath components of a moving human target performing continuous sequences of activities observed by a network of three radar sensors. Furthermore, the method has been verified with experimental data consisting of six activities and 14 volunteers by comparing classification metrics with the use of a single radar as well as only the LOS components of the three radars in the network. A 12-layer convolutional neural network (CNN) classifier has been designed to operate on range-Doppler (RD) images derived from the LOS and multipath components, extracted by the proposed method. A substantial performance improvement using the leave-one-person-out (L1Po) test set is demonstrated in the order of +11% by exploiting a multiradar network with its LOS and multipath components.