TY - GEN
T1 - The Instantaneous Accuracy
T2 - 2019 ICCV workshop on Human Behavior Understanding
AU - Baptista Ríos, Marcos
AU - Lopez-Sastre, Roberto J.
AU - Caba Heilbron, Fabian
AU - van Gemert, Jan
PY - 2019
Y1 - 2019
N2 - The problem of Online Human Behavior Recognition in untrimmed videos, aka Online Action Detection (OAD), needs to be revisited. Unlike traditional off-line action detection approaches, where the evaluation metrics are clear and well established, in the OAD setting we find few works and no consensus on evaluation protocols to be used. In this paper we introduce a novel online metric, the Instantaneous Accuracy (IA), that exhibits an online nature, solving most of the limitations of the previous (off-line) metrics. We conduct a thorough experimental evaluation on the TVSeries dataset, comparing the performance of various baseline methods with the state of the art. Our results confirm the problems of the previous evaluation protocols, and suggest that an IA-based protocol is more adequate to the online scenario for human behaviour understanding.
AB - The problem of Online Human Behavior Recognition in untrimmed videos, aka Online Action Detection (OAD), needs to be revisited. Unlike traditional off-line action detection approaches, where the evaluation metrics are clear and well established, in the OAD setting we find few works and no consensus on evaluation protocols to be used. In this paper we introduce a novel online metric, the Instantaneous Accuracy (IA), that exhibits an online nature, solving most of the limitations of the previous (off-line) metrics. We conduct a thorough experimental evaluation on the TVSeries dataset, comparing the performance of various baseline methods with the state of the art. Our results confirm the problems of the previous evaluation protocols, and suggest that an IA-based protocol is more adequate to the online scenario for human behaviour understanding.
KW - Evaluation protocols
KW - Online action detection
KW - Untrimmed videos
UR - http://www.scopus.com/inward/record.url?scp=85082453849&partnerID=8YFLogxK
U2 - 10.1109/ICCVW.2019.00162
DO - 10.1109/ICCVW.2019.00162
M3 - Conference contribution
SN - 978-1-7281-5024-6
T3 - Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
SP - 1282
EP - 1284
BT - Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
Y2 - 27 October 2019 through 27 October 2019
ER -