Using Phase Instead of Optical Flow for Action Recognition

Omar Hommos, Silvia L. Pintea, Pascal S.M. Mettes, Jan C. van Gemert

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

11 Downloads (Pure)

Abstract

Currently, the most common motion representation for action recognition is optical flow. Optical flow is based on particle tracking which adheres to a Lagrangian perspective on dynamics. In contrast to the Lagrangian perspective, the Eulerian model of dynamics does not track, but describes local changes. For video, an Eulerian phase-based motion representation, using complex steerable filters, has been successfully employed recently for motion magnification and video frame interpolation. Inspired by these previous works, here, we proposes learning Eulerian motion representations in a deep architecture for action recognition. We learn filters in the complex domain in an end-to-end manner. We design these complex filters to resemble complex Gabor filters, typically employed for phase-information extraction. We propose a phase-information extraction module, based on these complex filters, that can be used in any network architecture for extracting Eulerian representations. We experimentally analyze the added value of Eulerian motion representations, as extracted by our proposed phase extraction module, and compare with existing motion representations based on optical flow, on the UCF101 dataset.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2018 Workshops, Proceedings
EditorsLaura Leal-Taixé, Stefan Roth
Place of PublicationCham
PublisherSpringer
Pages678-691
Number of pages14
Editionpart VI
ISBN (Electronic)978-3-030-11024-6
ISBN (Print)978-303011023-9
DOIs
Publication statusPublished - 2019
Event15th European Conference on Computer Vision, ECCV 2018 - Munich, Germany
Duration: 8 Sep 201814 Sep 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11134 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th European Conference on Computer Vision, ECCV 2018
CountryGermany
CityMunich
Period8/09/1814/09/18

Keywords

  • Action recognition
  • Eulerian motion representation
  • Motion representation
  • Phase derivatives

Fingerprint Dive into the research topics of 'Using Phase Instead of Optical Flow for Action Recognition'. Together they form a unique fingerprint.

  • Cite this

    Hommos, O., Pintea, S. L., Mettes, P. S. M., & van Gemert, J. C. (2019). Using Phase Instead of Optical Flow for Action Recognition. In L. Leal-Taixé, & S. Roth (Eds.), Computer Vision – ECCV 2018 Workshops, Proceedings (part VI ed., pp. 678-691). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11134 LNCS). Springer. https://doi.org/10.1007/978-3-030-11024-6_51