Depth-aware motion magnification

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

13 Citations (Scopus)

Abstract

This paper adds depth to motion magnification. With the rise of cheap RGB+D cameras depth information is readily available. We make use of depth to make motion magnification robust to occlusion and large motions. Current approaches require a manual drawn pixel mask over all frames in the area of interest which is cumbersome and error-prone. By including depth, we avoid manual annotation and magnify motions at similar depth levels while ignoring occlusions at distant depth pixels. To achieve this, we propose an extension to the bilateral filter for non-Gaussian filters which allows us to treat pixels at very different depth layers as missing values. As our experiments will show, these missing values should be ignored, and not inferred with inpainting. We show results for a medical application (tremors) where we improve current baselines for motion magnification and motion measurements.
Original languageEnglish
Title of host publicationProceedings 14th European Conference on Computer Vision - ECCV 2016
EditorsB. Leibe, J. Matas, N. Sebe, M. Welling
Place of PublicationCham, Switzerland
PublisherSpringer
Pages467-482
ISBN (Electronic)978-3-319-46454-1
ISBN (Print)978-3-319-46453-4
DOIs
Publication statusPublished - 2016
EventECCV 2016: 29th European Conference on Computer Vision - Amsterdam, Netherlands
Duration: 8 Oct 201616 Oct 2016

Publication series

NameLecture Notes in Computer Science
Volume9912
ISSN (Print)0302-9743

Conference

ConferenceECCV 2016
CountryNetherlands
CityAmsterdam
Period8/10/1616/10/16

Keywords

  • Motion magnification
  • Bilateral filter
  • RGB+D

Fingerprint Dive into the research topics of 'Depth-aware motion magnification'. Together they form a unique fingerprint.

  • Cite this

    Kooij, J., & van Gemert, J. (2016). Depth-aware motion magnification. In B. Leibe, J. Matas, N. Sebe, & M. Welling (Eds.), Proceedings 14th European Conference on Computer Vision - ECCV 2016 (pp. 467-482). (Lecture Notes in Computer Science; Vol. 9912). Springer. https://doi.org/10.1007/978-3-319-46484-8_28