Beyond F-formations: Determining Social Involvement in Free Standing Conversing Groups from Static Images

Lu Zhang, Hayley Hung

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

18 Citations (Scopus)

Abstract

In this paper, we present the first attempt to analyse differing levels of social involvement in free standing conversing groups (or the so-called F-formations) from static images. In addition, we enrich state-of-the-art F-formation modelling by learning a frustum of attention that accounts for the spatial context. That is, F-formation configurations vary with respect to the arrangement of furniture and the non-uniform crowdedness in the space during mingling scenarios. The majority of prior works have considered the labelling of conversing group as an objective task, requiring only a single annotator. However, we show that by embracing the subjectivity of social involvement, we not only generate a richer model of the social interactions in a scene but also significantly improve F-formation detection. We carry out extensive experimental validation of our proposed approach by collecting a novel set of multi-annotator labels of involvement on the publicly available Idiap Poster Data, the only multi-annotator labelled database of free standing conversing groups that is currently available.
Original languageEnglish
Title of host publicationProceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016
EditorsLisa O'Conner
Place of PublicationLos Alamitos, CA
PublisherIEEE
Pages1086-1095
Number of pages10
ISBN (Electronic)978-1-4673-8851-1
DOIs
Publication statusPublished - 2016
EventCVPR 2016: 29th IEEE Conference on Computer Vision and Pattern Recognition - Las Vegas, United States
Duration: 26 Jun 20161 Jul 2016

Conference

ConferenceCVPR 2016
CountryUnited States
CityLas Vegas
Period26/06/161/07/16

Keywords

  • Psychology
  • Semantics
  • Image edge detection
  • Context
  • Visualization
  • Surveillance
  • Bridges

Fingerprint Dive into the research topics of 'Beyond F-formations: Determining Social Involvement in Free Standing Conversing Groups from Static Images'. Together they form a unique fingerprint.

  • Cite this

    Zhang, L., & Hung, H. (2016). Beyond F-formations: Determining Social Involvement in Free Standing Conversing Groups from Static Images. In L. O'Conner (Ed.), Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016 (pp. 1086-1095). IEEE. https://doi.org/10.1109/CVPR.2016.123