How Was It? Exploiting Smartphone Sensing to Measure Implicit Audience Responses to Live Performances

Claudio Martella, Ekin Gedik, Laura Cabrera-Quiros, Gwenn Englebienne, Hayley Hung

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

14 Citations (Scopus)

Abstract

In this paper, we present an approach to understand the response of an audience to a live dance performance by the processing of mobile sensor data. We argue that exploiting sensing capabilities already available in smart phones enables a potentially large scale measurement of an audience’s implicit response to a performance. In this work, we leverage both tri-axial accelerometers, worn by
ordinary members of the public during a dance performance, to predict responses to a number of survey answers, comprising enjoyment, immersion, willingness to recommend the event to others, and change in mood.We also analyse how behaviour as a result of seeing a dance performance might be reflected in a people’s subsequent social behaviour using proximity and acceleration sensing. To our knowledge, this is the first work where pervasive mobile sensing has been used to investigate spontaneous responses to predict the affective evaluation of a live performance. Using a single body worn accelerometer to monitor a set of audience members, we were able to predict whether they enjoyed the event with a balanced classification accuracy of 90%. The collective coordination of the audience’s bodily movements also highlighted memorable moments that were reported later by the audience. The effective use of body movements to measure affective responses in such a setting is particularly surprising given that traditionally, physiological signals such as skin
conductance or brain-based signals are the more commonly accepted methods to measure implicit affective response. Our experiments open interesting new directions for research on both automated techniques and applications for the implicit tagging of real world events via spontaneous and implicit audience responses during as well as after a performance.
Original languageEnglish
Title of host publicationProceedings of the 23rd Annual ACM Conference on Multimedia
EditorsD Bulterman, H Tao Shen, K Mayer-Patel
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages201-210
Number of pages10
ISBN (Print)978-1-4503-3459-4
DOIs
Publication statusPublished - 2015
EventMM '15: 23rd annual ACM International Conference on Multimedia - Brisbane Convention and Exhibition Centre, Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015
Conference number: 23

Conference

ConferenceMM '15
CountryAustralia
CityBrisbane
Period26/10/1530/10/15

Fingerprint Dive into the research topics of 'How Was It? Exploiting Smartphone Sensing to Measure Implicit Audience Responses to Live Performances'. Together they form a unique fingerprint.

  • Cite this

    Martella, C., Gedik, E., Cabrera-Quiros, L., Englebienne, G., & Hung, H. (2015). How Was It? Exploiting Smartphone Sensing to Measure Implicit Audience Responses to Live Performances. In D. Bulterman, H. Tao Shen, & K. Mayer-Patel (Eds.), Proceedings of the 23rd Annual ACM Conference on Multimedia (pp. 201-210). Association for Computing Machinery (ACM). https://doi.org/10.1145/2733373.2806276