Affective Driver-Pedestrian Interaction: Exploring Driver Affective Responses toward Pedestrian Crossing Actions using Camera and Physiological Sensors

Shruti Rao, Sabrina Wirjopawiro, Gerard Pons Rodriguez, Thomas Röggla, Pablo Cesar, Abdallah El Ali

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

43 Downloads (Pure)

Abstract

Eliciting and capturing drivers' affective responses in a realistic outdoor setting with pedestrians poses a challenge when designing in-vehicle, empathic interfaces. To address this, we designed a controlled, outdoor car driving circuit where drivers (N=27) drove and encountered pedestrian confederates who performed non-verbal positive or non-positive road crossing actions towards them. Our findings reveal that drivers reported higher valence upon observing positive, non-verbal crossing actions, and higher arousal upon observing non-positive crossing actions. Drivers' heart signals (BVP, IBI and BPM), skin conductance and facial expressions (brow lowering, eyelid tightening, nose wrinkling, and lip stretching) all varied significantly when observing positive and non-positive actions. Our car driving study, by drawing on realistic driving conditions, further contributes to the development of in-vehicle empathic interfaces that leverage behavioural and physiological sensing. Through automatic inference of driver affect resulting from pedestrian actions, our work can enable novel empathic interfaces for supporting driver emotion self-regulation.

Original languageEnglish
Title of host publication15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Main Conference Proceedings
PublisherAssociation for Computing Machinery (ACM)
Pages300-310
Number of pages11
ISBN (Electronic)9798400701054
DOIs
Publication statusPublished - 2023
Event15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023 - Ingolstadt, Germany
Duration: 18 Sept 202321 Sept 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2023
Country/TerritoryGermany
CityIngolstadt
Period18/09/2321/09/23

Keywords

  • driver emotion recognition
  • empathic cars
  • facial expression analysis
  • outdoor driving circuit
  • pedestrian non-verbal crossing actions
  • physiological sensing
  • thermal sensing

Fingerprint

Dive into the research topics of 'Affective Driver-Pedestrian Interaction: Exploring Driver Affective Responses toward Pedestrian Crossing Actions using Camera and Physiological Sensors'. Together they form a unique fingerprint.

Cite this