Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving

Christopher Cabrall; Nico Janssen; Joel Goncalves; Alberto Morando; Matthew Sassman; Joost De Winter

doi:10.1109/SMC.2016.7844530

Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving

Christopher Cabrall, Nico Janssen, Joel Goncalves, Alberto Morando, Matthew Sassman, Joost De Winter

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

10 Citations (Scopus)

95 Downloads (Pure)

Abstract

Automated driving vehicles of the future will most likely include multiple modes and levels of operation and thus include various transitions of control (ToC) between human and machine. Traditional activation devices (e.g., knobs, switches, buttons, and touchscreens) may be confused by operators among other system setting manipulators and also susceptible to inappropriate usage. Non-intrusive eye-tracking measures may assess driver states (i.e., distraction, drowsiness, and cognitive overload) automatically to trigger manual-to-automation ToC and serve as a driver readiness verification during automation-to-manual ToC. Our integrated driver state monitor is overviewed here within the scope of this brief system description/demonstration paper. It combines gaze position, gaze variability, eyelid opening, as well as external environmental complexity from the driving scene to facilitate ToC in automated driving. As both driver facing and forward facing cameras become increasingly commonplace and even legally mandated within various automated driving vehicles, our integrated system helps inform relevant future research and development towards improved human-computer interaction and driving safety.

Original language	English
Title of host publication	Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics
Subtitle of host publication	SMC 2016
Place of Publication	Piscataway, NJ, USA
Publisher	IEEE
Pages	1981-1982
ISBN (Electronic)	978-1-5090-1897-0
DOIs	https://doi.org/10.1109/SMC.2016.7844530
Publication status	Published - 2016
Event	2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Budapest, Hungary Duration: 9 Oct 2016 → 12 Oct 2016

Conference

Conference	2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016
Country/Territory	Hungary
City	Budapest
Period	9/10/16 → 12/10/16

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care

Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Vehicles
Automation
Monitoring
Safety
Roads
Bars
Time measurement

Access to Document

10.1109/SMC.2016.7844530

07844530Final published version, 2.01 MB

Cite this

Cabrall, C., Janssen, N., Goncalves, J., Morando, A., Sassman, M., & De Winter, J. (2016). Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics: SMC 2016 (pp. 1981-1982). IEEE. https://doi.org/10.1109/SMC.2016.7844530

@inproceedings{664a145dc59f431f9abf5719a8358f85,

title = "Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving",

abstract = "Automated driving vehicles of the future will most likely include multiple modes and levels of operation and thus include various transitions of control (ToC) between human and machine. Traditional activation devices (e.g., knobs, switches, buttons, and touchscreens) may be confused by operators among other system setting manipulators and also susceptible to inappropriate usage. Non-intrusive eye-tracking measures may assess driver states (i.e., distraction, drowsiness, and cognitive overload) automatically to trigger manual-to-automation ToC and serve as a driver readiness verification during automation-to-manual ToC. Our integrated driver state monitor is overviewed here within the scope of this brief system description/demonstration paper. It combines gaze position, gaze variability, eyelid opening, as well as external environmental complexity from the driving scene to facilitate ToC in automated driving. As both driver facing and forward facing cameras become increasingly commonplace and even legally mandated within various automated driving vehicles, our integrated system helps inform relevant future research and development towards improved human-computer interaction and driving safety.",

keywords = "Vehicles, Automation, Monitoring, Safety, Roads, Bars, Time measurement",

author = "Christopher Cabrall and Nico Janssen and Joel Goncalves and Alberto Morando and Matthew Sassman and {De Winter}, Joost",

note = "Green Open Access added to TU Delft Institutional Repository {\textquoteleft}You share, we take care!{\textquoteright} – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.; 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 ; Conference date: 09-10-2016 Through 12-10-2016",

year = "2016",

doi = "10.1109/SMC.2016.7844530",

language = "English",

pages = "1981--1982",

booktitle = "Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics",

publisher = "IEEE",

address = "United States",

}

Cabrall, C, Janssen, N, Goncalves, J, Morando, A, Sassman, M & De Winter, J 2016, Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving. in Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics: SMC 2016 . IEEE, Piscataway, NJ, USA, pp. 1981-1982, 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016, Budapest, Hungary, 9/10/16. https://doi.org/10.1109/SMC.2016.7844530

Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving. / Cabrall, Christopher; Janssen, Nico; Goncalves, Joel et al.
Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics: SMC 2016 . Piscataway, NJ, USA: IEEE, 2016. p. 1981-1982.

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving

AU - Cabrall, Christopher

AU - Janssen, Nico

AU - Goncalves, Joel

AU - Morando, Alberto

AU - Sassman, Matthew

AU - De Winter, Joost

N1 - Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2016

Y1 - 2016

N2 - Automated driving vehicles of the future will most likely include multiple modes and levels of operation and thus include various transitions of control (ToC) between human and machine. Traditional activation devices (e.g., knobs, switches, buttons, and touchscreens) may be confused by operators among other system setting manipulators and also susceptible to inappropriate usage. Non-intrusive eye-tracking measures may assess driver states (i.e., distraction, drowsiness, and cognitive overload) automatically to trigger manual-to-automation ToC and serve as a driver readiness verification during automation-to-manual ToC. Our integrated driver state monitor is overviewed here within the scope of this brief system description/demonstration paper. It combines gaze position, gaze variability, eyelid opening, as well as external environmental complexity from the driving scene to facilitate ToC in automated driving. As both driver facing and forward facing cameras become increasingly commonplace and even legally mandated within various automated driving vehicles, our integrated system helps inform relevant future research and development towards improved human-computer interaction and driving safety.

AB - Automated driving vehicles of the future will most likely include multiple modes and levels of operation and thus include various transitions of control (ToC) between human and machine. Traditional activation devices (e.g., knobs, switches, buttons, and touchscreens) may be confused by operators among other system setting manipulators and also susceptible to inappropriate usage. Non-intrusive eye-tracking measures may assess driver states (i.e., distraction, drowsiness, and cognitive overload) automatically to trigger manual-to-automation ToC and serve as a driver readiness verification during automation-to-manual ToC. Our integrated driver state monitor is overviewed here within the scope of this brief system description/demonstration paper. It combines gaze position, gaze variability, eyelid opening, as well as external environmental complexity from the driving scene to facilitate ToC in automated driving. As both driver facing and forward facing cameras become increasingly commonplace and even legally mandated within various automated driving vehicles, our integrated system helps inform relevant future research and development towards improved human-computer interaction and driving safety.

KW - Vehicles

KW - Automation

KW - Monitoring

KW - Safety

KW - Roads

KW - Bars

KW - Time measurement

UR - http://www.scopus.com/inward/record.url?scp=85015793110&partnerID=8YFLogxK

U2 - 10.1109/SMC.2016.7844530

DO - 10.1109/SMC.2016.7844530

M3 - Conference contribution

SP - 1981

EP - 1982

BT - Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics

PB - IEEE

CY - Piscataway, NJ, USA

T2 - 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016

Y2 - 9 October 2016 through 12 October 2016

ER -

Cabrall C, Janssen N, Goncalves J, Morando A, Sassman M, De Winter J. Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics: SMC 2016 . Piscataway, NJ, USA: IEEE. 2016. p. 1981-1982 doi: 10.1109/SMC.2016.7844530

Eye-based driver state monitor of distraction, drowsiness, and cognitive load for transitions of control in automated driving

Abstract

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this