DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech

Bo Dekker; Alfred Schouten; Odette Scharenborg

doi:10.1109/ICASSP49357.2023.10096145

DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech

Bo Dekker, Alfred Schouten, Odette Scharenborg

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

12 Downloads (Pure)

Abstract

Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person’s brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.

Original language	English
Title of host publication	Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Place of Publication	Piscataway
Publisher	IEEE
Number of pages	5
ISBN (Electronic)	978-1-7281-6327-7
ISBN (Print)	978-1-7281-6328-4
DOIs	https://doi.org/10.1109/ICASSP49357.2023.10096145
Publication status	Published - 2023
Event	48th IEEE International Conference on Acoustics, Speech and Signal Processing 2023 - Rhodes Island, Greece Duration: 4 Jun 2023 → 10 Jun 2023

Publication series

Name	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume	2023-June
ISSN (Print)	1520-6149

Conference

Conference	48th IEEE International Conference on Acoustics, Speech and Signal Processing 2023
Abbreviated title	ICASSP 2023
Country/Territory	Greece
City	Rhodes Island
Period	4/06/23 → 10/06/23

Bibliographical note

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Brain computer interfaces
covert (imagined) speech
, electroencephalography (EEG)
ResNet

Access to Document

10.1109/ICASSP49357.2023.10096145

DAIS_The_Delft_Database_of_EEG_Recordings_of_Dutch_Articulated_and_Imagined_SpeechFinal published version, 1.16 MB

Cite this

Dekker, B., Schouten, A., & Scharenborg, O. (2023). DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech. In Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2023-June). IEEE . https://doi.org/10.1109/ICASSP49357.2023.10096145

Dekker, Bo ; Schouten, Alfred ; Scharenborg, Odette. / DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech. Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Piscataway : IEEE , 2023. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

@inproceedings{53e8ba52452a4951b3f3c284f105dff0,

title = "DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech",

abstract = "Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person{\textquoteright}s brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.",

keywords = "Brain computer interfaces, covert (imagined) speech, , electroencephalography (EEG), ResNet",

author = "Bo Dekker and Alfred Schouten and Odette Scharenborg",

note = "Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.; 48th IEEE International Conference on Acoustics, Speech and Signal Processing 2023, ICASSP 2023 ; Conference date: 04-06-2023 Through 10-06-2023",

year = "2023",

doi = "10.1109/ICASSP49357.2023.10096145",

language = "English",

isbn = "978-1-7281-6328-4",

series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "IEEE ",

booktitle = "Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)",

address = "United States",

}

Dekker, B, Schouten, A & Scharenborg, O 2023, DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech. in Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. 2023-June, IEEE , Piscataway, 48th IEEE International Conference on Acoustics, Speech and Signal Processing 2023, Rhodes Island, Greece, 4/06/23. https://doi.org/10.1109/ICASSP49357.2023.10096145

DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech. / Dekker, Bo; Schouten, Alfred ; Scharenborg, Odette.

Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Piscataway : IEEE , 2023. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2023-June).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech

AU - Dekker, Bo

AU - Schouten, Alfred

AU - Scharenborg, Odette

N1 - Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2023

Y1 - 2023

N2 - Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person’s brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.

AB - Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person’s brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.

KW - Brain computer interfaces

KW - covert (imagined) speech

KW - , electroencephalography (EEG)

KW - ResNet

UR - http://www.scopus.com/inward/record.url?scp=85177596191&partnerID=8YFLogxK

U2 - 10.1109/ICASSP49357.2023.10096145

DO - 10.1109/ICASSP49357.2023.10096145

M3 - Conference contribution

SN - 978-1-7281-6328-4

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

BT - Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

PB - IEEE

CY - Piscataway

T2 - 48th IEEE International Conference on Acoustics, Speech and Signal Processing 2023

Y2 - 4 June 2023 through 10 June 2023

ER -

Dekker B, Schouten A , Scharenborg O. DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech. In Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Piscataway: IEEE . 2023. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). doi: 10.1109/ICASSP49357.2023.10096145

DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this