Position Paper: Brain signal-based dialogue systems

Activity: Talk or presentationTalk or presentation at a workshop, seminar, course or other meeting


This position paper focuses on the problem of building dialogue systems for people who have lost the ability to communicate via speech, e.g., patients of locked-in syndrome or severely disabled people. In order for such people to com-municate to other people and computers, dialogue systems that are based on brain responses to (imagined) speech are needed. A speech-based dialogue system typi-cally consists of an automatic speech recognition module and a speech synthesis module. In order to build a dialogue system that is able to work on the basis of brain signals, a system needs to be developed that is able to recognize speech imagined by a person and can synthesize speech from imagined speech. This paper proposes combining new and emerging technology on neural speech recognition and auditory stimulus construction from brain signals to build brain signal-based dialogue sys-tems. Such systems have a potentially large impact on society.
Period24 Apr 2019
Event titleIWSDS 2019: International Workshop on Spoken Dialog System Technology 2019
Event typeWorkshop
LocationSiracusa, Italy