Understanding Challenges and Opportunities of Technology-Supported Sign Language Learning

Sarah Faltaous, Torben Winkler, Christina Schneegass, Uwe Gruenefeld, Stefan Schneegass

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

2 Citations (Scopus)

Abstract

Around 466 million people in the world live with hearing loss, with many benefiting from sign language as a mean of communication. Through advancements in technology-supported learning, autodidactic acquisition of sign languages, e.g., American Sign Language (ASL), has become possible. However, little is known about the best practices for teaching signs using technology. This work investigates the use of different conditions for teaching ASL signs: audio, visual, electrical muscle stimulation (EMS), and visual combined with EMS. In a user study, we compare participants' accuracy in executing signs, recall ability after a two-week break, and user experience. Our results show that the conditions involving EMS resulted in the best overall user experience. Moreover, ten ASL experts rated the signs performed with visual and EMS combined highest. We conclude our work with the potentials and drawbacks of each condition and present implications that will benefit the design of future learning systems.

Original languageEnglish
Title of host publicationProceedings of Augmented Humans Conference 2022, AHs 2022
PublisherAssociation for Computing Machinery (ACM)
Pages15-25
Number of pages11
ISBN (Electronic)9781450396325
DOIs
Publication statusPublished - 2022
Externally publishedYes
Event2022 Augmented Humans Conference, AHs 2022 - Virtual, Online, Germany
Duration: 13 Mar 202215 Mar 2022

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2022 Augmented Humans Conference, AHs 2022
Country/TerritoryGermany
CityVirtual, Online
Period13/03/2215/03/22

Keywords

  • audio
  • electrical muscle stimulation
  • Sign language learning
  • visual

Fingerprint

Dive into the research topics of 'Understanding Challenges and Opportunities of Technology-Supported Sign Language Learning'. Together they form a unique fingerprint.

Cite this