Training Data Augmentation for Detecting Adverse Drug Reactions in User-Generated Content

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

160 Downloads (Pure)

Abstract

Social media provides a timely yet challenging data source for adverse drug reaction (ADR) detection. Existing dictionary-based, semi-supervised learning approaches are intrinsically limited by the coverage and maintainability of laymen health vocabularies. In this paper, we introduce a data augmentation approach that leverages variational autoencoders to learn high-quality data distributions from a large unlabeled dataset, and subsequently, to automatically generate a large labeled training set from a small set of labeled samples. This allows for efficient social-media ADR detection with low training and re-training costs to adapt to the changes and emergence of informal medical laymen terms. An extensive evaluation performed on Twitter and Reddit data shows that our approach matches the performance of fully-supervised approaches while requiring only 25% of training data.
Original languageEnglish
Title of host publicationInternational conference on Empirical Methods in Natural Language Processing (EMNLP)
Pages2349–2359
Number of pages11
DOIs
Publication statusPublished - 3 Nov 2019
Event2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing - Hong Kong, China
Duration: 3 Nov 20197 Nov 2019

Conference

Conference2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing
Country/TerritoryChina
CityHong Kong
Period3/11/197/11/19

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • NLP
  • ML
  • Data augmentation

Fingerprint

Dive into the research topics of 'Training Data Augmentation for Detecting Adverse Drug Reactions in User-Generated Content'. Together they form a unique fingerprint.

Cite this