Social media provides a timely yet challenging data source for adverse drug reaction (ADR) detection. Existing dictionary-based, semi-supervised learning approaches are intrinsically limited by the coverage and maintainability of laymen health vocabularies. In this paper, we introduce a data augmentation approach that leverages variational autoencoders to learn high-quality data distributions from a large unlabeled dataset, and subsequently, to automatically generate a large labeled training set from a small set of labeled samples. This allows for efficient social-media ADR detection with low training and re-training costs to adapt to the changes and emergence of informal medical laymen terms. An extensive evaluation performed on Twitter and Reddit data shows that our approach matches the performance of fully-supervised approaches while requiring only 25% of training data.
|Title of host publication||International conference on Empirical Methods in Natural Language Processing (EMNLP)|
|Number of pages||11|
|Publication status||Published - 3 Nov 2019|
|Event||2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing - Hong Kong, China|
Duration: 3 Nov 2019 → 7 Nov 2019
|Conference||2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing|
|Period||3/11/19 → 7/11/19|
Bibliographical noteGreen Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
- Data augmentation
FingerprintDive into the research topics of 'Training Data Augmentation for Detecting Adverse Drug Reactions in User-Generated Content'. Together they form a unique fingerprint.
Reddit dataset for Adverse Drug Reaction
Mesbah, S. (Creator), Yang, J. (Creator), Sips, R. J. (Creator), Valle Torre, M. (Creator), Lofi, C. (Creator), Bozzon, A. (Creator) & Houben, G. J. P. M. (Creator), TU Delft - 4TU.ResearchData, 19 May 2020