Abstract
Social media provides a timely yet challenging data source for adverse drug reaction (ADR) detection. Existing dictionary-based, semi-supervised learning approaches are intrinsically limited by the coverage and maintainability of laymen health vocabularies. In this paper, we introduce a data augmentation approach that leverages variational autoencoders to learn high-quality data distributions from a large unlabeled dataset, and subsequently, to automatically generate a large labeled training set from a small set of labeled samples. This allows for efficient social-media ADR detection with low training and re-training costs to adapt to the changes and emergence of informal medical laymen terms. An extensive evaluation performed on Twitter and Reddit data shows that our approach matches the performance of fully-supervised approaches while requiring only 25% of training data.
Original language | English |
---|---|
Title of host publication | International conference on Empirical Methods in Natural Language Processing (EMNLP) |
Pages | 2349–2359 |
Number of pages | 11 |
DOIs | |
Publication status | Published - 3 Nov 2019 |
Event | 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing - Hong Kong, China Duration: 3 Nov 2019 → 7 Nov 2019 |
Conference
Conference | 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing |
---|---|
Country | China |
City | Hong Kong |
Period | 3/11/19 → 7/11/19 |
Keywords
- NLP
- ML
- Data augmentation
Fingerprint Dive into the research topics of 'Training Data Augmentation for Detecting Adverse Drug Reactions in User-Generated Content'. Together they form a unique fingerprint.
Datasets
-
Reddit dataset for Adverse Drug Reaction
Mesbah, S. (Creator), Yang, J. (Creator), Sips, R. J. (Creator), Valle Torre, M. (Creator), Lofi, C. (Creator), Bozzon, A. (Creator) & Houben, G. J. P. M. (Creator), TU Delft - 4TU.Centre for Research Data, 2020
DOI: 10.4121/UUID:F87CB471-99DF-430D-9B40-080AFA36EE7F
Dataset