A benchmark and comparison of active learning for logistic regression

Yazhou Yang, Marco Loog

Research output: Contribution to journalArticleScientificpeer-review

39 Citations (Scopus)
29 Downloads (Pure)

Abstract

Logistic regression is by far the most widely used classifier in real-world applications. In this paper, we benchmark the state-of-the-art active learning methods for logistic regression and discuss and illustrate their underlying characteristics. Experiments are carried out on three synthetic datasets and 44 real-world datasets, providing insight into the behaviors of these active learning methods with respect to the area of the learning curve (which plots classification accuracy as a function of the number of queried examples) and their computational costs. Surprisingly, one of the earliest and simplest suggested active learning methods, i.e., uncertainty sampling, performs exceptionally well overall. Another remarkable finding is that random sampling, which is the rudimentary baseline to improve upon, is not overwhelmed by individual active learning techniques in many cases.

Original languageEnglish
Pages (from-to)401-415
Number of pages15
JournalPattern Recognition
Volume83
DOIs
Publication statusPublished - 2018

Keywords

  • Active learning
  • Benchmark
  • Experimental design
  • Logistic regression
  • Preference maps

Fingerprint Dive into the research topics of 'A benchmark and comparison of active learning for logistic regression'. Together they form a unique fingerprint.

Cite this