CLEF NewsREEL 2016: Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems

B. Kille, A. Lommatzsch, F. Hopfgartner, M. Larson, J. Seiler, D. Malagoli, A. Sereny, T. Brodt

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

3 Citations (Scopus)

Abstract

Running in its third year at CLEF, NewsREEL challenged participantsto develop news recommendation algorithms and have them benchmarked inan online (Task 1) and offline setting (Task 2), respectively. This paper providesan overview of the NewsREEL scenario, outlines this year’s campaign, presentsresults of both tasks, and discusses the approaches of participating teams. Moreover,it overviews ideas on living lab evaluation that have been presented as partof a “New Ideas” track at the conference in Portugal. Presented results illustratepotentials for multi-dimensional evaluation of recommendation algorithms ina living lab and simulation based evaluation setting.
Original languageEnglish
Title of host publicationCLEF 2016 Working Notes
Subtitle of host publicationConference and Labs of the Evaluation Forum
EditorsKrisztian Balog, Linda Cappellato, Nicola Ferro, Craig Macdonald
PublisherCEUR
Pages593-605
Number of pages13
Publication statusPublished - 2016
EventCLEF 2016 - Conference and Labs of the Evaluation Forum: Information Access Evaluation meets Multilinguality, and Interaction - University of Évora, Évora, Portugal
Duration: 5 Sep 20168 Sep 2016
Conference number: 7th
http://clef2016.clef-initiative.eu/

Publication series

NameCEUR Workshop Proceedings
PublisherCEUR
Volume1609
ISSN (Electronic)1613-0073

Conference

ConferenceCLEF 2016 - Conference and Labs of the Evaluation Forum
CountryPortugal
CityÉvora
Period5/09/168/09/16
Internet address

Keywords

  • recommender systems
  • news
  • multi-dimensional evaluation
  • living lab
  • stream-based recommender

Fingerprint Dive into the research topics of 'CLEF NewsREEL 2016: Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems'. Together they form a unique fingerprint.

Cite this