Abstract
Successful news recommendation requires facing the challenges of dynamic item sets, contextual item relevance, and of fulfilling non-functional requirements, such as response time. The CLEF NewsREEL challenge is a campaign-style evaluation lab allowing participants to tackle news recommendation and to optimize and evaluate their recommender algorithms both online and offline. In this paper, we summarize the objectives and challenges of NewsREEL 2016. We cover two contrasting perspectives on the challenge: that of the operator (the business providing recommendations) and that of the challenge participant (the researchers developing recommender algorithms). In the intersection of these perspectives, new insights can be gained on how to effectively evaluate real-time stream recommendation algorithms.
Original language | English |
---|---|
Title of host publication | Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2016 |
Subtitle of host publication | International Conference of the Cross-Language Evaluation Forum for European Languages |
Place of Publication | Cham |
Publisher | Springer |
Pages | 311-331 |
Number of pages | 21 |
ISBN (Electronic) | 978-3-319-44564-9 |
ISBN (Print) | 978-3-319-44563-2 |
DOIs | |
Publication status | Published - 23 Aug 2016 |
Event | CLEF 2016 - Conference and Labs of the Evaluation Forum: Information Access Evaluation meets Multilinguality, and Interaction - University of Évora, Évora, Portugal Duration: 5 Sept 2016 → 8 Sept 2016 Conference number: 7th http://clef2016.clef-initiative.eu/ |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
Publisher | Springer |
Volume | 9822 |
ISSN (Electronic) | 0302-9743 |
Conference
Conference | CLEF 2016 - Conference and Labs of the Evaluation Forum |
---|---|
Country/Territory | Portugal |
City | Évora |
Period | 5/09/16 → 8/09/16 |
Internet address |
Keywords
- Recommender Systems
- News
- Multi-dimensional Evaluation
- Living Lab
- Stream-based Recommender