CLEF NewsREEL 2017 Overview: A Stream-Based Recommender Task for Evaluation and Education

Andreas Lommatzsch, Benjamin Kille, Frank Hopfgartner, Martha Larson, Torben Brodt

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

News recommender systems provide users with access to news stories that they find interesting and relevant. As other online, stream-based recommender systems, they face particular challenges, including limited information on users’ preferences and also rapidly fluctuating item collections. In addition, technical aspects, such as response time and scalability, must be considered. Both algorithmic and technical considerations shape working requirements for real-world recommender systems in businesses. NewsREEL represents a unique opportunity to evaluate recommendation algorithms and for students to experience realistic conditions and to enlarge their skill sets. The NewsREEL Challenge requires participants to conduct data-driven experiments in NewsREEL Replay as well as deploy their best models into NewsREEL Live’s ‘living lab’. This paper presents NewsREEL 2017 and also provides insights into the effectiveness of NewsREEL to support the goals of instructors teaching recommender systems to students. We discuss the experiences of NewsREEL participants as well as those of instructors teaching recommender systems to students, and in this way, we showcase NewsREEL’s ability to support the education of future data scientists.
Original languageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction
Subtitle of host publication8th International Conference of the CLEF Association, CLEF 2017, Proceedings
EditorsGareth J.F. Jones, Séamus Lawless, Julio Gonzalo, Liadh Kelly, Lorraine Goeuriot, Thomas Mandl, Linda Cappellato, Nicola Ferro
Place of PublicationCham
PublisherSpringer
Pages239-254
Number of pages16
ISBN (Electronic)978-3-319-65813-1
ISBN (Print)978-3-319-65812-4
DOIs
Publication statusPublished - 2017
EventCLEF 2017 - Conference and Labs of the Evaluation Forum: Information Access Evaluation meets Multilinguality, Multimodality, amd Visualization - Dublin, Ireland
Duration: 11 Sep 201714 Sep 2017
Conference number: 8
http://clef2017.clef-initiative.eu/

Publication series

NameLecture Notes in Computer Science
Volume10456
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceCLEF 2017 - Conference and Labs of the Evaluation Forum
CountryIreland
CityDublin
Period11/09/1714/09/17
Internet address

Keywords

  • Recommender systems
  • News
  • Evaluation
  • Living lab
  • stream-based recommender

Fingerprint Dive into the research topics of 'CLEF NewsREEL 2017 Overview: A Stream-Based Recommender Task for Evaluation and Education'. Together they form a unique fingerprint.

  • Cite this

    Lommatzsch, A., Kille, B., Hopfgartner, F., Larson, M., & Brodt, T. (2017). CLEF NewsREEL 2017 Overview: A Stream-Based Recommender Task for Evaluation and Education. In G. J. F. Jones, S. Lawless, J. Gonzalo, L. Kelly, L. Goeuriot, T. Mandl, L. Cappellato, & N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 8th International Conference of the CLEF Association, CLEF 2017, Proceedings (pp. 239-254). (Lecture Notes in Computer Science; Vol. 10456). Springer. https://doi.org/10.1007/978-3-319-65813-1-23