From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442)

Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, Tsvi Kuflik, Krister Lindén, Bernardo Magnini, Jian-Yun Nie, Raffaele Perego, Nava Tintarev, More Authors

Research output: Contribution to journalArticleScientific

19 Downloads (Pure)

Abstract

We describe the state-of-the-art in performance modeling and prediction for Information Retrieval (IR), Natural Language Processing (NLP) and Recommender Systems (RecSys) along with its shortcomings and strengths. We present a framework for further research, identifying five major problem areas: understanding measures, performance analysis, making underlying assumptions explicit, identifying application features determining performance, and the development of prediction models describing the relationship between assumptions, features and resulting performance.
Original languageEnglish
Pages (from-to)96-139
Number of pages44
JournalDagstuhl Manifestos
Volume7
Issue number1
DOIs
Publication statusPublished - 2019
EventPerspectives Workshop - Schloss Dagatuhl, Wadern, Germany
Duration: 30 Oct 20193 Nov 2019

Fingerprint Dive into the research topics of 'From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442)'. Together they form a unique fingerprint.

  • Cite this