The Benchmark as a Research Catalyst: Charting the Progress of Geo-prediction for Social Multimedia

Martha Larson, Pascal Kelm, Adam Rae, Claudia Hauff, Bart Thomee, Michele Trevisiol, Jaeyoung Choi, Olivier van Laere, Steven Schockaert, Pavel Serdyukov, Vanessa Murdock, Gerald Friedland

Research output: Chapter in Book/Conference proceedings/Edited volumeChapterScientific

6 Citations (Scopus)


Benchmarks have the power to bring research communities together to focus on specific research challenges. They drive research forward by making it easier to systematically compare and contrast new solutions, and evaluate their performance with respect to the existing state of the art. In this chapter, we present a retrospective on the Placing Task, a yearly challenge offered by the MediaEval Multimedia Benchmark. The Placing Task, launched in 2010, is a benchmarking task that requires participants to develop algorithms that automatically predict the geolocation of social multimedia (videos and images). This chapter covers the editions of the Placing Task offered in 2010–2013, and also presents an outlook onto 2014. We present the formulation of the task and the task dataset for each year, tracing the design decisions that were made by the organizers, and how each year built on the previous year. Finally, we provide a summary of future directions and challenges for multimodal geolocation, and concluding remarks on how benchmarking has catalyzed research progress in the research area of geolocation prediction for social multimedia.
Original languageEnglish
Title of host publicationMultimodal Location Estimation of Videos and Images
EditorsJaeyoung Choi, Gerald Friedland
Place of PublicationCham
Number of pages36
ISBN (Electronic)978-3-319-09861-6
ISBN (Print)978-3-319-09860-9
Publication statusPublished - 2015


  • Signal, Image and Speech Processing
  • Communications Engineering, Networks
  • Multimedia Information Systems


Dive into the research topics of 'The Benchmark as a Research Catalyst: Charting the Progress of Geo-prediction for Social Multimedia'. Together they form a unique fingerprint.

Cite this