Dockerising terrier for the open-source IR replicability challenge

Arthur Câmara; Craig MacDonald

Dockerising terrier for the open-source IR replicability challenge

Web Information Systems

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

42 Downloads (Pure)

Abstract

Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.

Original language	English
Title of host publication	OSIRRC 2019 The Open-Source IR Replicability Challenge
Subtitle of host publication	Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019)
Editors	Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, Ze Zhong Wu
Publisher	CEUR-WS.org
Pages	26-30
Number of pages	5
Publication status	Published - 2019
Event	2019 Open-Source IR Replicability Challenge, OSIRRC 2019 - Paris, France Duration: 25 Jul 2019 → 25 Jul 2019

Publication series

Name	CEUR Workshop Proceedings
Volume	2409
ISSN (Print)	1613-0073

Conference

Conference	2019 Open-Source IR Replicability Challenge, OSIRRC 2019
Country/Territory	France
City	Paris
Period	25/07/19 → 25/07/19

Access to Document

docker02Final published version, 1.77 MBLicence: CC BY

http://ceur-ws.org/Vol-2409/

Cite this

Câmara, A., & MacDonald, C. (2019). Dockerising terrier for the open-source IR replicability challenge. In R. Clancy, N. Ferro, C. Hauff, J. Lin, T. Sakai, & Z. Z. Wu (Eds.), OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) (pp. 26-30). (CEUR Workshop Proceedings; Vol. 2409). CEUR-WS.org. http://ceur-ws.org/Vol-2409/

Câmara, Arthur ; MacDonald, Craig. / Dockerising terrier for the open-source IR replicability challenge. OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019). editor / Ryan Clancy ; Nicola Ferro ; Claudia Hauff ; Jimmy Lin ; Tetsuya Sakai ; Ze Zhong Wu. CEUR-WS.org, 2019. pp. 26-30 (CEUR Workshop Proceedings).

@inproceedings{a14bfb4ff4d54ab0aae33d950e64085c,

title = "Dockerising terrier for the open-source IR replicability challenge",

abstract = "Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.",

author = "Arthur C{\^a}mara and Craig MacDonald",

year = "2019",

language = "English",

series = "CEUR Workshop Proceedings",

publisher = "CEUR-WS.org",

pages = "26--30",

editor = "Ryan Clancy and Nicola Ferro and Claudia Hauff and Jimmy Lin and Tetsuya Sakai and Wu, {Ze Zhong}",

booktitle = "OSIRRC 2019 The Open-Source IR Replicability Challenge",

note = "2019 Open-Source IR Replicability Challenge, OSIRRC 2019 ; Conference date: 25-07-2019 Through 25-07-2019",

}

Câmara, A & MacDonald, C 2019, Dockerising terrier for the open-source IR replicability challenge. in R Clancy, N Ferro, C Hauff, J Lin, T Sakai & ZZ Wu (eds), OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019). CEUR Workshop Proceedings, vol. 2409, CEUR-WS.org, pp. 26-30, 2019 Open-Source IR Replicability Challenge, OSIRRC 2019, Paris, France, 25/07/19. <http://ceur-ws.org/Vol-2409/>

Dockerising terrier for the open-source IR replicability challenge. / Câmara, Arthur; MacDonald, Craig.

OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019). ed. / Ryan Clancy; Nicola Ferro; Claudia Hauff; Jimmy Lin; Tetsuya Sakai; Ze Zhong Wu. CEUR-WS.org, 2019. p. 26-30 (CEUR Workshop Proceedings; Vol. 2409).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Dockerising terrier for the open-source IR replicability challenge

AU - Câmara, Arthur

AU - MacDonald, Craig

PY - 2019

Y1 - 2019

N2 - Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.

AB - Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.

UR - http://www.scopus.com/inward/record.url?scp=85070711498&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85070711498

T3 - CEUR Workshop Proceedings

SP - 26

EP - 30

BT - OSIRRC 2019 The Open-Source IR Replicability Challenge

A2 - Clancy, Ryan

A2 - Ferro, Nicola

A2 - Hauff, Claudia

A2 - Lin, Jimmy

A2 - Sakai, Tetsuya

A2 - Wu, Ze Zhong

PB - CEUR-WS.org

T2 - 2019 Open-Source IR Replicability Challenge, OSIRRC 2019

Y2 - 25 July 2019 through 25 July 2019

ER -

Câmara A, MacDonald C. Dockerising terrier for the open-source IR replicability challenge. In Clancy R, Ferro N, Hauff C, Lin J, Sakai T, Wu ZZ, editors, OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019). CEUR-WS.org. 2019. p. 26-30. (CEUR Workshop Proceedings).

Dockerising terrier for the open-source IR replicability challenge

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this