A/B Testing with APONE

Mónica Marrero, Claudia Hauff

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

In order to improve long-term retention, ad conversion rates, and so on, A/B testing has become the norm within Web portals, enabling efficient large-scale experimentation. While A/B testing is also increasingly used by academic researchers (with crowd-working platforms offering a large pool of artificial users), few platforms are freely available to this end. Academic researchers usually develop adhoc solutions, leading to many duplicated efforts and time spent on work not directly related to one's research. As an alternative, we have developed and open sourced APONE, an A cademic P latform for ON line Experiments. APONE uses PlanOut, a framework and high-level language, to specify online experiments, and offers Web services and a Web GUI to easily create, manage and monitor them. By building a user friendly Web application, we enable not only experts to conduct valid A/B experiments. In particular as a secondary use case, we envision large classrooms to also benefit from the deployment of APONE, a vision we put into practice in a graduate Information Retrieval course. We open-source APONE at https://marrerom.github.io/APONE. A demo version is running at http://ireplatform.ewi.tudelft.nl:8080/APONE.
Original languageEnglish
Title of host publicationSIGIR'18
Subtitle of host publicationThe 41st International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Pages1269-1272
Number of pages4
ISBN (Electronic)978-1-4503-5657-2
DOIs
Publication statusPublished - 2018
EventSIGIR 2018: The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval - Ann Arbor, United States
Duration: 8 Jul 201812 Jul 2018
Conference number: 41st

Conference

ConferenceSIGIR 2018
Abbreviated titleSIGIR'18
Country/TerritoryUnited States
CityAnn Arbor
Period8/07/1812/07/18

Fingerprint

Dive into the research topics of 'A/B Testing with APONE'. Together they form a unique fingerprint.

Cite this