A/B Testing with APONE

Mónica Marrero, Claudia Hauff

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review


In order to improve long-term retention, ad conversion rates, and so on, A/B testing has become the norm within Web portals, enabling efficient large-scale experimentation. While A/B testing is also increasingly used by academic researchers (with crowd-working platforms offering a large pool of artificial users), few platforms are freely available to this end. Academic researchers usually develop adhoc solutions, leading to many duplicated efforts and time spent on work not directly related to one's research. As an alternative, we have developed and open sourced APONE, an A cademic P latform for ON line Experiments. APONE uses PlanOut, a framework and high-level language, to specify online experiments, and offers Web services and a Web GUI to easily create, manage and monitor them. By building a user friendly Web application, we enable not only experts to conduct valid A/B experiments. In particular as a secondary use case, we envision large classrooms to also benefit from the deployment of APONE, a vision we put into practice in a graduate Information Retrieval course. We open-source APONE at https://marrerom.github.io/APONE. A demo version is running at http://ireplatform.ewi.tudelft.nl:8080/APONE.
Original languageEnglish
Title of host publicationSIGIR'18
Subtitle of host publicationThe 41st International ACM SIGIR Conference on Research and Development in Information Retrieval
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Number of pages4
ISBN (Electronic)978-1-4503-5657-2
Publication statusPublished - 2018
EventSIGIR 2018: The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval - Ann Arbor, United States
Duration: 8 Jul 201812 Jul 2018
Conference number: 41st


ConferenceSIGIR 2018
Abbreviated titleSIGIR'18
CountryUnited States
CityAnn Arbor


Dive into the research topics of 'A/B Testing with APONE'. Together they form a unique fingerprint.

Cite this