Yardstick: A benchmark for minecraft-like services

Jerom Van Der Sar, Jesse Donkervliet, Alexandru Iosup

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

1 Citation (Scopus)

Abstract

Online gaming applications entertain hundreds of millions of daily active players and often feature vastly complex architecture. Among online games, Minecraft-like games simulate unique (e.g., modifiable) environments, are virally popular, and are increasingly provided as a service. However, the performance of Minecraft-like services, and in particular their scalability, is not well understood. Moreover, currently no benchmark exists for Minecraft-like games. Addressing this knowledge gap, in this work we design and use the Yardstick benchmark to analyze the performance of Minecraft-like services. Yardstick is based on an operational model that captures salient characteristics of Minecraft-like services. As input workload, Yardstick captures important features, such as the most-popular maps used within the Minecraft community. Yardstick captures system- and application-level metrics, and derives from them service-level metrics such as frequency of game-updates under scalable workload. We implement Yardstick, and, through real-world experiments in our clusters, we explore the performance and scalability of popular Minecraft-like servers, including the official vanilla server, and the community-developed servers Spigot and Glowstone. Our findings indicate the scalability limits of these servers, that Minecraft-like services are poorly parallelized, and that Glowstone is the least viable option among those tested.

Original languageEnglish
Title of host publicationICPE '19
Subtitle of host publicationProceedings of the 2019 ACM/SPEC International Conference on Performance Engineering
EditorsAntinisca Di Marco, Varsha Apte
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages242-252
Number of pages11
ISBN (Electronic)978-1-4503-6239-9
DOIs
Publication statusPublished - 2019
Event10th International Conference on Power Electronics - ECCE Asia, ICPE 2019 - ECCE Asia: 10th International Conference on Power Electronics - Busan, Korea, Republic of
Duration: 27 May 201930 May 2019
Conference number: 10th

Conference

Conference10th International Conference on Power Electronics - ECCE Asia, ICPE 2019 - ECCE Asia
CountryKorea, Republic of
CityBusan
Period27/05/1930/05/19

Keywords

  • As a service
  • Benchmark
  • Distributed systems
  • Minecraft
  • Online gaming
  • Yardstick

Fingerprint Dive into the research topics of 'Yardstick: A benchmark for minecraft-like services'. Together they form a unique fingerprint.

Cite this