Abstract
Online gaming applications entertain hundreds of millions of daily active players and often feature vastly complex architecture. Among online games, Minecraft-like games simulate unique (e.g., modifiable) environments, are virally popular, and are increasingly provided as a service. However, the performance of Minecraft-like services, and in particular their scalability, is not well understood. Moreover, currently no benchmark exists for Minecraft-like games. Addressing this knowledge gap, in this work we design and use the Yardstick benchmark to analyze the performance of Minecraft-like services. Yardstick is based on an operational model that captures salient characteristics of Minecraft-like services. As input workload, Yardstick captures important features, such as the most-popular maps used within the Minecraft community. Yardstick captures system- and application-level metrics, and derives from them service-level metrics such as frequency of game-updates under scalable workload. We implement Yardstick, and, through real-world experiments in our clusters, we explore the performance and scalability of popular Minecraft-like servers, including the official vanilla server, and the community-developed servers Spigot and Glowstone. Our findings indicate the scalability limits of these servers, that Minecraft-like services are poorly parallelized, and that Glowstone is the least viable option among those tested.
Original language | English |
---|---|
Title of host publication | ICPE '19 |
Subtitle of host publication | Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering |
Editors | Antinisca Di Marco, Varsha Apte |
Place of Publication | New York |
Publisher | Association for Computing Machinery (ACM) |
Pages | 242-252 |
Number of pages | 11 |
ISBN (Electronic) | 978-1-4503-6239-9 |
DOIs | |
Publication status | Published - 2019 |
Event | 10th International Conference on Power Electronics - ECCE Asia, ICPE 2019 - ECCE Asia: 10th International Conference on Power Electronics - Busan, Korea, Republic of Duration: 27 May 2019 → 30 May 2019 Conference number: 10th |
Conference
Conference | 10th International Conference on Power Electronics - ECCE Asia, ICPE 2019 - ECCE Asia |
---|---|
Country/Territory | Korea, Republic of |
City | Busan |
Period | 27/05/19 → 30/05/19 |
Keywords
- As a service
- Benchmark
- Distributed systems
- Minecraft
- Online gaming
- Yardstick