Kubernetes cluster optimization using hybrid shared-state scheduling framework

Oana Mihaela Ungureanu, Călin Vlădeanu, Robert Kooij

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

3 Downloads (Pure)

Abstract

This paper presents a novel approach for scheduling the workloads in a Kubernetes cluster, which are sometimes unequally distributed across the environment or deal with fluctuations in terms of resources utilization. Our proposal looks at a hybrid shared-state scheduling framework model that delegates most of the tasks to the distributed scheduling agents and has a scheduling correction function that mainly processes the unscheduled and unprioritized tasks. The scheduling decisions are made based on the entire cluster state which is synchronized and periodically updated by a master-state agent. By preserving the Kubernetes objects and concepts, we analyzed the proposed scheduler behavior under different scenarios, for instance we tested the failover/recovery behavior in a deployed Kubernetes cluster. Moreover, our findings show that in situations like collocation interference or priority preemption, other centralized scheduling frameworks integrated with the Kubernetes system might not perform accordingly due to high latency derived from the calculation of load spreading. In a wider context of the existing scheduling frameworks for container clusters, the distributed models lack of visibility at an upper-level scheduler might generate conflicting job placements. Therefore, our proposed scheduler encompasses the functionality of both centralized and distributed frameworks. By employing a synchronized cluster state, we ensure an optimal scheduling mechanism for the resources utilization.

Original languageEnglish
Title of host publicationProceedings of the 3rd International Conference on Future Networks and Distributed Systems, ICFNDS 2019
PublisherAssociation for Computing Machinery (ACM)
Number of pages12
ISBN (Electronic)9781450371636
DOIs
Publication statusPublished - 2019
Event3rd International Conference on Future Networks and Distributed Systems, ICFNDS 2019 - Paris, France
Duration: 1 Jul 20192 Jul 2019

Conference

Conference3rd International Conference on Future Networks and Distributed Systems, ICFNDS 2019
CountryFrance
CityParis
Period1/07/192/07/19

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

  • Affinity
  • Anti-affinity
  • Collocation interference
  • Inherent rescheduling
  • Kubernetes cluster
  • Node feasibility
  • Opportunistic scheduling
  • Optimistically concurrent transaction
  • Pod
  • Priority preemption
  • Service
  • Taints
  • Tolerations

Fingerprint

Dive into the research topics of 'Kubernetes cluster optimization using hybrid shared-state scheduling framework'. Together they form a unique fingerprint.

Cite this