Self-adaptive Executors for Big Data Processing

Dataset

Description

This dataset contains the measurements obtained with Apache Spark using different strategies for adapting the number of executor threads to reduce I/O contention. The two main strategies explored are a static solution (number of executor threads for I/O intensive tasks pre-determined) and a dynamic solution that employs an active control loop to measure epoll_wait time.
Date made available6 Sep 2019
PublisherTU Delft - 4TU.ResearchData
Date of data production2018 - 2019

Cite this