Virtualizing stream processing

Michael Duller, Jan S. Rellermeyer, Gustavo Alonso, Nesime Tatbul

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

6 Citations (Scopus)

Abstract

Stream processing systems have evolved into established solutions as standalone engines but they still lack flexibility in terms of large-scale deployment, integration, extensibility, and interoperability. In the last years, a substantial ecosystem of new applications has emerged that can potentially benefit from stream processing but introduces different requirements on how stream processing solutions can be integrated, deployed, extended, and federated. To address these needs, we present an exoengine architecture and the associated ExoP platform. Together, they provide the means for encapsulating components of stream processing systems as well as automating the data exchange between components and their distributed deployment. The proposed solution can be used, e.g., to connect heterogeneous streaming engines, replace operators at runtime, and migrate operators across machines with a negligible overhead.
Original languageEnglish
Title of host publicationMiddleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings
Place of PublicationBerlin
PublisherSpringer
Pages269-288
Number of pages20
Volume7049 LNCS
ISBN (Electronic)978-3-642-25821-3
ISBN (Print)9783642258206
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011 - Lisbon, Portugal
Duration: 12 Dec 201116 Dec 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7049 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Conference

Conference12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011
CountryPortugal
CityLisbon
Period12/12/1116/12/11

Keywords

  • federation
  • stream processing
  • virtualization

Fingerprint Dive into the research topics of 'Virtualizing stream processing'. Together they form a unique fingerprint.

Cite this