A metadata framework for data lagoons

Vasileios Theodorou; Rihan Hai; Christoph Quix

doi:10.1007/978-3-030-30278-8_44

A metadata framework for data lagoons

Vasileios Theodorou, Rihan Hai, Christoph Quix

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

4 Citations (Scopus)

Abstract

In this work, we present a Metadata Framework in the direction of extending intelligence mechanisms from the Cloud to the Edge. To this end, we build on our previously introduced notion of Data Lagoons—the analogous to Data Lakes at the network edge—and we introduce a novel architecture and Metadata model for the efficient interaction between Data Lagoons and Data Lakes. We identify the service and data planes of our architecture and we illustrate the application of our framework on a use case from the TPCx-IoT benchmark. To our knowledge, our approach is the first one to examine the integration of Data Lakes with Edge components, taking under consideration data and infrastructure resources of Edge Nodes.

Original language	English
Title of host publication	New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings
Editors	Tatjana Welzer, Vili Podgorelec, Aida Kamišalic Latific, Johann Eder, Robert Wrembel, Mikolaj Morzy, Mirjana Ivanovic, Johann Gamper, Theodoros Tzouramanis, Jérôme Darmont
Pages	452-462
Number of pages	11
ISBN (Electronic)	978-3-030-30278-8
DOIs	https://doi.org/10.1007/978-3-030-30278-8_44
Publication status	Published - 2019
Externally published	Yes

Publication series

Name	Communications in Computer and Information Science
Volume	1064
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Keywords

Data Lagoon
Data Lake
Edge Computing
Metadata

Access to Document

10.1007/978-3-030-30278-8_44

Cite this

Theodorou, V., Hai, R., & Quix, C. (2019). A metadata framework for data lagoons. In T. Welzer, V. Podgorelec, A. Kamišalic Latific, J. Eder, R. Wrembel, M. Morzy, M. Ivanovic, J. Gamper, T. Tzouramanis, & J. Darmont (Eds.), New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings (pp. 452-462). (Communications in Computer and Information Science; Vol. 1064). https://doi.org/10.1007/978-3-030-30278-8_44

Theodorou, Vasileios ; Hai, Rihan ; Quix, Christoph. / A metadata framework for data lagoons. New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings. editor / Tatjana Welzer ; Vili Podgorelec ; Aida Kamišalic Latific ; Johann Eder ; Robert Wrembel ; Mikolaj Morzy ; Mirjana Ivanovic ; Johann Gamper ; Theodoros Tzouramanis ; Jérôme Darmont. 2019. pp. 452-462 (Communications in Computer and Information Science).

@inproceedings{b17859977fa24f5da7711622879393ac,

title = "A metadata framework for data lagoons",

abstract = "In this work, we present a Metadata Framework in the direction of extending intelligence mechanisms from the Cloud to the Edge. To this end, we build on our previously introduced notion of Data Lagoons—the analogous to Data Lakes at the network edge—and we introduce a novel architecture and Metadata model for the efficient interaction between Data Lagoons and Data Lakes. We identify the service and data planes of our architecture and we illustrate the application of our framework on a use case from the TPCx-IoT benchmark. To our knowledge, our approach is the first one to examine the integration of Data Lakes with Edge components, taking under consideration data and infrastructure resources of Edge Nodes.",

keywords = "Data Lagoon, Data Lake, Edge Computing, Metadata",

author = "Vasileios Theodorou and Rihan Hai and Christoph Quix",

year = "2019",

doi = "10.1007/978-3-030-30278-8_44",

language = "English",

isbn = "9783030302771",

series = "Communications in Computer and Information Science",

pages = "452--462",

editor = "Tatjana Welzer and Vili Podgorelec and {Kami{\v s}alic Latific}, Aida and Johann Eder and Robert Wrembel and Mikolaj Morzy and Mirjana Ivanovic and Johann Gamper and Theodoros Tzouramanis and J{\'e}r{\^o}me Darmont",

booktitle = "New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings",

}

Theodorou, V, Hai, R & Quix, C 2019, A metadata framework for data lagoons. in T Welzer, V Podgorelec, A Kamišalic Latific, J Eder, R Wrembel, M Morzy, M Ivanovic, J Gamper, T Tzouramanis & J Darmont (eds), New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings. Communications in Computer and Information Science, vol. 1064, pp. 452-462. https://doi.org/10.1007/978-3-030-30278-8_44

A metadata framework for data lagoons. / Theodorou, Vasileios; Hai, Rihan; Quix, Christoph.
New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings. ed. / Tatjana Welzer; Vili Podgorelec; Aida Kamišalic Latific; Johann Eder; Robert Wrembel; Mikolaj Morzy; Mirjana Ivanovic; Johann Gamper; Theodoros Tzouramanis; Jérôme Darmont. 2019. p. 452-462 (Communications in Computer and Information Science; Vol. 1064).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - A metadata framework for data lagoons

AU - Theodorou, Vasileios

AU - Hai, Rihan

AU - Quix, Christoph

PY - 2019

Y1 - 2019

N2 - In this work, we present a Metadata Framework in the direction of extending intelligence mechanisms from the Cloud to the Edge. To this end, we build on our previously introduced notion of Data Lagoons—the analogous to Data Lakes at the network edge—and we introduce a novel architecture and Metadata model for the efficient interaction between Data Lagoons and Data Lakes. We identify the service and data planes of our architecture and we illustrate the application of our framework on a use case from the TPCx-IoT benchmark. To our knowledge, our approach is the first one to examine the integration of Data Lakes with Edge components, taking under consideration data and infrastructure resources of Edge Nodes.

AB - In this work, we present a Metadata Framework in the direction of extending intelligence mechanisms from the Cloud to the Edge. To this end, we build on our previously introduced notion of Data Lagoons—the analogous to Data Lakes at the network edge—and we introduce a novel architecture and Metadata model for the efficient interaction between Data Lagoons and Data Lakes. We identify the service and data planes of our architecture and we illustrate the application of our framework on a use case from the TPCx-IoT benchmark. To our knowledge, our approach is the first one to examine the integration of Data Lakes with Edge components, taking under consideration data and infrastructure resources of Edge Nodes.

KW - Data Lagoon

KW - Data Lake

KW - Edge Computing

KW - Metadata

UR - http://www.scopus.com/inward/record.url?scp=85072970701&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-30278-8_44

DO - 10.1007/978-3-030-30278-8_44

M3 - Conference contribution

SN - 9783030302771

T3 - Communications in Computer and Information Science

SP - 452

EP - 462

BT - New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings

A2 - Welzer, Tatjana

A2 - Podgorelec, Vili

A2 - Kamišalic Latific, Aida

A2 - Eder, Johann

A2 - Wrembel, Robert

A2 - Morzy, Mikolaj

A2 - Ivanovic, Mirjana

A2 - Gamper, Johann

A2 - Tzouramanis, Theodoros

A2 - Darmont, Jérôme

ER -

Theodorou V, Hai R, Quix C. A metadata framework for data lagoons. In Welzer T, Podgorelec V, Kamišalic Latific A, Eder J, Wrembel R, Morzy M, Ivanovic M, Gamper J, Tzouramanis T, Darmont J, editors, New Trends in Databases and Information Systems - ADBIS 2019 Short Papers, Workshops BBIGAP, QAUCA, SemBDM, SIMPDA, M2P, MADEISD, and Doctoral Consortium 2019, Proceedings. 2019. p. 452-462. (Communications in Computer and Information Science). doi: 10.1007/978-3-030-30278-8_44

A metadata framework for data lagoons

Abstract

Publication series

Keywords

Access to Document

Other files and links

Fingerprint

Cite this