Big data software analytics with Apache Spark

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

3 Citations (Scopus)

Abstract

At the beginning of every research effort, researchers in empirical software engineering have to go through the processes of extracting data from raw data sources and transforming them to what their tools expect as inputs. This step is time consuming and error prone, while the produced artifacts (code, intermediate datasets) are usually not of scientific value. In the recent years, Apache Spark has emerged as a solid foundation for data science and has taken the big data analytics domain by storm. We believe that the primitives exposed by Apache Spark can help software engineering researchers create and share reproducible, high-performance data analysis pipelines. In our technical briefing, we discuss how researchers can profit from Apache Spark, through a hands-on case study.

Original languageEnglish
Title of host publicationProceedings of the 40th International Conference on Software Engineering, ICSE '18
Subtitle of host publicationCompanion Proceedings
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Pages542-543
Number of pages2
VolumePart F137351
ISBN (Electronic)978-1-4503-5663-3
DOIs
Publication statusPublished - 2018
EventICSE 2018: 40th International Conference on Software Engineering - Gothenburg, Sweden
Duration: 27 May 20183 Jun 2018
Conference number: 40
https://www.icse2018.org/

Conference

ConferenceICSE 2018
CountrySweden
CityGothenburg
Period27/05/183/06/18
Internet address

Keywords

  • Apache Spark
  • Big data
  • Data analytics

Fingerprint Dive into the research topics of 'Big data software analytics with Apache Spark'. Together they form a unique fingerprint.

  • Cite this

    Gousios, G. (2018). Big data software analytics with Apache Spark. In Proceedings of the 40th International Conference on Software Engineering, ICSE '18: Companion Proceedings (Vol. Part F137351, pp. 542-543). Association for Computing Machinery (ACM). https://doi.org/10.1145/3183440.3183458