Artifact: Masa: Responsive Multi-DNN Inference on the Edge

Bart Cox, Jeroen Galjaard, Amirmasoud Ghiassi, Robert Birke, Lydia Y. Chen

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

3 Citations (Scopus)

Abstract

This artifact is a guideline how the Edgecaffe framework, presented in [1], can be used. Edgecaffe is an open-source Deep Neural Network framework for efficient multi-network inference on edge devices. This framework enables the layer by layer execution and fine-grained control during inference of Deep Neural Networks. Edgecaffe is created to give more fine grained-control over the execution during inference than offered by the original code of Caffe [2]. Edgecaffe made it possible for Masa to outperform Deepeye [3] and normal bulk execution. Besides the core implementation of Edgecaffe, the repository holds additional tools, Queue Runner and ModelSplitter, that make more convenient to run experiments and prepare newly trained networks

Original languageEnglish
Title of host publication2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages446-447
Number of pages2
ISBN (Electronic)9781665404242
DOIs
Publication statusPublished - 2021
Event2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021 - Kassel, Germany
Duration: 22 Mar 202126 Mar 2021

Publication series

Name2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021

Conference

Conference2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2021
Country/TerritoryGermany
CityKassel
Period22/03/2126/03/21

Keywords

  • edge devices
  • mean response time
  • memory-aware scheduling
  • Multiple DNNs inference

Fingerprint

Dive into the research topics of 'Artifact: Masa: Responsive Multi-DNN Inference on the Edge'. Together they form a unique fingerprint.

Cite this