Metadata Representations for Queryable Repositories of Machine Learning Models

Ziyu Li*, Henk Kant, Rihan Hai, Asterios Katsifodimos, Marco Brambilla, Alessandro Bozzon

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

81 Downloads (Pure)

Abstract

Machine learning (ML) practitioners and organizations are building model repositories of pre-trained models, referred to as model zoos. These model zoos contain metadata describing the properties of the ML models and datasets. The metadata serves crucial roles for reporting, auditing, ensuring reproducibility, and enhancing interpretability. Despite the growing adoption of descriptive formats like datasheets and model cards, the metadata available in existing model zoos remains notably limited. Moreover, existing formats have limited expressiveness, thus constraining the potential use of model repositories, extending their purpose beyond mere storage for pre-trained models. This paper proposes a unified metadata representation format for model zoos. We illustrate that comprehensive metadata enables a diverse range of applications, encompassing model search, reuse, comparison, and composition of ML models. We also detail the design and highlight the implementation of an advanced model zoo system built on top of our proposed metadata representation.

Original languageEnglish
Pages (from-to)125616-125630
Number of pages15
JournalIEEE Access
Volume11
DOIs
Publication statusPublished - 2023

Keywords

  • Machine learning
  • metadata representations
  • model search
  • model zoo

Fingerprint

Dive into the research topics of 'Metadata Representations for Queryable Repositories of Machine Learning Models'. Together they form a unique fingerprint.

Cite this