Macaroni: Crawling and Enriching Metadata from Public Model Zoos

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

17 Downloads (Pure)

Abstract

Machine learning (ML) researchers and practitioners are building repositories of pre-trained models, called model zoos. These model zoos contain metadata that detail various properties of the ML models and datasets, which are useful for reporting, auditing, reproducibility, and interpretability. Unfortunately, the existing metadata representations come with limited expressivity and lack of standardization. Meanwhile, an interoperable method to store and query model zoo metadata is missing. These two gaps hinder model search, reuse, comparison, and composition. In this demo paper, we advocate for standardized ML model metadata representation, proposing Macaroni, a metadata search engine with toolkits that support practitioners to obtain and enrich that metadata.
Original languageEnglish
Title of host publicationInternational Conference on Web Engineering
Pages376-380
DOIs
Publication statusPublished - 2023

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care
Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Fingerprint

Dive into the research topics of 'Macaroni: Crawling and Enriching Metadata from Public Model Zoos'. Together they form a unique fingerprint.

Cite this