Monocular Image Based 3D Model Retrieval

Wenhui Li, Anan Liu, Weizhi Nie, Dan Song, Yuqian Li, Zjenja Doubrovski, Jo Geraedts, Zishun Liu, Yunsheng Ma, More Authors

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

Monocular image based 3D object retrieval is a novel and challenging research topic in the field of 3D object retrieval. Given a RGB image captured in real world, it aims to search for relevant 3D objects from a dataset. To advance this promising research, we organize this SHREC track and build the first monocular image based 3D object retrieval benchmark by collecting 2D images from ImageNet and 3D objects from popular 3D datasets such as NTU, PSB, ModelNet40 and ShapeNet. The benchmark contains classified 21,000 2D images and 7,690 3D objects of 21 categories. This track attracted 9 groups from 4 countries and the submission of 20 runs. To have a comprehensive comparison, 7 commonly-used retrieval performance metrics have been used to evaluate their retrieval performance. The evaluation results show that the supervised cross domain learning get the superior retrieval performance (Best NN is 97.4 %) by bridging the domain gap with label information. However, there is still a big challenge for unsupervised cross domain learning (Best NN is 61.2%), which is more practical for the real application. Although we provided both view images and OBJ file for each 3D model, all the participants use the view images to represent the 3D model. One of the interesting work in the future is directly using the 3D information and 2D RGB information to solve the task of monocular Image based 3D model retrieval.
Original languageEnglish
Title of host publicationEurographics Workshop on 3D Object Retrieval
EditorsSilvia Biasotti, Guillaume Lavoué
PublisherThe Eurographics Association
Pages103-110
Number of pages8
ISBN (Electronic)978-3-03868-077-2
ISBN (Print)1997-0471
DOIs
Publication statusPublished - 2019

Fingerprint Dive into the research topics of 'Monocular Image Based 3D Model Retrieval'. Together they form a unique fingerprint.

  • Cite this

    Li, W., Liu, A., Nie, W., Song, D., Li, Y., Doubrovski, Z., Geraedts, J., Liu, Z., Ma, Y., & More Authors (2019). Monocular Image Based 3D Model Retrieval. In S. Biasotti, & G. Lavoué (Eds.), Eurographics Workshop on 3D Object Retrieval (pp. 103-110). The Eurographics Association. https://doi.org/10.2312/3dor.20191068