Indexing and Retrieving Voice Recordings by Instantly Tagging Mentioned Objects with Dots

Thibaut van Bergen, Rui Ishiyama, Kengo Makino, Yuta Kudo, Toru Takahashi, Hans Goosen

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

29 Downloads (Pure)

Abstract

This paper presents a novel framework and its prototype tool for indexing and retrieving specific fragments of voice recordings obtained during discussions about physical objects such as text documents, pictures, or 3D models. When a specific part of an object is mentioned, it is tagged with an ink dot that is immediately registered in a database by capturing a microscopic image of the dot. Simultaneously, an index of the recording fragment is created and linked with the dot. After the recording, a dot can be scanned and identified by matching its microscopic image with the database to retrieve the linked recording fragment for playback. A handy tool was developed to facilitate these operations while the user concentrates on the ongoing discussion. Performance tests of the dot identification have shown genuine matches without error. In demonstrations of a realistic usage scenario, the tool successfully facilitated the creation of indexes with dots during a voice recording and correctly played back all the specific recording fragments linked to the dots.
Original languageEnglish
Title of host publicationProceedings of the IEEE 5th World Forum on Internet of Things (WF-IoT)
Place of PublicationPiscataway, NJ, USA
PublisherIEEE
Pages183-188
ISBN (Electronic)978-1-5386-4980-0
DOIs
Publication statusPublished - 2019
Event2019 IEEE 5th World Forum on Internet of Things (WF-IoT) - Limerick, Ireland
Duration: 15 Apr 201918 Apr 2019

Conference

Conference2019 IEEE 5th World Forum on Internet of Things (WF-IoT)
CountryIreland
CityLimerick
Period15/04/1918/04/19

Keywords

  • voice recording
  • indexing
  • retrieval
  • playback
  • pattern recognition
  • identification
  • image matching

Fingerprint Dive into the research topics of 'Indexing and Retrieving Voice Recordings by Instantly Tagging Mentioned Objects with Dots'. Together they form a unique fingerprint.

  • Cite this

    van Bergen, T., Ishiyama, R., Makino, K., Kudo, Y., Takahashi, T., & Goosen, H. (2019). Indexing and Retrieving Voice Recordings by Instantly Tagging Mentioned Objects with Dots. In Proceedings of the IEEE 5th World Forum on Internet of Things (WF-IoT) (pp. 183-188). IEEE. https://doi.org/10.1109/WF-IoT.2019.8767339