Identify finger rotation angles with aruco markers and action cameras

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

Measuring the motion of human hand joints is a challenging task due to the high number of DOFs. In this study, we proposed a low-cost hand tracking system built on action cameras and ArUco markers to measure finger joint rotation angles. The lens distortion of each camera was corrected first via intra-calibration and the videos of different cameras were aligned to the reference camera using a dynamic time warping based method. Two methods were proposed and implemented for extracting the rotation angles of finger joints: one is based on the 3D positions of the markers via inter-calibration between cameras, named pos-based method; the other one is based on the relative marker orientation information from individual cameras, named rot-based method. An experiment was conducted to evaluate the effectiveness of the proposed system. The right hand of a volunteer was included in this practical study, where the movement of the fingers was recorded and the finger rotation angles were calculated with the two proposed methods, respectively. The results indicated that although using the rot-based method may collect less data than using the pos-based method, it was more stable and reliable. Therefore, the rot-based method is recommended for measuring finger joint rotation in practical setups.

Original languageEnglish
Title of host publication41st Computers and Information in Engineering Conference (CIE)
PublisherThe American Society of Mechanical Engineers(ASME)
Number of pages9
ISBN (Electronic)978-0-7918-8537-6
DOIs
Publication statusPublished - 2021
Event41st Computers and Information in Engineering Conference, CIE 2021, Held as Part of the ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2021 - Virtual, Online
Duration: 17 Aug 202119 Aug 2021

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume2

Conference

Conference41st Computers and Information in Engineering Conference, CIE 2021, Held as Part of the ASME 2021 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2021
CityVirtual, Online
Period17/08/2119/08/21

Keywords

  • ArUco marker
  • Finger joint rotation angles
  • Hand tracking

Fingerprint

Dive into the research topics of 'Identify finger rotation angles with aruco markers and action cameras'. Together they form a unique fingerprint.

Cite this