Skip to main navigation Skip to search Skip to main content

Multi-modal descriptors for multi-class hand pose recognition in human computer interaction systems

  • Jordi Abella
  • , Raúl Alcaide
  • , Anna Sabaté
  • , Joan Mas
  • , Sergio Escalera
  • , Jordi Gonzàlez
  • , Coen Antens

Research output: Book chapterConference contributionpeer-review

3 Citations (Scopus)

Abstract

Hand pose recognition in advanced Human Computer Interaction systems (HCI) is becoming more feasible thanks to the use of affordable multi-modal RGB-Depth cameras. Depth data generated by these sensors is a very valuable input information, although the representation of 3D descriptors is still a critical step to obtain robust object representations. This paper presents an overview of different multi-modal descriptors, and provides a comparative study of two feature descriptors called Multi-modal Hand Shape (MHS) and Fourier-based Hand Shape (FHS), which compute local and global 2D-3D hand shape statistics to robustly describe hand poses. A new dataset of 38K hand poses has been created for real-time hand pose and gesture recognition, corresponding to five hand shape categories recorded from eight users. Experimental results show good performance of the fused MHS and FHS descriptors, improving recognition accuracy while assuring real-time computation in HCI scenarios.

Original languageEnglish
Title of host publicationICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction
Pages503-508
Number of pages6
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013 - Sydney, NSW, Australia
Duration: 9 Dec 201313 Dec 2013

Publication series

NameICMI 2013 - Proceedings of the 2013 ACM International Conference on Multimodal Interaction

Conference

Conference2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013
Country/TerritoryAustralia
CitySydney, NSW
Period9/12/1313/12/13

Keywords

  • classifier
  • detection
  • features
  • hci
  • k-nn
  • multi-modal
  • random forest
  • svm

Fingerprint

Dive into the research topics of 'Multi-modal descriptors for multi-class hand pose recognition in human computer interaction systems'. Together they form a unique fingerprint.

Cite this