Skip navigation
Please use this identifier to cite or link to this item: http://repository.iitr.ac.in/handle/123456789/5627
Title: A position and rotation invariant framework for sign language recognition (SLR) using Kinect
Authors: Kumar P.
Saini R.
Pratim Roy, Partha
Dogra D.P.
Published in: Multimedia Tools and Applications
Abstract: Sign language is the only means of communication for speech and hearing impaired people. Using machine translation, Sign Language Recognition (SLR) systems provide medium of communication between speech and hearing impaired and others who have difficulty in understanding such languages. However, most of the SLR systems require the signer to sign in front of the capturing device/sensor. Such systems fail to recognize some gestures when the relative position of the signer is changed or when the body occlusion occurs due to position variations. In this paper, we present a robust position invariant SLR framework. A depth-sensor device (Kinect) has been used to obtain the signer’s skeleton information. The framework is capable of recognizing occluded sign gestures and has been tested on a dataset of 2700 gestures. The recognition process has been performed using Hidden Markov Model (HMM) and the results show the efficiency of the proposed framework with an accuracy of 83.77% on occluded gestures. © 2017, Springer Science+Business Media New York.
Citation: Multimedia Tools and Applications (2018), 77(7): 8823-8846
URI: https://doi.org/10.1007/s11042-017-4776-9
http://repository.iitr.ac.in/handle/123456789/5627
Issue Date: 2018
Publisher: Springer New York LLC
Keywords: Depth sensors
Hidden Markov Model (HMM)
Occluded gestures
Sign language
ISSN: 13807501
Author Scopus IDs: 57212043589
57190288840
56880478500
35408975400
Author Affiliations: Kumar, P., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Saini, R., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Roy, P.P., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Dogra, D.P., School of Electrical Sciences, IIT Bhubaneswar, Bhubaneswar, India
Corresponding Author: Kumar, P.; Department of Computer Science and Engineering, IIT RoorkeeIndia; email: pradeep.iitr7@gmail.com
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record


Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.