Skip navigation
Please use this identifier to cite or link to this item: http://repository.iitr.ac.in/handle/123456789/5600
Title: A Modified LSTM Model for Continuous Sign Language Recognition Using Leap Motion
Authors: Mittal A.
Kumar P.
Pratim Roy, Partha
Balasubramanian R.
Chaudhuri B.B.
Published in: IEEE Sensors Journal
Abstract: Sign language facilitates communication between hearing impaired peoples and the rest of the society. A number of sign language recognition (SLR) systems have been developed by researchers, but they are limited to isolated sign gestures only. In this paper, we propose a modified long short-term memory (LSTM) model for continuous sequences of gestures or continuous SLR that recognizes a sequence of connected gestures. It is based on splitting of continuous signs into sub-units and modeling them with neural networks. Thus, the consideration of a different combination of sub-units is not required during training. The proposed system has been tested with 942 signed sentences of Indian Sign Language (ISL). These sign sentences are recognized using 35 different sign words. The average accuracy of 72.3% and 89.5% has been recorded on signed sentences and isolated sign words, respectively. © 2001-2012 IEEE.
Citation: IEEE Sensors Journal (2019), 19(16): 7056-7063
URI: https://doi.org/10.1109/JSEN.2019.2909837
http://repository.iitr.ac.in/handle/123456789/5600
Issue Date: 2019
Publisher: Institute of Electrical and Electronics Engineers Inc.
Keywords: deep neural networks
depth sensors
leap motion sensor
Sign language recognition
ISSN: 1530437X
Author Scopus IDs: 56763507700
57212043589
56880478500
7103127999
57210120100
Author Affiliations: Mittal, A., Department of Computer Science Engineering, Indian Institute of Technology Roorkee, Roorkee, 247667, India
Kumar, P., Department of Computer Science Engineering, Indian Institute of Technology Roorkee, Roorkee, 247667, India
Roy, P.P., Department of Computer Science Engineering, Indian Institute of Technology Roorkee, Roorkee, 247667, India
Balasubramanian, R., Department of Computer Science Engineering, Indian Institute of Technology Roorkee, Roorkee, 247667, India
Chaudhuri, B.B., Techno India University, Kolkata, 700091, India
Corresponding Author: Kumar, P.; Department of Computer Science Engineering, Indian Institute of Technology RoorkeeIndia; email: pradeep.iitr7@gmail.com
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record


Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.