Skip navigation
Please use this identifier to cite or link to this item:
Title: Visual rendering of shapes on 2D display devices guided by hand gestures
Authors: Singla A.
Pratim Roy, Partha
Dogra D.P.
Published in: Displays
Abstract: Designing of touchless user interface is gaining popularity in various contexts. Users can interact with electronic devices using such interfaces even when their hands are dirty or non-conductive. Also, users with partial physical disability can interact with electronic devices with the help of touchless interfaces. In this paper, we propose a Leap Motion controller-based methodology to facilitate rendering of 2D and 3D shapes on display devices. The proposed method tracks finger movements while users perform natural gestures within the field of view of the motion sensor. Then, trajectories are analyzed to extract extended Npen++ features in 3D. These features capture finger movements during the gestures and they are fed to unidirectional left-to-right Hidden Markov Model (HMM) for training. A one-to-one mapping between gestures and shapes, is proposed. Finally, the shapes corresponding to these gestures are rendered over the display using a typical MuPad supported interface. We have created a dataset of 5400 samples recorded by 10 volunteers. Our dataset contains 18 geometric and 18 non-geometric shapes such as “circle”, “rectangle”, “flower”, “cone”, “sphere”, etc. The proposed method has achieved 92.87% accuracy using a 5-fold cross validation scheme. Experiments reveal that the extended 3D features perform better than the existing 3D features when applied for shape representation and classification. The method can be used for developing diverse HCI applications suitable for smart display devices. © 2019 Elsevier B.V.
Citation: Displays (2019), 57(): 18-33
Issue Date: 2019
Publisher: Elsevier B.V.
Keywords: 3D rendering
Gesture recognition
Shape matching
Shape rendering
ISSN: 1419382
Author Scopus IDs: 57208052015
Author Affiliations: Singla, A., Department of Electronics and Communication Engineering, NIT Kurukshetra, India
Roy, P.P., Department of Computer Science and Engineering, IIT Roorkee, India
Dogra, D.P., School of Electrical Sciences, IIT Bhubaneswar, India
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.