Skip navigation
Please use this identifier to cite or link to this item:
Title: 3D word spotting using leap motion sensor
Authors: Pratim Roy, Partha
Kumar P.
Patidar S.
Saini R.
Published in: Multimedia Tools and Applications
Abstract: Leap motion sensor provides a new way of interaction with computers or mobile devices. With this sensor, users can write in air by moving palm or finger, thus, avoiding traditional pen and paper for writing. The strokes of air-writing or 3D writing is different from conventional way of writing. In 3D writing, the words are connected by continuous lines instead of space between them. Also, the arbitrary size of characters and presence of frequent jitters in strokes make the recognition tasks of such words and sentences difficult. To understand the semantics of a word without recognizing each character of words, the alternative process called “word-spotting” is being used. Word-spotting is often useful than conventional recognition systems to understand complex handwriting. Hence, we propose a novel word spotting methodology for 3D text using Leap motion sensor data. Spotting/detection of a keyword in 3D sentences is carried out using Hidden Markov Model (HMM) framework. From experimental study, an average of 41.7 is recorded in terms of Mean-Average-Precision (MAP). The efficiency of the system is demonstrated by comparing traditional segmentation based system. The improved performance shows that the system could be used in developing novel applications in Human-Computer-Interaction (HCI) domain. © 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC part of Springer Nature.
Citation: Multimedia Tools and Applications, 80(8): 11671-11689
Issue Date: 2021
Publisher: Springer
Keywords: 3D words
Human computer interface
Leap motion
ISSN: 13807501
Author Scopus IDs: 56880478500
Author Affiliations: Roy, P.P., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Kumar, P., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Patidar, S., Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India
Saini, R., EISLAB Machine Learning, Department of Computer Science, Electrical and Space Engineering, Luleå tekniska universitet, Luleå, Sweden
Corresponding Author: Kumar, P.; Department of Computer Science and Engineering, India; email:
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.