Skip navigation
Please use this identifier to cite or link to this item: http://repository.iitr.ac.in/handle/123456789/5586
Title: Fusion of spatio-temporal information for indic word recognition combining online and offline text data
Authors: Mukherjee S.
Kumar P.
Pratim Roy, Partha
Published in: ACM Transactions on Asian and Low-Resource Language Information Processing
Abstract: We present a novel Indic handwritten word recognition scheme by fusion of spatio-temporal information extracted from handwritten images. The main challenge in Indic word recognition lies in its complexity because of modifiers, touching characters, and compound characters. Hidden Markov Models (HMMs) are being used to model such data due to their ability to learn sequential data, however, the recognition performance is not satisfactory. We propose here a Long Short-Term Memory (LSTM)-based architecture for offline Indic word recognition. Offline recognition methods usually involve spatial data, whereas it has been observed that online recognition schemes show better performance than the offline methodologies. Online information usually refers to the temporal information obtained from the strokes of the pen tip while writing, which is missing in offline word images. In this article, an effort has been made to extract the online temporal information from offline images using stroke recovery and later it is combined with spatial information in LSTM architecture. During recognition, the character models are trained using both offline and extracted pseudo-online handwritten data separately. Finally, a novel fusion scheme has been used to combine them together. From the experiment, it is noted that recognition performance of handwritten Indic words improves considerably due to the fusion scheme of spatial and temporal data. © 2019 Association for Computing Machinery.
Citation: ACM Transactions on Asian and Low-Resource Language Information Processing (2019), 19(2): -
URI: https://doi.org/10.1145/3364533
http://repository.iitr.ac.in/handle/123456789/5586
Issue Date: 2019
Publisher: Association for Computing Machinery
Keywords: Fusion
Indic word recognition
LSTM
Offline to online conversion
ISSN: 23754699
Author Scopus IDs: 57211037717
57212043589
56880478500
Author Affiliations: Mukherjee, S., Electronics and Communication Engineering, Institute of Engineering and Management, Kolkata, West Bengal 700091, India
Kumar, P., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, 247667, India
Roy, P.P., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, 247667, India
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record


Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.