Skip navigation
Please use this identifier to cite or link to this item:
Title: Keyword spotting in doctor's handwriting on medical prescriptions
Authors: Pratim Roy, Partha
Bhunia A.K.
Das A.
Dhar P.
Pal U.
Published in: Expert Systems with Applications
Abstract: In this paper, we propose a word spotting based information retrieval approach for medical prescriptions/reports written by doctors. Sometimes due to almost illegible handwriting, it is difficult to understand the medication reports of doctors. This often confuses the patients about the actual medicine/disease names written by doctors and as a consequence they suffer. A medical prescription is generally partitioned into two parts, a printed letterhead part containing the doctor's name, designation, organization name, etc. and a handwritten part where the doctor writes patient's name and report his/her findings and suggests medicine names. There are many significance impacts of the proposed work. For example, such work can be used (i) to develop expert diagnostic systems (ii) to extract information from patient history that can be obtained by this proposed method (iii) to detect wrong medication (iv) to make different statistical analysis of the medicines prescribed by the doctors etc. To extract the information from such document images, first we extract the domain specific knowledge of doctors by identifying department names from the printed text that appears in letterhead part. From the letterhead text, the specialty/expertise of doctors is understood and this helps us to search only relevant prescription documents for word spotting in handwritten portion. Word spotting in letterhead part as well as in handwritten part has been performed using Hidden Markov Model. An efficient MLP (Multilayer Perceptron) based Tandem feature is proposed to improve the performance. From the experiment with 500 prescriptions, we have obtained encouraging results. Information from printed letterhead part improved the word spotting performance in handwritten part, significantly. © 2017 Elsevier Ltd
Citation: Expert Systems with Applications (2017), 76(): 113-128
Issue Date: 2017
Publisher: Elsevier Ltd
Keywords: Hidden Markov model
Knowledge extraction
Medical prescriptions
Printed/handwritten text separation
Word spotting
ISSN: 9574174
Author Scopus IDs: 56880478500
Author Affiliations: Roy, P.P., Department of CSE, Indian Institute of Technology Roorkee, India
Bhunia, A.K., Department of ECE, Institute of Engineering & Management, Kolkata, India
Das, A., Department of ECE, Institute of Engineering & Management, Kolkata, India
Dhar, P., Department of CSE, Institute of Engineering & Management, Kolkata, India
Pal, U., CVPR Unit, Indian Statistical Institute, Kolkata, India
Corresponding Author: Roy, P.P.; Department of CSE, Indian Institute of Technology RoorkeeIndia; email:
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.