Skip navigation
Please use this identifier to cite or link to this item: http://repository.iitr.ac.in/handle/123456789/5550
Title: Prediction of advertisement preference by fusing EEG response and sentiment analysis
Authors: Gauba H.
Kumar P.
Roy P.P.
Singh P.
Dogra D.P.
Raman B.
Published in: Neural Networks
Abstract: This paper presents a novel approach to predict rating of video-advertisements based on a multimodal framework combining physiological analysis of the user and global sentiment-rating available on the internet. We have fused Electroencephalogram (EEG) waves of user and corresponding global textual comments of the video to understand the user's preference more precisely. In our framework, the users were asked to watch the video-advertisement and simultaneously EEG signals were recorded. Valence scores were obtained using self-report for each video. A higher valence corresponds to intrinsic attractiveness of the user. Furthermore, the multimedia data that comprised of the comments posted by global viewers, were retrieved and processed using Natural Language Processing (NLP) technique for sentiment analysis. Textual contents from review comments were analyzed to obtain a score to understand sentiment nature of the video. A regression technique based on Random forest was used to predict the rating of an advertisement using EEG data. Finally, EEG based rating is combined with NLP-based sentiment score to improve the overall prediction. The study was carried out using 15 video clips of advertisements available online. Twenty five participants were involved in our study to analyze our proposed system. The results are encouraging and these suggest that the proposed multimodal approach can achieve lower RMSE in rating prediction as compared to the prediction using only EEG data. © 2017 Elsevier Ltd
Citation: Neural Networks (2017), 92(): 77-88
URI: https://doi.org/10.1016/j.neunet.2017.01.013
http://repository.iitr.ac.in/handle/123456789/5550
Issue Date: 2017
Publisher: Elsevier Ltd
Keywords: EEG signal analysis
Multimedia indexing and retrieval
Multimodal rating
Predictive modeling
Sentiment analysis
ISSN: 8936080
Author Scopus IDs: 57192437259
57212043589
56880478500
57212591690
35408975400
23135470700
Author Affiliations: Gauba, H., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India
Kumar, P., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India
Roy, P.P., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India
Singh, P., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India
Dogra, D.P., School of Electrical Sciences, Indian Institute of Technology, Bhubaneswar, India
Raman, B., Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India
Corresponding Author: Gauba, H.; Department of Computer Science and Engineering, Indian Institute of TechnologyIndia; email: gauba.himanshu@gmail.com
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.