Skip navigation
Please use this identifier to cite or link to this item: http://repository.iitr.ac.in/handle/123456789/5617
Title: Summarization of videos by analyzing affective state of the user through crowdsource
Authors: Singhal A.
Kumar P.
Saini R.
Pratim Roy, Partha
Dogra D.P.
Kim B.-G.
Published in: Cognitive Systems Research
Abstract: Video summarization is one of the key techniques to access and manage a huge chunk of videos. Video summarization is used to extract the effective contents of a video sequence to generate a concise representation of its content. The involvement of crowdsourcing models in recent years is effectively used by researchers in E-commerce domain to increase the quality of the data contents. In this paper, we present a video summarization framework based on users emotion while they watch videos by analyzing cerebral activities through Electroencephalogram (EEG) signals. Three emotions, namely happy, sad and neutral have been extracted from the EEG signals. Video frames have been synchronized with EEG signals and tagged with various emotions. Finally, a crowdsourcing model has been used for effective summarization of the videos. The qualitative assessment of video summarization has been conducted with the help of user ratings using online Google Forms application. EEG signals of 28 users have been recorded while video streams of different emotions. An average accuracy of 83.93% has been recorded in emotion classification using crowdsourcing. Output summarized videos include dynamic video skims and the corresponding audio stream for better understanding. © 2018 Elsevier B.V.
Citation: Cognitive Systems Research (2018), 52(): 917-930
URI: https://doi.org/10.1016/j.cogsys.2018.09.019
http://repository.iitr.ac.in/handle/123456789/5617
Issue Date: 2018
Publisher: Elsevier B.V.
Keywords: Crowdsourcing
Electroencephalogram (EEG)
Random Forest
Video summarization
ISSN: 13890417
Author Scopus IDs: 57203987839
57212043589
57190288840
56880478500
35408975400
7501567302
Author Affiliations: Singhal, A., Department of Computer Science Engineering, Indian Institute of Technology, Roorkee, India
Kumar, P., Department of Computer Science Engineering, Indian Institute of Technology, Roorkee, India
Saini, R., Department of Computer Science Engineering, Indian Institute of Technology, Roorkee, India
Roy, P.P., Department of Computer Science Engineering, Indian Institute of Technology, Roorkee, India
Dogra, D.P., Department of Electrical Science, Indian Institute of Technology, Bhubaneswar, India
Kim, B.-G., Department of IT Engineering, Sookmyung Women's University, South Korea
Corresponding Author: Saini, R.; Department of Computer Science Engineering, Indian Institute of Technology, RoorkeeIndia; email: rajkumarsaini.rs@gmail.com
Appears in Collections:Journal Publications [CS]

Files in This Item:
There are no files associated with this item.
Show full item record


Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.