Tucker visual search-based hybrid tracking model and Fractional Kohonen Self-Organizing Map for anomaly localization and detection in surveillance videos

Abstract

Anomaly detection (AD) in video is a challenging task employed in the intelligent video surveillance applications. This paper presents a technique for localizing and detecting anomalies in surveillance videos by proposing hybrid tracking model and Fractional Kohonen Self-Organizing Map (FKSOM). At first, the objects in the initial frames are detected by extracting the background and comparing with the succeeding frames. Then, a tracking model is developed to track the objects in the frame. Further, the features, such as object shape, speed, energy, correlation, and homogeneity, are extracted in the feature extraction process. Finally, the proposed FKSOM algorithm performs AD by identifying anomalous and normal events in the frame. The performance of the proposed technique is evaluated using the metrics, such as Multiple Object Tracking Precision (MOTP), accuracy, sensitivity, and specificity, where it obtains MOTP of 0.9895 with an average accuracy of 0.9339, the sensitivity of 0.9288 and specificity of 1. © 2017 The Royal Photographic Society.