Abstract
In real life, the types of anomalous events are diverse and low-frequency, and the collection and labeling of training data is complex. However, most detection algorithms are based on training data and test data, which are difficult to adapt to various monitoring scenarios. In this paper, we propose a video A nomaly D etection algorithm based on G raph S tructure C hange detection, which we call ADGSC. Firstly, we use key frame technique to pre-process the video and enhance the pseudo-periodicity of the video data. Second, our approach proposes an improved DTW algorithm for pseudo-periodicity estimation, which transforms periodicity estimation into a global matching growth rate optimization problem. Thus, the periodicity calculation no longer requires a priori knowledge or parameter settings and can be automatically computed in practical applications. Then, we stitch the normalized HSV histogram and HOG feature descriptors into feature vectors following the period obtained in the previous step for feature extraction of key frames. Further, a sliding window is used to build a graph model to measure the temporal variation of the video data, and median plot denoising is used to reduce the errors caused by feature extraction and metric methods, reduce background, blur and other noise interference, and improve the detection effect. Finally, we use box-line plots and box-line graphs to make decisions. Since we do not use deep learning methods, the evaluation metrics AUC and ROC applied for deep learning are no longer applicable to this method. Instead, our experiments use precision, recall, and F-value, which are commonly used in anomaly detection, to measure the effectiveness of our method. Experiment results show that our algorithm outperforms other current algorithms with unsupervised, adaptive, fault-tolerant, and real-time performance.







Similar content being viewed by others
Data Availability
The datasets analysed during the current study are available at: http://mha.cs.umn.edu/; http://www.cse.cuhk.edu.hk/leojia/projects/detectabnormal/dataset.html
References
Benvenuto D, Giovanetti M, Vassallo L, Angeletti S, Ciccozzi M (2020) Application of the arima model on the covid-2019 epidemic dataset. Data in brief 29:105340
Cewu L u, Shi J, Jia J (2013) Abnormal event detection at 150 fps in matlab. In: Proceedings of the IEEE international conference on computer vision, pp 2720–2727
Chen T, Liu X, Feng R, Wang W, Yuan C, Lu W, He H, Gao H, Ying H, Chen DZ et al (2021) Discriminative cervical lesion detection in colposcopic images with global class activation and local bin excitation. IEEE J Biomed Health Inf 26(4):1411–1421
Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder
Chris C (1978) The holt-winters forecasting procedure. J Royal Stat Soc: Series C (Appl Stat) 27:264–279
Contreras J, Espinola R, Nogales FJ, Conejo AJ (2003) Arima models to predict next-day electricity prices. IEEE Trans Power Syst 18:1014–1020
Cui X, Liu Q, Gao M, Metaxas DN (2011) Abnormal detection using interaction energy potentials. In: CVPR 2011. IEEE, pp 3161–3167
Dan Xu, Ricci E, Yan Y, Song J, Sebe N (2015) Learning deep representations of appearance and motion for anomalous event detection. arXiv:1510.01553
Dehmer M, Mowshowitz A (2011) A history of graph entropy measures. Inf Sci 181:57–78
Gandhi T, Trivedi MM (2007) Pedestrian protection issues, survey, and challenges. IEEE Trans Intell Transp Syst 8:413–430
Gao H, Qiu B, Barroso RJD, Hussain W, Xu Y, Wang X (2022) Tsmae: a novel anomaly detection approach for internet of things time series data using memory-augmented autoencoder. IEEE Trans Netw Sci Eng
Gao H, Xiao J, Yin Y, Liu T, Shi J (2022) A mutually supervised graph attention network for few-shot segmentation: the perspective of fully utilizing limited samples. IEEE Trans Neural Netw Learning Syst
Gao H, Xu K, Cao M, Xiao J, Xu Q, Yin Y (2021) The deep features and attention mechanism-based method to dish healthcare under social iot systems: an empirical study with a hand-deep local–global net. IEEE Trans Comput Social Syst 9(1):336–347
Gong F, Han N, Li D (2020) Shiming Tian Trend analysis of building power consumption based on prophet algorithm. In: Asia energy and electrical engineering symposium (AEEES). IEEE, pp 1002–1006
Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis L (2016) Learning temporal regularity in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 733–742
Huang K, Tan T (2010) A visual interpretation system for visual surveillance. Pattern Recogn Lett 31:2265–2285
Jian M, Lam K-M, Dong J, Shen L (2014) Visual-patch-attention-aware saliency detection. IEEE Trans Cybern 45(8):1575–1586
Jian M, Wang J, Hui Y u, Wang Gai-Ge (2021) Integrating object proposal with attention networks for video saliency detection. Inf Sci 576:819–830
Jian M, Wang J, Hui Y u, Wang G, Meng X, Yang L u, Dong J, Yin Y (2021) Visual saliency detection by integrating spatial position prior of object with background cues. Expert Syst Appl 168:114219
Jian M, Yin Y, Dong J, Lam Kin-Man (2018) Content-based image retrieval via a hierarchical-local-feature extraction scheme. Multimed Tools Appl 77(21):29099–29117
Jiang X, Munger A, Bunke H (2001) An median graphs: properties, algorithms, and applications. IEEE Trans Patt Anal Mach Intell 23:1144–1151
Kim J, Grauman K (2009) Observe locally, infer globally: a space-time mrf for detecting abnormal activities with incremental updates. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 2921–2928
Krubsack DA, Niederjohn RJ (1991) An autocorrelation pitch detector and voicing decision with confidence measures developed for noise-corrupted speech. IEEE Trans Signal Process 39:319–329
Li H (2021) Time works well: dynamic time warping based on time weighting for time series data mining. Inf Sci 547:592–608
LiuJingjing T et al (2016) Video anomaly detection algorithm combined with histogram of oriented gradients and optical flow. J Signal Process 32:1
Lu G, Liu J, Yan P (2018) Graph-based structural change detection for rotating machinery monitoring. Mech Syst Signal Process 99:73–82
Lu X, Wang W, Shen J, Crandall D, Gool LV (2021) Segmenting objects from relational visual data. IEEE Trans Patt Anal Mach Intell
Lu X, Wenguan wang, Shen J, Crandall D, Luo J (2020) Zero-shot video object segmentation with co-attention siamese networks. IEEE Trans Patt Anal Mach Intell
Lu X, Wang W, Danelljan M, Zhou T, Shen J, Gool LV (2020) Video object segmentation with episodic graph memory networks. In: European conference on computer vision. Springer, pp 661–679
Michael IJ (2004) Graphical models. Stat Sci 19:140–155
Mohamed AA, Alqahtani F, Shalaby A, Tolba A (2022) Texture classification-based feature processing for violence-based anomaly detection in crowded environments. Image Vision Comput:104488
Mubashir M, Shao L, Seed L (2013) A survey on fall detection principles and approaches. Neurocomputing 100:144–152
Müller M (2007) Dynamic time warping, Inf Retriev Music Motion:69–84
Noureen S, Atique S, Roy V, Bayne S (2019) Analysis and application of seasonal arima model in energy demand forecasting: a case study of small scale agricultural load. In: 2019 IEEE 62nd international midwest symposium on circuits and systems (MWSCAS). IEEE, pp 521–524
Oscar T, García-díaz JC, Troncoso A (2020) Initialization methods for multiple seasonal holt–winters forecasting models. Mathematics 8:268
Ribeiro RCM, Marques GT, Santos Paulo Cerqueira dos (2019) Holt-winters forecasting for brazilian natural gas production. Int J Innov Educ and Res 7(6):119–129
Sodemann AA, Ross MP, Borghetti BJ (2012) A review of anomaly detection in automated surveillance. IEEE Transactions on Systems Man, and Cybernetics Part C (Applications and Reviews) 42:1257–1272
Spielman DA (2007) Spectral graph theory and its applications. In: 48th annual IEEE symposium on foundations of computer science (FOCS’07), pp 29–38
Tae HK, Nah S, Lee KM (2016) Dynamic scene deblurring using a locally adaptive linear blur model. arXiv:1603.04265
Taylor SJ, Letham B (2018) Forecasting at scale. American Stat 72:37–45
Teh YW (2003) Bethe free energy and contrastive divergence approximations for undirected graphical models
Thirumalai C, Kanimozhi R, Vaishnavi B (2017) Data analysis using box plot on electricity consumption. In: International conference of electronics, communication and aerospace technology (ICECA). IEEE, vol 2, pp 598–600, p 2017
Tirkeş G, Güray C, Neş’e Ç (2017) Demand forecasting a comparison between the holt-winters, trend analysis and decomposition models. Tehnicki vjesnik/Technical Gazette: 24
Ullah H, Khan SD, Ullah M, Cheikh FA (2021) Social modeling meets virtual reality: An immersive implication. In: International conference on pattern recognition. Springer, pp 131–140
Wang W, Lu X, Shen J, Crandall DJ, Shao L (2019) Zero-shot video object segmentation via attentive graph neural networks. In: Proceedings of the IEEE/CVF international conference on computer vision (ICCV)
Xiao J, Xu H, Gao H, Bian M, Li Y (2021) A weakly supervised semantic segmentation network by aggregating seed cues: the multi-object proposal generation perspective. ACM Trans Multimidia Comput Commun Appl 17(1s):1–19
Yang Hu, Zhang Y, Davis L (2013) Unsupervised abnormal crowd activity detection using semiparametric scan statistic. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 767–774
Zhang Y, Qin L, Yao H, Huang Q (2012) Abnormal crowd behavior detection based on social attribute-aware force model. In: 2012 19th IEEE international conference on image processing, pp 2689–2692. IEEE
Acknowledgements
This paper has undergone several revisions, and these revisions were finally completed successfully main thanks to two people. Wang Xin participated in writing of the manuscript. Caixia Ma is served as scientific advisors.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jiang, H., Lyu, C., Gao, Y. et al. ADGSC: video anomaly detection algorithm based on graph structure change detection in public places. Multimed Tools Appl 82, 38923–38945 (2023). https://doi.org/10.1007/s11042-023-15009-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-15009-5