Towards Efficient Crowd Counting and Behavior Analysis Using YOLOv11
Keywords:
Crowd Counting, Behavior Analysis, YOLOv11, Real-time Object Detection, Smart Surveillance, Deep LearningAbstract
The rapid growth of urban populations has intensified the need for robust crowd monitoring systems to ensure public safety and efficient resource management. This study explores the integration of YOLOv11, an advanced real-time object detection model, for crowd counting and behavior analysis in dynamic environments. We propose a hybrid framework that leverages YOLOv11’s high-speed detection capabilities to identify individuals in densely packed scenes and extract behavioral cues such as motion patterns and group interactions. The model is fine-tuned on benchmark datasets to optimize accuracy in varying lighting and occlusion conditions. Experimental results demonstrate that our approach achieves a significant improvement in both counting precision and behavioral feature extraction compared to previous YOLO versions and other baseline models. This research highlights YOLOv11’s potential as a lightweight yet powerful solution for real-time crowd analytics, with applications ranging from smart surveillance to public event management.
Downloads
References
W. Yang and P. T. I. Lam, “An experimental contingent valuation of users’ attitudes towards a Crowd Management System,” Saf. Sci., vol. 121, pp. 231–239, Jan. 2020, doi: https://doi.org/10.1016/j.ssci.2019.09.013.
R. Rusca, D. Gasco, C. Casetti, and P. Giaccone, “Privacy-preserving WiFi fingerprint-based people counting for crowd management,” Comput. Commun., vol. 225, pp. 339–349, Sep. 2024, doi: https://doi.org/10.1016/j.comcom.2024.07.010.
R. Alharbey, A. Banjar, Y. Said, M. Atri, A. Alshdadi, and M. Abid, “Human Faces Detection and Tracking for Crowd Management in Hajj and Umrah,” Comput. Mater. Contin., vol. 71, no. 3, pp. 6275–6291, 2022, doi: https://doi.org/10.32604/cmc.2022.024272.
Saluky, S. H. Supangkat, and F. F. Lubis, “Moving Image Interpretation Models to Support City Analysis,” in 2018 International Conference on ICT for Smart Society (ICISS), IEEE, Oct. 2018, pp. 1–5. doi: https://doi.org/10.1109/ICTSS.2018.8550012.
X. Wei, J. Du, M. Liang, and Z. Xue, “Crowd Density Field Estimation Based on Crowd Dynamics Theory and Social Force Model,” Chinese J. Electron., vol. 28, no. 3, pp. 521–528, May 2019, doi: https://doi.org/10.1049/cje.2019.03.021.
A. Chakraborty, A. Mallick, S. R. Nemalidinne, S. R. Krishna Vadali, S. Aruchamy, and V. S. Nageli, “A Novel Energy Based Ground Movement Detection Technique using Seismic Signal,” in 2021 5th International Conference on Information Systems and Computer Networks (ISCON), IEEE, Oct. 2021, pp. 1–6. doi: https://doi.org/10.1109/ISCON52037.2021.9702344.
T. Zhou, L. Zheng, Y. Peng, and R. Jiang, “A Survey of Research on Crowd Abnormal Behavior Detection Algorithm Based on YOLO Network,” in 2022 2nd International Conference on Consumer Electronics and Computer Engineering (ICCECE), IEEE, Jan. 2022, pp. 783–786. doi: https://doi.org/10.1109/ICCECE54139.2022.9712684.
H. Zoubir, M. Rguig, A. Chehri, M. El Aroussi, and R. Saadane, “Leveraging Public Safety and Enhancing Crack Detection in Concrete Bridges using Deep Convolutional Neural Networks,” in 2024 IEEE World Forum on Public Safety Technology (WFPST), IEEE, May 2024, pp. 37–41. doi: https://doi.org/10.1109/WFPST58552.2024.00029.
G. A. Macriga, B. S, A. S H, and J. N, “Crowd Management using AI & ML,” in 2024 International Conference on Power, Energy, Control and Transmission Systems (ICPECTS), IEEE, Oct. 2024, pp. 1–5. doi: https://doi.org/10.1109/ICPECTS62210.2024.10780050.
S. A. Sukarno, P. Anggraeni, and M. Milianka, “ROS-Based Multi-Quadcopter System for Enhancing Crowd Surveillance,” in 2024 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), IEEE, Dec. 2024, pp. 1302–1307. doi: https://doi.org/10.1109/ICICYTA64807.2024.10913092.
M. Abdou and A. Erradi, “Crowd Counting: A Survey of Machine Learning Approaches,” in 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), IEEE, Feb. 2020, pp. 48–54. doi: https://doi.org/10.1109/ICIoT48696.2020.9089594.
W. Li, D. Zhang, M. Sun, Y. Yin, and Y. Shen, “Loitering Detection Based on Trajectory Analysis,” in 2015 8th International Conference on Intelligent Computation Technology and Automation (ICICTA), IEEE, Jun. 2015, pp. 530–533. doi: https://doi.org/10.1109/ICICTA.2015.136.
B. Aldissi and H. Ammar, “Review on Real-time Detection of a Panic Behavior in Crowded Scenes,” in 2019 2nd International Conference on Computer Applications & Information Security (ICCAIS), IEEE, May 2019, pp. 1–5. doi: https://doi.org/10.1109/CAIS.2019.8769487.
M. V Karki, A. Aripirala, C. Vasist, A. Renith, and A. Balasubramanian, “Abnormal Human Behavior Detection in Crowded Scenes Based on Hybrid Neural Networks,” in 2022 4th International Conference on Circuits, Control, Communication and Computing (I4C), IEEE, Dec. 2022, pp. 54–58. doi: https://doi.org/10.1109/I4C57141.2022.10057910.
S. Banerjee et al., “Design of an Anonymity-Preserving Group Formation Based Authentication Protocol in Global Mobility Networks,” IEEE Access, vol. 6, pp. 20673–20693, 2018, doi: https://doi.org/10.1109/ACCESS.2018.2827027.
J. Sang et al., “Improved Crowd Counting Method Based on Scale-Adaptive Convolutional Neural Network,” IEEE Access, vol. 7, pp. 24411–24419, 2019, doi: https://doi.org/10.1109/ACCESS.2019.2899939.
K. B. Lee and H. S. Shin, “An Application of a Deep Learning Algorithm for Automatic Detection of Unexpected Accidents Under Bad CCTV Monitoring Conditions in Tunnels,” in 2019 International Conference on Deep Learning and Machine Learning in Emerging Applications (Deep-ML), IEEE, Aug. 2019, pp. 7–11. doi: https://doi.org/10.1109/Deep-ML.2019.00010.
Z. Tan and M. Karakose, “Optimized Reward Function Based Deep Reinforcement Learning Approach for Object Detection Applications,” in 2022 International Conference on Decision Aid Sciences and Applications (DASA), IEEE, Mar. 2022, pp. 1367–1370. doi: https://doi.org/10.1109/DASA54658.2022.9764979.
M. Zhou, “Research Advanced in Deep Learning Object Detection,” in 2022 IEEE Conference on Telecommunications, Optics and Computer Science (TOCS), IEEE, Dec. 2022, pp. 1318–1322. doi: https://doi.org/10.1109/TOCS56154.2022.10016018.
P. Likhitha, H. Kalyanam, S. S. Krishna Teja Sanku, and G. Ponsam. J, “Deep Learning in Autonomous Vehicles: A Comprehensive Review of Object Detection, Lane Detection and Scene Perception,” in 2024 International Conference on Emerging Research in Computational Science (ICERCS), IEEE, Dec. 2024, pp. 1–5. doi: https://doi.org/10.1109/ICERCS63125.2024.10895424.
M. F. Riftiarrasyid, F. L. Gaol, H. Soeparno, and Y. Arifin, “Suitability of Latest Version of YOLOv11 in Drone Development Studies,” in 2024 7th International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), IEEE, Dec. 2024, pp. 504–509. doi: https://doi.org/10.1109/ISRITI64779.2024.10963542.
S. Zheng, H. Qiao, L. Jia, and T. Fukuda, “A simplified minimum enclosing ball based fast incremental support vector machine (SVM) algorithm for person detection and tracking,” in Proceedings of the 10th World Congress on Intelligent Control and Automation, IEEE, Jul. 2012, pp. 4936–4941. doi: https://doi.org/10.1109/WCICA.2012.6359413.
S. Du and S. Chen, “Salient Object Detection via Random Forest,” IEEE Signal Process. Lett., vol. 21, no. 1, pp. 51–54, Jan. 2014, doi: 10.1109/LSP.2013.2290547.
R. Nidhya, R. Kalpana, G. Smilarubavathy, and S. M. Keerthana, “Brain Tumor Diagnosis with MCNN-Based MRI Image Analysis,” in 2023 1st International Conference on Optimization Techniques for Learning (ICOTL), IEEE, Dec. 2023, pp. 1–5. doi: https://doi.org/10.1109/ICOTL59758.2023.10435262.
A. Subramaniam, V. G. Shah, P. D. Tibrewala, and R. Kale, “Crowd Count Estimator Application using CSRNet,” in 2021 International Conference on Intelligent Technologies (CONIT), IEEE, Jun. 2021, pp. 1–6. doi: https://doi.org/10.1109/CONIT51480.2021.9498364.
J. Xu, W. Liu, Y. Qin, and G. Xu, “Sheep Counting Method Based on Multiscale Module Deep Neural Network,” IEEE Access, vol. 10, pp. 128293–128303, 2022, doi: https://doi.org/10.1109/ACCESS.2022.3221542.
K. Rohit, K. Mistree, and J. Lavji, “A review on abnormal crowd behavior detection,” in 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), IEEE, Mar. 2017, pp. 1–3. doi: https://doi.org/10.1109/ICIIECS.2017.8275999.
Z. Si, H. Zhao, H. Tang, F. Zhu, Y. Lv, and H. Lu, “Pedestrian Trajectory Prediction by Modeling the Interactions using Social LSTM Extensions,” in 2022 China Automation Congress (CAC), IEEE, Nov. 2022, pp. 4159–4164. doi: https://doi.org/10.1109/CAC57257.2022.10055377.
S. Xu, Y. Ji, G. Wang, L. Jin, and H. Wang, “GFSPP-YOLO: A Light YOLO Model Based on Group Fast Spatial Pyramid Pooling,” in 2023 IEEE 11th International Conference on Information, Communication and Networks (ICICN), IEEE, Aug. 2023, pp. 733–738. doi: https://doi.org/10.1109/ICICN59530.2023.10393445.
Y. Zhou and H. Li, “A Survey of Dense Object Detection Methods Based on Deep Learning,” IEEE Access, vol. 12, pp. 179944–179961, 2024, doi: https://doi.org/10.1109/ACCESS.2024.3507820.
A. Correia, H. Paredes, D. Schneider, S. Jameel, and B. Fonseca, “Towards Hybrid Crowd-AI Centered Systems: Developing an Integrated Framework from an Empirical Perspective,” in 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), IEEE, Oct. 2019, pp. 4013–4018. doi: https://doi.org/10.1109/SMC.2019.8914075.
