Tracking and detection in broadcast soccer video based on data fusion and YOLO model

Authors

  • Hayder Hussein Azeez Southern Technical University, Iraq Author
  • Noor Alhuda Ahmed Ibrahim National University of Science and Technology, Iraq Author

DOI:

https://doi.org/10.69055/jcsir.v2i2.10

Keywords:

Soccer video analysis, Object detection, Multi-object tracking, YOLOv8, Data fusion

Abstract

The broadcast soccer game video analysis system operates as a vital system which enables users to assess player performance and study team strategic methods. The process of reliable ball tracking during broadcast events faces multiple obstacles because the ball moves quickly while being small and because it often gets hidden by players and because the camera system continuously pans and zooms. The combination of these elements results in system failures which produce both incorrect tracking results and broken object paths and incorrect identification of tracked objects.

This paper presents a data fusion-based framework for joint detection and tracking of players and the ball in broadcast soccer video. The system uses YOLOv8 deep learning model for real-time object detection which then uses SORT algorithm to track multiple objects. SORT uses Kalman filter-based motion prediction together with IoU-based Hungarian association to preserve object identity consistency between different frames.

The system needs to perform preprocessing to remove non-play segments which contain replays and sudden scene changes for achieving better temporal stability. The system includes additional modules which perform camera motion compensation and homography-based field coordinate normalization and jersey color-based team classification and nearest-player assignment for ball possession estimation and speed and distance calculation for player performance analysis.

The researchers conducted experimental tests on Full HD broadcast videos which produced excellent detection results with precision at 0.96 and recall at 0.94 and F1-score at 0.95. The visual results show that the system identifies people correctly throughout all tests which used typical crowd numbers under conditions that mimic actual broadcasting scenarios. The proposed framework delivers organized spatiotemporal data which allows users to perform tactical analysis and performance assessment and operate automated sports analytics systems

References

[1] K. Rangasamy, M. A. As’ari, N. A. Rahmad, N. F. Ghazali, and S. Ismail, “Deep learning in sport video analysis: A review,” TELKOMNIKA, vol. 18, no. 4, pp. 1926–1933, 2020, doi: 10.12928/TELKOMNIKA.v18i4.14730. DOI: https://doi.org/10.12928/telkomnika.v18i4.14730

[2] P. Rahimian and L. Toka, “Optical tracking in team sports: A survey on player and ball tracking methods in soccer and other team sports,” Journal of Quantitative Analysis in Sports, vol. 18, no. 1, pp. 35–57, 2022, doi: 10.1515/jqas-2020-0088. DOI: https://doi.org/10.1515/jqas-2020-0088

[3] Z. Zhao, W. Chai, S. Hao, W. Hu, G. Wang, S. Cao, M. Song, J. N. Hwang, and G. Wang, “A survey of deep learning in sports applications: Perception, comprehension, and decision,” arXiv, 2023, doi: 10.48550/arXiv.2307.03353.

[4] A. Bochkovskiy, C. Y. Wang, and H. Y. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv, 2020, doi: 10.48550/arXiv.2004.10934.

[5] A. Bewley, L. Ott, F. Ramos, and B. Upcroft, “Simple online and realtime tracking,” in Proc. IEEE International Conference on Image Processing (ICIP), 2016, pp. 3464–3468, doi: 10.1109/ICIP.2016.7533003. DOI: https://doi.org/10.1109/ICIP.2016.7533003

[6] Y. Yang and D. Li, “Robust player detection and tracking in broadcast soccer video based on enhanced particle filter,” Journal of Visual Communication and Image Representation, vol. 46, pp. 152–163, 2017, doi: 10.1016/j.jvcir.2017.03.008. DOI: https://doi.org/10.1016/j.jvcir.2017.03.008

[7] N. Wojke, A. Bewley, and D. Paulus, “Simple online and realtime tracking with a deep association metric,” arXiv, 2017, doi: 10.48550/arXiv.1703.07402. DOI: https://doi.org/10.1109/ICIP.2017.8296962

[8] Y. Zhang, C. Wang, X. Wang, W. Zeng, and W. Liu, “FairMOT: On the fairness of detection and re-identification in multiple object tracking,” arXiv, 2021, doi: 10.48550/arXiv.2004.01888. DOI: https://doi.org/10.1007/s11263-021-01513-4

[9] Y. Zhang, P. Sun, Y. Jiang, D. Yu, F. Weng, Z. Yuan, P. Luo, W. Liu, and X. Wang, “ByteTrack: Multi-object tracking by associating every detection box,” arXiv, 2022, doi: 10.48550/arXiv.2110.06864. DOI: https://doi.org/10.1007/978-3-031-20047-2_1

[10] M. J. Penn, C. A. Donnelly, and S. Bhatt, “Continuous football player tracking from discrete broadcast data,” Royal Society Open Science, vol. 12, p. 251175, 2025, doi: 10.1098/rsos.251175. DOI: https://doi.org/10.1098/rsos.251175

[11] A. Cioppa, S. Giancola, A. Deliege, L. Kang, X. Zhou, Z. Cheng, B. Ghanem, and M. Van Droogenbroeck, “SoccerNet-Tracking: Multiple object tracking dataset and benchmark in soccer videos,” in CVPR Workshops, 2022, doi: 10.48550/arXiv.2204.01888. DOI: https://doi.org/10.1109/CVPRW56347.2022.00393

[12] R. Zhang, L. Wu, Y. Yang, W. Wu, Y. Chen, and M. Xu, “Multi-camera multi-player tracking with deep player identification in sports video,” Pattern Recognition, vol. 108, p. 107260, 2020, doi: 10.1016/j.patcog.2020.107260. DOI: https://doi.org/10.1016/j.patcog.2020.107260

[13] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” 2016, doi: 10.1109/CVPR.2016.91. DOI: https://doi.org/10.1109/CVPR.2016.91

[14] R. E. Kalman, “A new approach to linear filtering and prediction problems,” Journal of Basic Engineering, 1960. DOI: https://doi.org/10.1115/1.3662552

[15] B. D. Lucas and T. Kanade, “An iterative image registration technique,” 1981, doi: 10.1109/ICDAR.1981.4766994.

[16] R. Hartley and A. Zisserman, Multiple view geometry in computer vision. Cambridge University Press, 2004. DOI: https://doi.org/10.1017/CBO9780511811685

[17] J. J. Little and J. E. Boyd, “Recognizing people by their gait,” 1998, doi: 10.1109/CVPR.1998.698664. DOI: https://doi.org/10.1109/CVPR.1998.698664

[18] J. MacQueen, “Some methods for classification and analysis of multivariate observations,” 1967.

[19] M. M. Deza and E. Deza, Encyclopedia of distances. Springer, 2009. DOI: https://doi.org/10.1007/978-3-642-00234-2

[20] C. M. Bishop, Pattern recognition and machine learning. Springer, 2006.

[21] M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, “The Pascal Visual Object Classes (VOC) challenge,” International Journal of Computer Vision, vol. 88, no. 2, pp. 303–338, 2010, doi: 10.1007/s11263-009-0275-4. DOI: https://doi.org/10.1007/s11263-009-0275-4

Downloads

Published

2026-08-06

How to Cite

Tracking and detection in broadcast soccer video based on data fusion and YOLO model. (2026). Journal of Computer Science Innovations and Research, 2(2), 28-40. https://doi.org/10.69055/jcsir.v2i2.10