PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY

Malaysia ranks third among ASEAN countries in terms of deaths due to accidents, with an alarming increase in the number of fatalities each year. Road conditions contribute significantly to near-miss incidents, while the inefficiency of installed CCTVs and the lack of monitoring system algorithms worsen the situation. The objective of this research is to address the issue of increasing accidents and fatalities on Malaysian roads. Specifically, the study aims to investigate the use of video technology and machine learning algorithms for the car detection and analysis of near-miss accidents. To achieve this goal, the researchers focused on Penang, where the MBPP has deployed 1841 CCTV cameras to monitor traffic and document near-miss accidents. The study utilised the YOLOv3, YOLOv4, and Faster RCNN algorithms for vehicle detection. Additionally, the study employed image processing techniques such as Bird’s Eye View and Social Distancing Monitoring to detect and analyse how near misses occur. Various video lengths (20s, 40s, 60s and 80s) were tested to compare the algorithms’ error detection percentage and test duration. The results indicate that Faster RCNN beats YOLOv3 and YOLOV4 in car detection with low error detection, whereas YOLOv3 and YOLOv4 outperform near-miss detection, while Faster RCNN does not perform it. Overall, this study demonstrates the potential of video technology and machine learning algorithms in near-miss accident detection and analysis. Transportation authorities can better understand the causes of accidents and take appropriate measures to improve road safety using these models. This research can be a foundation for further traffic safety and accident prevention studies.

• Abdullah, A., & Oothariasamy, J. (2020). Vehicle counting using deep learning models: A comparative study. International Journal of Advanced Computer Science and Applications, 11(7), 697-703. https://dx.doi.org/10.14569/IJACSA.2020.0110784

• Abdurahman, F., Fante, K. A., & Aliy, M. (2021). Malaria parasite detection in thick blood smear microscopic images using modified YOLOV3 and YOLOV4 models. BMC Bioinformatics, 22(1), Article 112. https://doi.org/10.1186/s12859-021-04036-4

• Aldred, R. (2016). Cycling near misses: Their frequency, impact and prevention. Transport Research Part A, 90(1), 69-83. https://doi.org/10.1016/j.tra.2016.04.016

• Adarsh, P., Rathi, P., & Kumar, M. (2020, March). YOLO v3-Tiny: Object Detection and Recognition using one stage improved model. In 2020 6th international conference on advanced computing and communication systems (ICACCS) (pp. 687-694). IEEE Publishing. https://doi.org/10.1109/ICACCS48705.2020.9074315

• Alganci, U., Soydas, M., & Sertel, E. (2020). Comparative research on deep learning approaches for airplane detection from very high-resolution satellite images. Remote Sensing, 12(3), Article 458. https://doi.org/10.3390/rs12030458

• AlKishri, W., & Al-Bahri, M. (2021). Object recognition for organizing the movement of self-driving car. International Journal of Computation and Applied Sciences, 10(1), 1-8. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3828692

• Ammar, A., Koubaa, A., Ahmed, M., Saad, A., & Benjdira, B. (2021). Vehicle detection from aerial images using deep learning: A comparative study. Electronics, 10(7), Article 820. https://doi.org/10.3390/electronics10070820

• Arinaldi, A., Pradana, J., A., & Gurusniaga, A., A. (2018). Detection and classification of vehicles for traffic video analytics. Procedia Computer Science, 144, 259-268. https://doi.org/10.1016/j.procs.2018.10.527

• Bochkovskiy, A., Wang, C., Y., & Liao, H., Y., M. (2020). YOLOv4: Optimal speed and accuracy of object detection. ArXiv Preprint. https://doi.org/10.48550/arXiv.2004.10934

• Calles, M., B., Nelson, T., & Winters, M. (2017). Comparing crowdsourced near-miss and collision cycling data and official bike safety reporting. Transportation Research Record: Journal of the Transportation Research Board, 2662(1), 1-11. https://doi.org/10.3141/2662-01

• Cepni, S., Atik, M. E., & Druan, Z. (2020). Vehicle detection using different deep learning algorithms from image sequence. Baltic Journal of Modern Computing, 8(2), 347-358. https://doi.org/10.22364/bjmc.2020.8.2.10

• Ciberlin, J., Grbic, R., Teslic, N. and Pilipovic, M. (2019). Object detection and object tracking in front of the vehicle using front view camera. In IEEE 2019 Zooming Innovation in Consumer Technologies Conference (ZINC) (pp. 27-32). IEEE Publishing. https://doi.org/10.1109/ZINC.2019.8769367

• Ding, X., & Yang, R. (2019). Vehicle and parking space detection based on improved YOLO network model. Journal of Physics: Conference Series, 1325, 1-7. https://doi.org/10.1088/1742-6596/1325/1/012084

• Dixit, K. S., Chadaga, M. G., Savalgimath, S. S., Rakshith, G. R., & Kumar, M. N. (2019). Evaluation and evolution of object detection techniques YOLO and R-CNN. International Journal of Recent Technology and Engineering (IJRTE), 8(2S3), 824-829. https://doi.org/10.35940/ijrte.B1 154 07 0782S319

• Ezat, W., A., Dessouky, M., M., & Ismail, N., A. (2021). Evaluation of deep learning YOLOv3 algorithm for object detection and classification. Menoufia Journal of Electronic Engineering Research (MJEER), 30(1), 52-57. http://dx.doi.org/10.21608/mjeer.2021.146237

• Gai, J., Zhong, K., Du, X., Yan, K., & Shen, J. (2021). Detection of gear fault severity based on parameter-optimized deep belief network using sparrow search algorithm. Measurement, 185, Article 110079. https://doi.org/10.1016/j.measurement.2021.110079

• Girshick, R. (2015). Fast R-CNN. ArXiv Preprint. https://doi.org/10.48550/arXiv.1504.08083

• Gou, C., Peng, B., Li, T., & Gao, Z. (2019). Pavement crack detection based on the improved faster-RCNN. In 2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE) (pp. 962-967). IEEE Publishing. https://doi.org/10.1109/iske47853.2019.9170456

• Gulati, I., & Srinivasan, R. (2019). Image processing in intelligent traffic management. International Journal of Recent Technology and Engineering (IJRTE), 8(2S4), 213-218.

• Harianto, R. A., Pranoto, Y. M., & Gunawan, T. P. (2021). Data augmentation and faster RCNN improve vehicle detection and recognition. In 2021 3rd East Indonesia Conference on Computer and Information Technology (EIConCIT) (pp. 128-133). IEEE Publishing. https://doi.org/10.1109/eiconcit50028.2021.9431863

• Huang, Y. Q., Zheng, J. C., Sun, S. D., Yang, C. F., & Liu, J. (2020). Optimized YOLOv3 algorithm and its application in traffic flow detections. Applied Sciences, 10(9), Article 3079. https://doi.org/10.3390/app10093079

• Jiang, Z., G., & Shi, X., T. (2021). Application research of key frames extraction technology combined with optimized faster R-CNN algorithm in traffic video analysis. Complexity, 2021, Article 6620425. https://doi.org/10.1155/2021/6620425

• Jiang, Z., Zhao, L., Li, S., & Jia, Y. (2020). Real-time object detection method for embedded devices. ArXiv Preprint. https://doi.org/10.48550/arXiv.2011.04244

• Kumar, B. C., Punitha, R., & Mohana. (2020). YOLOv3 and YOLOv4: Multiple object detection for surveillance applications. In 2020 Third international conference on smart systems and inventive technology (ICSSIT) (pp. 1316-1321). IEEE Publishing. https://doi.org/10.1109/icssit48917.2020.9214094

• Lim, L. M., Ali, M. K. M., Ismail, M. T., & Mohamed, A. S. A. (2022). Data safety prediction using bird’s eye view and social distancing monitoring for Penang roads. Pertanika Journal of Science & Technology, 30(4), 2563-2587. https://doi.org/10.47836/pjst.30.4.15

• Lim, L. M., Sadullah, A. F. M., Ismail, M. T., Awang, N., & Ali, M. K. M. (2022). Penang data safety prediction using database development and alternative road identification using Dijkstra approach. AIP Conference Proceedings, 2465, Article 040007. https://doi.org/10.1063/5.0078252

• Lokanath, M., Kumar, K. S., & Keerthi, E. S. (2017). Accurate object classification and detection by faster-RCNN. IOP Conference Series: Materials Science and Engineering, 263, Article 052028. https://doi.org/10.1088/1757-899x/263/5/052028

• Mahto, P., Garg, P., Seth, P., & Panda, J. (2020). Refining Yolov4 for vehicle detection. International Journal of Advanced Research in Engineering and Technology (IJARET), 11(5), 409-419.

• Manne, G., & Raghuwanshi, N. (2017). Review on vehicle detection techniques. International Journal of Science, Engineering and Technology Research (IJSETR), 6(4), 482-486.

• Maqbool, S., Khan, M., Tahir, J., Jalil, A., Ali, A., & Ahmad, J. (2018). Vehicle detection, tracking and counting. In 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP) (pp. 126-132). IEEE Publishing. https://doi.org/10.1109/SIPROCESS.2018.8600460

• Matsui, Y., Hitosugi, M., Doi, T., Oikawa, S., Takahashi, K., & Ando, K. (2013). Features of pedestrian behavior in car-to-pedestrian contact situations in Near-Miss incidents in Japan. Traffic Injury Prevention, 14(1), 58-63. https://doi.org/10.1080/15389588.2013.796372

• Meng, C., Bao, H., & Ma, Y. (2020). Vehicle detection: A review. Journal of Physics: Conference Series CISAT 2020, 1634, Article 012107. https://doi.org/10.1088/1742-6596/1634/1/012107

• Moutakki, Z., Ouloul, I. M., Afdel, K., & Amghar, A. (2018). Real-time system based on feature extraction for vehicle detection and classification. Transport and Telecommunication, 19(2), Article 93. https://sciendo.com/article/10.2478/ttj-2018-0008

• Nepal, U., & Eslamiat, H. (2020). Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors, 22(464) 1-15. https://doi.org/10.3390/s22020464

• Nousi, P., Triantafyllidou, D., Tefas, A., & Pitas, I. (2019). Joint lightweight object tracking and detection for unmanned vehicles. In 2019 IEEE International Conference on Image Processing (ICIP) (pp. 160-164). IEEE Publishing. https://doi.org/10.1109/ICIP.2019.8802988

• Ong, Y. (2020). Near Miss Vehicle Collisions Estimation using YOLO. (Unpublished master’s thesis). Universiti Sains Malaysia, Malaysia.

• Pawar, B., Humbe, V., & Kundnani, L. R. (2017). Morphological approach for moving vehicle detection. IOSR Journal of Computer Engineering (IOSR-JCE), 3(1), 73-80.

• Redmon, J., & Farhadi, A. (2018). YOLOv3: An incremental improvement. ArXiv Preprint. https://doi.org/10.48550/arXiv.1804.02767

• Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788). IEEE Publishing. https://doi.org/10.1109/cvpr.2016.91

• Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137-1149. https://doi.org/10.1109/tpami.2016.2577031

• Rin, V., & Nuthong, C. (2019). Front moving vehicle detection and tracking with Kalman Filter. In IEEE 4th International Conference on Computer and Communication Systems (pp. 304-310). IEEE Publishing. 10.1109/CCOMS.2019.8821772

• Sekar, A., & Perumal, V. (2021). Automatic road crack detection and classification using multi-tasking faster RCNN. Journal of Intelligent & Fuzzy Systems, 41(6), 6615-6628. https://doi.org/10.3233/jifs-210475

• Silva, L. A., Sanchez San Blas, H., Peral García, D., Sales Mendes, A., & Villarubia González, G. (2020). An architectural multi-agent system for a pavement monitoring system with pothole recognition in UAV images. Sensors, 20(21), Article 6205. https://doi.org/10.3390/s20216205

• Sonnleitner, E., Barth, O., Palmanshofer, A., & Kurz, M. (2020). Traffic measurement and congestion detection based on real-time highway video data. Applied Sciences, 10(18), Article 6270. https://doi.org/10.3390/app10186270

• Soviany, P., & Ionescu., R., T. (2018). Optimizing the trade-off between single-stage and two-stage deep object detectors using image difficulty prediction. ArXiv Preprint. https://doi.org/10.48550/arXiv.1803.08707

• Sowmya, V., & Radha, R. (2021). Comparative analysis on deep learning approaches for heavy-vehicle detection based on data augmentation and transfer-learning techniques. Journal of Scientific Research, 13(3), 809-820. https://doi.org/10.3329/jsr.v13i3.52332

• Tariq, A., Khan, M. Z., & Khan, M. U. G. (2021). Real time vehicle detection and colour recognition using tuned features of faster-RCNN. In 2021 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA) (pp. 262-267). IEEE Publishing. https://doi.org/10.1109/caida51941.2021.9425106

• Uus, J., & Krilavičius, T. (2018). Vehicle detection and classification in aerial imagery. IEEE International Conference on Image Processing, 2410(1), 80-85.

• Vançin, S., & Erdem, E. (2018). Detection of the vehicle direction with adaptive threshold algorithm using magnetic sensor nodes. Journal of Polytechnic, 21(2), 333-340.

• Vinitha, V., & Velantina, V. (2020). Social distancing detection system with artificial intelligence using computer vision and deep learning. International Research Journal of Engineering and Technology (IRJET), 7(8), 4049-4053.

• Wang, C., Dai, Y., Zhou, W., & Geng, Y. (2020). A vision-based video crash detection framework for mixed traffic flow environment considering low-visibility condition. Hindawi, Journal of Advanced Transportation, 2020, Article 9194028. https://doi.org/10.1155/2020/9194028

• Wang, G., Guo, J. M., Chen, Y., Li, Y., & Xu, Q. (2019). A PSO and BFO-based learning strategy applied to faster R-CNN for object detection in autonomous driving. IEEE Access, 7, 18840-18859. https://doi.org/10.1109/access.2019.2897283

• Wang, S. (2021). Research towards yolo-series algorithms: Comparison and analysis of object detection models for real-time UAV applications. Journal of Physics: Conference Series, 1948(1), Article 012021. https://doi.org/10.1088/1742-6596/1948/1/012021

• World Health Organization. (2020, December 9). The Top 10 Causes of Death. World Health Organization. https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death

• Zhang, Y., Shen, Y., & Zhang, J. (2019). An improved tiny-YOLOv3 pedestrian detection algorithm. Optik, 183, 17-23. https://doi.org/10.1016/j.ijleo.2019.02.038

• Zhang, Z., Trivedi, C., & Liu, X. (2018). Automated detection of grade-crossing-trespassing near misses based on computer vision analysis of surveillance video data. Safety Science, 110(Part B), 276-285. https://doi.org/10.1016/j.ssci.2017.11.023

• Zhao, J., Wei, S., Xie, H., & Zhong, H. (2020). Image recognition of small UAVs based on faster RCNN. In Proceedings of the 2020 4th International Conference on Vision, Image and Signal Processing (pp. 1-6). ACM Publishing. https://doi.org/10.1145/3448823.3448844

• Zhao, X., Pu, F., Wang, H., Chen, H. and Xu, Z. (2019). Detection, tracking, geolocation of moving vehicle from UAV using monocular camera. IEEE Access, 7(1), 101160-101170.

• Zohra, A., F., Kamilia, S., & Souad, S. (2018). Detection and classification of vehicles using deep learning. International Journal of Computer Science Trends and Technology (IJCST), 6(3), 23-29.