Efficient Deep Learning Methods for Detecting Road Accidents by Analyzing Traffic Accident Images
DOI:
https://doi.org/10.47839/ijc.23.3.3664Keywords:
CNN, Deep Learning, VGG16, Inception v3, Feature Extraction, Machine Learning, SpinalNetAbstract
Speed is one of the major factors in car crashes. Many lives could have been saved if emergency services had been alerted to the disaster and arrived in time. For the sake of protecting valuable human lives, an effective automatic accident detection system with prompt reporting of the accident scene to emergency services is essential. Therefore, this research proposes some effective Deep Learning techniques that properly recognize the incidence of accidents. The paper introduces two different techniques for image classification, with a particular focus on distinguishing between accident and non-accident images. The dataset used for the proposed model is taken from Kaggle, which is a collection of CCTV images. The first approach is a hybridized TL-ML method that employs transfer learning techniques that use different pre-trained versions of convolutional neural networks to extract features from image datasets. These extracted features are then fed into various machine learning classifiers to categorize the images as either Accident or Non-accident. To make the final decision, a voting classifier is utilized to choose the best classification outcome from the set of previously employed machine learning classifiers. In the second method, a modified Convolutional Neural Network (CNN) called SpinalNet is adopted. The performance of these models was evaluated by comparing them with each other and with a customized CNN base model. SpinalNet consistently surpassed the other models in terms of Precision, Recall, F1-Score, and Accuracy, demonstrating its outstanding capabilities.
References
Road traffic injuries. [Online]. Available at: https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries.
W. Wijnen, “Socio-economic costs of road crashes in middle-income countries: Applying a hybrid approach to Kazakhstan,” IATSS Res., vol. 45, no. 3, pp. 293–302, 2021, https://doi.org/10.1016/j.iatssr.2020.12.006.
Md. A. Fattah, S. R. Morshed, and A.-A. Kafy, “Insights into the socio-economic impacts of traffic congestion in the port and industrial areas of Chittagong city, Bangladesh,” Transp. Eng., vol. 9, p. 100122, 2022, https://doi.org/10.1016/j.treng.2022.100122.
D. Oladimeji, K. Gupta, N. A. Kose, K. Gundogan, L. Ge, and F. Liang, “Smart transportation: An overview of technologies and applications,” Sensors, vol. 23, no. 8, Art. no. 8, 2023, https://doi.org/10.3390/s23083880.
Predictors of Mental Health Outcomes in Road Traffic Accident Survivors - PMC. [Online]. available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7074414/
E. Poornima et al., “Fog robotics-based intelligence transportation system using line-of-sight intelligent transportation,” Multimed. Tools Appl., 2023, https://doi.org/10.1007/s11042-023-15086-6.
M. I. Basheer Ahmed et al., “A real-time computer vision based approach to detection and classification of traffic incidents,” Big Data Cogn. Comput., vol. 7, no. 1, Art. no. 1, 2023, https://doi.org/10.3390/bdcc7010022.
H. Hozhabr Pour et al., “A machine learning framework for automated accident detection based on multimodal sensors in cars,” Sensors, vol. 22, no. 10, Art. no. 10, 2022, https://doi.org/10.3390/s22103634.
N. Pathik, R. K. Gupta, Y. Sahu, A. Sharma, M. Masud, and M. Baz, “AI enabled accident detection and alert system using IoT and deep learning for smart cities,” Sustainability, vol. 14, no. 13, Art. no. 13, 2022, https://doi.org/10.3390/su14137701.
I. Badi, M. B. Bouraima, and M. Jibril, “The role of intelligent transportation systems in solving traffic problems and reducing environmental negative impact of urban transport,” p. 2023, 2022, https://doi.org/10.55976/dma.1202311371-9.
M. M. Rahman, M. K. Islam, A. Al-Shayeb, and M. Arifuzzaman, “Towards sustainable road safety in Saudi Arabia: exploring traffic accident causes associated with driving behavior using a Bayesian belief network,” Sustainability, vol. 14, no. 10, Art. no. 10, 2022, https://doi.org/10.3390/su14106315.
V. Petraki, A. Ziakopoulos, and G. Yannis, “Combined impact of road and traffic characteristic on driver behavior using smartphone sensor data,” Accid. Anal. Prev., vol. 144, p. 105657, 2020, https://doi.org/10.1016/j.aap.2020.105657.
S. Sahu, S. Mishra, K. K. Barik, and D. Sahu, “Implementation of road safety audit to highlight the deformities in the design and environmental safety features: A case study on national highway-326,” Int. J. Environ. Clim. Change, vol. 12, pp. 1123–1140, 2022, https://doi.org/10.9734/ijecc/2022/v12i1131089.
J. El, “Historical developments of random forest,” Medium, Jul. 23, 2020. [Online]. available at: https://drjariel.medium.com/historical-developments-of-random-forest-41492deb6737.
explorium_admin, “Decision Trees: Complete Guide to Decision Tree Analysis,” Explorium, Dec. 10, 2019. [Online]. Available at: https://www.explorium.ai/blog/the-complete-guide-to-decision-trees/
K. Thankachan, “What? When? How?: ExtraTrees Classifier,” Medium, Aug. 09, 2022. [Online]. Available at: https://towardsdatascience.com/what-when-how-extratrees-classifier-c939f905851c.
J. S. Cramer, The origins of logistic regression, 2002. https://doi.org/10.2139/ssrn.360300.
S. Albawi, T. A. Mohammed, and S. Al-Zawi, “Understanding of a convolutional neural network,” Proceedings of the 2017 International Conference on Engineering and Technology (ICET), August 2017, pp. 1–6. https://doi.org/10.1109/ICEngTechnol.2017.8308186.
J. G. Choi, C. W. Kong, G. Kim, and S. Lim, “Car crash detection using ensemble deep learning and multimodal data from dashboard cameras,” Expert Syst. with Appl., vol. 183, p. 115400, 2021, https://doi.org/10.1016/j.eswa.2021.115400.
N. R. Vatti, P. L. Vatti, R. Vatti, and C. Garde, “Smart road accident detection and communication system,” Proceedings of the 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT), March 2018, pp. 1–4. https://doi.org/10.1109/ICCTCT.2018.8551179.
H. M. Sherif, M. A. Shedid, and S. A. Senbel, “Real time traffic accident detection system using wireless sensor network,” Proceedings of the 2014 6th International Conference of Soft Computing and Pattern Recognition (SoCPaR), August 2014, pp. 59–64. https://doi.org/10.1109/SOCPAR.2014.7007982.
J. Amala Ruby Florence and G. Kirubasri, “Accident detection system using deep learning,” in Computational Intelligence in Data Science, L. Kalinathan, P. R., M. Kanmani, and M. S., Eds., in IFIP Advances in Information and Communication Technology. Cham: Springer International Publishing, 2022, pp. 301–310. https://doi.org/10.1007/978-3-031-16364-7_23.
S. Robles-Serrano, G. Sanchez-Torres, and J. Branch-Bedoya, “Automatic detection of traffic accidents from video using deep learning techniques,” Computers, vol. 10, no. 11, Art. no. 11, 2021, https://doi.org/10.3390/computers10110148.
A. K. Paul, P. K. Boni, and M. Z. Islam, “A data-driven study to investigate the causes of severity of road accidents,” Proceedings of the 2022 IEEE 13th International Conference on Computing Communication and Networking Technologies (ICCCNT), 2022, pp. 1–7. https://doi.org/10.1109/ICCCNT54827.2022.9984499.
T. K. Vijay, D. P. Dogra, H. Choi, G. Nam, and I.-J. Kim, “Detection of road accidents using synthetically generated multi-perspective accident videos,” IEEE Trans. Intell. Transp. Syst., vol. 24, no. 2, pp. 1926–1935, 2023, https://doi.org/10.1109/TITS.2022.3222769.
K. V. Thakare, D. P. Dogra, H. Choi, H. Kim, and I.-J. Kim, “Object interaction-based localization and description of road accident events using deep learning,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 11, pp. 20601–20613, 2022, https://doi.org/10.1109/TITS.2022.3170648.
A. Saveliev, V. Lebedeva, I. Lebedev, and M. Uzdiaev, “An approach to the automatic construction of a road accident scheme using UAV and deep learning methods,” Sensors, vol. 22, no. 13, Art. no. 13, 2022, https://doi.org/10.3390/s22134728.
M. S. Basit, U. Ahmad, J. Ahmad, K. Ijaz, and S. F. Ali, “Driver drowsiness detection with region-of-interest selection based spatio-temporal Deep Convolutional-LSTM,” Proceedings of the 2022 16th International Conference on Open Source Systems and Technologies (ICOSST), 2022, pp. 1–6. https://doi.org/10.1109/ICOSST57195.2022.10016825.
P. Prajwal, D. Prajwal, D. H. Harish, R. Gajanana, B. S. Jayasri, and S. Lokesh, “Object detection in self driving cars using deep learning,” Proceedings of the 2021 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), September 2021, pp. 1–7. https://doi.org/10.1109/ICSES52305.2021.9633965.
T. Tamagusko, M. G. Correia, M. A. Huynh, and A. Ferreira, “Deep learning applied to road accident detection with transfer learning and synthetic images,” Transp. Res. Procedia, vol. 64, pp. 90–97, 2022, https://doi.org/10.1016/j.trpro.2022.09.012.
Accident Detection from CCTV Footage. [Online]. Available at: https://www.kaggle.com/datasets/ckay16/accident-detection-from-cctv-footage.
R. Chauhan, K. K. Ghanshala, and R. C. Joshi, “Convolutional Neural Network (CNN) for image detection and recognition,” Proceedings of the 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC), December 2018, pp. 278–282. https://doi.org/10.1109/ICSCCC.2018.8703316.
S. Indolia, A. K. Goswami, S. P. Mishra, and P. Asopa, “Conceptual understanding of convolutional neural network - A deep learning approach,” Procedia Comput. Sci., vol. 132, pp. 679–688, 2018, https://doi.org/10.1016/j.procs.2018.05.069.
S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345–1359, 2010, https://doi.org/10.1109/TKDE.2009.191.
S. Tammina, “Transfer learning using VGG-16 with deep convolutional neural network for classifying images,” Int. J. Sci. Res. Publ. IJSRP, vol. 9, no. 10, p9420, 2019, https://doi.org/10.29322/IJSRP.9.10.2019.p9420.
X. Xia, C. Xu, and B. Nan, “Inception-v3 for flower classification,” Proceedings of the 2017 2nd Int. Conf. Image Vis. Comput. ICIVC 2017, pp. 783–787, 2017, https://doi.org/10.1109/ICIVC.2017.7984661.
J. Tao, Y. Gu, J. Sun, Y. Bie, and H. Wang, “Research on vgg16 convolutional neural network feature classification algorithm based on Transfer Learning,” Proceedings of the 2021 2nd China International SAR Symposium (CISS), 2021, pp. 1–3. https://doi.org/10.23919/CISS51089.2021.9652277.
A. Bagaskara and M. Suryanegara, “Evaluation of VGG-16 and VGG-19 deep learning architecture for classifying dementia people,” Proceedings of the 2021 4th International Conference of Computer and Informatics Engineering (IC2IE), September 2021, pp. 1–4. https://doi.org/10.1109/IC2IE53219.2021.9649132.
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2818–2826. https://doi.org/10.1109/CVPR.2016.308
C. Wang et al., “Pulmonary image classification based on inception-v3 transfer learning model,” IEEE Access, vol. 7, pp. 146533–146541, 2019, https://doi.org/10.1109/ACCESS.2019.2946000.
H. M. D. Kabir et al., SpinalNet: Deep Neural Network with Gradual Input. 2020.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
