A Novel Bayesian Convolutional Neural Network with Variational Dropout in Crash Severity Estimation

Document Type : Scientific - Research

Authors
1 Associate Professor, Department of Transportation Engineering, School of Civil Engineering, Iran University of Science and Technology, Tehran, Iran
2 MSc Transportation Engineering, Department of Transportation Engineering, School of Civil Engineering, Iran University of Science and Technology, Tehran, Iran
Abstract
Due to high socio-economical costs of traffic crashes, accident injury prediction is an important aspect in safety related studies. Although statistical methods have been traditionally applied in crash severity prediction, there are some limitations regarding their application, hence limiting their usage in various tasks? With the aim of overcoming such limitations, Machine Learning methods have been developed and successfully applied in numerous fields including traffic safety. Deep Neural Networks are a field of research in Machine Learning which have been able to achieve state of the art performance in variety of fields. However, their usage has been limited in safety critical fields due to number of drawbacks. The current study addresses two of such drawbacks; namely, their inability to provide uncertainty measures in their predictions and time consuming hyperparameter optimization, due to high computational complexity. Hence, the current study proposed a novel approach to Deep Neural Networks. The proposed LRT-CNN-VD model aims to provide uncertainty measures using Bayesian Neural Networks, and simultaneously provides a Bayesian justification for Dropout regularization which renders grid search methods for regularization’s hyperparameter tuning useless. In order to evaluate our model’s performance, comparisons are made between the proposed model and two Convolutional Neural Network models and a binary Logistic Regression model. Results show improvement across different evaluation metrics, and regularization performance on par with dropout regularization.
Keywords
Subjects

  • Abdelwahab, H. T. and M. A. Abdel-Aty (2001). "Development of artificial neural network models to predict driver injury severity in traffic accidents at signalized intersections." Transportation research record 1746(1): 6-13.

 

  • Ali, A., Y. Zhu and M. Zakarya (2022). "Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction." Neural networks 145: 233-247.

 

  • Bejani, M. M. and M. Ghatee (2019). "Regularized deep networks in intelligent transportation systems: A taxonomy and a case study." arXiv preprint arXiv:1911.03010.

 

  • Bejani, M. M. and M. Ghatee (2021). "A systematic review on overfitting control in shallow and deep neural networks." Artificial Intelligence Review: 1-48.

 

  • Blei, D. M., A. Kucukelbir and J. D. McAuliffe (2017). "Variational inference: A review for statisticians." Journal of the American statistical Association 112(518): 859-877.

 

  • Chimba, D. and T. Sando (2009). "The prediction of highway traffic accident injury severity with neuromorphic techniques." Advances in transportation studies 19: 17-26.

 

  • Delen, D., R. Sharda and M. Bessonov (2006). "Identifying significant predictors of injury severity in traffic accidents using a series of artificial neural networks." Accident Analysis & Prevention 38(3.444-434).

 

  • Do, L. N., H. L. Vu, B. Q. Vo, Z. Liu and D. Phung (2019). "An effective spatial-temporal attention based neural network for traffic flow prediction." Transportation research part C: emerging technologies 108: 12-28.

 

  • Fang, S.-H., Y.-X. Fei, Z. Xu and Y. Tsao (2017).

 

  • "Learning transportation modes from smartphone sensors based on deep neural network." IEEE Sensors Journal 17(18): 6111-6118.

 

  • Fanyu, M., N. Sze, S. Cancan, C. Tiantian and Z. Yiping (2021). "Temporal instability of truck volume composition on non-truck-involved crash severity using uncorrelated and correlated grouped random parameters binary logit models with space-time variations." Analytic Methods in Accident Research 31: 100168.

 

  • Haghshenas, S. S., G. Guido, A. Vitale and V. Astarita (2023). "Assessment of the level of road crash severity: Comparison of intelligence studies." Expert Systems with Applications 234: 121118.

 

  • Hou, Q., X. Huo, J. Leng and F. Mannering (2022). "A note on out-of-sample prediction, marginal effects computations, and temporal testing with random parameters crash-injury severity models." Analytic methods in accident research 33: 100191.

 

  • Hu, Z., J. Zhou, K. Huang and E. Zhang (2022). "A data-driven approach for traffic crash prediction: A case study in Ningbo, China." International Journal of Intelligent Transportation Systems Research 20(2): 508-518.

 

  • Islam, M. R., K. B. Kelarestaghi, A. Ermagun and S. Banerjee (2019). "Gender Differences in Injury Severity Risk of Single-Vehicle Crashes in Virginia: A Nested Logit Analysis of Heterogeneity." arXiv preprint arXiv:1901.03289.

 

  • Kingma, D. P., T. Salimans and M. Welling (2015). "Variational dropout and the local reparameterization trick." Advances in neural information processing systems 28.

 

  • Li, L., J. Zhu, H. Zhang, H. Tan, B. Du and B. Ran (2020). "Coupled application of generative adversarial networks and conventional neural networks for travel mode detection using GPS data." Transportation Research Part A: Policy and Practice 136: 282-292.

 

  • Li, P., M. Abdel-Aty and J. Yuan (2020). "Real-time crash risk prediction on arterials based on LSTM-CNN." Accident Analysis & Prevention 135: 105371.

 

  • Park, S. and J. Park (2022). "Multilevel Mixed-Effects Models to Identify Contributing Factorson Freight Vehicle Crash Severity." Sustainability 14(19): 11804.

 

  • Patil, S., S. R. Geedipally and D. Lord (2012). "Analysis of crash severities using nested logit model—accounting for the underreporting of crashes." Accident Analysis & Prevention 45: 646-653.

 

  • Rahim, M. A. and H. M. Hassan (2021). "A deep learning based traffic crash severity prediction framework." Accident Analysis & Prevention 154: 106090.

 

  • Rezapour, M., S. Nazneen and K. Ksaibati (2020). "Application of deep learning techniques in predicting motorcycle crash severity." Engineering Reports 2(7): e12175.
  • Rezapour, M., S. S. Wulff and K. Ksaibati (2020). "Bayesian hierarchical modelling of traffic barrier crash severity." International journal of injury control and safety promotion 28(1): 94-102.

 

  • Sameen, M. I. and B. Pradhan (2017). "Severity prediction of traffic accidents with recurrent neural networks." Applied Sciences 7(6): 476.

 

  • Shiran, G., R. Imaninasab and R. Khayamim (2021). "Crash severity analysis of highways based on multinomial logistic regression model, decision tree techniques, and artificial neural network: a Modeling comparison." Sustainability 13(10): 5670.

 

  • Silva, P. B., M. Andrade and S. Ferreira (2020). "Machine learning applied to road safety modeling: A systematic literature review." Journal of traffic and transportation engineering (English edition) 7(6): 775-790.

 

  • Vajari, M. A., K. Aghabayk, M. Sadeghian and N. Shiwakoti (2020). "A multinomial logit model of motorcycle crash severity at Australian intersections." Journal of safety research 73: 124-7.

 

  • Yu, H., Z. Li, G. Zhang, P. Liu and T. Ma (2021). "Fusion convolutional neural network-based interpretation of unobserved heterogeneous factors in driver injury severity outcomes in single-vehicle crashes." Analytic methods in accident research 30: 100157.

 

  • Zeng, Q., W. Gu, X. Zhang, H. Wen, J. Lee and W. Hao (2019). "Analyzing freeway crash severity using a Bayesian spatial generalized ordered logit model with conditional autoregressive priors." Accident Analysis & Prevention 127: 87-95.

 

  • Zeng, Q. and H. Huang (2014). "A stable and optimized neural network model for crash injury severity prediction." Accident Analysis & Prevention 73: 351-358.
Volume 16, Issue 2 - Serial Number 63
Winter 2025
Pages 4461-4474

  • Receive Date 30 August 2023
  • Revise Date 04 October 2023
  • Accept Date 09 October 2023