Deep Learning for Assessing Severity of Cracks in Concrete Structures

Ahmed BaniMustafa; Rozan AbdelHalim; Olla Bulkrock; Ahmad Al-Hmouz

doi:10.15837/ijccc.2023.1.4977

Authors

Ahmed BaniMustafa Data Science & AI Dept., Isra University, Amman, Jordan
Rozan AbdelHalim Computer Science, Middle East University, Amman, Jordan
Olla Bulkrock Data Science Department, Princess Sumaya University for Technology, Amman, Jordan
Ahmad Al-Hmouz Computer Science Department, Middle East University, Amman, Jordan

DOI:

https://doi.org/10.15837/ijccc.2023.1.4977

Keywords:

Machine Learning, Deep Learning, Structural Health Monitoring (SHM), Concrete Structure, Civil Engineering

Abstract

Most concrete structures suffer from degradation, where cracks are the most obvious visual sign. Concrete structures must be continuously monitored and assessed to avoid further deterioration, which may lead to a partial or total collapse. This is particularly important when constructing large structures such as towers, bridges, tunnels, and dams. This work aims to demonstrate and evaluate several deep learning approaches that can be used for monitoring and assessing the level of concrete degradation based on the cracks’ visual signs, which can then be embedded in Health Monitoring Systems (SHM). The experimental work in this study involves creating three models: Two were built using ResNet-50 and Xception transfer learning networks. In contrast, the third was built using a customized Sequential Convolutional Neural Network (SCNN) architecture. The dataset comprises 2,000 image samples sampled from a larger dataset that contains 56,000 images and which belong to four severity classes: minor, moderate, and severe, in addition to a normal class for no crack signs. The SCNN model achieved an accuracy of 90.2%, while the Xception and ResNet-50 models scored an accuracy of 86.3% and 70%, respectively.

References

Alpaydin, E., 2021. Machine learning. MIT Press.

https://doi.org/10.7551/mitpress/13811.001.0001

Arbaoui, A., Ouahabi, A., Jacques, S., Hamiane, M., 2021. Concrete cracks detection and monitoring using deep learning-based multiresolution analysis. Electronics 10, 1772.

https://doi.org/10.3390/electronics10151772

Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., Baskurt, A., . Sequential deep learning for human action recognition, in: International workshop on human behavior understanding, Springer. pp. 29-39.

https://doi.org/10.1007/978-3-642-25446-8_4

Ballard, W., 2018. Hands-on Deep Learning for Images with TensorFlow: Build Intelligent Computer Vision Applications Using TensorFlow and Keras. Packt Publishing Ltd.

Bani Mustafa, A.M., 2012. A knowledge discovery and data mining process model for metabolomics. Thesis. Computer Science Department.

BaniMustafa, A., . Predicting software effort estimation using machine learning techniques, in: 2018 8th International Conference on Computer Science and Information Technology (CSIT), IEEE. pp. 249-256.

https://doi.org/10.1109/CSIT.2018.8486222

BaniMustafa, A., 2019. Enhancing learning from imbalanced classes via data preprocessing: A data-driven application in metabolomics data mining. The ISC International Journal of Information Security 11, 79-89.

Banimustafa, A., Hardy, N., 2020. A scientific knowledge discovery and data mining process model for metabolomics. IEEE Access 8, 209964-210005.

https://doi.org/10.1109/ACCESS.2020.3039064

BaniMustafa, A.H., Hardy, N.W., 2012. A strategy for selecting data mining techniques in metabolomics. Springer. book section 18. pp. 317-333.

https://doi.org/10.1007/978-1-61779-594-7_18

Billah, U.H., Tavakkoli, A., La, H.M., . Concrete crack pixel classification using an encoder decoder based deep learning architecture, in: International Symposium on Visual Computing, Springer. pp. 593-604.

https://doi.org/10.1007/978-3-030-33720-9_46

Cha, Y.J., Choi, W., Büyüköztürk, O., 2017. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering 32, 361- 378.

https://doi.org/10.1111/mice.12263

Chollet, F., . Xception: Deep learning with depthwise separable convolutions, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1251-1258.

https://doi.org/10.1109/CVPR.2017.195

Deng, J., Dong, W., Socher, R., Li, L.J., Kai, L., Li, F.F., . Imagenet: A large-scale hierarchical image database, in: IEEE Conference on Computer Vision and Pattern Recognition, pp. 248-255.

https://doi.org/10.1109/CVPR.2009.5206848

Dorafshan, S., Thomas, R.J., Maguire, M., 2018. Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete. Construction Building Materials 186, 1031-1045.

https://doi.org/10.1016/j.conbuildmat.2018.08.011

Dung, C.V., 2019. Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction 99, 52-58.

https://doi.org/10.1016/j.autcon.2018.11.028

Farrar, C.R., Worden, K., 2007. An introduction to structural health monitoring. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 365, 303- 315.

https://doi.org/10.1098/rsta.2006.1928

Goodfellow, I., Bengio, Y., Courville, A., 2016. Deep learning. MIT press.

He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778.

https://doi.org/10.1109/CVPR.2016.90

Jin, H., Ling, C.X., 2005. Using auc and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering 17, 299-310.

https://doi.org/10.1109/TKDE.2005.50

LeCun, Y., Bengio, Y., Hinton, G., 2015. Deep learning. nature 521, 436-444.

https://doi.org/10.1038/nature14539

Ling, C.X., Huang, J., Zhang, H., . Auc: A better measure than accuracy in comparing learning algorithms, in: Xiang, Y., Chaib-draa, B. (Eds.), Advances in Artificial Intelligence, Springer Berlin Heidelberg. pp. 329-341.

https://doi.org/10.1007/3-540-44886-1_25

Park, R., Paulay, T., 1991. Reinforced concrete structures. John Wiley & Sons.

da Silva, W.R.L., de Lucena, D.S., . Concrete cracks detection based on deep learning image classification, in: Multidisciplinary digital publishing institute proceedings, p. 489.

Simonyan, K., Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint URL: https://arxiv.org/abs/1409.1556.

Speckmann, H., Henrich, R., . Structural health monitoring (shm)-overview on technologies under development, in: Proceedings of the 16th World Conference on NDT, pp. 1-8. URL: https://www.ndt.net/abstract/wcndt2004/563.htm.

Sumitro, S., Hida, K., Diouron, T.L., . Structural health monitoring paradigm for concrete structures, in: 28th Conference on Our World In Concrete & Structures, Singapore, 27-29 August 2003, Conference Documentation Volume XXII, Citeseer. pp. 525-532. URL: https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.502.2512.

Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A., a. Inception-v4, inception-resnet and the impact of residual connections on learning, in: Thirty-first AAAI conference on artificial intelligence, pp. 1-12.

https://doi.org/10.1609/aaai.v31i1.11231

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z., b. Rethinking the inception architecture for computer vision, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2818-2826.

https://doi.org/10.1109/CVPR.2016.308

Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S., 2008. Image-based crack detection for real concrete surfaces. IEEJ Transactions on Electrical and Electronic Engineering 3, 128-135.

https://doi.org/10.1002/tee.20244

Yamane, T., Chun, P.j., 2020. Crack detection from a concrete surface image based on semantic segmentation using deep learning. Journal of Advanced Concrete Technology 18, 493-504.

https://doi.org/10.3151/jact.18.493

Yuen, K.V., Kuok, S.C., 2010. Modeling of environmental influence in structural health assessment for reinforced concrete buildings. Earthquake Engineering Engineering Vibration 9, 295-306.

https://doi.org/10.1007/s11803-010-0014-4