Abstract
Trucks are the key transporters of freight. The types of commodities and goods mainly determine the right trailer for carrying them. Furthermore, finding the commodities’ flow is an important task for transportation agencies in better planning freight infrastructure investments and initiating near-term traffic throughput improvements. In this paper, we propose a fine-grained deep learning based truck classification system that can detect and classify the trucks, tractors, and trailers following the Federal Highway Administration’s (FHWA) vehicle schema. We created a large, fine-grained labeled dataset of vehicle images collected from state highways. Experimental results show the high accuracy of our system and visualize the salient features of the trucks that influence classification.
Similar content being viewed by others
References
Freight transportation forecast (2020). URL http://www.atabusinesssolutions.com/
Adu-Gyamfi, Y.O., Asare, S.K., Sharma, A., Titus, T.: Automated vehicle recognition with deep convolutional neural networks. Transportation Research Record 2645(1), 113–122 (2017). https://doi.org/10.3141/2645-13
Bautista, C.M., Dy, C.A., Maalac, M.I., Orbe, R.A., Cordel, M.: Convolutional neural network for vehicle detection in low resolution traffic videos. In: 2016 IEEE Region 10 Symposium (TENSYMP), pp. 277–281 (2016). https://doi.org/10.1109/TENCONSpring.2016.7519418
Chen, L., Jia, Y., Sun, P.Y., Sinnott, R.O.: Identification and classification of trucks and trailers on the road network through deep learning. BDCAT ’19, p. 117–126. Association for Computing Machinery, New York, NY, USA (2019). 10.1145/3365109.3368781. URL https://doi.org/10.1145/3365109.3368781
Chen, Z., Ellis, T., Velastin, S.A.: Vehicle detection, tracking and classification in urban traffic. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems, pp. 951–956 (2012). https://doi.org/10.1109/ITSC.2012.6338852
Dong, Z., Wu, Y., Pei, M., Jia, Y.: Vehicle type classification using a semisupervised convolutional neural network. IEEE transactions on intelligent transportation systems 16(4), 2247–2256 (2015)
Fu, H., Ma, H., Liu, Y., Lu, D.: A vehicle classification system based on hierarchical multi-svms in crowded traffic scenes. Neurocomputing 211, 182–190 (2016)
Gupte, S., Masoud, O., Martin, R.F.K., Papanikolopoulos, N.P.: Detection and classification of vehicles. IEEE Transactions on Intelligent Transportation Systems 3(1), 37–47 (2002). https://doi.org/10.1109/6979.994794
He, P., Wu, A., Huang, X., Scott, J., Rangarajan, A., Ranka, S.: Deep learning based geometric features for effective truck selection and classification from highway videos. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 824–830 (2019). https://doi.org/10.1109/ITSC.2019.8917097
He, P., Wu, A., Huang, X., Scott, J., Rangarajan, A., Ranka, S.: Truck and trailer classification with deep learning based geometric features. IEEE Transactions on Intelligent Transportation Systems pp. 1–10 (2020). https://doi.org/10.1109/TITS.2020.3009254
Hernandez, S.V., Tok, A., Ritchie, S.G.: Integration of weigh-in-motion (wim) and inductive signature data for truck body classification. Transportation Research Part C: Emerging Technologies 68, 1–21 (2016)
Hussain, K.F., Moussa, G.S.: On-road vehicle classification based on random neural network and bag-of-visual words. Probability in the Engineering and Informational Sciences 30(3), 403–412 (2016). https://doi.org/10.1017/S0269964816000073
Huttunen, H., Yancheshmeh, F.S., Ke Chen: Car type recognition with deep neural networks. In: 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 1115–1120 (2016). https://doi.org/10.1109/IVS.2016.7535529
Jo, S.Y., Ahn, N., Lee, Y., Kang, S.: Transfer learning-based vehicle classification. In: 2018 International SoC Design Conference (ISOCC), pp. 127–128 (2018). https://doi.org/10.1109/ISOCC.2018.8649802
Kafai, M., Bhanu, B.: Dynamic bayesian networks for vehicle classification in video. IEEE Transactions on Industrial Informatics 8(1), 100–109 (2012). https://doi.org/10.1109/TII.2011.2173203
Kamath, U., Liu, J., Whitaker, J.: Deep learning for NLP and speech recognition, vol. 84. Springer (2019)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, NIPS’12, pp. 1097–1105. Curran Associates Inc., USA (2012). URL http://dl.acm.org/citation.cfm?id=2999134.2999257
Lai, A.H., Fung, G.S., Yung, N.H.: Vehicle type classification from visual-based dimension estimation. In: Intelligent Transportation Systems, 2001. Proceedings. 2001 IEEE, pp. 201–206. IEEE (2001)
Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., Dollr, P.: Microsoft coco: Common objects in context (2014). URL http://arxiv.org/abs/1405.0312. Cite arxiv:1405.0312Comment: 1) updated annotation pipeline description and figures; 2) added new section describing datasets splits; 3) updated author list
Liu, H., Tian, Y., Yang, Y., Pang, L., Huang, T.: Deep relative distance learning: Tell the difference between similar vehicles. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2167–2175 (2016)
Ma, W., Xing, D., McKee, A., Bajwa, R., Flores, C., Fuller, B., Varaiya, P.: A wireless accelerometer-based automatic vehicle classification prototype system. IEEE Transactions on Intelligent Transportation Systems 15(1), 104–111 (2014). https://doi.org/10.1109/TITS.2013.2273488
Malinovskiy, Y., Wu, Y.J., Wang, Y.: Video-based vehicle detection and tracking using spatiotemporal maps. Transportation Research Record 2121(1), 81–89 (2009). https://doi.org/10.3141/2121-09
Psyllos, A., Anagnostopoulos, C.N., Kayafas, E.: Vehicle model recognition from frontal view image measurements. Computer Standards & Interfaces 33(2), 142–151 (2011)
Redmon, J., Farhadi, A.: Yolo9000: better, faster, stronger. arXiv preprint arXiv:1612.08242 (2016)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626 (2017)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Y. Bengio, Y. LeCun (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings (2015). URL http://arxiv.org/abs/1409.1556
Singh, S.P., Kumar, A., Darbari, H., Singh, L., Rastogi, A., Jain, S.: Machine translation using deep learning: An overview. In: 2017 international conference on computer, communications and electronics (comptelix), pp. 162–167. IEEE (2017)
Sochor, J., Herout, A.: Unsupervised processing of vehicle appearance for automatic understanding in traffic surveillance. In: Digital Image Computing: Techniques and Applications (DICTA), 2015 International Conference on, pp. 1–8. IEEE (2015)
Sochor, J., Herout, A., Havel, J.: Boxcars: 3d boxes as cnn input for improved fine-grained vehicle recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3006–3015 (2016).https://doi.org/10.1109/CVPR.2016.328
Texas DOT: Vehicle Classification Using FHWA 13-Category Scheme, Appendix A:
Tok, A., Hyun, K., Hernandez, S., Jeong, K., Sun, Y., Rindt, C., Ritchie, S.G.: Truck activity monitoring system (tams) for freight transportation analysis (2017)
Wang, W., Yang, Y., Wang, X., Wang, W., Li, J.: Development of convolutional neural network and its application in image classification: a survey. Optical Engineering 58(4), 040901 (2019)
Xiang, Z., Huang, X., Zou, Y.: An effective and robust multi-view vehicle classification method based on local and structural features. In: Multimedia Big Data (BigMM), 2016 IEEE Second International Conference on, pp. 68–73. IEEE (2016)
Xiao, W., Vallet, B., Schindler, K., Paparoditis, N.: Street-side vehicle detection, classification and change detection using mobile laser scanning data. ISPRS Journal of Photogrammetry and Remote Sensing 114, 166–178 (2016). https://doi.org/10.1016/j.isprsjprs.2016.02.007
Yu, S., Wu, Y., Li, W., Song, Z., Zeng, W.: A model for fine-grained vehicle classification based on deep learning. Neurocomputing (2017)
Zhang, G., Avery, R., Wang, Y.: Video-based vehicle detection and classification system for real-time traffic data collection using uncalibrated video cameras. Transportation Research Record: Journal of the Transportation Research Board 1993, 138–147 (2007)
Zhang, Z., Tan, T., Huang, K., Wang, Y.: Three-dimensional deformable-model-based localization and recognition of road vehicles. IEEE Transactions on Image Processing 21(1), 1–13 (2012)
Zhou, Y., Nejati, H., Do, T.T., Cheung, N.M., Cheah, L.: Image-based vehicle analysis using deep neural network: A systematic study (2016)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Almutairi, A., He, P., Rangarajan, A. et al. Automated Truck Taxonomy Classification Using Deep Convolutional Neural Networks. Int. J. ITS Res. 20, 483–494 (2022). https://doi.org/10.1007/s13177-022-00306-4
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s13177-022-00306-4