Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network

Nowadays, License Plate Recognition (LPR) becomes popular among researchers due to its compatibility in many applications. For instance, LPR significantly can be applied to toll gate systems, surveillance systems and law enforcement. However, the previous LPR system still does not meet optimum accur...

Full description

Saved in:
Bibliographic Details
Main Author: Piramli, Muhamad Marzuki
Format: Thesis
Language:English
English
Published: 2020
Subjects:
Online Access:http://eprints.utem.edu.my/id/eprint/25422/1/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf
http://eprints.utem.edu.my/id/eprint/25422/2/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-utem-ep.25422
record_format uketd_dc
institution Universiti Teknikal Malaysia Melaka
collection UTeM Repository
language English
English
advisor Ahmad Radzi, Syafeeza

topic T Technology (General)
T Technology (General)
spellingShingle T Technology (General)
T Technology (General)
Piramli, Muhamad Marzuki
Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
description Nowadays, License Plate Recognition (LPR) becomes popular among researchers due to its compatibility in many applications. For instance, LPR significantly can be applied to toll gate systems, surveillance systems and law enforcement. However, the previous LPR system still does not meet optimum accuracy and speed. Current Convolutional Neural Network (CNN) improvements have the ability to solve complex visual recognition tasks. The primary aim of this system is to ensure that the character of the vehicle plate recognize accurately and efficiently using CNN techniques. A method utilizing two CNN network architectures of deep object detection was designed to solve the Malaysian License Plate Recognition (MLPR) task. The first and the second network were designed for plate detection and recognition of license plate characters respectively. Both of the networks utilized the architecture of YOLOv2 with high speed and accuracy. The accuracy and speed of the plate recognition of the MLPR obtained were 98.75% and 0.0104 seconds respectively. The MLPR has obtained high prediction accuracy and has outperformed the existing methods. In conclusion, the system adapted from deep object detection is the best solution for the MLPR problem based on the accuracy and speed achieved.
format Thesis
qualification_name Master of Philosophy (M.Phil.)
qualification_level Master's degree
author Piramli, Muhamad Marzuki
author_facet Piramli, Muhamad Marzuki
author_sort Piramli, Muhamad Marzuki
title Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
title_short Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
title_full Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
title_fullStr Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
title_full_unstemmed Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network
title_sort malaysian license plate recognition algorithm using convolutional neural network
granting_institution Universiti Teknikal Malaysia Melaka
granting_department Faculty of Electronics and Computer Engineering
publishDate 2020
url http://eprints.utem.edu.my/id/eprint/25422/1/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf
http://eprints.utem.edu.my/id/eprint/25422/2/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf
_version_ 1747834124675055616
spelling my-utem-ep.254222021-12-07T14:03:55Z Malaysian License Plate Recognition Algorithm Using Convolutional Neural Network 2020 Piramli, Muhamad Marzuki T Technology (General) TK Electrical engineering. Electronics Nuclear engineering Nowadays, License Plate Recognition (LPR) becomes popular among researchers due to its compatibility in many applications. For instance, LPR significantly can be applied to toll gate systems, surveillance systems and law enforcement. However, the previous LPR system still does not meet optimum accuracy and speed. Current Convolutional Neural Network (CNN) improvements have the ability to solve complex visual recognition tasks. The primary aim of this system is to ensure that the character of the vehicle plate recognize accurately and efficiently using CNN techniques. A method utilizing two CNN network architectures of deep object detection was designed to solve the Malaysian License Plate Recognition (MLPR) task. The first and the second network were designed for plate detection and recognition of license plate characters respectively. Both of the networks utilized the architecture of YOLOv2 with high speed and accuracy. The accuracy and speed of the plate recognition of the MLPR obtained were 98.75% and 0.0104 seconds respectively. The MLPR has obtained high prediction accuracy and has outperformed the existing methods. In conclusion, the system adapted from deep object detection is the best solution for the MLPR problem based on the accuracy and speed achieved. 2020 Thesis http://eprints.utem.edu.my/id/eprint/25422/ http://eprints.utem.edu.my/id/eprint/25422/1/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf text en public http://eprints.utem.edu.my/id/eprint/25422/2/Malaysian%20license%20plate%20recognition%20algorithm%20using%20convolutional%20neural%20network.pdf text en validuser https://plh.utem.edu.my/cgi-bin/koha/opac-detail.pl?biblionumber=119752 mphil masters Universiti Teknikal Malaysia Melaka Faculty of Electronics and Computer Engineering Ahmad Radzi, Syafeeza 1. Baştanlar, Y. and Özuysal, M., 2014. Introduction to machine learning. miRNomics: MicroRNA Biology and Computational Analysis, pp. 105-128. 2. Dickson N. and Sahari K.S.M., 2016. Character recognition of Malaysian vehicle license plate with deep convolutional neural networks. IRIS: IEEE International Symposium on Robotics and Intelligent Sensors, pp. 71-75. 3. Dong, C., Loy, C.C., He, K. and Tang, X., 2015. Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2), pp. 295-307. 4. Du, S., Ibrahim, M., Shehata, M. and Badawy, W. 2013. Automatic license plate recognition (ALPR): A state-of-the-art review. IEEE Transactions on Circuits and Systems for Video Technology, 23(2), pp. 311–325. 5. Erhan, D., Szegedy, C., Toshev, A. and Anguelov, D., 2014. Scalable object detection using deep neural networks. Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2147-2154. 6. Everingham, M., Eslami, S.M.A., Van Gool, L., Williams, C.K.I., Winn, J. and Zisserman, A. 2014. The Pascal Visual Object Classes Challenge: A Retrospective. International Journal of Computer Vision, 111(1), pp. 98-136. 7. Everingham, M, Van Gool L, Williams C. K, Winn J., and Zisserman A., 2015. The pascal visual object classes (voc) challenge. International journal of computer vision, 88(2), pp. 303– 338. 8. Fisher, M., 2011. The lost unconscious: Delusions and dreams in Inception. Film Quart, 64(3), pp. 37-45. 9. Forsyth, D. 2014. Object detection with discriminatively trained part-based models. Computer, 2, pp. 6-7. 10. Girshick, R. 2015. Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, pp. 1440-1448. 11. Girshick, R., Donahue, J., Darrell, T. and Malik, J. 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 580-587. 12. Graves, A., Mohamed, A.R. and Hinton, G. 2013. Speech recognition with deep recurrent neural networks. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. pp. 6645-6649. 13. He, K., Gkioxari, G., Dollar, P. and Girshick, R. 2017. Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, pp. 2961-2969. 14. He, K., Zhang, X., Ren, S. and Sun, J. 2015. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(9), pp. 1904-1916. 15. He, K., Zhang, X., Ren, S. and Sun, J. 2016. Identity Mappings in Deep Residual Networks Importance of Identity Skip Connections Usage of Activation Function Analysis of Pre-activation Structure. arXiv Preprint. pp. 630-645. 16. Hoiem, D., Efros, A.A. and Hebert, M. 2011. Recovering occlusion boundaries from an image. International Journal of Computer Vision. 91(3), pp. 328-346. 17. Hopfield, J.J. and Tank, D.W. 1985. ‘Neural’ computation of decisions in optimization problems. Biological Cybernetics, 52(3), pp. 141-152. 18. Huang, H., Liu Y. and Cao J. 2017. Convolutional neural networks-based intelligent recognition of Chinese license plates. Soft Computing Journal. 22(7), pp. 2403–2419. 19. Jaderberg, M., Simonyan, K., Vedaldi, A. and Zisserman, A. 2016. Reading Text in the Wild with Convolutional Neural Networks. International Journal of Computer Vision, 116(1), pp. 1–20. 20. Jain, V., Sasindran, Z., Rajagopal, A., Biswas, S., Bharadwaj, H.S. and Ramakrishnan, K.R. 2016. Deep automatic license plate recognition system. Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing - ICVGIP ’16. pp. 6-9. 21. Krizhevsky, A., Srivastava, N., Hinton, G., Sutskever, I. and Salakhutdinov, R., 2014. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1), pp. 1929-1958. 22. Lazebnik, L., 2018. Convolutional neural network architectures: from LeNet to ResNet. Presentation, University of Illinois, pp. 20-27. 23. LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. 1998. 1998 LeNet5. Proceedings of the IEEE, pp. 20-26. 24. LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. 1998. Gradient-based learning applied to document. Proceedings of the IEEE, 86(11), pp. 2278-2324. 25. Li, H. and Shen, C., 2016. Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:1601.05610. 26. Li, H., Wang, P., You, M. and Shen, C., 2018. Reading car license plates using deep neural networks. Image and Vision Computing, 72, pp. 14-23. 27. Lindeberg, T. 2012. Scale Invariant Feature Transform. Scholarpedia. 28. Liu, S. and Deng, W., 2015. Very deep convolutional neural network based image classification using small training sample size. 2015 3rd IAPR Asian conference on pattern recognition (ACPR), pp. 730-734. 29. Norouzi, M., Fleet, D.J. and Salakhutdinov, R.R., 2012. Hamming distance metric learning. Advances in neural information processing systems, pp. 1061-1069. 30. Ortiz EG., Masood SZ, Shu G, Dehghan A, 2017. License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:1703.07330. 31. Peng, E., Chen, F. and Song, X., 2016. Traffic sign detection with convolutional neural networks. International Conference on Cognitive Systems and Signal Processing, pp. 214-224. 32. Redmon, J. and Farhadi, A. 2017. YOLO9000: Better, faster, stronger. Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, pp. 7263-7271. 33. Redmon, J., Divvala, S., Girshick, R. and Farhadi, A., 2016. You only look once: Unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788. 34. Ren, S., He, K., Girshick, R. and Sun, J., 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, pp. 91-99. 35. Ringset, P.K., 2015. Automatisk nummerskiltgjenkjenning for mobile enheter. Master's thesis, NTNU. 36. Schmidhuber, J., 2015. Deep learning in neural networks: An overview. Neural networks, 61, pp. 85-117. 37. Shin, H.C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D. and Summers, R.M. 2016. Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. IEEE Transactions on Medical Imaging. 38. Shivakumara P. Tang D., Lu T., Pal U. and Anisi M. H. 2018. CNN-RNN Based Method For License Plate Recognition. CAAI Transactions on Intelligence Technology. Institution of Electrical Technology (IET), 3(3), pp. 169 - 175. 39. Simonyan, K., Andrew Zisserman and Zisserman, A. 2014, VGGNet, ICLR. 40. Syafeeza, A.R. and Khalil-Hani, M. 2011. Character recognition of license plate number using convolutional neural network. International Visual Informatics Conference, pp. 45-55. 41. Syafeeza, A.R., Khalil-Hani, M., Liew, S.S. and Bakhteri, R. 2014. Convolutional neural network for face recognition with pose and illumination variation. International Journal of Engineering and Technology, 6(1), pp. 44–57. 42. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V. and Rabinovich, A. 2014. 'GoogLeNet', CVPR. 43. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V. and Rabinovich, A. 2015. Going deeper with convolutions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1-9. 44. Szegedy, C., Toshev, A. and Erhan, D., 2013. Deep neural networks for object detection. Advances in neural information processing system, pp. 2553-2561. 45. Tay. Y. H., Cheang T. K and Chong Y. S., 2017. Segmentation-free Vehicle License Plate Recognition using ConvNet-RNN. International Workshop on Advanced Image Technology. pp 40-44. 46. Uijlings, J.R., Van De Sande, K.E., Gevers, T. and Smeulders, A.W., 2013. Selective search for object recognition. International journal of computer vision, 104(2), pp.154-171. 47. Vojir, T., Noskova, J. and Matas, J., 2014. Robust scale-adaptive mean-shift for tracking Pattern Recognition Letters. 49, pp.250-258. 48. Wang, T., Wu, D.J., Coates, A. and Ng, A.Y. 2012. End-to-end text recognition with convolutional neural networks. ICPR, International Conference on Pattern Recognition, pp. 3304–3308. 49. Wen, Y., Lu, Y., Yan, J., Zhou, Z., von Deneen, K.M. and Shi, P., 2011. An algorithm for license plate recognition applied to intelligent transportation system. IEEE Transactions on Intelligent Transportation Systems, 12(3), pp.830-845. 50. Wu, S., Zhong, S. and Liu, Y. 2015, ResNet, CVPR. 51. Xiong, W., Du, B., Zhang, L., Hu, R. and Tao, D., 2016. Regularizing deep convolutional neural networks with a structured decorrelation constraint. 2016 IEEE 16th International Conference on Data Mining (ICDM), pp. 519-528. 52. Xue, W., Mou, X., Zhang, L. and Feng, X., 2013. Perceptual fidelity aware mean squared error. Proceedings of the IEEE International Conference on Computer Vision, pp. 705-712. 53. Yan, J. Lei, Z. Wen, L. and Li. S. Z., 2014. The fastest deformable part model for object detection. Proceedings of the IEEE Computer Vision and Pat-tern Recognition (CVPR), 2014 IEEE Conference, pp 2497–2504. 54. Zheng, L., He, X., Samali, B. and Yang, L.T., 2013. An algorithm for accuracy enhancement of license plate recognition. Journal of computer and system sciences, 79(2), pp.245-255. 55. Zhou, W., Li, H., Lu, Y. and Tian, Q., 2012. Principal visual word discovery for automatic license plate detection. IEEE Transactions on Image Processing, 21(9), pp.4269-4279.