Steel strips surface classification and defect detection based on multiple integrated features and classification schemes

Machine vision has become an indispensable tool in automated steel surface inspection. Such technologies are able to facilitate or replace manual inspection methods with benefits such as manpower reduction and operator error minimization. In the last two decades, researchers have actively explored c...

Full description

Saved in:

Bibliographic Details
Main Author:	Ashour, Mohammed W. M.
Format:	Thesis
Language:	English
Published:	2018
Subjects:	Construction industry - Information technology Steel - Industrial applications
Online Access:	http://psasir.upm.edu.my/id/eprint/83754/1/FSKTM%202018%2080%20-%20ir.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-upm-ir.83754
record_format	uketd_dc
spelling	my-upm-ir.837542022-01-04T08:08:06Z Steel strips surface classification and defect detection based on multiple integrated features and classification schemes 2018-09 Ashour, Mohammed W. M. Machine vision has become an indispensable tool in automated steel surface inspection. Such technologies are able to facilitate or replace manual inspection methods with benefits such as manpower reduction and operator error minimization. In the last two decades, researchers have actively explored computer extractable visual features for steel surface inspection. However, existing approaches suffer from certain limitations that cause ineffectiveness. Specifically, (i) non-discriminating feature choices lead to poor inter-class separability; and (ii) classifier complexity coupled with high numbers of training epochs. Therefore, this research aims to propose two frameworks to improve the inspection performance of steel surface types. The first framework performs two tasks for machined surface texture classification and identification. The first task generates the most discriminating feature representation for surface texture. This is achieved through the proposed feature extraction method DST-GLCM, which integrates the Discrete Shearlet Transform (DST) and the Gray Level Co-occurrence Matrix (GLCM), producing a compact yet discriminative feature representation. A two-level classification scheme is then proposed combining the capabilities of the Support Vector Machine (SVM) and a proposed Consecutive Training with Collective Testing Artificial Neural Network (CTCT-ANN) technique. The SVM-level classifies the surface images into six categories based on surface texture features. This is followed by the CTCT-ANN-level where each of the surface textured images are further classified into sub-categories according to their surface roughness. Finally, the surface roughness parameters for all classified images are estimated. The second framework extracts and combines different features (global and local) from hot-rolled steel surface images of different forms into different domains (spatial and frequency). This improves the image content description and offers a variant representation of the surface image. This is useful for surface defect detection and classification. The global features are extracted from the input image using the proposed DST-GLCM (from Framework-1). Local features are extracted after dividing each input image into four blocks. Then, local features/descriptors namely the GLCM, Uniform Local Binary Pattern (ULBP) and Speeded-Up Robust Features (SURF) are extracted from every block. All the extracted global and local features are combined in a high dimensional feature vector, whose dimensionality is later reduced using Principal Components Analysis (PCA). The final classification is accomplished using an SVM. Both frameworks are evaluated using two different datasets of steel surface images. The first framework uses Engineering Machined Textures (EMT) workpiece surface images produced using several machining processes. The second framework uses the Northeastern University (NEU) standard database that comprises surface images of hot-rolled steel strips with different defect types. The results in this research show improvement when compared with previous related studies. The maximum accuracy achieved in surface classification of EMT dataset was up to 100%, with a maximum error in surface roughness estimation of 0.004 micrometer. In addition, the maximum accuracy achieved in defect detection of NEU dataset was up to 99.34%. Construction industry - Information technology Steel - Industrial applications 2018-09 Thesis http://psasir.upm.edu.my/id/eprint/83754/ http://psasir.upm.edu.my/id/eprint/83754/1/FSKTM%202018%2080%20-%20ir.pdf text en public doctoral Universiti Putra Malaysia Construction industry - Information technology Steel - Industrial applications Khalid, Fatimah
institution	Universiti Putra Malaysia
collection	PSAS Institutional Repository
language	English
advisor	Khalid, Fatimah
topic	Construction industry - Information technology Steel - Industrial applications
spellingShingle	Construction industry - Information technology Steel - Industrial applications Ashour, Mohammed W. M. Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
description	Machine vision has become an indispensable tool in automated steel surface inspection. Such technologies are able to facilitate or replace manual inspection methods with benefits such as manpower reduction and operator error minimization. In the last two decades, researchers have actively explored computer extractable visual features for steel surface inspection. However, existing approaches suffer from certain limitations that cause ineffectiveness. Specifically, (i) non-discriminating feature choices lead to poor inter-class separability; and (ii) classifier complexity coupled with high numbers of training epochs. Therefore, this research aims to propose two frameworks to improve the inspection performance of steel surface types. The first framework performs two tasks for machined surface texture classification and identification. The first task generates the most discriminating feature representation for surface texture. This is achieved through the proposed feature extraction method DST-GLCM, which integrates the Discrete Shearlet Transform (DST) and the Gray Level Co-occurrence Matrix (GLCM), producing a compact yet discriminative feature representation. A two-level classification scheme is then proposed combining the capabilities of the Support Vector Machine (SVM) and a proposed Consecutive Training with Collective Testing Artificial Neural Network (CTCT-ANN) technique. The SVM-level classifies the surface images into six categories based on surface texture features. This is followed by the CTCT-ANN-level where each of the surface textured images are further classified into sub-categories according to their surface roughness. Finally, the surface roughness parameters for all classified images are estimated. The second framework extracts and combines different features (global and local) from hot-rolled steel surface images of different forms into different domains (spatial and frequency). This improves the image content description and offers a variant representation of the surface image. This is useful for surface defect detection and classification. The global features are extracted from the input image using the proposed DST-GLCM (from Framework-1). Local features are extracted after dividing each input image into four blocks. Then, local features/descriptors namely the GLCM, Uniform Local Binary Pattern (ULBP) and Speeded-Up Robust Features (SURF) are extracted from every block. All the extracted global and local features are combined in a high dimensional feature vector, whose dimensionality is later reduced using Principal Components Analysis (PCA). The final classification is accomplished using an SVM. Both frameworks are evaluated using two different datasets of steel surface images. The first framework uses Engineering Machined Textures (EMT) workpiece surface images produced using several machining processes. The second framework uses the Northeastern University (NEU) standard database that comprises surface images of hot-rolled steel strips with different defect types. The results in this research show improvement when compared with previous related studies. The maximum accuracy achieved in surface classification of EMT dataset was up to 100%, with a maximum error in surface roughness estimation of 0.004 micrometer. In addition, the maximum accuracy achieved in defect detection of NEU dataset was up to 99.34%.
format	Thesis
qualification_level	Doctorate
author	Ashour, Mohammed W. M.
author_facet	Ashour, Mohammed W. M.
author_sort	Ashour, Mohammed W. M.
title	Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
title_short	Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
title_full	Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
title_fullStr	Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
title_full_unstemmed	Steel strips surface classification and defect detection based on multiple integrated features and classification schemes
title_sort	steel strips surface classification and defect detection based on multiple integrated features and classification schemes
granting_institution	Universiti Putra Malaysia
publishDate	2018
url	http://psasir.upm.edu.my/id/eprint/83754/1/FSKTM%202018%2080%20-%20ir.pdf
_version_	1747813417367896064

Steel strips surface classification and defect detection based on multiple integrated features and classification schemes

Similar Items