A modified weighted support vector machine (WSVM) to reduce noise data in classification problem
Classification refers to a predictive modeling problem where a class label is predicted for a given example of input data. Data is everywhere and the amount of digital data that exists is growing exponentially. However, data is rarely perfect and there are many inconsistencies that affect data quali...
Saved in:
Main Author: | |
---|---|
Format: | Thesis |
Language: | English English English |
Published: |
2021
|
Subjects: | |
Online Access: | http://eprints.uthm.edu.my/10805/1/24p%20SYARIZUL%20AMRI%20MOHD%20DZULKIFLI.pdf http://eprints.uthm.edu.my/10805/2/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/10805/3/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20WATERMARK.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-uthm-ep.10805 |
---|---|
record_format |
uketd_dc |
spelling |
my-uthm-ep.108052024-05-13T06:56:15Z A modified weighted support vector machine (WSVM) to reduce noise data in classification problem 2021-12 Mohd Dzulkifli, Syarizul Amri T Technology (General) Classification refers to a predictive modeling problem where a class label is predicted for a given example of input data. Data is everywhere and the amount of digital data that exists is growing exponentially. However, data is rarely perfect and there are many inconsistencies that affect data quality such as noise data. Nowadays, the use of SVM is very perspective for the big data classification. SVM provides a global solution for data classification but SVM is highly sensitive to noise data and may not be effective when the level of noise data is high. When noise exists in training data, the decision boundary of SVM would deviate from the optimal hyperplane severely. To overcome SVM drawback for noise data problem, WSVM using KPCM algorithm was used but WSVM using kernel-based learning algorithm such as KPCM algorithm suffer from training complexity, expensive computation time and storage memory when noise data contaminate training data. Thus, through a simple pruning and speed-up method such as clustering method, WKM-SVM has been proposed. However, WKM-SVM has several limitations that are related to k-Means Clustering. One of the limitations of WKM-SVM is the clustering centers may not suitably represent original data structures which can potentially cause poor prediction results. Therefore, this research work proposes a modified WSVM utilized with instance selection method and weighted learning to improve WSVM training and classification accuracy. The modification of WSVM will reduce noise data by producing multiple hyperplanes and selecting the optimal hyperplane based on the lowest noise data. The overall result shows that the proposed method outperforms WSVM, OWSVM and WKM-SVM in all datasets in terms of classification accuracy. Specifically, the proposed method produces classification accuracy equal to or higher than 85% for three datasets and lower than 85% for six datasets. However, the performance of the proposed method for test data may not be as good as anticipated since most of the datasets produced classification accuracy lower than 85%. 2021-12 Thesis http://eprints.uthm.edu.my/10805/ http://eprints.uthm.edu.my/10805/1/24p%20SYARIZUL%20AMRI%20MOHD%20DZULKIFLI.pdf text en public http://eprints.uthm.edu.my/10805/2/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20COPYRIGHT%20DECLARATION.pdf text en public http://eprints.uthm.edu.my/10805/3/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20WATERMARK.pdf text en validuser phd doctoral Universiti Tun Hussein Onn Malaysia Fakulti Sains Komputer dan Teknologi Maklumat |
institution |
Universiti Tun Hussein Onn Malaysia |
collection |
UTHM Institutional Repository |
language |
English English English |
topic |
T Technology (General) |
spellingShingle |
T Technology (General) Mohd Dzulkifli, Syarizul Amri A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
description |
Classification refers to a predictive modeling problem where a class label is predicted for a given example of input data. Data is everywhere and the amount of digital data that exists is growing exponentially. However, data is rarely perfect and there are many inconsistencies that affect data quality such as noise data. Nowadays, the use of SVM is very perspective for the big data classification. SVM provides a global solution for data classification but SVM is highly sensitive to noise data and may not be effective when the level of noise data is high. When noise exists in training data, the decision boundary of SVM would deviate from the optimal hyperplane severely. To overcome SVM drawback for noise data problem, WSVM using KPCM algorithm was used but WSVM using kernel-based learning algorithm such as KPCM algorithm suffer from training complexity, expensive computation time and storage memory when noise data contaminate training data. Thus, through a simple pruning and speed-up method such as clustering method, WKM-SVM has been proposed. However, WKM-SVM has several limitations that are related to k-Means Clustering. One of the limitations of WKM-SVM is the clustering centers may not suitably represent original data structures which can potentially cause poor prediction results. Therefore, this research work proposes a modified WSVM utilized with instance selection method and weighted learning to improve WSVM training and classification accuracy. The modification of WSVM will reduce noise data by producing multiple hyperplanes and selecting the optimal hyperplane based on the lowest noise data. The overall result shows that the proposed method outperforms WSVM, OWSVM and WKM-SVM in all datasets in terms of classification accuracy. Specifically, the proposed method produces classification accuracy equal to or higher than 85% for three datasets and lower than 85% for six datasets. However, the performance of the proposed method for test data may not be as good as anticipated since most of the datasets produced classification accuracy lower than 85%. |
format |
Thesis |
qualification_name |
Doctor of Philosophy (PhD.) |
qualification_level |
Doctorate |
author |
Mohd Dzulkifli, Syarizul Amri |
author_facet |
Mohd Dzulkifli, Syarizul Amri |
author_sort |
Mohd Dzulkifli, Syarizul Amri |
title |
A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
title_short |
A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
title_full |
A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
title_fullStr |
A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
title_full_unstemmed |
A modified weighted support vector machine (WSVM) to reduce noise data in classification problem |
title_sort |
modified weighted support vector machine (wsvm) to reduce noise data in classification problem |
granting_institution |
Universiti Tun Hussein Onn Malaysia |
granting_department |
Fakulti Sains Komputer dan Teknologi Maklumat |
publishDate |
2021 |
url |
http://eprints.uthm.edu.my/10805/1/24p%20SYARIZUL%20AMRI%20MOHD%20DZULKIFLI.pdf http://eprints.uthm.edu.my/10805/2/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/10805/3/SYARIZUL%20AMRI%20MOHD%20DZULKIFLI%20WATERMARK.pdf |
_version_ |
1804890118561988608 |