Anomaly detection for controlling data accruracy in service industry
The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR)...
Saved in:
Main Author: | |
---|---|
Format: | Thesis |
Published: |
2013
|
Subjects: | |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-utm-ep.41784 |
---|---|
record_format |
uketd_dc |
spelling |
my-utm-ep.417842020-07-02T06:01:44Z Anomaly detection for controlling data accruracy in service industry 2013 Samsuddin, Nurul Asyikin TK Electrical engineering. Electronics Nuclear engineering The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR) control chart, moving average (MA) control chart and exponentially weighted moving average (EWMA) control chart. The quantitative and qualitative detection performance of these control charts is analyzed on two scenarios: live stream and data profiling. Results are compared with expected anomalies determined by system experts. It is discovered that individual control chart performed best for live stream scenario, while MR control chart performed best for data profiling scenario. Qualitatively control charts are simple, user-friendly and easy to fully automate and implement when compared with other detection methods available in literature. In addition, a suitable data quality assurance and control program using the two control charts is suggested 2013 Thesis http://eprints.utm.my/id/eprint/41784/ http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:78059?queryType=vitalDismax&query=Anomaly+detection+for+controlling+data+accruracy&public=true masters Universiti Teknologi Malaysia, Faculty of Mechanical Engineering Faculty of Mechanical Engineering |
institution |
Universiti Teknologi Malaysia |
collection |
UTM Institutional Repository |
topic |
TK Electrical engineering Electronics Nuclear engineering |
spellingShingle |
TK Electrical engineering Electronics Nuclear engineering Samsuddin, Nurul Asyikin Anomaly detection for controlling data accruracy in service industry |
description |
The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR) control chart, moving average (MA) control chart and exponentially weighted moving average (EWMA) control chart. The quantitative and qualitative detection performance of these control charts is analyzed on two scenarios: live stream and data profiling. Results are compared with expected anomalies determined by system experts. It is discovered that individual control chart performed best for live stream scenario, while MR control chart performed best for data profiling scenario. Qualitatively control charts are simple, user-friendly and easy to fully automate and implement when compared with other detection methods available in literature. In addition, a suitable data quality assurance and control program using the two control charts is suggested |
format |
Thesis |
qualification_level |
Master's degree |
author |
Samsuddin, Nurul Asyikin |
author_facet |
Samsuddin, Nurul Asyikin |
author_sort |
Samsuddin, Nurul Asyikin |
title |
Anomaly detection for controlling data accruracy in service industry |
title_short |
Anomaly detection for controlling data accruracy in service industry |
title_full |
Anomaly detection for controlling data accruracy in service industry |
title_fullStr |
Anomaly detection for controlling data accruracy in service industry |
title_full_unstemmed |
Anomaly detection for controlling data accruracy in service industry |
title_sort |
anomaly detection for controlling data accruracy in service industry |
granting_institution |
Universiti Teknologi Malaysia, Faculty of Mechanical Engineering |
granting_department |
Faculty of Mechanical Engineering |
publishDate |
2013 |
_version_ |
1747816617315663872 |