Error magnitude and directional accuracy for time series forecasting evaluation
Evaluation of forecast accuracy is very much influenced by the choice of accurate measurement since it can produce different conclusion from the empirical results. Thus, it is important to use appropriate measurement in accordance to the purpose of forecasting. Commonly, accuracy is measured in term...
Saved in:
| 主要作者: | |
|---|---|
| 格式: | Thesis |
| 語言: | English |
| 出版: |
2014
|
| 主題: | |
| 在線閱讀: | http://eprints.utm.my/id/eprint/78185/2/MariaElenaNorPFS2014.pdf |
| 標簽: |
添加標簽
沒有標簽, 成為第一個標記此記錄!
|
| id |
my-utm-ep.78185 |
|---|---|
| record_format |
uketd_dc |
| spelling |
my-utm-ep.781852018-07-25T07:59:44Z Error magnitude and directional accuracy for time series forecasting evaluation 2014-10 Nor, Maria Elena QA Mathematics Evaluation of forecast accuracy is very much influenced by the choice of accurate measurement since it can produce different conclusion from the empirical results. Thus, it is important to use appropriate measurement in accordance to the purpose of forecasting. Commonly, accuracy is measured in terms of error magnitude. However, directional accuracy is as important as error magnitude especially in economics since it considers directional movement of the data. This research attempted to combine the two types of measurements by introducing a new element, the slope value. This proposed measure is known as square error modified of directional accuracy (SE-mDA). Before that, the existing directional change error measurement was modified by comparing the direction of two subsequent forecasts data with two subsequent observed data. Empirical application utilizing the monthly data of Malaysia and Bali tourism demand was used to compare the forecast performance between SARIMA, time series regression, Holt-Winter, intervention neural network and fuzzy time series. The root mean square error, mean absolute percentage error, mean absolute deviation, Fisher’s exact test, Chi-square test, directional accuracy, directional value and the modified of directional change error were used in forecast accuracy evaluation. The best forecast model in terms of SE-mDA for the data of Malaysia and Bali are Holt-Winters and neural network, respectively. The main conclusion from this study is that SE-mDA is able to improve the forecasting performance assessment of error magnitude measurement by considering the directional movements. At the same time it also enhances the available directional accuracy measurement by taking into account the difference between slopes of forecast data and observed data. These improvements will help forecaster to choose the best forecasting method or model so as to produce the most accurate forecast. 2014-10 Thesis http://eprints.utm.my/id/eprint/78185/ http://eprints.utm.my/id/eprint/78185/2/MariaElenaNorPFS2014.pdf application/pdf en public http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:97925 phd doctoral Universiti Teknologi Malaysia, Faculty of Science Faculty of Science |
| institution |
Universiti Teknologi Malaysia |
| collection |
UTM Institutional Repository |
| language |
English |
| topic |
QA Mathematics |
| spellingShingle |
QA Mathematics Nor, Maria Elena Error magnitude and directional accuracy for time series forecasting evaluation |
| description |
Evaluation of forecast accuracy is very much influenced by the choice of accurate measurement since it can produce different conclusion from the empirical results. Thus, it is important to use appropriate measurement in accordance to the purpose of forecasting. Commonly, accuracy is measured in terms of error magnitude. However, directional accuracy is as important as error magnitude especially in economics since it considers directional movement of the data. This research attempted to combine the two types of measurements by introducing a new element, the slope value. This proposed measure is known as square error modified of directional accuracy (SE-mDA). Before that, the existing directional change error measurement was modified by comparing the direction of two subsequent forecasts data with two subsequent observed data. Empirical application utilizing the monthly data of Malaysia and Bali tourism demand was used to compare the forecast performance between SARIMA, time series regression, Holt-Winter, intervention neural network and fuzzy time series. The root mean square error, mean absolute percentage error, mean absolute deviation, Fisher’s exact test, Chi-square test, directional accuracy, directional value and the modified of directional change error were used in forecast accuracy evaluation. The best forecast model in terms of SE-mDA for the data of Malaysia and Bali are Holt-Winters and neural network, respectively. The main conclusion from this study is that SE-mDA is able to improve the forecasting performance assessment of error magnitude measurement by considering the directional movements. At the same time it also enhances the available directional accuracy measurement by taking into account the difference between slopes of forecast data and observed data. These improvements will help forecaster to choose the best forecasting method or model so as to produce the most accurate forecast. |
| format |
Thesis |
| qualification_name |
Doctor of Philosophy (PhD.) |
| qualification_level |
Doctorate |
| author |
Nor, Maria Elena |
| author_facet |
Nor, Maria Elena |
| author_sort |
Nor, Maria Elena |
| title |
Error magnitude and directional accuracy for time series forecasting evaluation |
| title_short |
Error magnitude and directional accuracy for time series forecasting evaluation |
| title_full |
Error magnitude and directional accuracy for time series forecasting evaluation |
| title_fullStr |
Error magnitude and directional accuracy for time series forecasting evaluation |
| title_full_unstemmed |
Error magnitude and directional accuracy for time series forecasting evaluation |
| title_sort |
error magnitude and directional accuracy for time series forecasting evaluation |
| granting_institution |
Universiti Teknologi Malaysia, Faculty of Science |
| granting_department |
Faculty of Science |
| publishDate |
2014 |
| url |
http://eprints.utm.my/id/eprint/78185/2/MariaElenaNorPFS2014.pdf |
| _version_ |
1747817927829094400 |