Modeling time series data using Genetic Algorithm based on Backpropagation Neural network

Artificial Neural Networks (ANNs) is an example of nonlinear models that have found applications in various fields such as function approximations, time series predictions, and adaptive controls. One form of ANNs models are widely used for various applications are Feedforward Neural Networks (FFNN)....

Full description

Saved in:

Bibliographic Details
Main Author:	Haviluddin
Format:	Thesis
Language:	English
Published:	2018
Subjects:	TK Electrical engineering Electronics Nuclear engineering
Online Access:	https://eprints.ums.edu.my/id/eprint/26924/1/Modeling%20time%20series%20data%20using%20Genetic%20Algorithm%20based%20on%20Backpropagation%20Neural%20network.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-ums-ep.26924
record_format	uketd_dc
spelling	my-ums-ep.269242021-05-27T03:29:24Z Modeling time series data using Genetic Algorithm based on Backpropagation Neural network 2018 Haviluddin TK Electrical engineering. Electronics Nuclear engineering Artificial Neural Networks (ANNs) is an example of nonlinear models that have found applications in various fields such as function approximations, time series predictions, and adaptive controls. One form of ANNs models are widely used for various applications are Feedforward Neural Networks (FFNN). The performance of ANNs depend on many factors, including the network structure, the selection of activation function, the learning rate of the training algorithm, and initial synaptic weight values, the number of input variables, and the number of units in the hidden layer. These became the central topics of research on ANNs. Not many researchers have investigated the effects of optimizing both the topology structures and the parameters used in ANNs. This research utilizes a genetic algorithm (GA) to optimize the multi-layer FFNN performance and structure in modelling three datasets: network traffic, rainfall, and tourist. There are three objectives in this research. The first objective is to study the effects of varying the architecture designs and parameter values of the backpropagation neural network (BPNN) learning algorithm. The second objective is to compare the performances of machine learning (ML) techniques (e.g., BPNN and GA) with the statistical techniques (e.g., autoregressive integrated moving average (ARIMA)) in learning time series data. This comparison is taken as a performance benchmark for the given problem. Finally, a GA based BPNN called (GA-BPNN) is designed and evaluated. The proposed GA-BPNN is evaluated for the prediction task for the nonlinearity datasets. Several experiments have been conducted to evaluate the performance of the proposed GA-BPNN based on the percentage of mean squared error (MSE) in learning several nonlinearity datasets. The results of the experiments indicated that one should examine the appropriate topology structures, especially the three most important factors (number of input nodes, hidden nodes, learning rate) prior to using ANNs for time series forecasting. In other words, in order to get a good result, the BPNN learning algorithm needs to be executed several times with different topology structures and parameter values in order to determine the best set of parameter values used in the BPNN. However, if there is no prior knowledge of the problem, an optimization method (e.g., GA) can be used to determine the best topology structure coupled with the appropriate parameter values used to perform the proposed GA-BPNN. This study showed the task of optimizing the topology structure and the parameter values (e.g., weights) used in the BPNN learning algorithm by using the GA. Based on the results obtained, a better prediction result can be produced by the proposed GA-BPNN learning algorithm. 2018 Thesis https://eprints.ums.edu.my/id/eprint/26924/ https://eprints.ums.edu.my/id/eprint/26924/1/Modeling%20time%20series%20data%20using%20Genetic%20Algorithm%20based%20on%20Backpropagation%20Neural%20network.pdf text en validuser dphil doctoral Universiti Malaysia Sabah School Of Engineering & Information Technology
institution	Universiti Malaysia Sabah
collection	UMS Institutional Repository
language	English
topic	TK Electrical engineering Electronics Nuclear engineering
spellingShingle	TK Electrical engineering Electronics Nuclear engineering Haviluddin Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
description	Artificial Neural Networks (ANNs) is an example of nonlinear models that have found applications in various fields such as function approximations, time series predictions, and adaptive controls. One form of ANNs models are widely used for various applications are Feedforward Neural Networks (FFNN). The performance of ANNs depend on many factors, including the network structure, the selection of activation function, the learning rate of the training algorithm, and initial synaptic weight values, the number of input variables, and the number of units in the hidden layer. These became the central topics of research on ANNs. Not many researchers have investigated the effects of optimizing both the topology structures and the parameters used in ANNs. This research utilizes a genetic algorithm (GA) to optimize the multi-layer FFNN performance and structure in modelling three datasets: network traffic, rainfall, and tourist. There are three objectives in this research. The first objective is to study the effects of varying the architecture designs and parameter values of the backpropagation neural network (BPNN) learning algorithm. The second objective is to compare the performances of machine learning (ML) techniques (e.g., BPNN and GA) with the statistical techniques (e.g., autoregressive integrated moving average (ARIMA)) in learning time series data. This comparison is taken as a performance benchmark for the given problem. Finally, a GA based BPNN called (GA-BPNN) is designed and evaluated. The proposed GA-BPNN is evaluated for the prediction task for the nonlinearity datasets. Several experiments have been conducted to evaluate the performance of the proposed GA-BPNN based on the percentage of mean squared error (MSE) in learning several nonlinearity datasets. The results of the experiments indicated that one should examine the appropriate topology structures, especially the three most important factors (number of input nodes, hidden nodes, learning rate) prior to using ANNs for time series forecasting. In other words, in order to get a good result, the BPNN learning algorithm needs to be executed several times with different topology structures and parameter values in order to determine the best set of parameter values used in the BPNN. However, if there is no prior knowledge of the problem, an optimization method (e.g., GA) can be used to determine the best topology structure coupled with the appropriate parameter values used to perform the proposed GA-BPNN. This study showed the task of optimizing the topology structure and the parameter values (e.g., weights) used in the BPNN learning algorithm by using the GA. Based on the results obtained, a better prediction result can be produced by the proposed GA-BPNN learning algorithm.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Haviluddin
author_facet	Haviluddin
author_sort	Haviluddin
title	Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
title_short	Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
title_full	Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
title_fullStr	Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
title_full_unstemmed	Modeling time series data using Genetic Algorithm based on Backpropagation Neural network
title_sort	modeling time series data using genetic algorithm based on backpropagation neural network
granting_institution	Universiti Malaysia Sabah
granting_department	School Of Engineering & Information Technology
publishDate	2018
url	https://eprints.ums.edu.my/id/eprint/26924/1/Modeling%20time%20series%20data%20using%20Genetic%20Algorithm%20based%20on%20Backpropagation%20Neural%20network.pdf
_version_	1747836561956798464

Modeling time series data using Genetic Algorithm based on Backpropagation Neural network

Similar Items