PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah

System Identification, a discipline for constructing models from dynamic systems, consist of three major steps: structure selection, parameter estimation and model validation. The parameter estimation step is concerned with the estimation of model parameters once the structure is known. Typically, p...

Full description

Saved in:

Bibliographic Details
Main Author:	Abdullah, Siti Muniroh
Format:	Thesis
Language:	English
Published:	2017
Subjects:	Electric apparatus and materials Electric circuits Electric networks Microelectronics
Online Access:	https://ir.uitm.edu.my/id/eprint/21667/1/TM_SITI%20MUNIROH%20ABDULLAH%20EE%2017_5.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-uitm-ir.21667
record_format	uketd_dc
spelling	my-uitm-ir.216672022-04-18T09:09:46Z PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah 2017-05 Abdullah, Siti Muniroh Electric apparatus and materials. Electric circuits. Electric networks Microelectronics System Identification, a discipline for constructing models from dynamic systems, consist of three major steps: structure selection, parameter estimation and model validation. The parameter estimation step is concerned with the estimation of model parameters once the structure is known. Typically, parameter estimation is performed using various types of Least Squares (LS) algorithms due to its stable and efficient numerical computation. However, LS methods suffers from oversmoothing properties (such as in curve fitting) and high sensitivity to outliers as error squaring significantly increases in magnitude. Additionally, when the range of data increases, it makes the nonlinear processes become more difficult. In this thesis, the Particle Swarm Optimization (PSO) is proposed for parameter estimation of a Nonlinear Autoregressive Moving Average with Exogeneous Inputs (NARMAX) and its derivatives ((NARX) and (NARMA)) of three datasets, which are Direct Current Motor (DCM), Flexible Robot Arm (FRA) and Mackey Glass (MG) system. PSO is a swarm-based search algorithm perform a stochastic search to explore the search space. Due to its stochastic nature, the algorithm does not inherit the numerical problems posed by the LLS algorithms. The proposed method is compared with three established conventional Linear Least Squares (LLS) solution methods : Normal Equation (NE), QR factorization (QR) and Singular Value Decomposition (SVD). Results suggest that the PSO algorithm is viable alternative to other established algorithms for LLS parameter estimation. In DCM NARX experiment, LLS is outperform in term of criterion fitness while PSO outperform in correlation violation values. For model fit test (MSE and R-squared) both methods perform similar. For FRA NARMAX, PSO outperform than LLS in term of criterion fitness, MSE and correlation violation while in R-squared analysis both methods perform similar. In the last experiment MG NARMA, LLS outperform than PSO in MSE value, criterion fitness and R -squared analysis while in term of correlation violation, PSO outperform than LLS. Additionally, the PSO algorithm was found to improve the correlation tests (reduction in correlation violation 22.22% in DCM NARX, 1.89% in FRA NARMAX and 10.46% in MG NARMA experiment) relative to the LLS algorithms. 2017-05 Thesis https://ir.uitm.edu.my/id/eprint/21667/ https://ir.uitm.edu.my/id/eprint/21667/1/TM_SITI%20MUNIROH%20ABDULLAH%20EE%2017_5.pdf text en public masters Universiti Teknologi MARA Faculty of Electrical Engineering
institution	Universiti Teknologi MARA
collection	UiTM Institutional Repository
language	English
topic	Electric apparatus and materials Electric circuits Electric networks Microelectronics
spellingShingle	Electric apparatus and materials Electric circuits Electric networks Microelectronics Abdullah, Siti Muniroh PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
description	System Identification, a discipline for constructing models from dynamic systems, consist of three major steps: structure selection, parameter estimation and model validation. The parameter estimation step is concerned with the estimation of model parameters once the structure is known. Typically, parameter estimation is performed using various types of Least Squares (LS) algorithms due to its stable and efficient numerical computation. However, LS methods suffers from oversmoothing properties (such as in curve fitting) and high sensitivity to outliers as error squaring significantly increases in magnitude. Additionally, when the range of data increases, it makes the nonlinear processes become more difficult. In this thesis, the Particle Swarm Optimization (PSO) is proposed for parameter estimation of a Nonlinear Autoregressive Moving Average with Exogeneous Inputs (NARMAX) and its derivatives ((NARX) and (NARMA)) of three datasets, which are Direct Current Motor (DCM), Flexible Robot Arm (FRA) and Mackey Glass (MG) system. PSO is a swarm-based search algorithm perform a stochastic search to explore the search space. Due to its stochastic nature, the algorithm does not inherit the numerical problems posed by the LLS algorithms. The proposed method is compared with three established conventional Linear Least Squares (LLS) solution methods : Normal Equation (NE), QR factorization (QR) and Singular Value Decomposition (SVD). Results suggest that the PSO algorithm is viable alternative to other established algorithms for LLS parameter estimation. In DCM NARX experiment, LLS is outperform in term of criterion fitness while PSO outperform in correlation violation values. For model fit test (MSE and R-squared) both methods perform similar. For FRA NARMAX, PSO outperform than LLS in term of criterion fitness, MSE and correlation violation while in R-squared analysis both methods perform similar. In the last experiment MG NARMA, LLS outperform than PSO in MSE value, criterion fitness and R -squared analysis while in term of correlation violation, PSO outperform than LLS. Additionally, the PSO algorithm was found to improve the correlation tests (reduction in correlation violation 22.22% in DCM NARX, 1.89% in FRA NARMAX and 10.46% in MG NARMA experiment) relative to the LLS algorithms.
format	Thesis
qualification_level	Master's degree
author	Abdullah, Siti Muniroh
author_facet	Abdullah, Siti Muniroh
author_sort	Abdullah, Siti Muniroh
title	PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
title_short	PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
title_full	PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
title_fullStr	PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
title_full_unstemmed	PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah
title_sort	pso and linear ls for parameter estimation of narmax/narma/narx models for non-linear data / siti muniroh abdullah
granting_institution	Universiti Teknologi MARA
granting_department	Faculty of Electrical Engineering
publishDate	2017
url	https://ir.uitm.edu.my/id/eprint/21667/1/TM_SITI%20MUNIROH%20ABDULLAH%20EE%2017_5.pdf
_version_	1783733767650672640

PSO and Linear LS for parameter estimation of NARMAX/NARMA/NARX models for non-linear data / Siti Muniroh Abdullah

Similar Items