Diagonal quasi-newton's method for large-scale systems of nonlinear equations

The famous and well known method for solving systems of nonlinear equations is the Newton’s method. This method is simple to implement and converges rapidly. Nevertheless, an iteration of this method turns out to be computational expensive,this is due to the fact that the method requires the computa...

Full description

Saved in:

Bibliographic Details
Main Author:	Yusuf, Mohammed Waziri
Format:	Thesis
Language:	English English
Published:	2011
Subjects:	Newton-Raphson method Newton diagrams Nonlinear theories
Online Access:	http://psasir.upm.edu.my/id/eprint/26476/1/FS%202011%2065R.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-upm-ir.26476
record_format	uketd_dc
spelling	my-upm-ir.264762022-01-26T05:29:53Z Diagonal quasi-newton's method for large-scale systems of nonlinear equations 2011-12 Yusuf, Mohammed Waziri The famous and well known method for solving systems of nonlinear equations is the Newton’s method. This method is simple to implement and converges rapidly. Nevertheless, an iteration of this method turns out to be computational expensive,this is due to the fact that the method requires the computation and storage of the Jacobian matrix, the floating point operations is O(n)3 and as well as the solution of an n linear systems in each iteration. In addition the convergence may even be lost when the Jacobian is singular at a solution. These drawbacks/disadvantages is more noticeable when handling large-scale systems of nonlinear equations. This leads to the idea of this thesis. This thesis focuses on some variants of Newton’s method for solving systems of nonlinear equation, especially large-scale systems. Several diagonal Newton’s methods for solving systems of nonlinear equations have been derived. Unlike the classi cal Newton’s method, the proposed schemes require neither the computation and storage of the Jacobian matrix, nor the solution of a system of linear equations in each iteration. Thus, the floating point operations have been reduced to O(n). This is made possible by approximating the Newton step via diagonal updating. The basic idea behind this novel approach is to approximate the Jacobian or its inverse to a nonsingular diagonal matrix which can be updated in each iteration. The anticipation of the methods proposed in this thesis when applied to large-scale systems of nonlinear equation has been in the reduction of computational costs, storage requirements, floating points operations and processing time. Extensive computational experiments are performed on standard problems to examine the impact of the proposed methods compared to other variants of Newton’s method for solving systems of nonlinear equations. The results suggest that the proposed methods outperform the classical Newton’s method and some of its variants in terms of matrix storage requirements, computational cost and processing time in seconds. In addition, the local convergence of the proposed methods have been proven. We further apply the diagonal updating schemes proposed in this thesis to handle some well known real-life problems and compare their numerical performance with some Newton-like methods. Finally, we discuss some possible extension of our work. Newton-Raphson method Newton diagrams Nonlinear theories 2011-12 Thesis http://psasir.upm.edu.my/id/eprint/26476/ http://psasir.upm.edu.my/id/eprint/26476/1/FS%202011%2065R.pdf application/pdf en public doctoral Universiti Putra Malaysia Newton-Raphson method Newton diagrams Nonlinear theories Faculty of Science English
institution	Universiti Putra Malaysia
collection	PSAS Institutional Repository
language	English English
topic	Newton-Raphson method Newton diagrams Nonlinear theories
spellingShingle	Newton-Raphson method Newton diagrams Nonlinear theories Yusuf, Mohammed Waziri Diagonal quasi-newton's method for large-scale systems of nonlinear equations
description	The famous and well known method for solving systems of nonlinear equations is the Newton’s method. This method is simple to implement and converges rapidly. Nevertheless, an iteration of this method turns out to be computational expensive,this is due to the fact that the method requires the computation and storage of the Jacobian matrix, the floating point operations is O(n)3 and as well as the solution of an n linear systems in each iteration. In addition the convergence may even be lost when the Jacobian is singular at a solution. These drawbacks/disadvantages is more noticeable when handling large-scale systems of nonlinear equations. This leads to the idea of this thesis. This thesis focuses on some variants of Newton’s method for solving systems of nonlinear equation, especially large-scale systems. Several diagonal Newton’s methods for solving systems of nonlinear equations have been derived. Unlike the classi cal Newton’s method, the proposed schemes require neither the computation and storage of the Jacobian matrix, nor the solution of a system of linear equations in each iteration. Thus, the floating point operations have been reduced to O(n). This is made possible by approximating the Newton step via diagonal updating. The basic idea behind this novel approach is to approximate the Jacobian or its inverse to a nonsingular diagonal matrix which can be updated in each iteration. The anticipation of the methods proposed in this thesis when applied to large-scale systems of nonlinear equation has been in the reduction of computational costs, storage requirements, floating points operations and processing time. Extensive computational experiments are performed on standard problems to examine the impact of the proposed methods compared to other variants of Newton’s method for solving systems of nonlinear equations. The results suggest that the proposed methods outperform the classical Newton’s method and some of its variants in terms of matrix storage requirements, computational cost and processing time in seconds. In addition, the local convergence of the proposed methods have been proven. We further apply the diagonal updating schemes proposed in this thesis to handle some well known real-life problems and compare their numerical performance with some Newton-like methods. Finally, we discuss some possible extension of our work.
format	Thesis
qualification_level	Doctorate
author	Yusuf, Mohammed Waziri
author_facet	Yusuf, Mohammed Waziri
author_sort	Yusuf, Mohammed Waziri
title	Diagonal quasi-newton's method for large-scale systems of nonlinear equations
title_short	Diagonal quasi-newton's method for large-scale systems of nonlinear equations
title_full	Diagonal quasi-newton's method for large-scale systems of nonlinear equations
title_fullStr	Diagonal quasi-newton's method for large-scale systems of nonlinear equations
title_full_unstemmed	Diagonal quasi-newton's method for large-scale systems of nonlinear equations
title_sort	diagonal quasi-newton's method for large-scale systems of nonlinear equations
granting_institution	Universiti Putra Malaysia
granting_department	Faculty of Science
publishDate	2011
url	http://psasir.upm.edu.my/id/eprint/26476/1/FS%202011%2065R.pdf
_version_	1747811543246962688

Diagonal quasi-newton's method for large-scale systems of nonlinear equations

Similar Items