Loading...
Gradient-descent iterative algorithm for solving exact and weighted least-squares solutions of rectangular linear systems
Author(s)
Tansri, Kanjanaporn
Date Issued
January 1, 2023
Type
Article
Abstract
Consider a linear system Ax = b where the coefficient matrix A is rectangular and of full-column rank. We propose an iterative algorithm for solving this linear system, based on gradient-descent optimization technique, aiming to produce a sequence of well-approximate least-squares solutions. Here, we consider least-squares solutions in a full generality, that is, we measure any related error through an arbitrary vector norm induced from weighted positive definite matrices W. It turns out that when the system has a unique solution, the proposed algorithm produces approximated solutions converging to the unique solution. When the system is inconsistent, the sequence of residual norms converges to the weighted least-squares error. Our work includes the usual least-squares solution when W = I. Numerical experiments are performed to validate the capability of the algorithm. Moreover, the performance of this algorithm is better than that of recent gradient-based iterative algorithms in both iteration numbers and computational time.
Citation
Aims Mathematics, 8(5), 11781-11798, 2023