ISSN E 2409-2770
ISSN P 2521-2419

Two-Step Skipping Techniques For Solution of Nonlinear Unconstrained Optimization Problems


Nudrat Aamir, John Ford


Vol. 8, Issue 06, PP. 170-174, June 2021

DOI

Keywords: unconstrained non-linear optimization, quasi-Newton methods, approximation to the inverse Hessian, skipping updates, two-step methods

Download PDF


The development of recent engineering systems has introduced increasing levels of complexity and uncertainty over time. Combined with the planning philosophy of engineering itself, this has given rise to several studies addressing the straightforward or multi-objective optimization problems present in these complex systems. Although conventional approaches are often applied to engineering optimization depends largely on the character of problem, but they suffered to supply some quick and reasonable feedback to designers and cannot be challenging to further possible problems. However, researchers prefer quasi-Newton methodsto solve the unconstrained non-linear optimization problems, using updating the approximation to the inverse Hessian. This technique is a computationally expensive operation and, therefore, in this paper we investigate the possibility of skipping update of Hessian approximation on every second step. The experimental results show that the new methods (i.e. with skipping) give better performance in general than existing two-step methods, particularly as the dimension of the test problem increases.


  1. Nudrat Aamir, nudrat@cecos.edu.pk, CECOS University of IT & Emerging Sciences, Peshawar, Pakistan.
  2. John Ford, fordj@essex.ac.uk, Department of Mathematical Sciences, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, United Kingdom.

Nudrat Aamir John Ford “Two-Step Skipping Techniques For Solution of Nonlinear UnconstrainedOptimization International Journal of Engineering Works Vol. 8 Issue 06 PP. 170-174 June 2021 https://doi.org/10.34259/ijew.21.806170174.


[1]   Nudrat Aamir, Multi-Step Skipping Methods for Unconstrained Non-Linear Optimization, Ph. D Thesis, University of Essex, United Kingdom, 2014.

[2]   J.A. Ford and I.A. Moghrabi, Alternative parametric choices for Multi-Step Quasi-Newton Methods, Optimization Methods and Software 50,305-323, 1993.

[3]   J.A. Ford and Nudrat Aamir, Multi-Step Skipping Methods for UnconstrainedOptimization, AIP conf Proc 1389, 1806, 2011.

[4]   Tamara G. Kolda, Dianne P. O Leary and Larry Nazareth, BFGS

with Update Skipping and Varying Memory, J. Optim. 8, 1060-1083,1998.

[5]   D. Li, M. Fukushima, On the Global Convergence of BFGS Method for Nonconvex Unconstrained Optimization, SIAM J. Optim. 11(4), 1054-1064, 2001.

[6]   J.-L. Hu and Z. Wu and H. McCann and L.E. Devis and C.-G. Xie, BFGS Quasi-Newton Method for Solving Electromagnetic Inverse Problems, IEEE Proc-Micro: Antennas Propag. 153(2), 199-204, 2006.

[7]   C.T. Kelley and E.W. Sachs, Quasi-Newton Methods and Unconstrained Optimal Control Problems, IEEE Conference on decision and Control. 25, 1829-1831, 1986.

[8]   M.H. Loke and T. Dahlin, A Comparison of the Gauss-newton and Quasi-Newton Methods in Resistivity Imaging Inversion, Journal of Applied Geophysics. 49, 149-162, 2002.

[9]   J.A.Ford and I.A. Moghrabi, Multi-step Quasi-Newton Methods for Optimization, Journal Of Computational And Applied Mathematics. 50,305-323, 1994.

[10] J.J. Mor_e, B.S. Garbow, K.E. Hillstrom,Testing Unconstrained Optimization Software, ACM Trans. Math. Software. 7, 17-41,.1981

[11] Ph.L. Toint, On Large Scale Nonlinear Least Squares Calculations, SIAM J. Sci. Statist. Comput. 8, 416-435, 1987.

[12] G. Alefeld and L. Platzoder, A Quadratically Convergent Krawczyklike Algorithm, SIAM J. Numer. Anal. 20, 210-219, 1983.

[13] W. Burmeister (1972), Inversionfreie Verfahren zur Lo Sung Nichtlinearen Operatorgleichungen, Z. Angew. Math. Mech. 52, 101-110, 1972.