Abstract
In this paper, based on a nonmonotone derivative-free line search, we propose a two-step Broyden-like method (denoted by TS-BLM) for solving the nonlinear equations. TS-BLM computes one quasi-Newton step at the beginning iterations. When the iterations are close to the solution set of the nonlinear equations, an additional approximate quasi-Newton step is calculated by solving a linear system formed by using the previous Broyden-like matrix. We prove that TS-BLM converges globally under appropriate conditions. Moreover, we analyze the convergence rate of TS-BLM depending on the approximation of the Broyden-like matrix to the Jacobian. Some numerical results are reported to show the superior numerical performances of TS-BLM compared with the traditional BLM.
Similar content being viewed by others
Availability of supporting data
The data sets generated during the current study are available from the authors on reasonable request.
References
Amini, K., Rostami, F.: A new modified two steps Levenberg-Marquardt method for nonlinear equations. J. Comput. Appl. Math. 288, 341–350 (2015)
Broyden, C.G.: A class of methods for solving nonlinear simultaneous equations. Math. Comput. 19, 577–593 (1965)
Chen, B., Ma, C.: A new smoothing Broyden-like method for solving nonlinear complementarity problem with a \(P_0\)-function. J. Global Optim. 51, 473–495 (2011)
Chen, B., Ma, C.: Superlinear/quadratic smoothing Broyden-like method for the generalized nonlinear complementarity problem. Nonlinear Anal. Real World Appl. 12, 1250–1263 (2011)
Dennis, J.E., Jr., Moré, J.J.: Quasi-Newton methods, motivation and theory. SIAM Rev. 19, 46–89 (1977)
Facchinei, F., Pang, J.S.: Finite-dimensional variational inequalities and complementarity problems, Vol. I and II. Springer, New York (2003)
Fan, B.: A smoothing Broyden-like method with a nonmonotone derivative-free line search for nonlinear complementarity problems. J. Comput. Appl. Math. 290, 641–655 (2015)
Fan, J.Y.: The modified Levenberg-Marquardt method for nonlinear equations with cubic convergence. Math. Comput. 81, 447–466 (2012)
Fan, J.Y.: Accelerating the modified Levenberg-Marquardt method for nonlinear equations. Math. Comput. 83, 1173–1187 (2014)
Kelley, C.T.: Iterative methods for optimization, Frontiers in Applied Mathematics, 18. SIAM, Philadelphia (1999)
Li, D.H., Fukushima, M.: A derivative-free line search and global convergence of Broyden-like method for nonlinear equations. Optim. Methods Softw. 13(3), 181–201 (2000)
Li, D.H., Fukushima, M.: Globally convergent Broyden-Like methods for semismooth equations and applications to VIP. NCP and MCP. Ann. Oper. Res. 103, 71–97 (2001)
Li, D.H., Zeng, J.P., Zhou, S.Z.: Convergence of Broyden-like matrix. Appl. Math. Lett. 11, 35–37 (1998)
Li, Y.F., Sun, G., Wang, Y.J.: A smoothing Broyden-like method for polyhedral cone constrained eigenvalue problem. Numer. Algebra. Control. Optim. 1(3), 529–537 (2011)
La Cruz, W., Martinez, J.M., Raydan, M.: Spectral residual method without gradient information for solving large-scale nonlinear systems of equations. Math. Comput. 75(255), 1429–1448 (2006)
La Cruz, W., Martinez, J.M., Raydan, M.: Spectral residual method without gradient information for solving large-scale nonlinear systems: theory and experiments, Technical Report RT-04-08, Dpto. de Computacion, UCV, (2004). Available at www.kuainasi.ciens.ucv.ve/ccct/mraydan_pub.html
Mannel, F.: Convergence properties of the Broyden-like method for mixed linear-nonlinear systems of equations. Numer. Algor. 88, 853–881 (2021)
Mannel, F.: On the convergence of Broyden’s method and some accelerated schemes for singular problems. IMA J. Numer. Anal. 43, 414–442 (2023)
Ortega, J.M., Rheinboldt, W.C.: Iterative solution of nonlinear equations in several variables. Academic Press, New York (1970)
Powell, M.J.D.: A Fortran subroutine for solving systems of nonlinear algebraic equations. In: Rabinowitz, P. (Ed.), Numerical Methods for Nonlinear Algebraic Equations. Gordon and Breach, London (Chapter 7) (1970)
Tang, J.Y., Zhou, J.C.: A smoothing quasi-Newton method for solving general second-order cone complementarity problems. J. Global Optim. 80, 415–438 (2021)
Tang, J.Y., Zhou, J.C.: Smoothing inexact Newton method based on a new derivative-free nonmonotone line search for the NCP over circular cones. Ann. Oper. Res. 295, 787–808 (2020)
Tang, J.Y., Zhou, J.C., Sun, Z.F.: A derivative-free line search technique for Broyden-like method with applications to NCP, wLCP and SI. Ann. Oper. Res. 321, 541–564 (2023)
Tang, J.Y., Zhou, J.C., Zhang, H.C.: An accelerated smoothing Newton method with cubic convergence for weighted complementarity problems. J. Optim. Theory Appl. 196, 641–665 (2023)
Wang, H.Y.: Convergence rate of the accelerated modified Levenberg-Marquardt method under Hölderian local error bound. Pac. J. Optim. 8(3), 661–677 (2022)
Zheng, L., Chen, L., Ma, Y.F.: Convergence rate of the modified Levenberg-Marquardt method under Hölderian local error bound. Open Math. 20, 998–1012 (2022)
Zhou, W.J.: On the convergence of the modified Levenberg-Marquardt method with a nonmonotone second order Armijo type line search. J. Comput. Appl. Math. 239, 152–161 (2013)
Acknowledgements
The authors would like to thank two referees for their valuable suggestions that greatly improved the paper.
Funding
This work was partially supported by the National Natural Science Foundation of China (Grant No. 12371305), the Natural Science Foundation of Shandong Province (Grant No. ZR2023MA020), the Natural Science Foundation of Henan Province (Grant No. 222300420520) and the Key Scientific Research Projects of Higher Education of Henan Province (Grant No. 22A110020).
Author information
Authors and Affiliations
Contributions
Jingyong Tang contributed to the analysis of the algorithm and manuscript preparation; Jinchuan Zhou helped perform the analysis with constructive discussions.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no conflicts of interest.
Ethical Approval
Not Applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Tang, J., Zhou, J. A two-step Broyden-like method for nonlinear equations. Numer Algor (2024). https://doi.org/10.1007/s11075-024-01827-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11075-024-01827-7