Quasi-Newton Methods

The problem to be solved is formulated precisely and the introduction of quasi-Newton methods is motivated by considering the classical Newton and secant methods and their properties. Three highly successful quasi-Newton methods are surveyed: Broyden's method for the solution of general nonlinear equations, and the Davidon-Fletcher-Powell and Broyden-Fletcher-Goldfarb-Shanno procedures for unconstrained minimization. Finally, the properties of these methods are compared to those of Newton's method and UHMLE in potential applications to maximum-likelihood estimation of parameters in mixture distributions.