Optimization Algorithms

1. One-Dimensional Optimization

1.1 Dichotomous Search

1.2 Fibonacci search

1.3 Golden-section search

1.4 Quadratic interpolation method

1.5 Cubic interpolation method

1.6 The Davies, Swann, and Campey method

2. One-Dimensional Gradient Methods

3. Multi-Dimensional Gradient Methods

4. Conjugate-Direction Gradient Methods

5. Quasi-Newton Methods