PARALLEL TANGENTS
Parallel tangents (PARTAN). An algorithm developed from the zigzag phenomenon observed using Cauchy's steepest descent . It takes two gradient steps, then performs a line search on the line through the first and last points (xk+2–xk). (For a quadratic objective, PARTAN is equivalent to the conjugate gradient method .)
