Introduction to Convex Optimization for Machine Learning

← Back to document page

Optimization is at the heart of many (most practical?) machine learning algorithms. Linear regression: minimize w kXw −yk2 Classification (logistic regresion or SVM): minimize w Xn i=1 log 1+exp(−yixT i w) or kwk2 +C Xn i=1 ξi s.t. ξi ≥ 1−yixTiw,ξi ≥ 0. Duchi (UC Berkeley) Convex Optimization for Machine Learning Fall 2009 5 / 53

  Machine, Optimization, Convex, Convex optimization