Editing Support vector machine (section)

==== Coordinate descent ====
[[Coordinate descent]] algorithms for the SVM work from the dual problem

<math display="block"> \begin{align}
&\text{maximize}\,\, f(c_1 \ldots c_n) =  \sum_{i=1}^n c_i - \frac 1 2 \sum_{i=1}^n\sum_{j=1}^n y_i c_i(x_i \cdot x_j)y_j c_j,\\
&\text{subject to } \sum_{i=1}^n c_iy_i = 0,\,\text{and } 0 \leq c_i \leq \frac{1}{2n\lambda}\;\text{for all }i.
\end{align}</math>

For each <math> i \in \{1,\, \ldots,\, n\}</math>, iteratively, the coefficient <math> c_i</math> is adjusted in the direction of <math> \partial f/ \partial c_i</math>. Then, the resulting vector of coefficients <math> (c_1',\,\ldots,\,c_n')</math> is projected onto the nearest vector of coefficients that satisfies the given constraints. (Typically Euclidean distances are used.) The process is then repeated until a near-optimal vector of coefficients is obtained. The resulting algorithm is extremely fast in practice, although few performance guarantees have been proven.<ref>{{Cite book |publisher=ACM |date=2008-01-01 |location=New York, NY, USA |isbn=978-1-60558-205-4 |pages=408–415 |doi=10.1145/1390156.1390208 |first1=Cho-Jui |last1=Hsieh |first2=Kai-Wei |last2=Chang |first3=Chih-Jen |last3=Lin |first4=S. Sathiya |last4=Keerthi |first5=S. |last5=Sundararajan |title=Proceedings of the 25th international conference on Machine learning - ICML '08 |chapter=A dual coordinate descent method for large-scale linear SVM |citeseerx=10.1.1.149.5594 |s2cid=7880266 }}</ref>