Editing Evolution strategy (section)

==History==
The 'evolution strategy' optimization technique was created in the early 1960s and developed further in the 1970s and later by [[Ingo Rechenberg]], [[Hans-Paul Schwefel]] and their co-workers.<ref name=overview/>
{| class="wikitable sortable"
|+ Timeline of ES - selected algorithms<ref name=overview/>
|-
! Year !! Description !! Reference
|-
| 1973 || ES introduced with mutation and selection || <ref>{{cite journal |last1=Vent |first1=W. |title=Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann-Holzboog-Verlag. Stuttgart 1973. Broschiert |journal=Feddes Repertorium |date=January 1975 |volume=86 |issue=5 |pages=337 |doi=10.1002/fedr.19750860506}}</ref>
|-
| 1994 || Derandomized self-adaptation ES - Derandomized scheme of mutative step size control is used || <ref>{{cite journal |last1=Ostermeier |first1=Andreas |last2=Gawelczyk |first2=Andreas |last3=Hansen |first3=Nikolaus |title=A Derandomized Approach to Self-Adaptation of Evolution Strategies |journal=Evolutionary Computation |date=December 1994 |volume=2 |issue=4 |pages=369–380 |doi=10.1162/evco.1994.2.4.369}}</ref>
|-
| 1994 || CSA-ES - usage information from the old generations || <ref>{{cite book |last1=Ostermeier |first1=Andreas |last2=Gawelczyk |first2=Andreas |last3=Hansen |first3=Nikolaus |chapter=Step-size adaptation based on non-local use of selection information |title=Parallel Problem Solving from Nature — PPSN III |series=Lecture Notes in Computer Science |date=1994 |volume=866 |pages=189–198 |doi=10.1007/3-540-58484-6_263 |chapter-url=https://link.springer.com/chapter/10.1007/3-540-58484-6_263 |publisher=Springer |isbn=978-3-540-58484-1 |language=en}}</ref>
|-
| 2001 || [[CMA-ES]] || <ref>{{cite journal |last1=Hansen |first1=Nikolaus |last2=Ostermeier |first2=Andreas |title=Completely Derandomized Self-Adaptation in Evolution Strategies |journal=Evolutionary Computation |date=June 2001 |volume=9 |issue=2 |pages=159–195 |doi=10.1162/106365601750190398|pmid=11382355 }}</ref>
|-
| 2006 || Weighted multi-recombination ES - usage of weighted recombination || <ref>{{cite journal |last1=Arnold |first1=Dirk V. |title=Weighted multirecombination evolution strategies |journal=Theoretical Computer Science |date=28 August 2006 |volume=361 |issue=1 |pages=18–37 |doi=10.1016/j.tcs.2006.04.003 |url=https://www.sciencedirect.com/science/article/pii/S0304397506003008 |issn=0304-3975}}</ref>
|-
| 2007 || Meta-ES - incremental aggregation of partial semantic structures ||  <ref>{{cite book |last1=Jung |first1=Jason J. |last2=Jo |first2=Geun-Sik |last3=Yeo |first3=Seong-Won |chapter=Meta-evolution Strategy to Focused Crawling on Semantic Web |title=Artificial Neural Networks – ICANN 2007 |series=Lecture Notes in Computer Science |date=2007 |volume=4669 |pages=399–407 |doi=10.1007/978-3-540-74695-9_41 |chapter-url=https://link.springer.com/chapter/10.1007/978-3-540-74695-9_41 |publisher=Springer |isbn=978-3-540-74693-5 |language=en}}</ref>
|-
| 2008 || [[Natural evolution strategy|Natural ES]] - usage of natural gradient || <ref>{{cite journal |last1=Wierstra |first1=Daan |last2=Schaul |first2=Tom |last3=Glasmachers |first3=Tobias |last4=Sun |first4=Yi |last5=Peters |first5=Jan |last6=Schmidhuber |first6=Jürgen |title=Natural evolution strategies |journal=J. Mach. Learn. Res. |date=1 January 2014 |volume=15 |issue=1 |pages=949–980 |url=https://dl.acm.org/doi/abs/10.5555/2627435.2638566 |issn=1532-4435}}</ref>
|-
| 2010 || Exponential natural ES - a simpler version of natural ES || <ref>{{cite book |last1=Glasmachers |first1=Tobias |last2=Schaul |first2=Tom |last3=Yi |first3=Sun |last4=Wierstra |first4=Daan |last5=Schmidhuber |first5=Jürgen |chapter=Exponential natural evolution strategies |title=Proceedings of the 12th annual conference on Genetic and evolutionary computation |date=7 July 2010 |pages=393–400 |doi=10.1145/1830483.1830557 |chapter-url=https://dl.acm.org/doi/abs/10.1145/1830483.1830557 |publisher=Association for Computing Machinery|isbn=978-1-4503-0072-8 |url=https://infoscience.epfl.ch/record/163869/files/exponentialnaturalevolutionstrategies.pdf }}</ref>
|-
| 2014 || Limited memory CMA-ES - time–memory complexity reduction by covariance matrix decomposition || <ref>{{cite book |last1=Loshchilov |first1=Ilya |chapter=A computationally efficient limited memory CMA-ES for large scale optimization |title=Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation |date=12 July 2014 |pages=397–404 |doi=10.1145/2576768.2598294 |publisher=Association for Computing Machinery|arxiv=1404.5520 |isbn=978-1-4503-2662-9 }}</ref>
|-
| 2016 || Fitness inheritance CMA-ES - fitness evaluation computational cost reduction using fitness inheritance || <ref>{{cite book |last1=Liaw |first1=Rung-Tzuo |last2=Ting |first2=Chuan-Kang |chapter=Enhancing covariance matrix adaptation evolution strategy through fitness inheritance |title=2016 IEEE Congress on Evolutionary Computation (CEC) |date=July 2016 |pages=1956–1963 |doi=10.1109/CEC.2016.7744027 |isbn=978-1-5090-0623-6 }}</ref>
|-
| 2017 || RS-CMSA ES - usage of subpopulations || <ref>{{cite journal |last1=Ahrari |first1=Ali |last2=Deb |first2=Kalyanmoy |last3=Preuss |first3=Mike |title=Multimodal Optimization by Covariance Matrix Self-Adaptation Evolution Strategy with Repelling Subpopulations |journal=Evolutionary Computation |date=September 2017 |volume=25 |issue=3 |pages=439–471 |doi=10.1162/evco_a_00182|pmid=27070282 |hdl=1887/76707 |hdl-access=free }}</ref>
|-
| 2017 || MA-ES - COV update and COV matrix square root are not used || <ref>{{cite journal |last1=Beyer |first1=Hans-Georg |last2=Sendhoff |first2=Bernhard |title=Simplify Your Covariance Matrix Adaptation Evolution Strategy |journal=IEEE Transactions on Evolutionary Computation |date=October 2017 |volume=21 |issue=5 |pages=746–759 |doi=10.1109/TEVC.2017.2680320}}</ref>
|-
| 2018 || Weighted ES - weighted recombination of general convex quadratic functions || <ref>{{cite journal |last1=Akimoto |first1=Youhei |last2=Auger |first2=Anne |last3=Hansen |first3=Nikolaus |title=Quality gain analysis of the weighted recombination evolution strategy on general convex quadratic functions |journal=Theoretical Computer Science |date=6 September 2020 |volume=832 |pages=42–67 |doi=10.1016/j.tcs.2018.05.015 |url=https://www.sciencedirect.com/science/article/pii/S0304397518303359 |issn=0304-3975|arxiv=1608.04813 }}</ref>
|}