ECCC-Report TR10-102https://eccc.weizmann.ac.il/report/2010/102Comments and Revisions published for TR10-102en-usFri, 01 Oct 2010 13:42:00 +0200
Revision 1
| Black-Box Search by Unbiased Variation |
Per Kristian Lehre,
Carsten Witt
https://eccc.weizmann.ac.il/report/2010/102#revision1The complexity theory for black-box algorithms, introduced by
Droste et al. (2006), describes common limits on the efficiency of
a broad class of randomised search heuristics. There is an
obvious trade-off between the generality of the black-box model
and the strength of the bounds that can be proven in such a
model. In particular, the original black-box model allows
polynomial complexity for certain NP-complete problems and
provides for well-known benchmark problems relatively small lower
bounds, which are typically not met by popular search heuristics.
In this paper, we introduce a more restricted black-box model
which we claim captures the working principles of many randomised
search heuristics including simulated annealing, evolutionary
algorithms, randomised local search and others. The key concept
worked out is an unbiased variation operator. Considering this
class of algorithms, significantly better lower bounds on the
black-box complexity are proved, amongst them an
$\Omega(n\log n)$ bound for functions with unique optimum. Moreover,
a simple unimodal function and gap functions are considered.
We show that a simple (1+1) EA is able to match the runtime
bounds in several cases.
Fri, 01 Oct 2010 13:42:00 +0200https://eccc.weizmann.ac.il/report/2010/102#revision1
Paper TR10-102
| Black-Box Search by Unbiased Variation |
Per Kristian Lehre,
Carsten Witt
https://eccc.weizmann.ac.il/report/2010/102The complexity theory for black-box algorithms, introduced by
Droste et al. (2006), describes common limits on the efficiency of
a broad class of randomised search heuristics. There is an
obvious trade-off between the generality of the black-box model
and the strength of the bounds that can be proven in such a
model. In particular, the original black-box model allows
polynomial complexity for certain NP-complete problems and
provides for well-known benchmark problems relatively small lower
bounds, which are typically not met by popular search heuristics.
In this paper, we introduce a more restricted black-box model
which we claim captures the working principles of many randomised
search heuristics including simulated annealing, evolutionary
algorithms, randomised local search and others. The key concept
worked out is an unbiased variation operator. Considering this
class of algorithms, significantly better lower bounds on the
black-box complexity are proved, amongst them an
$\Omega(n\log n)$ bound for functions with unique optimum. Moreover,
a simple unimodal function and gap functions are considered.
We show that a simple (1+1) EA is able to match the runtime
bounds in several cases.
Sat, 26 Jun 2010 15:04:45 +0300https://eccc.weizmann.ac.il/report/2010/102