Transcription of A Tutorial on Bayesian Optimization - arXiv
{{id}} {{{paragraph}}}
A Tutorial on Bayesian OptimizationPeter I. FrazierJuly 10, 2018 AbstractBayesian Optimization is an approach to optimizing objective functions that take a long time (min-utes or hours) to evaluate. It is best-suited for Optimization over continuous domains of less than 20dimensions, and tolerates stochastic noise in function evaluations. It builds a surrogate for the objectiveand quantifies the uncertainty in that surrogate using a Bayesian machine learning technique, Gaussianprocess regression, and then uses an acquisition function defined from this surrogate to decide where tosample. In this Tutorial , we describe how Bayesian Optimization works, including Gaussian process re-gression and three common acquisition functions: expected improvement, entropy search, and knowledgegradient.
the application of rst- and second-order methods like gradient descent, Newton’s method, or quasi-Newton methods. We refer to problems with this property as \derivative-free". Through most of the article, we will assume f(x) is observed without noise. Later (Section 5) we will allow f(x) to be obscured by stochastic noise.
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}