A Tutorial on Bayesian Optimization - arXiv
A Tutorial on Bayesian OptimizationPeter I. FrazierJuly 10, 2018AbstractBayesian Optimization is an approach to optimizing objective functions that take a long time (min-utes or hours) to evaluate. It is best-suited for Optimization over continuous domains of less than 20dimensions, and tolerates stochastic noise in function evaluations. It builds a surrogate for the objectiveand quantifies the uncertainty in that surrogate using a Bayesian machine learning technique, Gaussianprocess regression, and then uses an acquisition function defined from this surrogate to decide where tosample.
tion made by Snoek et al. (2012) that BayesOpt is useful for training deep neural networks sparked a surge of interest within machine learning, with complementary innovations from that literature including multi-task optimization (Swersky et al., 2013; Toscano-Palmerin and Frazier, 2018), multi- delity opti-
Download A Tutorial on Bayesian Optimization - arXiv
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: