The talk will cover the main components of sequential model-based optimization algorithms.
Algorithms of this kind represent the state-of-the-art for expensive black-box optimization problems and are getting increasingly popular for hyper-parameter optimization of machine learning algorithms, especially on larger datasets.
The talk will cover the main components of sequential model-based optimization algorithms, e.g., surrogate regression models like Gaussian processes or random forests, initialization phase and point acquisition.
In a second part, some recent extensions with regard to parallel point acquisition and multi-criteria optimization will be covered.
The talk will finish with a brief overview of open questions and challenges.