Nonparametric Learning and Optimization with Covariates
- Title: Nonparametric Learning and Optimization with Covariates
- Speaker: Prof. Ningyuan CHEN
- Time: 14:00-15:00, Tuesday, August 07, 2018
- Venue: Boardroom, Dao Yuan Building
Abstract:
Modern decision analytics frequently involves the optimization of an objective over a finite horizon where the functional form of the objective is unknown. The decision analyst observes covariates and tries to learn and optimize the objective by experimenting with the decision variables. We present a nonparametric learning and optimization policy with covariates. The policy is based on adaptively splitting the covariate space into smaller bins (hyper-rectangles) and learning the optimal decision in each bin. We show that the algorithm achieves a regret of order $O(\log(T)^2 T^{(2+d)/(4+d)})$, where $T$ is the length of the horizon and $d$ is the dimension of the covariates, and show that no policy can achieve a regret less than $O(T^{(2+d)/(4+d)})$ and thus demonstrate the near optimality of the proposed policy. The role of $d$ in the regret is not seen in parametric learning problems: It highlights the complex interaction between the nonparametric formulation and the covariate dimension. It also suggests the decision analyst should incorporate contextual information selectively.
Biography:
Dr. Ningyuan Chen is currently an assistant professor at the Department of Industrial Engineering and Decision Analytics of the Hong Kong University of Science and Technology. He received his Ph.D. from the Department of Industrial Engineering and Operations Research at Columbia University. He was a postdoctoral associate at Yale School of Management from 2015 to 2016. His research interest includes revenue management, statistics, applied probability and networks.
