Doctoral Thesis: On The Performance Of The Maximum Likelihood Over Large Models

Tuesday, June 27
1:00 pm - 2:30 pm

34-401A

Add to Calendar
FacebookTwitterLinkedInEmailShare

Gil Kur

Abstract: 
This dissertation investigates non-parametric regression over large function classes, specifically,
non-Donsker classes. We will present the concept of non-Donsker classes and study the statistical
performance of Least Squares Estimator (LSE) — which also serves as the Maximum Likelihood
Estimator (MLE) under Gaussian noise — over these classes. (1) We demonstrate the minimax
sub-optimality of the LSE in the non-Donkser regime, extending traditional findings of Birgé and
Massart 93’ and resolving a longstanding conjecture of Gardner, Markus and Milanfar 06’. (2) We
reveal that in the non-Donsker regime, the sub-optimality of LSE arises solely from its elevated bias
error term (in terms of the bias and variance decomposition). (3) We introduce the first minimax
optimal algorithm for multivariate convex regression with a polynomial runtime in the number of
samples – showing that one can overcome the sub-optimality of the LSE in efficient runtime. (4)
We study the minimal error of the LSE both in random and fixed design settings.

Thesis Supervisor: Prof. Alexander Rakhlin (IDSS & BCS)

Details

  • Date: Tuesday, June 27
  • Time: 1:00 pm - 2:30 pm
  • Category:
  • Location: 34-401A
Additional Location Details:

Zoom Link: https://mit.zoom.us/j/98686537380