Passer au contenu

/ Department of Computer Science and Operations Research

Je donne

Rechercher

Navigation secondaire

Soutenance de thèse du Predoc III de Jarrid Rector-Brooks

Dear all / Bonjour à tous,

We are happy to invite you to the Predoc III Evaluation of Jarrid Rector-Brooks on August 20th at 2h30 pm (hybrid mode).

Vous êtes cordialement invité.e.s à l'évaluation du Predoc III de Jarrid Rector-Brooks , le 20 août à 14h30 (mode hybride).


Title: TOWARDS SCALABLE SAMPLING FROM BOLTZMANN DISTRIBUTIONS

Date: August 20th, 2h30 pm

Location: Mila 6650, Auditorium 1

Link: Google Meet Lien Google

 

Jury

President
Pierre-Luc Bacon
Director
Yoshua Bengio
Member
Gauthier Gidel

 

Abstract

 

Efficiently generating statistically independent samples from an
unnormalized probability distribution, such as equilibrium samples of
many-body systems, is a foundational problem in science. While the practice
of training generative models in the presence of datasets via maximum
likelihood is mature and able to scale to very high dimensional problems
the same is not true for sampling given only the unnormalized distribution.
Current approaches to sampling from unnormalized densities range from
Markov Chain Monte Carlo (MCMC) methods which strug- gle to move from mode
to mode in high dimensions to different neural samplers that,
unfortunately, have various drawbacks in their learning procedures holding
them back from scaling to very high dimensional problems. For example, some
require integrating an entire SDE trajectory to evaluate the loss, others
rely on con- sistency objectives where credit assignment is a struggle,
while others require the restrictive architecture choices preventing wider
adoption. In this thesis proposal we attempt to take inspiration from
approaches that work well when training via maximum likelihood, in
particular diffusion and flow matching models, to further the scalability
of neural sampling algorithms.