Unsupervised Learning of Finite Mixture Models using Mean Field Games

In this presentation we develop a dynamic continuous solution to the clustering problem of data characterized by a mixture of K distributions, where K is given a priori. The proposed solution resorts to game theory tools, in particular mean field games and can be interpreted as the continuous version of a generalized Expectation-Maximization (GEM) algorithm. The main contributions of this paper are twofold: first, we prove that the proposed solution is a GEM algorithm; second, we derive closed-form solution for a Gaussian mixture model and show that the proposed algorithm converges exponentially fast to a maximum of the log-likelihood function, improving significantly over the state of the art. We conclude the paper by presenting simulation results for the Gaussian case that indicate better performance of the proposed algorithm in term of speed of convergence and with respect to the overlap problem.

Sérgio Pequito

Sérgio Pequito is a doctoral student in the CMU-Portugal Program,at the Instituto Superior Técnico (IST) in Lisbon. He received his BSc and MSc in Applied Mathematics from the IST. Pequito's interests pass through the use of advanced mathematical tools with application to Electronic Engineering, ranging from nonlinear estimation/control to nonlinear optimization. His CDC 2009 paper, The Entropy Penalized Minimum Energy Estimator has been awarded with best student paper award finalist.CMU/IST