1 / 33

Expectation Maximization

Expectation Maximization . Machine Learning. Last Time. Expectation Maximization Gaussian Mixture Models. Today. EM Proof Jensen’s Inequality Clustering sequential data EM over HMMs EM in any Graphical Model Gibbs Sampling. Gaussian Mixture Models. How can we be sure GMM/EM works?.

maeve
Download Presentation

Expectation Maximization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Expectation Maximization Machine Learning

  2. Last Time • Expectation Maximization • Gaussian Mixture Models

  3. Today • EM Proof • Jensen’s Inequality • Clustering sequential data • EM over HMMs • EM in any Graphical Model • Gibbs Sampling

  4. Gaussian Mixture Models

  5. How can we be sure GMM/EM works? • We’ve already seen that there are multiple clustering solutions for the same data. • Non-convex optimization problem • Can we prove that we’re approaching some maximum, even if many exist.

  6. Bound maximization • Since we can’t optimize the GMM parameters directly, maybe we can find the maximum of a lower bound. • Technically: optimize a convex lower bound of the initial non-convex function.

  7. EM as a bound maximization problem • Need to define a function Q(x,Θ) such that • Q(x,Θ) ≤ l(x,Θ) for all x,Θ • Q(x,Θ) = l(x,Θ) at a single point • Q(x,Θ) is concave

  8. EM as bound maximization • Claim: • for GMM likelihood • The GMM MLE estimate is a convex lower bound

  9. EM Correctness Proof • Prove that l(x,Θ) ≥ Q(x,Θ) Likelihood function Introduce hidden variable (mixtures in GMM) A fixed value of θt Jensen’s Inequality (coming soon…)

  10. EM Correctness Proof GMM Maximum Likelihood Estimation

  11. The missing link: Jensen’s Inequality • If f is concave (or convex down): • Incredibly important tool for dealing with mixture models. if f(x) = log(x)

  12. Generalizing EM from GMM • Notice, the EM optimization proof never introduced the exact form of the GMM • Only the introduction of a hidden variable, z. • Thus, we can generalize the form of EM to broader types of latent variable models

  13. General form of EM • Given a joint distribution over observed and latent variables: • Want to maximize: • Initialize parameters • E Step: Evaluate: • M-Step: Re-estimate parameters (based on expectation of complete-data log likelihood) • Check for convergence of params or likelihood

  14. Applying EM to Graphical Models • Now we have a general form for learning parameters for latent variables. • Take a Guess • Expectation: Evaluate likelihood • Maximization: Reestimate parameters • Check for convergence

  15. Clustering over sequential data • Recall HMMs • We only looked at training supervised HMMs. • What if you believe the data is sequential, but you can’t observe the state.

  16. EM on HMMs • also known as Baum-Welch • Recall HMM parameters: • Now the training counts are estimated.

  17. EM on HMMs • Standard EM Algorithm • Initialize • E-Step: evaluate expected likelihood • M-Step: reestimate parameters from expected likelihood • Check for convergence

  18. EM on HMMs • Guess: Initialize parameters, • E-Step: Compute

  19. EM on HMMs • But what are these E{…} quantities? so… These can be efficiently calculated from JTA potentials and separators.

  20. EM on HMMs

  21. EM on HMMs • Standard EM Algorithm • Initialize • E-Step: evaluate expected likelihood • JTA algorithm. • M-Step: reestimate parameters from expected likelihood • Using expected values from JTA potentials and separators • Check for convergence

  22. Training latent variables in Graphical Models • Now consider a general Graphical Model with latent variables.

  23. EM on Latent Variable Models • Guess • Easy, just assign random values to parameters • E-Step: Evaluate likelihood. • We can use JTA to evaluate the likelihood. • And marginalize expected parameter values • M-Step: Re-estimate parameters. • Based on the form of the models generate new expected parameters • (CPTs or parameters of continuous distributions) • Depending on the topology this can be slow

  24. Maximization Step in Latent Variable Models • Why is this easy in HMMs, but difficult in general Latent Variable Models? • Many parents graphical model

  25. Junction Trees • In general, we have no guarantee that we can isolate a single variable. • We need to estimate marginal separately. • “Dense Graphs”

  26. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Keep k-1 parameters fixed (to the current estimate) • Identify a better guess for the free parameter.

  27. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Keep k-1 parameters fixed (to the current estimate) • Identify a better guess for the free parameter.

  28. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Keep k-1 parameters fixed (to the current estimate) • Identify a better guess for the free parameter.

  29. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Keep k-1 parameters fixed (to the current estimate) • Identify a better guess for the free parameter.

  30. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Keep k-1 parameters fixed (to the current estimate) • Identify a better guess for the free parameter.

  31. M-Step in Latent Variable Models • M-Step: Reestimate Parameters. • Gibbs Sampling. • This is helpful if it’s easier to sample from a conditional than it is to integrate to get the marginal. • If the joint is too complicated to solve for directly, sampling is a tractable approach.

  32. EM on Latent Variable Models • Guess • Easy, just assign random values to parameters • E-Step: Evaluate likelihood. • We can use JTA to evaluate the likelihood. • And marginalize expected parameter values • M-Step: Re-estimate parameters. • Either JTA potentials and marginals • Or don’t do EM and Sample…

  33. Break • Unsupervised Feature Selection • Principle Component Analysis

More Related