This wiki has been automatically closed because there have been no edits or log actions made within the last 60 days. If you are a user (who is not the bureaucrat) that wishes for this wiki to be reopened, please request that at Requests for reopening wikis. If this wiki is not reopened within 6 months it may be deleted. Note: If you are a bureaucrat on this wiki, you can go to Special:ManageWiki and uncheck the "Closed" box to reopen it.

Mixture Model

From Ioannis Kourouklides

This page contains resources about Mixture Models and the Expectation-Maximization Algorithm.

Subfields and Concepts

  • Bayesian Models
  • Non-Bayesian Models
  • Mixture of Experts
  • Hierarchical Mixture of Experts
  • k-Nearest Neighbour (k-NN)
  • Gaussian Mixture Model (GMM)
  • Deep Latent Gaussian Mixture Model (DLGMMs)
  • Mixture of Factor Analyzers
  • Mixture of Dimensionality Reducers
  • Latent Variable Models
  • Maximum a posteriori (MAP) EM Algorithm
  • Sparse EM Algorithm
  • Baum-Welch Algorithm (i.e. EM when applied to HMMs)
  • Generalized (Incomplete) EM Algorithm
  • Monte Carlo EM
  • Variational EM
  • Variational Bayesian EM (VBEM)

Online Courses

Video Lectures

Lecture Notes

Books and Book Chapters

  • Theodoridis, S. (2015). "Chapter 12.5: Latent Variables and the EM Algorithm" Machine Learning: A Bayesian and Optimization Perspective. Academic Press.
  • Murphy, K. P. (2012). "Chapter 11: Mixture models and the EM algorithm ". Machine Learning: A Probabilistic Perspective. MIT Press.
  • Barber, D. (2012). "Chapter 11: Learning with Hidden Variables". Bayesian Reasoning and Machine Learning. Cambridge University Press.
  • Barber, D. (2012). "Chapter 20: Mixture Models". Bayesian Reasoning and Machine Learning. Cambridge University Press.
  • McLachlan, G., & Krishnan, T. (2007). The EM algorithm and extensions. John Wiley & Sons.
  • Bishop, C. M. (2006). "Chapter 9: Mixture Models and EM". Pattern Recognition and Machine Learning. Springer.
  • McLachlan, G., & Peel, D. (2004). Finite mixture models. John Wiley & Sons.

Scholarly Articles

  • Nalisnick, E., Hertel, L., & Smyth, P. (2016). Approximate inference for deep latent gaussian mixtures. In NIPS Workshop on Bayesian Deep Learning.

Tutorials

Software

See also

Other Resources