Sparse Coding

From Ioannis Kourouklides
Jump to navigation Jump to search

This page contains resources about Sparse Coding and Dictionary Learning .

Subfields and Concepts[edit]

  • Method of Optimal Directions
  • K-SVD
  • Orthogonal Matching Pursuit
  • Stochastic Gradient Descent
  • Lagrange Dual Method
  • Online Dictionary Learning
  • Sparse Dictionary Learning
  • Sparse Autoencoder

Online Courses[edit]

Video Lectures[edit]


Lecture Notes[edit]

Books and Book Chapters[edit]

  • Bengio, Y., Goodfellow, I. J., & Courville, A. (2016). "Section 13.4: Sparse Coding". Deep Learning. MIT Press.
  • Hastie, T., Tibshirani, R., & Wainwright, M. (2015). "Chapter 8: Sparse Multivariate Methods". Statistical learning with sparsity: the lasso and generalizations. CRC Press.
  • Rish, I., & Grabarnik, G. (2014). Sparse modeling: theory, algorithms, and applications. CRC Press.
  • Northoff, G. (2013). Unlocking the Brain: Volume 1: Coding (Vol. 1). Oxford University Press.
  • Murphy, K. P. (2012). "Chapter 13: Sparse linear models". Machine Learning: A Probabilistic Perspective. MIT Press.

Scholarly Articles[edit]

See also References .

  • Zhang, H., & Xu, J. (2014). Sparse Coding on Multiple Manifold Data. In International Conference on Neural Information Processing (pp. 515-523). Springer International Publishing.
  • Tosic, I., & Frossard, P. (2011). Dictionary Learning. IEEE Signal Processing Magazine28(2), 27-38.
  • Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. Journal of Machine Learning Research,11(Jan), 19-60.
  • Rubinstein, R., Bruckstein, A. M., & Elad, M. (2010). Dictionaries for sparse representation modeling. Proceedings of the IEEE, 98(6), 1045-1057.
  • Rubinstein, R., Zibulevsky, M., & Elad, M. (2010). Double sparsity: Learning sparse dictionaries for sparse signal approximation. IEEE Transactions on signal processing58(3), 1553-1564.
  • Gregor, K., & LeCun, Y. (2010). Learning fast approximations of sparse coding. In Proceedings of the 27th International Conference on Machine Learning (pp. 399-406).
  • Mairal, J., Ponce, J., Sapiro, G., Zisserman, A., & Bach, F. R. (2009). Supervised dictionary learning. In Advances in Neural Information Processing Systems (pp. 1033-1040).
  • Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009). Online dictionary learning for sparse coding. In Proceedings of the 26th International Conference on Machine Learning (pp. 689-696).
  • Rubinstein, R., Zibulevsky, M., & Elad, M. (2008). Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit. Technical Report.
  • Aharon, M., Elad, M., & Bruckstein, A. (2006). K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation. IEEE Transactions on Signal Processing54(11), 4311-4322.
  • Hoyer, P. O. (2004). Non-negative matrix factorization with sparseness constraints. Journal of Machine Learning Research5(Nov), 1457-1469.

Tutorials[edit]

Software[edit]

See also[edit]

Other Resources[edit]