This wiki has had no edits or log actions made within the last 45 days and has been automatically marked as inactive. If you would like to prevent this wiki from being closed, please start showing signs of activity here. If there are no signs of this wiki being used within the next 15 days, this wiki will be closed in accordance to the Dormancy Policy (which all wiki founders accept when requesting a wiki). If this wiki is closed and no one reopens it 135 days from now, this wiki will become eligible for deletion. Note: If you are a bureaucrat, you can go to Special:ManageWiki and uncheck "inactive" yourself.

Sparse Coding

From Ioannis Kourouklides

This page contains resources about Sparse Coding and Dictionary Learning .

Subfields and Concepts[edit]

  • Method of Optimal Directions
  • K-SVD
  • Orthogonal Matching Pursuit
  • Stochastic Gradient Descent
  • Lagrange Dual Method
  • Online Dictionary Learning
  • Sparse Dictionary Learning
  • Sparse Autoencoder

Online Courses[edit]

Video Lectures[edit]


Lecture Notes[edit]

Books and Book Chapters[edit]

  • Bengio, Y., Goodfellow, I. J., & Courville, A. (2016). "Section 13.4: Sparse Coding". Deep Learning. MIT Press.
  • Hastie, T., Tibshirani, R., & Wainwright, M. (2015). "Chapter 8: Sparse Multivariate Methods". Statistical learning with sparsity: the lasso and generalizations. CRC Press.
  • Rish, I., & Grabarnik, G. (2014). Sparse modeling: theory, algorithms, and applications. CRC Press.
  • Northoff, G. (2013). Unlocking the Brain: Volume 1: Coding (Vol. 1). Oxford University Press.
  • Murphy, K. P. (2012). "Chapter 13: Sparse linear models". Machine Learning: A Probabilistic Perspective. MIT Press.

Scholarly Articles[edit]

See also References .

  • Zhang, H., & Xu, J. (2014). Sparse Coding on Multiple Manifold Data. In International Conference on Neural Information Processing (pp. 515-523). Springer International Publishing.
  • Tosic, I., & Frossard, P. (2011). Dictionary Learning. IEEE Signal Processing Magazine28(2), 27-38.
  • Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. Journal of Machine Learning Research,11(Jan), 19-60.
  • Rubinstein, R., Bruckstein, A. M., & Elad, M. (2010). Dictionaries for sparse representation modeling. Proceedings of the IEEE, 98(6), 1045-1057.
  • Rubinstein, R., Zibulevsky, M., & Elad, M. (2010). Double sparsity: Learning sparse dictionaries for sparse signal approximation. IEEE Transactions on signal processing58(3), 1553-1564.
  • Gregor, K., & LeCun, Y. (2010). Learning fast approximations of sparse coding. In Proceedings of the 27th International Conference on Machine Learning (pp. 399-406).
  • Mairal, J., Ponce, J., Sapiro, G., Zisserman, A., & Bach, F. R. (2009). Supervised dictionary learning. In Advances in Neural Information Processing Systems (pp. 1033-1040).
  • Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009). Online dictionary learning for sparse coding. In Proceedings of the 26th International Conference on Machine Learning (pp. 689-696).
  • Rubinstein, R., Zibulevsky, M., & Elad, M. (2008). Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit. Technical Report.
  • Aharon, M., Elad, M., & Bruckstein, A. (2006). K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation. IEEE Transactions on Signal Processing54(11), 4311-4322.
  • Hoyer, P. O. (2004). Non-negative matrix factorization with sparseness constraints. Journal of Machine Learning Research5(Nov), 1457-1469.

Tutorials[edit]

Software[edit]

See also[edit]

Other Resources[edit]