Skip to content

zayd/sparsenet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

author
S. Zayd Enam
Apr 25, 2014
87df900 · Apr 25, 2014

History

38 Commits
Mar 27, 2014
Mar 27, 2014
Jul 11, 2013
Apr 25, 2014
Mar 27, 2014
Apr 25, 2014
Mar 27, 2014
Mar 27, 2014

Repository files navigation

Python implementation of sparse dictionary learning. Trains on Van Hateran's or David Field's natural image datasets. Based upon Sparsenet algorithm (1996 Olshausen & Field). Standard stochastic gradient descent to learn dictionary and multiple algorithms to infer coefficients. Minimizes the following objective function:

min_{\Phi, s} || I - \Phi*s ||^2 + || s ||_1

I: Data Phi: Learned dictionary s: Coefficients

L1 optimization LCA: Locally Competitive Algorithm (2006 Rozell et al.)
FISTA: Fast Iterative Shrinkage and Thresholding Algorithm (2009 Beck & Teboulle)
L0 optimization L1 Initialization and IHT: Iterative Hard Thresholding (2008 Blumensath & Davies)

To run: sparsenet(inference='fista')

2x Overcomplete Dictionary 2x Overcomplete Dictionary Trained on Natural Image Patches

About

Sparse dictionary learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published