Sparsity in Neural Networks (first workshop with this title)

[dmm]

I am very interested in sparsity in neural nets and I am super-happy that the community around sparsity is growing, and the first workshop on the subject had just taken place.

The key organizer is D.C.Mocanu; I did an experimental PyTorch project building upon his work a couple of years ago.

I learned about this via the ML Collective reading group mailing list. The links are in the comments.

Comments

[dmm]

The work on this subject I did a couple of years ago, "Regularization in intrinsically sparse networks":

https://github.com/anhinga/synapses/blob/master/regularization.md

https://anhinga-drafts.dreamwidth.org/29924.html

(cross-post: https://anhinga-drafts.livejournal.com/30356.html)