A Deep Representation for Invariance And Music Classification
Author(s)
Zhang, Chiyuan; Evangelopoulos, Georgios; Voinea, Stephen; Rosasco, Lorenzo; Poggio, Tomaso![Thumbnail](/bitstream/handle/1721.1/100163/CBMM-Memo-002.pdf.jpg?sequence=5&isAllowed=y)
DownloadCBMM-Memo-002.pdf (1.628Mb)
Terms of use
Metadata
Show full item recordAbstract
Representations in the auditory cortex might be based on mechanisms similar to the visual ventral stream; modules for building invariance to transformations and multiple layers for compositionality and selectivity. In this paper we propose the use of such computational modules for extracting invariant and discriminative audio representations. Building on a theory of invariance in hierarchical architectures, we propose a novel, mid-level representation for acoustical signals, using the empirical distributions of projections on a set of templates and their transformations. Under the assumption that, by construction, this dictionary of templates is composed from similar classes, and samples the orbit of variance-inducing signal transformations (such as shift and scale), the resulting signature is theoretically guaranteed to be unique, invariant to transformations and stable to deformations. Modules of projection and pooling can then constitute layers of deep networks, for learning composite representations. We present the main theoretical and computational aspects of a framework for unsupervised learning of invariant audio representations, empirically evaluated on music genre classification.
Date issued
2014-17-03Publisher
Center for Brains, Minds and Machines (CBMM), arXiv
Citation
arXiv:1404.0400v1
Series/Report no.
CBMM Memo Series;002
Keywords
Audio Representation, Hierarchy, Invariance, Machine Learning, Theories for Intelligence
Collections
The following license files are associated with this item: