Browsing CBMM Memo Series by Author "Galanti, Liane"
Now showing items 1-1 of 1
-
Norm-Based Generalization Bounds for Compositionally Sparse Neural Network
Galanti, Tomer; Xu, Mengjia; Galanti, Liane; Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2023-02-14)In this paper, we investigate the Rademacher complexity of deep sparse neural networks, where each neuron receives a small number of inputs. We prove generalization bounds for multilayered sparse ReLU neural networks, ...