Browsing CBMM Memo Series by Author "Gan, Yulu"

Now showing items 1-1 of 1

    • A Homogeneous Transformer Architecture 

      Gan, Yulu; Poggio, Tomaso (Center for Brains, Minds and Machines (CBMM), 2023-09-18)
      While the Transformer architecture has made a substantial impact in the field of machine learning, it is unclear what purpose each component serves in the overall architecture. Heterogeneous nonlinear circuits such as ...