Publications: Recent submissions

Now showing items 25-27 of 156

    • Measuring Social Biases in Grounded Vision and Language Embeddings 

      Ross, Candace; Barbu, Andrei; Katz, Boris (Center for Brains, Minds and Machines (CBMM), Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL), 2021-06-06)
      We generalize the notion of measuring social biases in word embeddings to visually grounded word embeddings. Biases are present in grounded embeddings, and indeed seem to be equally or more significant than for ungrounded ...

    • Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas 

      Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei (Center for Brains, Minds and Machines (CBMM), The Ninth International Conference on Learning Representations (ICLR), 2020-10-25)
      We demonstrate a reinforcement learning agent which uses a compositional recurrent neural network that takes as input an LTL formula and determines satisfying actions. The input LTL formulas have never been seen before, ...

    • Deep compositional robotic planners that follow natural language commands 

      Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei (Center for Brains, Minds and Machines (CBMM), Computation and Systems Neuroscience (Cosyne), 2020-05-31)
      We demonstrate how a sampling-based robotic planner can be augmented to learn to understand a sequence of natural language commands in a continuous configuration space to move and manipu- late objects. Our approach combines ...