Now showing items 31-33 of 160

    • Deep compositional robotic planners that follow natural language commands 

      Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei (Center for Brains, Minds and Machines (CBMM), Computation and Systems Neuroscience (Cosyne), 2020-05-31)
      We demonstrate how a sampling-based robotic planner can be augmented to learn to understand a sequence of natural language commands in a continuous configuration space to move and manipu- late objects. Our approach combines ...
    • PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception 

      Netanyahu, Aviv; Shu, Tianmin; Katz, Boris; Barbu, Andrei; Tenenbaum, Joshua B. (Center for Brains, Minds and Machines (CBMM), The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), 2021, 2021-03-19)
      The ability to perceive and reason about social interactions in the context of physical environments is core to human social intelligence and human-machine cooperation. However, no prior dataset or benchmark has ...
    • Learning a natural-language to LTL executable semantic parser for grounded robotics 

      Wang, Christopher; Ross, Candace; Kuo, Yen-Ling; Katz, Boris; Barbu, Andrei (Center for Brains, Minds and Machines (CBMM), Conference on Robot Learning (CoRL), 2020-11-16)
      Children acquire their native language with apparent ease by observing how language is used in context and attempting to use it themselves. They do so without laborious annotations, negative examples, or even direct ...