IRCS / GRASP Seminar - Dieter Fox, University Of Washington, "Grounding Natural Language In Robot Control And Perception Systems"

Presenter: Dieter Fox (Homepage)

Event Dates:
  Friday November 2, 2012 from 11:00am to 12:00pm

Robots are becoming more and more capable at reasoning about people, objects, and activities in their environments. The ability to extract high-level semantic information from sensor data provides new opportunities for human robot interaction. One such opportunity is to explore interacting with robots via natural language. In this talk I will present our recent work toward enabling robots to interpret, or ground, natural language commands in robot control systems. We build on techniques developed by the semantic natural language processing community on learning combinatory categorial grammars (CCGs) that parse natural language input to logic-based semantic meaning. I will demonstrate results in two application domains: First, learning to follow natural language directions through indoor environments; and, second, learning to ground object attributes via weakly supervised training.

Joint work with Luke Zettlemoyer, Cynthia Matuszek, Nicolas Fitzgerald, Yuyin Sun, and Liefeng Bo. Support provided by Intel ISTC-PC, NSF, and ARL, and ONR.

Presenter's Biography:

Dieter Fox is an Associate Professor in the Department of Computer Science & Engineering at the University of Washington, where he heads the UW Robotics and State Estimation Lab. From 2009 to 2011, he was also Director of the Intel Research Labs Seattle. He currently serves as the academic PI of the Intel Science and Technology Center for Pervasive Computing hosted at UW. Dieter obtained his Ph.D. from the University of Bonn, Germany. Before going to UW, he spent two years as a postdoctoral researcher at the CMU Robot Learning Lab.

Fox's research is in artificial intelligence, with a focus on state estimation applied to robotics and activity recognition. He has published over 100 technical papers and is co-author of the text book "Probabilistic Robotics". He is a fellow of the AAAI and received several best paper awards at major robotics and AI conferences. He is also an editor of the IEEE Transactions on Robotics and was program co-chair of the 2008 AAAI Conference on Artificial Intelligence. He currently serves as the program chair of the 2013 Robotics Science and Systems conference.