Loading Events

« All Events

  • This event has passed.

GRASP Special Seminar: Roy Fox, Hebrew University, “Optimal Selective Attention and Action in Reactive Agents”

September 15, 2014 @ 2:00 pm - 3:00 pm

Abstract: Intelligent agents, interacting with their environment, operate
under constraints on what they can observe and how they can act.
Unbounded agents can use standard Reinforcement Learning to optimize
their inference and control under purely external constraints. Bounded
agents, on the other hand, are subject to internal constraints as well.
This only allows them to partially notice their observations, and to
partially intend their actions, requiring rational selection of
attention and action.In this talk we will see
how to find the optimal information-constrained policy in reactive
(memoryless) agents. We will discuss a number of reasons why internal
constraints are often best modeled as bounds on information-theoretic
quantities, and why we can focus on reactive agents with hardly any loss
of generality. We will link the solution of the constrained problem to
that of soft clustering, and present some of its nice properties, such
as principled dimensionality reduction.


- Learn More

Roy Fox is a Ph.D. candidate at the Hebrew University, working with
Prof. Naftali Tishby on Information Theoretic methods for Reinforcement
Learning. He took his M.Sc. at the Technion, where he worked with Prof.
Moshe Tennenholtz on an extension of the R-MAX algorithm to partially
observable decision problems. He recently spent a year as a visiting
student at Prof. Larry Abbott’s lab at Columbia University, where he
worked with Prof. Liam Paninski on interactive models for adaptive
brain-computer interfaces.


September 15, 2014
2:00 pm - 3:00 pm
Event Category: