Loading Events

« All Events

  • This event has passed.

Spring 2012 GRASP Seminar: Kristen Grauman, University of Texas, “Focusing Human Attention on the “Right” Visual Data”

April 27, 2012 @ 11:00 am - 12:00 pm

Widespread visual sensors and unprecedented
connectivity have left us awash with visual data—from online photo
collections, home videos, news footage, medical images, or surveillance
feeds.  Which images and videos
among them warrant human attention? 
I present two problem settings in which this question is critical:
supervised learning of object categories, and unsupervised video

In the first setting, the challenge is
to sift through candidate training images and select those that, if labeled by a
human, would be most informative to the recognition system.  To address this challenge, we introduce
a novel large-scale active learning algorithm that efficiently indexes millions
of unlabeled instances according to their informativeness.  We use it to deploy a “live
learning” system that actively requests crowd-sourced annotations on images
crawled from the Web, yielding state-of-the-art accuracy on the PASCAL object
detection benchmark with minimal human intervention.

In the second setting, the challenge is to sift
through a long-running video and select only the essential parts needed to
summarize it for a human viewer. 
Unlike traditional keyframe selection techniques, we propose an
object-driven approach that predicts the impact each object has on generating
the “story” of the video.  Using
novel importance cues indicative of importance in an egocentric camera’s view,
our approach turns hours of video into a compact storyboard summary that a human
can interpret in just seconds.

Both domains demonstrate the importance of isolating
the key visual data that deserves human attention, and suggest exciting new
applications for large-scale visual

This talk describes work with Yong Jae Lee, Sudheendra
Vijayanarasimhan, and Prateek Jain.



- Learn More

Grauman is a Clare Boothe Luce Assistant Professor in the Department of Computer
Science at the University of Texas at Austin. Her research in computer vision and
machine learning focuses on visual search and object recognition. Before joining UT-Austin in 2007, she
received her Ph.D. in the EECS department at MIT, in the Computer Science and
Artificial Intelligence Laboratory. She is an Alfred P. Sloan Research Fellow and Microsoft Research New
Faculty Fellow, and a recipient of NSF CAREER and ONR Young Investigator
awards. She and her collaborators
were recognized with the CVPR Best Student Paper Award in 2008 for work on
hashing algorithms for large-scale image retrieval, and the Marr Best Paper
Prize at ICCV in 2011 for work on modeling relative visual


April 27, 2012
11:00 am - 12:00 pm
Event Category: