Loading Events

« All Events

  • This event has passed.

GRASP Special Seminar: Abhinav Gupta, Carnegie Mellon University, “Supersizing Self-Supervision: ConvNets and Common Sense without Manual Supervision”

June 15, 2016 @ 11:00 am - 12:00 pm


In this talk, I will discuss how to learn visual representation and common sense knowledge without using any manual supervision. First, I am going to discuss how we can learn ConvNets in a completely unsupervised manner using auxiliary tasks. Specifically, I am going to demonstrate how spatial context in images and viewpoint changes in videos can be used to train visual representations. Then, I am going to introduce NEIL (Never Ending Image Learner), a computer program that runs 24×7 to automatically build visual detectors and common sense knowledge from web data. NEIL is an attempt to develop a large and rich visual knowledge base with minimum human labeling effort. Every day, NEIL scans through images of our mundane world, and little by little, it learns common sense relationships about our world. For example, with no input from humans, NEIL can tell you that trading floors are crowded and babies have eyes. In eight months, NEIL has analyzed more than 25 million images, labeled ~4M annotations (boxes and segments), learned models for 7500 concepts and discovered more than 20K common sense relationships. Finally, in an effort to diversify the knowledge base, I will briefly discuss how NEIL is also being extended to a physical robot which learns about knowledge for actions.


- Learn More

Abhinav Gupta is an assistant research professor at the Robotics Institute of Carnegie Mellon University. Prior to this, he was a post-doctoral fellow working st CMU with Alyosha Efros and Martial Hebert. Before coming to Pittsburgh, Abhinvav was working with Larry Davis at UMD and Jianbo Shi at UPenn. His PhD thesis was on “Beyond Nouns and Verbs”.

In addition, Abhinav has created a computer program called NEIL (Never Ending Image Learner) that scans the Internet to extract visual knowledge and common sense on a vast scale. NEIL was rated as one of the top ten CNN Ideas of 2013. Gupta is a recipient of the UMD Dean’s Fellowship, Google Faculty Research Award, Bosch Young Faculty Fellowship, and the ECCV Best Paper Runner-up Award. His research has also been featured in Newsweek, The Wall Street Journal, Wired, Slashdot, and on the BBC.


June 15, 2016
11:00 am - 12:00 pm
Event Category: