Abstract: A social camera is a camera carried or worn by a member of a social
group, (e.g., a smartphone camera, a hand-held camcorder, or a wearable
camera). These cameras are becoming increasingly immersed in our social
lives and closely capture our social activities. In this talk, I argue
that social cameras are the ideal sensors for social scene
understanding, as they inherit social signals such as the gaze behavior
of the people carrying them. I will present a computational
representation for social scene understanding from social cameras.
In the first part of my talk, I will show how visible social signals,
such as body gestures, gaze directions, or facial expression, can be
recovered in 3D from social cameras. This work includes 3D trajectory
reconstruction and motion capture from body-mounted cameras. The second
part of the talk will focus on analysis on the relationship between the
social signals using 3D joint attention. This analysis allows us to
predict social gaze behaviors.