People


Faculty

Jianbo Shi

Jianbo Shi

Professor, CIS

Jianbo’s group is developing vision algorithms for both human and image recognition. Their ultimate goal is to develop computation algorithms to understand human behavior and interaction with objects in video, and to do so at multiple levels of abstractions: from the basic body limb tracking, to human identification, gesture recognition, and activity inference. Jianbo and his group are working to develop a visual thinking model that allows computers not only to understand their surroundings, but also to achieve higher level cognitive abilities such as machine memory and learning.

Publications

Deep image blending

Publisher IEEE Winter Conference on Applications of Computer Vision (WACV)

Enhanced generative adversarial network for 3D brain MRI super-resolution

Publisher IEEE Winter Conference on Applications of Computer Vision (WACV)

Force from Motion: Decoding Control Force of Activity in a First-Person Video

Publisher IEEE Transactions on Pattern Analysis and Machine Intelligence

FoveaBox: Beyound Anchor-based Object Detection

Publisher IEEE Transactions on Image Processing

Multimodal image outpainting with regularized normalized diversification

Publisher IEEE Winter Conference on Applications of Computer Vision (WACV)

Nested Scale-Editing for Conditional Image Synthesis

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Adversarial structure matching for structured prediction tasks

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Normalized diversification

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

SegSort: Segmentation by discriminative sorting of segments

Publisher IEEE International Conference on Computer Vision (ICCV)

Zoom-in-to-check: Boosting video interpolation via instance-level discrimination

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Egocentric Basketball Motion Planning from a Single First-Person Image

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Object detection in video with spatiotemporal sampling networks

Publisher Lecture Notes in Computer Science (LNCS)

Am i a Baller? Basketball Performance Assessment from First-Person Videos

Publisher IEEE International Conference on Computer Vision (ICCV)

Connecting the dots: Embodied visual perception from first-person cameras

Publisher IAPR International Conference on Machine Vision Applications (MVA)

Convolutional random walk networks for semantic image segmentation

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

First-person action-object detection with EgoNet

Publisher Robotics: Science and Systems (RSS)

Local perturb-and-MAP for structured prediction

Publisher International Conference on Artificial Intelligence and Statistics (AISTATS)

Motion-Based Temporal Alignment of Independently Moving Cameras

Publisher IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Predicting behaviors of basketball players from first person videos

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Synchronization of Video Sequences Through 3D Trajectory Reconstruction

Publisher Zidonghua Xuebao/Acta Automatica Sinica

Unsupervised Learning of Important Objects from First-Person Videos

Publisher IEEE International Conference on Computer Vision (ICCV)

Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention

Publisher IEEE International Conference on Computer Vision Workshops (ICCVW)

Egocentric future localization

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Force from Motion: Decoding Physical Sensation in a First Person Video

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Integrated intelligence for human-robot teams

Publisher International Symposium on Experimental Robotics (ISER)

Rich Representations with Exposed Semantics for Deep Visual Reasoning

Publisher Carnegie Melon University Pittsburgh United States

Semantic Segmentation with Boundary Neural Fields

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

DeepEdge: A multi-scale bifurcated deep network for top-down contour detection

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Social saliency prediction

Publisher IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)

Ph.D. Students

Rohit Jena

CIS, PhD


Hyung Seok Roh

PhD, CIS


Shan Su

PhD, CIS


Yifan Wu

PhD, BE


Katherine Xu

PhD, CIS


Huzheng Yang

PhD, CIS


Alumni

Gedas Bertasius

PhD, CIS '19 - Assistant Professor, University of North Carolina, Chapel Hill


Katerina Fragkiadaki

PhD, CIS '13 - JPMorgan Chase Assistant Professor, Machine Learning Department, CMU


Anthony Hoogs

Senior Director of Computer Vision, Kitware, Inc.


Jyh-Jing Hwang

PhD, CIS '20


Hyun Soo Park

PostDoc, CIS '16 - UMN Faculty


Keyan Ren

Visiting Scholar, CIS '09


Lingzhi Zhang

Robotics MSE '19, PhD, CIS '23


Jianbo Shi