Video-based Rendering

Tuesday, February 7, 2006 - 1:30pm - 2:30pm
EE/CS 3-180
Richard Szeliski (Microsoft Research)
Image-based rendering has been one of the hottest areas in computer
graphics in recent years. Instead of using CAD and painting tools to
construct graphics models by hand, IBR uses real-world imagery to
rapidly create extremely photorealistic shape and appearance
models. However, IBR results to date have mostly been restricted to
static objects and scenes.

Video-based rendering brings the same kind of realism to computer
animation, using video instead of still images as the source
material. Examples of VBR include facial animation from sample video,
repetitive video textures that can be used to animate still scenes and
photos, 3D environment walkthroughs built from panoramic video, and 3D
video constructed from multiple synchronized cameras. In this talk, I
survey a number of such systems developed by our group and by others,
and suggest how this kind of approach has the potential to fundamentally
transform the production (and consumption) of interactive visual media.

About the Speaker

Richard Szeliski leads the Interactive Visual Media Group at Microsoft
Research, which does research in digital and computational photography,
video scene analysis, 3-D computer vision, and image-based rendering. He
received a Ph.D. degree in Computer Science from Carnegie Mellon
University, Pittsburgh, in 1988. He joined Microsoft Research in
1995. Prior to Microsoft, he worked at Bell-Northern Research,
Schlumberger Palo Alto Research, the Artificial Intelligence Center of
SRI International, and the Cambridge Research Lab of Digital Equipment

Dr. Szeliski has published over 100 research papers in computer vision,
computer graphics, medical imaging, and neural nets, as well as the book
Bayesian Modeling of Uncertainty in Low-Level Vision. He was a Program
Committee Chair for ICCV'2001 and the 1999 Vision Algorithms Workshop,
served as an Associate Editor of the IEEE Transactions on Pattern
Analysis and Machine Intelligence and on the Editorial Board of the
International Journal of Computer Vision, and is a Founding Editor of
Foundations and Trends in Computer Graphics and Vision.
MSC Code: