umn logo IMA home |  Contact IMA 
IMA Web

IMA Annual Program Year Workshop

The Mathematics and Art of Film Editing and Restoration

February 6-10, 2006

Organizers:

Guillermo R. Sapiro

Department of Electrical and Computer Engineering
University of Minnesota
http://www.ece.umn.edu/users/guille/

Lance J. Williams

Applied Minds


Andrew Zisserman

Department of Engineering Science
Oxford University
http://www.eng.ox.ac.uk/World/Info/Staff/zisserman.a.html

Schedule Participants Program Application Feedback
IMA Live Streaming and Webcasting Maps
Abstracts and Talk Materials Dining Guide
Photo Gallery

Description:

We enjoy movies on a daily basis, but are rarely aware of the image processing involved in creating and editing a film. Examples of frequent operations are format conversion, compression, scratch and blotch removal, introducing special effects, motion estimation, camera calibration, segmentation and super-resolution. These techniques are so important that, today, virtually every movie undergoes some digital image processing. Still, some of the fundamental problems remain unsolved, often involving very time-consuming manual labor. The quality standards are also very different -- often far stricter -- than those in most common applications of image processing. This brings significant mathematical and engineering challenges. The goal of this workshop is to have a uniquely interactive setting in which engineers, mathematicians, and artists implicated in film editing, restoration and "post-processing" are assembeled in order to inform and instruct each other as well as discuss possible solutions and directions of research. The workshop will start with a number of tutorials by leaders in the area (from industry and academia) and will be followed by interleaved talks in the interdisciplinary aspects of movie editing and restoration.

Schedule
Monday, February 6
8:15a-9:00a Registration and coffee   EE/CS 3-176
9:00a-9:10a Welcome to the IMA Douglas N. Arnold (University of Minnesota Twin Cities) EE/CS 3-180
9:10a-9:20a Opening Remarks Guillermo R. Sapiro (University of Minnesota Twin Cities), Lance J. Williams (Applied Minds, Inc.), Andrew Zisserman (University of Oxford) EE/CS 3-180
9:20a-10:20a The grammar of storytelling on film survives technology Jay Cassidy (MTI Film, LLC) EE/CS 3-180
10:20a-10:45a coffee   EE/CS 3-176
10:45a-11:45a Pushing pixels: From restoration to postproduction Anil Kokaram (Trinity College) EE/CS 3-180
11:45a-1:30p lunch    
1:30p-2:30p The evolution of film editing technique and its implications to the parsing and summarization of motion pictures John W. Mateer (University of York) EE/CS 3-180
2:30p-3:00p Second Chances   EE/CS 3-180
3:10p-3:15p Group photos    
3:15p-4:30p Poster Session/Reception
Lind Hall 400
PrestoSpace project Laurent Joyeux (Joanneum Research)
Cross-generalization: learning novel classes from a single example by feature replacement Evgeniy Bart (University of Minnesota Twin Cities)
Digital restoration of antique documents Sebastiano Battiato (Università di Catania)
A Variational Approach to Image and Video Super-Resolution Todd Wittman (University of Minnesota Twin Cities)
Video content analysis Alvaro Pardo (Instituto de Ingenieria Electrica)
Getting rid of scratches and blotches Harald Grossauer (Leopold-Franzens Universität Innsbruck)
Restoration and zoom of irregularly sampled, blurred and noisy images by accurate total variation minimization with local constraints Gloria Haro Ortega (University of Minnesota Twin Cities)
Variational approach to interpolate and correct adhesion bias in low-baseline stereo correlation Andres Almansa (Facultad de Ingeniería)
Movie and Video Scale-Time Equalization Julie Delon (France Telecom R&D, LLC)
A variational approach to blending based on warping for non-overlapped images Chang-Ock Lee (Korea Advanced Institute of Science and Technology (KAIST))
A human color perception model for film unsupervised digital restoration Alessandro Rizzi (Università di Milano)
New approaches to line scratch restoration Lucia Maddalena (Consiglio Nazionale delle Ricerche (CNR))
Novel image processing algorithms for European Union Digital Cinema projects Marcelo Jose Bertalmio (Universitat Pompeu Fabra)
Blotch Detection for Digital Archives Restoration based on the Fusion of Spatial and Temporal Detectors Louis Laborelli (Institut de l'Audiovisuel)
Scratch detection Bernard Besserer (Université de La Rochelle)
Tuesday, February 7
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a 3D models from image sequences Andrew Fitzgibbon (Microsoft Research) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Computer vision success stories in visual media production : Camera tracking and motion capture David Capel (2d3 Limited) EE/CS 3-180
11:30a-1:30p lunch    
1:30p-2:30p Video-based rendering Richard Szeliski (Microsoft Research) EE/CS 3-180
2:30p-3:00p Second Chances   EE/CS 3-180
Wednesday, February 8
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Image and video inpainting Guillermo R. Sapiro (University of Minnesota Twin Cities) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a "But you said it was 99% accurate! Why is there a defect in the first frame?"
Gentle techniques for using mathematics in motion picture processes to marry film and digital
Daniel Rosen (Warner Bros.) EE/CS 3-180
11:30a-1:30p lunch    
1:30p-2:30p Techniques and rationale for motion picture restoration Kevin Manbeck (MTI Film, LLC) EE/CS 3-180
2:30p-3:00p Restoration revisited Jay Cassidy (MTI Film, LLC) EE/CS 3-180
3:00p-3:30p Second Chances   EE/CS 3-180
3:45p-5:00p Poster Session   Lind Hall 400
7:00p-8:00p Math Matters: IMA Public Lecture - Artful mathematics Daniel Rockmore (Dartmouth College) Willey Hall 125 
Thursday, February 9
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Retrieving video of people and places Andrew Zisserman (University of Oxford) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Tracking planes in images: Applications in post-production Philip McLauchlan (Imagineer Systems Limited) EE/CS 3-180
11:30a-1:30p lunch    
12:00p-1:00p Mathematics: Maker and muse for modern art Daniel Rockmore (Dartmouth College) Weisman Art Museum 
1:30p-2:30p Computer vision in movie production: problems and expectations Eugene Vendrovsky (Rhythm & Hues Studios, Inc.) EE/CS 3-180
2:45p-3:15p Disney human face project Lance J. Williams (Applied Minds, Inc.) EE/CS 3-180
3:15p-4:30p Challenging shots: Demo your problem and discuss it with us Pierre Jasmin (RE:Vision Effects, Inc.) EE/CS 3-180
6:00p-7:30p workshop dinner   Gardens of Salonica 
Friday, February 10
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Movie restoration methods Toni Buades (University of the Balearic Islands (Illes Balears)) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Denoising archival films using a field-of-experts model of film grain and natural image statistics Michael Black (Brown University) EE/CS 3-180
11:30a-12:00p Second Chances   EE/CS 3-180

LIST OF CONFIRMED PARTICIPANTS

Name Department Affiliation
Iman Aganj Department of Electrical and Computer Engineering University of Minnesota Twin Cities
Andres Almansa Centro de Calculo Facultad de Ingeniería
Jung-Ha An Institute for Mathematics and its Applications University of Minnesota Twin Cities
Pablo Arias Instituto de Ingeneria Electrica University of the Republic
Douglas N. Arnold Institute for Mathematics and its Applications University of Minnesota Twin Cities
Donald G. Aronson Institute for Mathematics and its Applications University of Minnesota Twin Cities
Evgeniy Bart Institute for Mathematics and its Applications University of Minnesota Twin Cities
Sebastiano Battiato Mathematics and Informatics Università di Catania
Marcelo Jose Bertalmio Departament de Tecnologia Universitat Pompeu Fabra
Bernard Besserer L3i : Laboratoire Informatique, Image, Interaction Université de La Rochelle
Michael Black Department of Computer Science Brown University
Francisco Blanco-Silva Department of Mathematics Purdue University
Toni Buades Departament de Matematiques I Informatica University of the Balearic Islands (Illes Balears)
David Capel   2d3 Limited
Jay Cassidy Department of Science and Technology MTI Film, LLC
Qianyong Chen Institute for Mathematics and its Applications University of Minnesota Twin Cities
Barry Cipra   NONE
Steven Benjamin Damelin Department of Mathematics Georgia Southern University
Julie Delon LTCI France Telecom R&D, LLC
Brian DiDonna Institute for Mathematics and its Applications University of Minnesota Twin Cities
Andrew Fitzgibbon   Microsoft Research
Harald Grossauer Department of Computer Science Leopold-Franzens Universität Innsbruck
Changfeng Gui Department of Mathematics University of Connecticut
Jooyoung Hahn Division of Applied Mathematics Korea Advanced Institute of Science and Technology (KAIST)
Gloria Haro Ortega Institute for Mathematics and its Applications University of Minnesota Twin Cities
Sheryl Hemkin Department of Chemistry Kenyon College
Xiang Huang Department of Mathematics University of Connecticut
Pierre Jasmin   RE:Vision Effects, Inc.
Sookyung Joo Institute for Mathematics and its Applications University of Minnesota Twin Cities
Laurent Joyeux Institute for Information Systems and Information Management Joanneum Research
Sung Ha Kang Department of Mathematics University of Kentucky
Gisela Klette Department of Computer Science University of Auckland
Reinhard Klette Department of Computer Science University of Auckland
Anil Kokaram Department of Electronic and Electrical Engineering Trinity College
Shin Kurokawa   Maximum Output Designs, Inc.
Matthias Kurzke Institute for Mathematics and its Applications University of Minnesota Twin Cities
Song-Hwa Kwon Institute for Mathematics and its Applications University of Minnesota Twin Cities
Louis Laborelli   Institut de l'Audiovisuel
Chang-Ock Lee Division of Applied Mathematics Korea Advanced Institute of Science and Technology (KAIST)
Nam-Yong Lee School of Computer Aided Science Inje University
Stacey E. Levine Department of Mathematics and Computer Science Duquesne University
Debra Lewis Institute for Mathematics and its Applications University of Minnesota Twin Cities
Hstau Liao Institute for Mathematics and its Applications University of Minnesota Twin Cities
Peter Litwinowicz   RE:Vision Effects, Inc.
Bradley J. Lucier Department of Mathematics Purdue University
Lucia Maddalena Institute for High-Performance Computing and Networking (ICAR) Consiglio Nazionale delle Ricerche (CNR)
Alison Malcolm Institute for Mathematics and its Applications University of Minnesota Twin Cities
Kevin Manbeck Department of Science and Technology MTI Film, LLC
John W. Mateer Department of Electronics University of York
Philip McLauchlan   Imagineer Systems Limited
Mila Nikolova Centre de Mathematiques et leurs Applications(CMLA) École Normale Supérieure de Cachan
Peter J. Olver School of Mathematics University of Minnesota Twin Cities
Alvaro Pardo Department of Electrical Engineering Instituto de Ingenieria Electrica
Gregory J. Randall Instituto de Ingenieria Electrica University of the Republic
Walter Richardson Jr. Department of Mathematical Sciences University of Texas
Alessandro Rizzi Dipartimento di Tecnologie dell'Informazione Università di Milano
Daniel Rosen   Warner Bros.
Fadil Santosa School of Mathematics University of Minnesota Twin Cities
Guillermo R. Sapiro Department of Electrical and Computer Engineering University of Minnesota Twin Cities
Arnd Scheel Institute for Mathematics and its Applications University of Minnesota Twin Cities
Jin Keun Seo Department of Mathematics Yonsei University
Tatiana Soleski Institute for Mathematics and its Applications University of Minnesota Twin Cities
Rashmi Sundareswara   University of Minnesota Twin Cities
Vladimir Sverak School of Mathematics University of Minnesota Twin Cities
Richard Szeliski Vision Technology Group Microsoft Research
Carl Toews Institute for Mathematics and its Applications University of Minnesota Twin Cities
Eugene Vendrovsky   Rhythm & Hues Studios, Inc.
Jingyue Wang Department of Mathematics Purdue University
Xiaoqiang Wang Institute for Mathematics and its Applications University of Minnesota Twin Cities
Martin Welk Mathematical Image Analysis Group Universität des Saarlandes
Michael Werman Institute of Computer Science Hebrew University
Lance J. Williams   Applied Minds, Inc.
Todd Wittman School of Mathematics University of Minnesota Twin Cities
Ofer Zeitouni School of Mathematics University of Minnesota Twin Cities
Andrew Zisserman Department of Engineering Science University of Oxford