HOME    »    PROGRAMS/ACTIVITIES    »    Annual Thematic Program
IMA Annual Program Year Workshop
The Mathematics and Art of Film Editing and Restoration
February 6-10, 2006


Imaging

Organizers:

Guillermo R. Sapiro

Department of Electrical and Computer Engineering
University of Minnesota
http://www.ece.umn.edu/users/guille/

Lance J. Williams

Applied Minds


Andrew Zisserman

Department of Engineering Science
Oxford University
http://www.eng.ox.ac.uk/World/Info/Staff/zisserman.a.html

Description:

We enjoy movies on a daily basis, but are rarely aware of the image processing involved in creating and editing a film. Examples of frequent operations are format conversion, compression, scratch and blotch removal, introducing special effects, motion estimation, camera calibration, segmentation and super-resolution. These techniques are so important that, today, virtually every movie undergoes some digital image processing. Still, some of the fundamental problems remain unsolved, often involving very time-consuming manual labor. The quality standards are also very different -- often far stricter -- than those in most common applications of image processing. This brings significant mathematical and engineering challenges. The goal of this workshop is to have a uniquely interactive setting in which engineers, mathematicians, and artists implicated in film editing, restoration and "post-processing" are assembeled in order to inform and instruct each other as well as discuss possible solutions and directions of research. The workshop will start with a number of tutorials by leaders in the area (from industry and academia) and will be followed by interleaved talks in the interdisciplinary aspects of movie editing and restoration.

Schedule
Monday, February 6
8:15a-9:00a Registration and coffee   EE/CS 3-176
9:00a-9:10a Welcome to the IMA Douglas N. Arnold (University of Minnesota Twin Cities) EE/CS 3-180
9:10a-9:20a Opening Remarks Guillermo R. Sapiro (University of Minnesota Twin Cities), Lance J. Williams (Applied Minds, Inc.), Andrew Zisserman (University of Oxford) EE/CS 3-180
9:20a-10:20a The grammar of storytelling on film survives technology Jay Cassidy (MTI Film, LLC) EE/CS 3-180
10:20a-10:45a coffee   EE/CS 3-176
10:45a-11:45a Pushing pixels: From restoration to postproduction Anil Kokaram (Trinity College) EE/CS 3-180
11:45a-1:30p lunch    
1:30p-2:30p The evolution of film editing technique and its implications to the parsing and summarization of motion pictures John W. Mateer (University of York) EE/CS 3-180
2:30p-3:00p Second Chances   EE/CS 3-180
3:10p-3:15p Group photos    
3:15p-4:30p Poster Session/Reception
Lind Hall 400
PrestoSpace project Laurent Joyeux (Joanneum Research)
Cross-generalization: learning novel classes from a single example by feature replacement Evgeniy Bart (University of Minnesota Twin Cities)
Digital restoration of antique documents Sebastiano Battiato (Università di Catania)
A Variational Approach to Image and Video Super-Resolution Todd Wittman (University of Minnesota Twin Cities)
Video content analysis Alvaro Pardo (Instituto de Ingenieria Electrica)
Getting rid of scratches and blotches Harald Grossauer (Leopold-Franzens Universität Innsbruck)
Restoration and zoom of irregularly sampled, blurred and noisy images by accurate total variation minimization with local constraints Gloria Haro Ortega (University of Minnesota Twin Cities)
Variational approach to interpolate and correct adhesion bias in low-baseline stereo correlation Andres Almansa (Facultad de Ingeniería)
Movie and Video Scale-Time Equalization Julie Delon (France Telecom R&D, LLC)
A variational approach to blending based on warping for non-overlapped images Chang-Ock Lee (Korea Advanced Institute of Science and Technology (KAIST))
A human color perception model for film unsupervised digital restoration Alessandro Rizzi (Università di Milano)
New approaches to line scratch restoration Lucia Maddalena (Consiglio Nazionale delle Ricerche (CNR))
Novel image processing algorithms for European Union Digital Cinema projects Marcelo Jose Bertalmio (Universitat Pompeu Fabra)
Blotch Detection for Digital Archives Restoration based on the Fusion of Spatial and Temporal Detectors Louis Laborelli (Institut de l'Audiovisuel)
Scratch detection Bernard Besserer (Université de La Rochelle)
Tuesday, February 7
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a 3D models from image sequences Andrew Fitzgibbon (Microsoft Research) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Computer vision success stories in visual media production : Camera tracking and motion capture David Capel (2d3 Limited) EE/CS 3-180
11:30a-1:30p lunch    
1:30p-2:30p Video-based rendering Richard Szeliski (Microsoft Research) EE/CS 3-180
2:30p-3:00p Second Chances   EE/CS 3-180
Wednesday, February 8
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Image and video inpainting Guillermo R. Sapiro (University of Minnesota Twin Cities) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a "But you said it was 99% accurate! Why is there a defect in the first frame?"
Gentle techniques for using mathematics in motion picture processes to marry film and digital
Daniel Rosen (Warner Bros.) EE/CS 3-180
11:30a-1:30p lunch    
1:30p-2:30p Techniques and rationale for motion picture restoration Kevin Manbeck (MTI Film, LLC) EE/CS 3-180
2:30p-3:00p Restoration revisited Jay Cassidy (MTI Film, LLC) EE/CS 3-180
3:00p-3:30p Second Chances   EE/CS 3-180
3:45p-5:00p Poster Session   Lind Hall 400
7:00p-8:00p Math Matters: IMA Public Lecture - Artful mathematics Daniel Rockmore (Dartmouth College) Willey Hall 125 
Thursday, February 9
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Retrieving video of people and places Andrew Zisserman (University of Oxford) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Tracking planes in images: Applications in post-production Philip McLauchlan (Imagineer Systems Limited) EE/CS 3-180
11:30a-1:30p lunch    
12:00p-1:00p Mathematics: Maker and muse for modern art Daniel Rockmore (Dartmouth College) Weisman Art Museum 
1:30p-2:30p Computer vision in movie production: problems and expectations Eugene Vendrovsky (Rhythm & Hues Studios, Inc.) EE/CS 3-180
2:45p-3:15p Disney human face project Lance J. Williams (Applied Minds, Inc.) EE/CS 3-180
3:15p-4:30p Challenging shots: Demo your problem and discuss it with us Pierre Jasmin (RE:Vision Effects, Inc.) EE/CS 3-180
6:00p-7:30p workshop dinner   Gardens of Salonica 
Friday, February 10
8:45a-9:00a coffee   EE/CS 3-176
9:00a-10:00a Movie restoration methods Toni Buades (University of the Balearic Islands (Illes Balears)) EE/CS 3-180
10:00a-10:30a coffee   EE/CS 3-176
10:30a-11:30a Denoising archival films using a field-of-experts model of film grain and natural image statistics Michael Black (Brown University) EE/CS 3-180
11:30a-12:00p Second Chances   EE/CS 3-180

LIST OF CONFIRMED PARTICIPANTS

NAMEDEPARTMENTAFFILIATION
Iman Aganj University of Minnesota, Twin Cities
Andres AlmansaCentro de Calculo University of Barcelona
Jung_Ha AnInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Pablo AriasInstituto de Ingenieria Electrica University of the Republic
Douglas ArnoldInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Donald AronsonInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Evgeniy BartInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Sebastiano BattiatoDepartment of Mathematics and Informatics Università di Catania
Marcelo BertalmíoDepartamento de Tecnologías de la Información i les Comunicaciones Universitat Pompeu Fabra
Bernard BessererLaboratoire Informatique, Image, Interaction Université de La Rochelle
Michael BlackDepartment of Computer Science Brown University
Francisco Blanco-SilvaDepartment of Mathematics Purdue University
Antoni BuadesDepartament de Matematiques I Informatica University of the Balearic Islands (Illes Balears)
David Capel 2d3 Limited
Jay CassidyDepartment of Science and Technology MTI Film, LLC
Qian-Yong ChenInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Barry Cipra NONE
Steven DamelinInstitute for Mathematics and its Applications Georgia Southern University
Julie DelonLTCI France Telecom R&D, LLC
Brian DiDonnaInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Andrew FitzgibbonDepartment of Engineering Science Microsoft Research
Harald GrossauerDepartment of Computer Science Leopold-Franzens Universität Innsbruck
Changfeng GuiDepartment of Mathematics University of Connecticut
Jooyoung HahnDivision of Applied Mathematics Korea Advanced Institute of Science and Technology (KAIST)
Gloria Haro OrtegaInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Sheryl HemkinDepartment of Chemistry Kenyon College
Xiang HuangDepartment of Mathematics University of Connecticut
Pierre Jasmin RE:Vision Effects, Inc.
Sookyung JooInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Laurent JoyeuxInstitute for Information Systems and Information Management Joanneum Research
Sung Ha KangDepartment of Mathematics University of Kentucky
Gisela KletteDepartment of Computer Science University of Auckland
Reinhard KletteDepartment of Computer Science University of Auckland
Anil KokaramDepartment of Electrical and Electronic Engineering Trinity College
Shin Kurokawa Maximum Output Designs, Inc.
Matthias KurzkeInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Song-Hwa KwonInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Louis Laborelli Institut National de l'Audiovisuel
Chang-Ock LeeDepartment of Mathematical Sciences Korea Advanced Institute of Science and Technology (KAIST)
Nam-Yong LeeSchool of Computer Aided Science Inje University
Stacey LevineDepartment of Mathematics and Computer Science Duquesne University
Debra LewisInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Hstau LiaoInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Peter Litwinowicz RE:Vision Effects, Inc.
Bradley LucierDepartment of Mathematics Purdue University
Lucia MaddalenaInstitute for High-Performance Computing and Networking (ICAR) Consiglio Nazionale delle Ricerche (CNR)
Alison MalcolmInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Kevin ManbeckDepartment of Science and Technology MTI Film, LLC
John MateerDepartment of Electronics University of York
Philip McLauchlan Imagineer Systems Limited
Mila NikolovaCentre de Mathematiques et leurs Applications(CMLA) École Normale Supérieure de Cachan
Peter OlverSchool of Mathematics University of Minnesota, Twin Cities
Alvaro PardoThe Institute of Electrical Engineering University of the Republic
Gregory RandallInstituto de Ingenieria Electrica University of the Republic
Walter RichardsonDepartment of Mathematical Sciences University of Texas
Alessandro RizziDipartimento di Informatica e Comunicazione Università di Milano
Daniel Rosen Warner Bros.
Fadil SantosaSchool of Mathematics University of Minnesota, Twin Cities
Guillermo SapiroDepartment of Electrical and Computer Engineering University of Minnesota, Twin Cities
Arnd ScheelInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Jin SeoDepartment of Mathematics, Computational Science and Engineering Yonsei University
Tatiana SoleskiInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Rashmi Sundareswara University of Minnesota, Twin Cities
Vladimir SverakSchool of Mathematics University of Minnesota, Twin Cities
Richard SzeliskiVision Technology Group Microsoft Research
Carl ToewsInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Eugene Vendrovsky Rhythm & Hues Studios, Inc.
Jingyue WangDepartment of Mathematics Purdue University
Xiaoqiang WangInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Martin WelkMathematical Image Analysis Group Universität des Saarlandes
Michael WermanInstitute of Computer Science Hebrew University
Lance Williams Applied Minds, Inc.
Todd WittmanSchool of Mathematics University of Minnesota, Twin Cities
Ofer ZeitouniSchool of Mathematics University of Minnesota, Twin Cities
Andrew ZissermanDepartment of Engineering Science University of Oxford

Go