We enjoy movies on a daily basis, but are rarely aware of the image processing involved in creating and editing a film. Examples of frequent operations are format conversion, compression, scratch and blotch removal, introducing special effects, motion estimation, camera calibration, segmentation and super-resolution. These techniques are so important that, today, virtually every movie undergoes some digital image processing. Still, some of the fundamental problems remain unsolved, often involving very time-consuming manual labor. The quality standards are also very different -- often far stricter -- than those in most common applications of image processing. This brings significant mathematical and engineering challenges. The goal of this workshop is to have a uniquely interactive setting in which engineers, mathematicians, and artists implicated in film editing, restoration and "post-processing" are assembeled in order to inform and instruct each other as well as discuss possible solutions and directions of research. The workshop will start with a number of tutorials by leaders in the area (from industry and academia) and will be followed by interleaved talks in the interdisciplinary aspects of movie editing and restoration.
| Schedule |
| Monday, February 6
|
| 8:15a-9:00a |
Registration and coffee |
|
EE/CS 3-176 |
| 9:00a-9:10a |
Welcome to the IMA |
Douglas N. Arnold (University of Minnesota Twin Cities) |
EE/CS 3-180 |
| 9:10a-9:20a |
Opening Remarks |
Guillermo R. Sapiro (University of Minnesota Twin Cities), Lance J. Williams (Applied Minds, Inc.), Andrew Zisserman (University of Oxford) |
EE/CS 3-180 |
| 9:20a-10:20a |
The grammar of storytelling on film survives technology
|
Jay Cassidy (MTI Film, LLC) |
EE/CS 3-180 |
| 10:20a-10:45a |
coffee |
|
EE/CS 3-176 |
| 10:45a-11:45a |
Pushing pixels: From restoration to postproduction
|
Anil Kokaram (Trinity College) |
EE/CS 3-180 |
| 11:45a-1:30p |
lunch |
|
|
| 1:30p-2:30p |
The evolution of film editing technique and its implications to the
parsing and summarization of motion pictures
|
John W. Mateer (University of York) |
EE/CS 3-180 |
| 2:30p-3:00p |
Second Chances
|
|
EE/CS 3-180 |
| 3:10p-3:15p |
Group photos |
|
|
| 3:15p-4:30p |
Poster Session/Reception Lind Hall 400
|
| Tuesday, February 7
|
| 8:45a-9:00a |
coffee |
|
EE/CS 3-176 |
| 9:00a-10:00a |
3D models from image sequences
|
Andrew Fitzgibbon (Microsoft Research) |
EE/CS 3-180 |
| 10:00a-10:30a |
coffee |
|
EE/CS 3-176 |
| 10:30a-11:30a |
Computer vision success stories in visual media production : Camera
tracking and motion capture
|
David Capel (2d3 Limited) |
EE/CS 3-180 |
| 11:30a-1:30p |
lunch |
|
|
| 1:30p-2:30p |
Video-based rendering
|
Richard Szeliski (Microsoft Research) |
EE/CS 3-180 |
| 2:30p-3:00p |
Second Chances
|
|
EE/CS 3-180 |
| Wednesday, February 8
|
| 8:45a-9:00a |
coffee |
|
EE/CS 3-176 |
| 9:00a-10:00a |
Image and video inpainting
|
Guillermo R. Sapiro (University of Minnesota Twin Cities) |
EE/CS 3-180 |
| 10:00a-10:30a |
coffee |
|
EE/CS 3-176 |
| 10:30a-11:30a |
"But you said it was 99% accurate! Why is there a defect in the first frame?"
Gentle techniques for using mathematics in motion picture processes to marry film and digital
|
Daniel Rosen (Warner Bros.) |
EE/CS 3-180 |
| 11:30a-1:30p |
lunch |
|
|
| 1:30p-2:30p |
Techniques and rationale for motion picture restoration
|
Kevin Manbeck (MTI Film, LLC) |
EE/CS 3-180 |
| 2:30p-3:00p |
Restoration revisited |
Jay Cassidy (MTI Film, LLC) |
EE/CS 3-180 |
| 3:00p-3:30p |
Second Chances |
|
EE/CS 3-180 |
| 3:45p-5:00p |
Poster Session |
|
Lind Hall 400 |
| 7:00p-8:00p |
Math Matters: IMA Public Lecture - Artful mathematics
|
Daniel Rockmore (Dartmouth College) |
Willey Hall 125 |
| Thursday, February 9
|
| 8:45a-9:00a |
coffee |
|
EE/CS 3-176 |
| 9:00a-10:00a |
Retrieving video of people and places
|
Andrew Zisserman (University of Oxford) |
EE/CS 3-180 |
| 10:00a-10:30a |
coffee |
|
EE/CS 3-176 |
| 10:30a-11:30a |
Tracking planes in images: Applications in post-production
|
Philip McLauchlan (Imagineer Systems Limited) |
EE/CS 3-180 |
| 11:30a-1:30p |
lunch |
|
|
| 12:00p-1:00p |
Mathematics: Maker and muse for modern art
|
Daniel Rockmore (Dartmouth College) |
Weisman Art Museum |
| 1:30p-2:30p |
Computer vision in movie production: problems and expectations
|
Eugene Vendrovsky (Rhythm & Hues Studios, Inc.) |
EE/CS 3-180 |
| 2:45p-3:15p |
Disney human face project |
Lance J. Williams (Applied Minds, Inc.) |
EE/CS 3-180 |
| 3:15p-4:30p |
Challenging shots: Demo your problem and discuss it with us
|
Pierre Jasmin (RE:Vision Effects, Inc.) |
EE/CS 3-180 |
| 6:00p-7:30p |
workshop dinner |
|
Gardens of Salonica |
| Friday, February 10
|
| 8:45a-9:00a |
coffee |
|
EE/CS 3-176 |
| 9:00a-10:00a |
Movie restoration methods
|
Toni Buades (University of the Balearic Islands (Illes Balears)) |
EE/CS 3-180 |
| 10:00a-10:30a |
coffee |
|
EE/CS 3-176 |
| 10:30a-11:30a |
Denoising archival films using a field-of-experts model of
film grain and natural image statistics
|
Michael Black (Brown University) |
EE/CS 3-180 |
| 11:30a-12:00p |
Second Chances |
|
EE/CS 3-180 |
| Name |
Department |
Affiliation |
| Iman Aganj |
Department of Electrical and Computer Engineering |
University of Minnesota Twin Cities |
| Andres Almansa |
Centro de Calculo |
Facultad de Ingeniería |
| Jung-Ha An |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Pablo Arias |
Instituto de Ingeneria Electrica |
University of the Republic |
| Douglas N. Arnold |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Donald G. Aronson |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Evgeniy Bart |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Sebastiano Battiato |
Mathematics and Informatics |
Università di Catania |
| Marcelo Jose Bertalmio |
Departament de Tecnologia |
Universitat Pompeu Fabra |
| Bernard Besserer |
L3i : Laboratoire Informatique, Image, Interaction |
Université de La Rochelle |
| Michael Black |
Department of Computer Science |
Brown University |
| Francisco Blanco-Silva |
Department of Mathematics |
Purdue University |
| Toni Buades |
Departament de Matematiques I Informatica |
University of the Balearic Islands (Illes Balears) |
| David Capel |
|
2d3 Limited |
| Jay Cassidy |
Department of Science and Technology |
MTI Film, LLC |
| Qianyong Chen |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Barry Cipra |
|
NONE |
| Steven Benjamin Damelin |
Department of Mathematics |
Georgia Southern University |
| Julie Delon |
LTCI |
France Telecom R&D, LLC |
| Brian DiDonna |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Andrew Fitzgibbon |
|
Microsoft Research |
| Harald Grossauer |
Department of Computer Science |
Leopold-Franzens Universität Innsbruck |
| Changfeng Gui |
Department of Mathematics |
University of Connecticut |
| Jooyoung Hahn |
Division of Applied Mathematics |
Korea Advanced Institute of Science and Technology (KAIST) |
| Gloria Haro Ortega |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Sheryl Hemkin |
Department of Chemistry |
Kenyon College |
| Xiang Huang |
Department of Mathematics |
University of Connecticut |
| Pierre Jasmin |
|
RE:Vision Effects, Inc. |
| Sookyung Joo |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Laurent Joyeux |
Institute for Information Systems and Information Management |
Joanneum Research |
| Sung Ha Kang |
Department of Mathematics |
University of Kentucky |
| Gisela Klette |
Department of Computer Science |
University of Auckland |
| Reinhard Klette |
Department of Computer Science |
University of Auckland |
| Anil Kokaram |
Department of Electronic and Electrical Engineering |
Trinity College |
| Shin Kurokawa |
|
Maximum Output Designs, Inc. |
| Matthias Kurzke |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Song-Hwa Kwon |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Louis Laborelli |
|
Institut de l'Audiovisuel |
| Chang-Ock Lee |
Division of Applied Mathematics |
Korea Advanced Institute of Science and Technology (KAIST) |
| Nam-Yong Lee |
School of Computer Aided Science |
Inje University |
| Stacey E. Levine |
Department of Mathematics and Computer Science |
Duquesne University |
| Debra Lewis |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Hstau Liao |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Peter Litwinowicz |
|
RE:Vision Effects, Inc. |
| Bradley J. Lucier |
Department of Mathematics |
Purdue University |
| Lucia Maddalena |
Institute for High-Performance Computing and Networking (ICAR) |
Consiglio Nazionale delle Ricerche (CNR) |
| Alison Malcolm |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Kevin Manbeck |
Department of Science and Technology |
MTI Film, LLC |
| John W. Mateer |
Department of Electronics |
University of York |
| Philip McLauchlan |
|
Imagineer Systems Limited |
| Mila Nikolova |
Centre de Mathematiques et leurs Applications(CMLA) |
École Normale Supérieure de Cachan |
| Peter J. Olver |
School of Mathematics |
University of Minnesota Twin Cities |
| Alvaro Pardo |
Department of Electrical Engineering |
Instituto de Ingenieria Electrica |
| Gregory J. Randall |
Instituto de Ingenieria Electrica |
University of the Republic |
| Walter Richardson Jr. |
Department of Mathematical Sciences |
University of Texas |
| Alessandro Rizzi |
Dipartimento di Tecnologie dell'Informazione |
Università di Milano |
| Daniel Rosen |
|
Warner Bros. |
| Fadil Santosa |
School of Mathematics |
University of Minnesota Twin Cities |
| Guillermo R. Sapiro |
Department of Electrical and Computer Engineering |
University of Minnesota Twin Cities |
| Arnd Scheel |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Jin Keun Seo |
Department of Mathematics |
Yonsei University |
| Tatiana Soleski |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Rashmi Sundareswara |
|
University of Minnesota Twin Cities |
| Vladimir Sverak |
School of Mathematics |
University of Minnesota Twin Cities |
| Richard Szeliski |
Vision Technology Group |
Microsoft Research |
| Carl Toews |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Eugene Vendrovsky |
|
Rhythm & Hues Studios, Inc. |
| Jingyue Wang |
Department of Mathematics |
Purdue University |
| Xiaoqiang Wang |
Institute for Mathematics and its Applications |
University of Minnesota Twin Cities |
| Martin Welk |
Mathematical Image Analysis Group |
Universität des Saarlandes |
| Michael Werman |
Institute of Computer Science |
Hebrew University |
| Lance J. Williams |
|
Applied Minds, Inc. |
| Todd Wittman |
School of Mathematics |
University of Minnesota Twin Cities |
| Ofer Zeitouni |
School of Mathematics |
University of Minnesota Twin Cities |
| Andrew Zisserman |
Department of Engineering Science |
University of Oxford |