Generalized Image Acquisition and Analysis

Animation Cartography - Intrinsic Reconstruction of Shape and Motion

In this paper, we consider the problem of animation reconstruction, i.e., the reconstruction of shape and motion of a deformable object from dynamic 3D scanner data, without using user provided template models. Unlike pre- vious work that addressed this problem, we do not rely on locally conver- gent optimization but present a system that can handle fast motion, tem- porally disrupted input, and can correctly match objects that disappear for extended time periods in acquisition holes due to occlusion. Our approach is motivated by cartography: We first estimate a few landmark correspon- dences, which are extended to a dense matching and then used to recon- struct geometry and motion. We propose a number of algorithmic building blocks: a scheme for tracking landmarks in temporally coherent and inco- herent data, an algorithm for robust estimation of dense correspondences under topological noise, and the integration of local matching techniques to refine the result. We describe and evaluate the individual components and propose a complete animation reconstruction pipeline based on these ideas. We evaluate our method on a number of standard benchmark data sets and show that we can obtain correct reconstructions in situations where other techniques fail completely or require additional user guidance such as a template model.

Projects

A Reconfigurable Camera Add-On for High Dynamic Range, Multispectral, Polarization, and Light-Field Imaging

Alkhazur Manakov, Oliver Klehm, Elmar Eisemann, Hans-Peter Seidel, Ivo Ihrke
SIGGRAPH 2013



Abstract

We propose a non-permanent add-on that enables plenoptic imaging with standard cameras which we refer to as KaleidoCamera. Our design is based on a physical copying mechanism that multiplies a sensor image into a number of identical copies that still carry the plenoptic information of interest. Via different optical filters, we can then recover the desired information. A minor modification of the design also allows for aperture subsampling and, hence, light-field imaging. As the filters in our design are exchangeable, a reconfiguration for different imaging purposes is possible. We show in a prototype setup that high dynamic range, multispectral, polarization, and light-field imaging can be achieved with our design.
Project Page Video Data Set

Bibtex

@article{Manakov:13,
author = {Alkhazur Manakov and John Restrepo and Oliver Klehm and Ramon Hegeds and Elmar Eisemann and Hans-Peter Seidel and Ivo Ihrke},
title = {A Reconfigurable Camera Add-On for High Dynamic Range, Multispectral, Polarization, and Light-Field Imaging},
journal = {ACM Trans. on Graphics (SIGGRAPH'13)},
volume = 32, number = 4, year = 2013,
pages = {xx--yy},
}
Go to project list