Generalized Image Acquisition and Analysis
Performance Capture of High-Speed Motion Using Staggered Multi-View Recording
We present a markerless performance capture system that can acquire the motion and the texture of human actors
performing fast movements using only commodity hardware. To this end we introduce two novel concepts: First, a
staggered surround multi-view recording setup that enables us to perform model-based motion capture on motion-blurred
images, and second, a model-based deblurring algorithm which is able to handle disocclusion, self-occlusion and
complex object motions. We show that the model-based approach is not only a powerful strategy for tracking but also for
deblurring highly complex blur patterns.
Projects
Computational Plenoptic Imaging
Computer Graphics Forum 2011
Abstract
The plenoptic function is a ray-based model for light that includes the color spectrum as well as spatial,
temporal, and directional variation. Although digital light sensors have greatly evolved in the last years,
one fundamental limitation remains: all standard CCD and CMOS sensors integrate over the dimensions of the
plenoptic function as they convert photons into electrons; in the process, all visual information is irreversibly
lost, except for a two-dimensional, spatially-varying subset - the common photograph. In this state of the
art report, we review approaches that optically encode the dimensions of the plenpotic function transcending
those captured by traditional photography and reconstruct the recorded information computationally.
Project Page Slides Bibtex
@Article{Wetzstein11:CPI,
author = {Gordon Wetzstein, Ivo Ihrke, Douglas Lanman, and Wolfgang Heidrich},
title = {Computational Plenoptic Imaging},
journal = {Computer Graphics Forum},
volume = {30},
number = {8},
year = {2011},
pages = {2397--2426},
publisher = {Blackwell Publishing},
}
author = {Gordon Wetzstein, Ivo Ihrke, Douglas Lanman, and Wolfgang Heidrich},
title = {Computational Plenoptic Imaging},
journal = {Computer Graphics Forum},
volume = {30},
number = {8},
year = {2011},
pages = {2397--2426},
publisher = {Blackwell Publishing},
}