Generalized Image Acquisition and Analysis

Performance Capture of High-Speed Motion Using Staggered Multi-View Recording

We present a markerless performance capture system that can acquire the motion and the texture of human actors performing fast movements using only commodity hardware. To this end we introduce two novel concepts: First, a staggered surround multi-view recording setup that enables us to perform model-based motion capture on motion-blurred images, and second, a model-based deblurring algorithm which is able to handle disocclusion, self-occlusion and complex object motions. We show that the model-based approach is not only a powerful strategy for tracking but also for deblurring highly complex blur patterns.


On Plenoptic Multiplexing and Reconstruction

Gordon Wetzstein, Ivo Ihrke, Wolfgang Heidrich
In: International Journal of Computer Vision (IJCV).


Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.
Project Page


title={{On Plenoptic Multiplexing and Reconstruction}},
author={Gordon Wetzstein and Ivo Ihrke and Wolfgang Heidrich},
volume = 101,
number = 2,
year = {2013},
pages = {384--400},
Go to project list