Generalized Image Acquisition and Analysis

Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays

Two major obstacles to the use of consumer camcorders in computer vision applications are the lack of synchronization hardware, and the use of a "rolling" shutter, which introduces a temporal shear in the video volume. We present two simple approaches for solving both the rolling shutter shear and the synchronization problem at the same time. The first approach is based on strobe illumination, while the second employs a subframe warp along optical flow vectors. In our experiments we have used the proposed methods to effectively remove temporal shear, and synchronize up to 16 consumer-grade camcorders in multiple geometric configurations.


A Theory of Plenoptic Multiplexing

Ivo Ihrke, Gordon Wetzstein, Wolfgang Heidrich
In: Proceedings of CVPR 2010 (oral).


Multiplexing is a common technique for encoding highdimensional image data into a single, two-dimensional image. Examples of spatial multiplexing include Bayer patterns to capture color channels, and integral images to encode light fields. In the Fourier domain, optical heterodyning has been used to acquire light fields. In this paper, we develop a general theory of multiplexing the dimensions of the plenoptic function onto an image sensor. Our theory enables a principled comparison of plenoptic multiplexing schemes, including noise analysis, as well as the development of a generic reconstruction algorithm. The framework also aides in the identification and optimization of novel multiplexed imaging applications.
Project Page


title={{A theory of plenoptic multiplexing}},
author={Ihrke, I. and Wetzstein, G. and Heidrich, W.},
Go to project list