State of the Art in Computational Plenoptic Imaging
The plenoptic function is a ray-based model for light that includes the color spectrum as well as spatial,
temporal, and directional variation. Although digital light sensors have greatly evolved in the last years,
one fundamental limitation remains: all standard CCD and CMOS sensors integrate over the dimensions of the
plenoptic function as they convert photons into electrons; in the process, all visual information is irreversibly
lost, except for a two-dimensional, spatially-varying subset - the common photograph. In this state of the
art report, we review approaches that optically encode the dimensions of the plenpotic function transcending
those captured by traditional photography and reconstruct the recorded information computationally.
Projects
Derek Bradley, Bradley Atcheson, Ivo Ihrke, Wolfgang Heidrich
In: Proceedings of PROCAMS 2009 (2nd best paper).
Go to project listIn: Proceedings of PROCAMS 2009 (2nd best paper).
Abstract
Two major obstacles to the use of consumer camcorders in computer vision applications are the lack of synchronization hardware, and the use of a "rolling" shutter, which introduces a temporal shear in the video volume. We present two simple approaches for solving both the rolling shutter shear and the synchronization problem at the same time. The first approach is based on strobe illumination, while the second employs a subframe warp along optical flow vectors. In our experiments we have used the proposed methods to effectively remove temporal shear, and synchronize up to 16 consumer-grade camcorders in multiple geometric configurations.
Project Page Bibtex
@INPROCEEDINGS{Bradley:2009,
author = {Derek Bradley and Bradley Atcheson and Ivo Ihrke and Wolfgang Heidrich},
title = {Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays},
journal = {International Workshop on Projector-Camera Systems (PROCAMS 2009)},
year = {2009},
}
author = {Derek Bradley and Bradley Atcheson and Ivo Ihrke and Wolfgang Heidrich},
title = {Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays},
journal = {International Workshop on Projector-Camera Systems (PROCAMS 2009)},
year = {2009},
}