Generalized Image Acquisition and Analysis

On Plenoptic Multiplexing and Reconstruction

Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.

Projects

Three-Dimensional Kaleidoscopic Imaging

Ilya Reshetouski, Alkhazur Manakov, Hans-Peter Seidel, Ivo Ihrke
In: Proceedings of CVPR 2011 (oral).



Abstract

Three-dimensional kaleidoscopic imaging, a promising alternative for recording multi-view imagery. The main limitation of multi-view reconstruction techniques is the limited number of views that are available from multi-camera systems, especially for dynamic scenes. Our new system is based on imaging an object inside a kaleidoscopic mirror system. We show that this approach can generate a large number of high-quality views well distributed over the hemisphere surrounding the object in a single shot. In comparison to existing multi-view systems, our method offers a number of advantages: it is possible to operate with a single camera, the individual views are perfectly synchronized, and they have the same radiometric and colorimetric properties. We describe the setup both theoretically, and provide methods for a practical implementation. Enabling interfacing to standard multi-view algorithms for further processing is an important goal of our techniques.
Project Page Slides

Bibtex

@inproceedings{Reshetouski11:TKI,
author = {Ilya Reshetouski and Alkhazur Manakov and Hans-Peter Seidel and Ivo Ihrke},
title = {Three-Dimensional Kaleidoscopic Imaging},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = 2011,
pages = {353--360},
}
Go to project list