Generalized Image Acquisition and Analysis

A Reconfigurable Camera Add-On for High Dynamic Range, Multispectral, Polarization, and Light-Field Imaging

We propose a non-permanent add-on that enables plenoptic imaging with standard cameras which we refer to as KaleidoCamera. Our design is based on a physical copying mechanism that multiplies a sensor image into a number of identical copies that still carry the plenoptic information of interest. Via different optical filters, we can then recover the desired information. A minor modification of the design also allows for aperture subsampling and, hence, light-field imaging. As the filters in our design are exchangeable, a reconfiguration for different imaging purposes is possible. We show in a prototype setup that high dynamic range, multispectral, polarization, and light-field imaging can be achieved with our design.


On Plenoptic Multiplexing and Reconstruction

Gordon Wetzstein, Ivo Ihrke, Wolfgang Heidrich
In: International Journal of Computer Vision (IJCV).


Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.
Project Page


title={{On Plenoptic Multiplexing and Reconstruction}},
author={Gordon Wetzstein and Ivo Ihrke and Wolfgang Heidrich},
volume = 101,
number = 2,
year = {2013},
pages = {384--400},
Go to project list