Generalized Image Acquisition and Analysis
State of the Art in Computational Plenoptic Imaging
The plenoptic function is a ray-based model for light that includes the color spectrum as well as spatial,
temporal, and directional variation. Although digital light sensors have greatly evolved in the last years,
one fundamental limitation remains: all standard CCD and CMOS sensors integrate over the dimensions of the
plenoptic function as they convert photons into electrons; in the process, all visual information is irreversibly
lost, except for a two-dimensional, spatially-varying subset - the common photograph. In this state of the
art report, we review approaches that optically encode the dimensions of the plenpotic function transcending
those captured by traditional photography and reconstruct the recorded information computationally.
Projects
On Plenoptic Multiplexing and Reconstruction
In: International Journal of Computer Vision (IJCV).
Abstract
Photography has been striving to capture an ever increasing
amount of visual information in a single image. Digital
sensors, however, are limited to recording a small subset of
the desired information at each pixel. A common approach to
overcoming the limitations of sensing hardware is the optical
multiplexing of high-dimensional data into a photograph. While
this is a well-studied topic for imaging with color filter
arrays, we develop a mathematical framework that generalizes
multiplexed imaging to all dimensions of the plenoptic
function. This framework unifies a wide variety of existing
approaches to analyze and reconstruct multiplexed data in
either the spatial or the frequency domain. We demonstrate
many practical applications of our framework including
high-quality light field reconstruction, the first comparative
noise analysis of light field attenuation masks, and an
analysis of aliasing in multiplexing applications.
Project Page Bibtex
@article{Wetzstein:PlenopticMultiplexing:2012,
title={{On Plenoptic Multiplexing and Reconstruction}},
author={Gordon Wetzstein and Ivo Ihrke and Wolfgang Heidrich},
year={2013},
volume = 101,
number = 2,
year = {2013},
pages = {384--400},
}
title={{On Plenoptic Multiplexing and Reconstruction}},
author={Gordon Wetzstein and Ivo Ihrke and Wolfgang Heidrich},
year={2013},
volume = 101,
number = 2,
year = {2013},
pages = {384--400},
}