Generalized Image Acquisition and Analysis

State of the Art in Computational Plenoptic Imaging

The plenoptic function is a ray-based model for light that includes the color spectrum as well as spatial, temporal, and directional variation. Although digital light sensors have greatly evolved in the last years, one fundamental limitation remains: all standard CCD and CMOS sensors integrate over the dimensions of the plenoptic function as they convert photons into electrons; in the process, all visual information is irreversibly lost, except for a two-dimensional, spatially-varying subset - the common photograph. In this state of the art report, we review approaches that optically encode the dimensions of the plenpotic function transcending those captured by traditional photography and reconstruct the recorded information computationally.

Projects

On Plenoptic Multiplexing and Reconstruction

Gordon Wetzstein, Ivo Ihrke, Wolfgang Heidrich
In: International Journal of Computer Vision (IJCV).



Abstract

Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.
Project Page

Bibtex

@article{Wetzstein:PlenopticMultiplexing:2012,
title={{On Plenoptic Multiplexing and Reconstruction}},
author={Gordon Wetzstein and Ivo Ihrke and Wolfgang Heidrich},
year={2013},
volume = 101,
number = 2,
year = {2013},
pages = {384--400},
}
Go to project list




Imprint-Dataprotection