Generalized Image Acquisition and Analysis

On Plenoptic Multiplexing and Reconstruction

Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.


Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor

Oliver Klehm, Ivo Ihrke, Hans-Peter Seidel, Elmar Eisemann
TVCG 2014


Although volumetric phenomena are important for realistic rendering and can even be a crucial component in the image, the artistic control of the volume’s appearance is challenging. Appropriate tools to edit volume properties are missing, which can make it necessary to use simulation results directly. Alternatively, high-level modifications that are rarely intuitive, e.g., the tweaking of noise function parameters, can be utilized. Our work introduces a solution to stylize single-scattering volumetric effects in static volumes. Hereby, an artistic and intuitive control of emission, scattering and extinction becomes possible, while ensuring a smooth and coherent appearance when changing the viewpoint. Our method is based on tomographic reconstruction, which we link to the volumetric rendering equation. It analyzes a number of target views provided by the artist and adapts the volume properties to match the appearance for the given perspectives. Additionally, we describe how we can optimize for the environmental lighting to match a desired scene appearance, while keeping volume properties constant. Finally, both techniques can be combined. We demonstrate several use cases of our approach and illustrate its effectiveness.


author = {Oliver Klehm and Ivo Ihrke and Hans-Peter Seidel and Elmar Eisemann},
title = {Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor},
journal = {Transactions of Visualization and Computer Graphics},
year = 2014,
pages = {xx--yy},
Go to project list