Generalized Image Acquisition and Analysis

On Plenoptic Multiplexing and Reconstruction

Photography has been striving to capture an ever increasing amount of visual information in a single image. Digital sensors, however, are limited to recording a small subset of the desired information at each pixel. A common approach to overcoming the limitations of sensing hardware is the optical multiplexing of high-dimensional data into a photograph. While this is a well-studied topic for imaging with color filter arrays, we develop a mathematical framework that generalizes multiplexed imaging to all dimensions of the plenoptic function. This framework unifies a wide variety of existing approaches to analyze and reconstruct multiplexed data in either the spatial or the frequency domain. We demonstrate many practical applications of our framework including high-quality light field reconstruction, the first comparative noise analysis of light field attenuation masks, and an analysis of aliasing in multiplexing applications.

Projects

From Capture to Simulation - Connecting Forward and Inverse Problems in Fluids

James Gregson, Ivo Ihrke, Nils Thuerey, Wolfgang Heidrich
SIGGRAPH 2014



Abstract

We explore the connection between fluid capture, simulation and proximal methods, a class of algorithms commonly used for inverse problems in image processing and computer vision. Our key finding is that the proximal operator constraining fluid velocities to be divergence-free is directly equivalent to the pressure-projection methods commonly used in incompressible flow solvers. This observation lets us treat the inverse problem of fluid tracking as a constrained flow problem all while working in an efficient, modular framework. In addition it lets us tightly couple fluid simulation into flow tracking, providing a global prior that significantly increases tracking accuracy and temporal coherence as compared to previous techniques. We demonstrate how we can use these improved results for a variety of applications, such as re-simulation, detail enhancement, and domain modification. We furthermore give an outlook of the applications beyond fluid tracking that our proximal operator framework could enable by exploring the connection of deblurring and fluid guiding.
Project Page Video

Bibtex

@article{Gregson:14,
author = {James Gregson and Ivo Ihrke and Nils Thuerey and Wolfgang Heidrich},
title = {From Capture to Simulation - Connecting Forward and Inverse Problems in Fluids},
journal = {ACM Trans. on Graphics (SIGGRAPH'14)},
volume = 33, number = 4, year = 2014,
pages = {xx--yy},
}
Go to project list




Imprint-Dataprotection