Generalized Image Acquisition and Analysis

A Kaleidoscopic Approach to Surround Geometry and Reflectance Acquisition

We describe a system for acquiring reflectance fields of objects without moving parts and without a massively parallel hardware setup. Our system consists of a set of planar mirrors which serve to multiply a single camera and a single projector into a multitude of virtual counterparts. Using this arrangement, we can acquire reflectance fields with an average angular sampling rate of about 120+ view/light pairs per surface point. The mirror system allows for freely programmable illumination with full directional coverage. We employ this setup to realize a 3D acquisition system that employs structured illumination to capture the unknown object geometry, in addition to dense reflectance sampling. On the software side, we combine state-of-the-art 3D reconstruction algorithms with a reflectance sharing technique based on non-negative matrix factorization in order to reconstruct a joint model of geometry and reflectance. We demonstrate for a number of test scenes that the kaleidoscopic approach can acquire complex reflectance properties faithfully. The main limitation is that the multiplexing approach limits the attainable spatial resolution, trading it off for improved directional coverage.

Projects

Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor

Oliver Klehm, Ivo Ihrke, Hans-Peter Seidel, Elmar Eisemann
TVCG 2014



Abstract

Although volumetric phenomena are important for realistic rendering and can even be a crucial component in the image, the artistic control of the volume’s appearance is challenging. Appropriate tools to edit volume properties are missing, which can make it necessary to use simulation results directly. Alternatively, high-level modifications that are rarely intuitive, e.g., the tweaking of noise function parameters, can be utilized. Our work introduces a solution to stylize single-scattering volumetric effects in static volumes. Hereby, an artistic and intuitive control of emission, scattering and extinction becomes possible, while ensuring a smooth and coherent appearance when changing the viewpoint. Our method is based on tomographic reconstruction, which we link to the volumetric rendering equation. It analyzes a number of target views provided by the artist and adapts the volume properties to match the appearance for the given perspectives. Additionally, we describe how we can optimize for the environmental lighting to match a desired scene appearance, while keeping volume properties constant. Finally, both techniques can be combined. We demonstrate several use cases of our approach and illustrate its effectiveness.
Video

Bibtex

@article{Klehm:14,
author = {Oliver Klehm and Ivo Ihrke and Hans-Peter Seidel and Elmar Eisemann},
title = {Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor},
journal = {Transactions of Visualization and Computer Graphics},
year = 2014,
pages = {xx--yy},
}
Go to project list