Generalized Image Acquisition and Analysis

A Kaleidoscopic Approach to Surround Geometry and Reflectance Acquisition

We describe a system for acquiring reflectance fields of objects without moving parts and without a massively parallel hardware setup. Our system consists of a set of planar mirrors which serve to multiply a single camera and a single projector into a multitude of virtual counterparts. Using this arrangement, we can acquire reflectance fields with an average angular sampling rate of about 120+ view/light pairs per surface point. The mirror system allows for freely programmable illumination with full directional coverage. We employ this setup to realize a 3D acquisition system that employs structured illumination to capture the unknown object geometry, in addition to dense reflectance sampling. On the software side, we combine state-of-the-art 3D reconstruction algorithms with a reflectance sharing technique based on non-negative matrix factorization in order to reconstruct a joint model of geometry and reflectance. We demonstrate for a number of test scenes that the kaleidoscopic approach can acquire complex reflectance properties faithfully. The main limitation is that the multiplexing approach limits the attainable spatial resolution, trading it off for improved directional coverage.

Projects

Eikonal Rendering: Efficient Light Transport in Refractive Objects

Ivo Ihrke, Gernot Ziegler, Art Tevs, Christian Theobalt, Marcus Magnor, Hans-Peter Seidel
In: Proceedings of SIGGRAPH 2007.



Abstract

We present a new method for real-time rendering of sophisticated lighting effects in and around refractive objects. It enables us to realistically display refractive objects with complex material properties, such as arbitrarily varying refraction index, inhomogeneous attenuation, as well as spatially-varying anisotropic scattering and reflectance properties. User-controlled changes of lighting positions only require a few seconds of update time. Our method is based on a set of ordinary differential equations derived from the eikonal equation, the main postulate of geometric optics. This set of equations allows for fast casting of bent light rays with the complexity of a particle tracer. Based on this concept, we also propose an efficient light propagation technique using adaptive wavefront tracing. Efficient GPU implementations for our algorithmic concepts enable us to render visual effects that were previously not reproducible in this combination in real-time.
Project Page Video

Bibtex

@article{Ihrke:2007:ERE,
author = "I.~Ihrke and G.~Ziegler and A.~Tevs and C.~Theobalt and M.~Magnor and H.-P.~Seidel",
title = "Eikonal Rendering: Efficient Light Transport in Refractive Objects",
journal = "ACM Trans. on Graphics (Siggraph'07)",
year = "2007",
month = aug,
pages="to appear"
}
Go to project list