Generalized Image Acquisition and Analysis

A Kaleidoscopic Approach to Surround Geometry and Reflectance Acquisition

We describe a system for acquiring reflectance fields of objects without moving parts and without a massively parallel hardware setup. Our system consists of a set of planar mirrors which serve to multiply a single camera and a single projector into a multitude of virtual counterparts. Using this arrangement, we can acquire reflectance fields with an average angular sampling rate of about 120+ view/light pairs per surface point. The mirror system allows for freely programmable illumination with full directional coverage. We employ this setup to realize a 3D acquisition system that employs structured illumination to capture the unknown object geometry, in addition to dense reflectance sampling. On the software side, we combine state-of-the-art 3D reconstruction algorithms with a reflectance sharing technique based on non-negative matrix factorization in order to reconstruct a joint model of geometry and reflectance. We demonstrate for a number of test scenes that the kaleidoscopic approach can acquire complex reflectance properties faithfully. The main limitation is that the multiplexing approach limits the attainable spatial resolution, trading it off for improved directional coverage.

Projects

Performance Capture of High-Speed Motion Using Staggered Multi-View Recording

Di Wu, Yebin Liu, Ivo Ihrke, Qionghai Dai, Christian Theobalt
Pacific Graphics 2012



Abstract

We present a markerless performance capture system that can acquire the motion and the texture of human actors performing fast movements using only commodity hardware. To this end we introduce two novel concepts: First, a staggered surround multi-view recording setup that enables us to perform model-based motion capture on motion-blurred images, and second, a model-based deblurring algorithm which is able to handle disocclusion, self-occlusion and complex object motions. We show that the model-based approach is not only a powerful strategy for tracking but also for deblurring highly complex blur patterns.
Project Page Video

Bibtex

@Article{Wu12,
author = {Di Wu and Yebin Liu and Ivo Ihrke and Qionghai Dai and Christian Theobalt},
title = {Performance Capture of High-Speed Motion Using Staggered Multi-View Recording},
journal = {Computer Graphics Forum},
volume = {31},
number = {7},
year = {2012},
pages = {2019--2028},
publisher = {Blackwell Publishing},
}
Go to project list