Generalized Image Acquisition and Analysis

Performance Capture of High-Speed Motion Using Staggered Multi-View Recording

We present a markerless performance capture system that can acquire the motion and the texture of human actors performing fast movements using only commodity hardware. To this end we introduce two novel concepts: First, a staggered surround multi-view recording setup that enables us to perform model-based motion capture on motion-blurred images, and second, a model-based deblurring algorithm which is able to handle disocclusion, self-occlusion and complex object motions. We show that the model-based approach is not only a powerful strategy for tracking but also for deblurring highly complex blur patterns.

Three-Dimensional Kaleidoscopic Imaging

Ilya Reshetouski, Alkhazur Manakov, Hans-Peter Seidel, and Ivo Ihrke
CVPR 2011 (oral)
  Abstract

  We introduce three-dimensional kaleidoscopic imaging, a promising alternative for recording multi-view imagery.
  The main limitation of multi-view reconstruction techniques is the limited number of views that are available from multi-camera systems, especially for dynamic scenes.
  Our new system is based on imaging an object inside a kaleidoscopic mirror system. We show that this approach can generate a large number of high-quality views well distributed over the hemisphere surrounding the object in a single shot. In comparison to existing multi-view systems, our method offers a number of advantages: it is possible to operate with a single camera, the individual views are perfectly synchronized, and they have the same radiometric and colorimetric properties.
  We describe the setup both theoretically, and provide methods for a practical implementation. Enabling interfacing to standard multi-view algorithms for further processing is an important goal of our techniques.

  Example of labeling process:

=> => => =>
Source image Silhouette image Chambers extraction Visual hull
estimation
Labeling of views

  Files

Paper [pdf]
Supplemental materials [pdf]
Presentation [ppt]
Labeling data example (with MatLab loader) [zip]
Labeling of the dynamic scene example: Input movie [mpg], Segmentation movie [mpg], Labeling movie [mpg]