Rendering for an Interactive 360º Light Field Display

Two simultaneously photographed stereo pairs of a 3D object shown within the 360º field of view around the display. The images are left-right reversed for cross-fused stereo viewing.

Andrew Jones     Ian McDowall*     Hideshi Yamada**     Mark Bolas***     Paul Debevec

USC Institute for Creative Technologies
*Fakespace Labs, Inc.
**Sony Corporation
***USC School of Cinematic Arts

SIGGRAPH 2007 Papers Proceedings
SIGGRAPH 2007 Emerging Technologies

ABSTRACT

We describe a set of rendering techniques for an autostereoscopic light field display able to present interactive 3D graphics to multiple simultaneous viewers 360 degrees around the display. The display consists of a high-speed video projector, a spinning mirror covered by a holographic diffuser, and FPGA circuitry to decode specially rendered DVI video signals. The display uses a standard programmable graphics card to render over 5,000 images per second of interactive 3D graphics, projecting 360-degree views with 1.25 degree separation up to 20 updates per second. We describe the system's projection geometry and its calibration process, and we present a multiple-center-of-projection rendering technique for creating perspective-correct images from arbitrary viewpoints around the display. Our projection technique allows correct vertical perspective and parallax to be rendered for any height and distance when these parameters are known, and we demonstrate this effect with interactive raster graphics using a tracking system to measure the viewer's height and distance. We further apply our projection technique to the display of photographed light fields with accurate horizontal and vertical parallax. We conclude with a discussion of the display's visual accommodation performance and discuss techniques for displaying color imagery.

PUBLICATIONS

SIGGRAPH 2007 Paper: Preprint, PDF 1.9MB. (Adobe Acrobat)
SIGGRAPH 2007 Video: 3Ddisplay.mov, 86.6MB, (Quicktime h264)

The display will be shown as part of the SIGGRAPH 2007 Emerging Technologies exhibition.