Abstract
Devices and systems for measuring real-world shape, motion, and appearance have contributed to progress in computer graphics over the last 15 years. For example, digital photography and image-based rendering have had a profound impact on rendering. Motion capture has transformed computer animation. Geometry acquisition using 3D scanners has driven developments in geometry processing. However, these techniques typically operate in a laboratory setting and are used by a relatively small number of experts. In my talk, I will argue that the future of computer graphics lies in novel input/output devices with embedded computation. These devices should operate in real, unconstrained environments, allowing computer graphics techniques to go beyond the lab and to reach a larger population.

First, I will describe a wearable system that can continuously capture human motion outside of a studio. Second, I will discuss three-dimensional TV: a complete system that allows for scalable real-time acquisition, transmission, and 3-D display of dynamic scenes. Finally, I will describe mathematical modeling of light reflection from surfaces, based on measurements of physical materials, as well as the reverse process: manufacturing physical materials with desired reflectance properties. Not only do these research projects showcase how computer graphics can be brought into the wild, but they also prompt fundamental research into the representation and processing of data types that go beyond images and video.