Rapid proto-typing of product is important technology that the computer science can contribute. Especially, the evaluation of realistic appearance decides the quality of the product in a final process. As the industrial design application, we have been developing the Appearance-based Display System by using the radiance control of projector and technique of mixed-reality. In this paper, we proposed a novel reproduction system of three-dimensional appearance with glossiness, which is controlled by two or more projection images. R. Raskar et al. proposed 2-pass rendering method to consider the 3D geometry. However, view-dependent shading, such as specular highlights is not considered in this method. Because the shading view is assumed to be the same as rendering view or user's viewpoint, the view-dependent shading could not ensure consistency. Therefore, in this paper, we divide 3D geometry into object shape, virtual light direction (shading direction), user's viewpoint (view-dependent rendering view) and projector position(view-independent rendering view). 3D geometry of the viewpoint and the object can be calibrated by the space encoding method with projector-camera system. According to the geometry calibration, the partial responsibility and compensation of the intensities errors such as occlusions, overlaps and attenuation for each projection is automatically decided. As the result, this system can generate the real appearance of gloss, color and shade on the mock object's surface.
Sayuri Kamimigaki, Shoji Yamamoto, Keita Hirai, Norimichi Tsumura, Toshiya Nakaguchi, Yoichi Miyake, "Real reproducing of 3D appearance with multi-projectors and cameras" in Proc. IS&T 17th Color and Imaging Conf., 2009, pp 164 - 169, https://doi.org/10.2352/CIC.2009.17.1.art00031