Abstract
We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Kautz, J.; Sattler, M.; Sarlette, R.; Klein, R.; Seidel. H.-P. Decoupling BRDFs from surface mesostructures. In: Proceedings of Graphics Interface 2004, 177–182, 2004.
Ritz, M.; Santos, P.; Fellner, D. Automated acquisition and real-time rendering of spatially varying optical material behavior. In: Proceedings of the ACM SIGGRAPH 2018 Posters, Article No. 33, 2018.
Schwartz, C.; Sarlette, R.; Weinmann, M.; Klein, R. Dome II: A parallelized BTF acquisition system. In: Proceedings of the Workshop on Material Appearance Modeling, 2013.
Weinmann, M.; Klein, R. Advances in geometry and reflectance acquisition (course notes). In: Proceedings of the SIGGRAPHAsia 2015 Courses, Article No. 1. 2015.
Cohen, M. F.; Shade, J.; Hiller, S.; Deussen, O. Wang Tiles for image and texture generation. ACM Transactions on Graphics Vol. 22, No. 3, 287–294, 2003.
Ng, T. Y.; Wen, C.; Tan, T. S.; Zhang, X.; Kim, Y. J. Generating an /spl omega/-tile set for texture synthesis. In: Proceedings of the International 2005 Computer Graphics, 177–184, 2005.
Efros, A. A.; Freeman, W. T. Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 341–346, 2001.
Liu, X.; Yu, Y.; Shum, H.-Y. Synthesizing bidirectional texture functions for real-world surfaces. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 97–106, 2001.
Nozick, V.; Ismael, D.; Saito, H. GPU-based photometric reconstruction from screen light. In: Proceedings of the 8th Annual International Conference on Artificial Reality and Telexistence, 242–245, 2008.
Lagae, A.; Dutré, P. An alternative for Wang tiles: Colored edges versus colored corners. ACM Transactions on Graphics Vol. 25, No. 4, 1442–1459, 2006.
Acknowledgements
This work was partially supported by the European project MAXIMUS (No. FP7-ICT-2007-1-217039) and the German Federal Ministry for Economic Affairs and Energy project CultLab3D (No. 01MT12022E).
Author information
Authors and Affiliations
Corresponding author
Additional information
Martin Ritz is deputy head of the Dept. of Cultural Heritage Digitization at Fraunhofer IGD. Next to technical coordination, his research targets acquisition of 3D geometry and optical material behavior, describing light interaction of objects for arbitrary combinations of light and observer directions. He received his bachelor and master of science degrees in informatics in 2006 and 2009 from TU Darmstadt, respectively, as well as his master of science degree in computer science in 2008 from the University of Colorado at Boulder.
Simon Breitfelder completed his bachelor and master degrees in computer science at TU Darmstadt in 2011 and 2018, respectively. He focused on computer graphics topics during his studies and is now working as software engineer at DENIC eG.
Pedro Santos is head of the Dept. of Cultural Heritage Digitization at Fraunhofer IGD. He received his diploma and master degrees from the University of Applied Sciences in Darmstadt. Germany and the Technical University of Lisbon, Portugal, respectively. His research interest is autonomous, color-calibrated 3D mass-digitization.
Arjan Kuijper holds a chair in Mathematical and Applied Visual Computing at TU Darmstadt and is a member of the management of Fraunhofer IGD, responsible for scientific dissemination. He obtained his M.Sc. degree in applied mathematics from Twente University and Ph.D. degree from Utrecht University, both in the Netherlands. He was assistant research professor at the IT University of Copenhagen, Denmark, and senior researcher at RICAM in Linz, Austria. He obtained his habilitation degree from TU Graz, Austria. He is the author of over 300 peer-reviewed publications, associate editor for CVIU, PR, and TVCJ, secretary of the International Association for Pattern Recognition (IAPR) and serves both as reviewer for many journals and conferences, and as program committee member and organizer of conferences. His research interests cover all aspects of mathematics-based methods for computer vision, graphics, imaging, pattern recognition, interaction, and visualization.
Dieter W. Fellner is a professor of computer science at TU Darmstadt, Germany, and director of the Fraunhofer Institute for Computer Graphics Research IGD at the same location since Oct. 2006. He is still affiliated with the Graz University of Technology where he chairs the Institute of Computer Graphics and Knowledge Visualization he founded in 2005. Dieter W. Fellner's research activities over the last years as documented in more than 370 publications covered algorithms and software architectures to integrate modeling and rendering, efficient rendering and visualization algorithms, generative and reconstructive modeling, virtual and augmented reality, graphical aspects of internet-based multimedia information systems and cultural heritage as well as digital libraries. He is a member of EUROGRAPHICS, ACM, IEEE Computer Society, and the Gesellschaft fr Informatik (GI).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
About this article
Cite this article
Ritz, M., Breitfelder, S., Santos, P. et al. Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior. Comp. Visual Media 5, 161–170 (2019). https://doi.org/10.1007/s41095-019-0141-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-019-0141-4