- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Communicating the spatiotemporal transformation of architectural heritage via an in-situ projection mapping installation
摘要： Understanding the spatial transformation of architectural heritage over time is crucial for documentation and conservation purposes, but also for communicating the salient architectural features of the buildings’ evolution to the public at large. With the rapid evolution of physical computing technologies such as electronics, sensors and digital projections, we believe that the technique of projection mapping offers great potential in communicating heritage in-situ because its graphical depiction on the heritage itself can more directly relate to the real context in more experiential ways. Furthermore, digital projections can include various interactive functionalities that together with its architectural size provide an immersive experience that is dynamic and adaptable to the interests of the visitors. Consequently, this paper aims to investigate the deployment of an interactive projection mapping installation in-situ which can be steered by a tangible user interface (TUI). Through an in-the-wild study, we deployed a mixed-method evaluation to investigate how such an interactive projection mapping enhances the communication of the spatiotemporal transformation of a medieval chapel that occurred during the last 850 years. Our findings show how the in-situ projection positively affects visitors’ understanding and memorability of the aesthetic features, and how its combination with a tangible interface enhances the communication of the spatial features of the chapel over time, and allows for more social interaction among them. The paper concludes with several discussion points and recommendations for applying interactive projection mapping and TUIs in the context of architectural heritage.
关键词： Spatiotemporal transformation,Tangible user interface (TUI),Heritage communication,Architectural heritage,Projection mapping,In-situ installation
更新于2025-09-23 15:23:52
-
MIDAS projection
摘要： The visual appearance of an object can be disguised by projecting virtual shading as if overwriting the material. However, conventional projection-mapping methods depend on markers on a target or a model of the target shape, which limits the types of targets and the visual quality. In this paper, we focus on the fact that the shading of a virtual material in a virtual scene is mainly characterized by surface normals of the target, and we attempt to realize markerless and modelless projection mapping for material representation. In order to deal with various targets, including static, dynamic, rigid, soft, and fluid objects, without any interference with visible light, we measure surface normals in the infrared region in real time and project material shading with a novel high-speed texturing algorithm in screen space. Our system achieved 500-fps high-speed projection mapping of a uniform material and a tileable-textured material with millisecond-order latency, and it realized dynamic and flexible material representation for unknown objects. We also demonstrated advanced applications and showed the expressive shading performance of our technique.
关键词： material,photometric stereo,projection mapping,infrared
更新于2025-09-23 15:23:52
-
[ACM Press the 16th ACM SIGGRAPH International Conference - Tokyo, Japan (2018.12.02-2018.12.03)] Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry - VRCAI '18 - Projection mapping based on BRDF reconstruction from single RGBD image
摘要： There have been many researches on projection mapping focused on target objects tracking, geometric shape recovering or virtual materials simulating such as clothes. However, few people pay attention to the material of target object which actually influences the visual results of projection. We present a new projection mapping framework based on BRDF reconstruction for the goal of more real projection results by enhancing the effects of Augmented Reality. In the framework, 3D computer vision method is used to reconstruct the BRDF of target object with a single RGBD image. A new algorithm is proposed using two Convolutional Neural Networks(CNN) which can predict both normal map and reflectance map of the target surface simultaneously with the RGBD image. The predicted maps are used to render the content to be projected onto the target object. Our BRDF reconstruction algorithm can recover several materials in one scene correctly in use of just one image. Experimental results show our framework has impressive performance and relatively accurate consequence.
关键词： BRDF Reconstruction,Projection Mapping,Augmented Reality
更新于2025-09-19 17:15:36