研究目的
To realize markerless and modelless dynamic projection mapping for material representation by measuring surface normals in the infrared region and projecting virtual shading at high speed.
研究成果
The MIDAS-projection system successfully achieves markerless and modelless dynamic projection mapping by measuring surface normals with NIR photometric stereo and projecting virtual shading at high speed. It supports various object types and provides immersive material representation with low latency. Advanced applications like albedo-dependent shading and graphical Midas touch effects demonstrate its expressive capabilities. Future work could address limitations such as viewer tracking and improved optical flow algorithms.
研究不足
The system assumes Lambertian reflectance and cannot handle general textures requiring absolute UV coordinates. The viewing point is fixed, limiting accuracy for multiple viewers. Computational complexity limits dense texture control, and optical flow errors can cause texture drift. Specular reflections or shadows may cause failures in normal measurement.
1：Experimental Design and Method Selection:
The system uses a photometric stereo method with near-infrared light to measure surface normals in real time, combined with a high-speed texturing algorithm for screen-space rendering. It involves wavelength-division photometric stereo for high-speed sensing and a novel algorithm for UV mapping of tileable textures.
2：Sample Selection and Data Sources:
Various objects are used as targets, including rigid bodies (nylon sphere, nylon Stanford bunny), soft bodies (polyester cloth, human hand), and fluids (clay, colloidal solution of TiO2). Data is captured using high-speed cameras.
3：2). Data is captured using high-speed cameras. List of Experimental Equipment and Materials:
3. List of Experimental Equipment and Materials: High-speed cameras (XIMEA, MQ003MG-CM), dichroic mirrors (SIGMA KOKI, special order), NIR LED arrays (OSRAM SFH 4786S, SFH 4715AS, SFH 4725S), hot mirror (SIGMA KOKI, special order), high-speed color projector (inrevium, TB-UK-DYNAFLASH), workstation (CPU: Intel Xeon E5-2687W v4, GPU: nVidia Quadro M5000).
4：0). Experimental Procedures and Operational Workflow:
4. Experimental Procedures and Operational Workflow: The system captures images at 500 fps, calculates surface normals using photometric stereo, renders shading or textures based on normals, and projects the image. Calibration involves manual alignment and homography transformation.
5：Data Analysis Methods:
Performance is evaluated based on latency, throughput, and visual quality. Optical flow algorithms (e.g., Farneback) are used for motion tracking, and regularization techniques are applied to correct UV coordinate distortions.
独家科研数据包，助您复现前沿成果，加速创新突破
获取完整内容-
high-speed camera
MQ003MG-CM
XIMEA
Captures infrared monochrome images at high speed for photometric stereo measurement.
立即获取同款设备 -
dichroic mirror
special order
SIGMA KOKI
Splits near-infrared light into different wavelength groups for wavelength-division photometric stereo.
暂无现货
预约到货通知
-
NIR LED array
SFH 4786S
OSRAM
Provides illumination at specific NIR wavelengths for photometric stereo.
暂无现货
预约到货通知
-
NIR LED array
SFH 4715AS
OSRAM
Provides illumination at specific NIR wavelengths for photometric stereo.
暂无现货
预约到货通知
-
NIR LED array
SFH 4725S
OSRAM
Provides illumination at specific NIR wavelengths for photometric stereo.
暂无现货
预约到货通知
-
hot mirror
special order
SIGMA KOKI
Arranges the projector to be concentric with the cameras, simplifying alignment.
暂无现货
预约到货通知
-
high-speed color projector
TB-UK-DYNAFLASH
inrevium
Projects rendered images at high speed for dynamic projection mapping.
暂无现货
预约到货通知
-
workstation
Processes data and runs algorithms for rendering and projection.
暂无现货
预约到货通知
-
spectrometer
PS-2600
PASCO
Measures reflectance of materials in the NIR region for calibration.
暂无现货
预约到货通知
-
登录查看剩余7件设备及参数对照表
查看全部
