研究目的
Investigating the method to distinguish between refracted and Lambertian image features using a light field camera to improve the reliability of robotic vision algorithms in scenes with refractive objects.
研究成果
The proposed method to distinguish refracted features based on a planar fit in 4D and slope consistency demonstrates higher detection and lower failure rates than previous work for LF camera arrays and extends the detection capability to lenslet-based LF cameras. Rejecting refracted features for monocular SfM yields lower reprojection errors and more accurate pose estimates, making it a critical step toward allowing robots to operate in the presence of refractive objects.
研究不足
The method requires background visual texture to be distorted by the refractive object. Its effectiveness depends on the extent to which the appearance of the object is warped in the light field, which in turn depends on the scene geometry and refractive indexes of the object involved.
1:Experimental Design and Method Selection:
The study employs a novel textural cross-correlation technique to extract feature curves from the 4D light field (LF) and compares this motion to its Lambertian equivalent based on 4-D light field geometry.
2:Sample Selection and Data Sources:
The experiments use light fields captured by a camera array and a lenslet-based LF camera, including sequences of LFs that gradually approach a refractive object.
3:List of Experimental Equipment and Materials:
The equipment includes a light field camera mounted on a robot arm, the Stanford New Light Field Database, and a Lytro Illum lenslet-based LF camera.
4:Experimental Procedures and Operational Workflow:
The method involves detecting SIFT features in the central view, applying 2D Gaussian-weighted normalized cross-correlation (WNCC) across views to yield correlation images, and fitting 4D planarity to feature curves to distinguish refracted features.
5:Data Analysis Methods:
The analysis includes measuring the ratio of refracted features, reprojection error, and the accuracy of pose estimates in structure from motion (SfM) pipelines.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容