研究目的
To enhance the accuracy and speed of RGB-D sensors in capturing depth information from shiny/transparent objects using block matching stereo vision (BMSV) with rectified/non-rectified block matching and image pyramiding along with dynamic programming.
研究成果
The proposed BMSV RGB-D method improves the speed and accuracy of RGB-D sensors in capturing depth information from shiny/transparent objects. The results from the depth information analysis carried out on a 3D realistic head model and an fMRI image illustrate the accuracy of the proposed method. The capture and accurate reconstruction of an object with transparent surface is demonstrated using the proposed method.
研究不足
The accuracy of depth information restoration is limited for shiny or transparent objects or objects that have an absorbing matte surface. Also, there can be an interference in the IR pattern due to the use of multiple RGB-D cameras and the depth information is correctly interpreted only for short distances between the camera and the object.
1:Experimental Design and Method Selection:
The proposed system, BMSV RGB-D, utilizes block matching and image pyramiding along with dynamic programming for accurate capture of depth information from shiny/transparent objects.
2:Sample Selection and Data Sources:
The method is applied to a 3D realistic head model and a functional magnetic resonance image (fMRI).
3:List of Experimental Equipment and Materials:
RGB-D cameras (Asus Xtion Pro, Microsoft Kinect, Intel RealSenseTM), MATLAB R2018a with neuroelectromagnetic forward head modelling toolbox (NFT) plugin.
4:Experimental Procedures and Operational Workflow:
The object of interest is captured from two different viewpoints using two RGB cameras. The focused color image pair consists of a left and right image. The depth map of the stereo image, the intrinsic parameters of the RGB-D camera and the concerned image are back projected on a pixel to pixel basis to form the 3D points.
5:Data Analysis Methods:
The depth information is analyzed using block matching, image pyramiding, and dynamic programming to enhance the accuracy and speed of RGB-D sensors.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容