研究目的
To develop a method for accurate depth estimation of skin surfaces using a light field camera for haptic palpation, overcoming limitations of low-resolution images and erroneous disparity matching.
研究成果
The proposed method using a light field camera and GAN-based super-resolution effectively estimates accurate depth maps for skin surfaces, preserving textural details and enabling potential haptic palpation. It outperforms existing state-of-the-art methods in both super-resolution and depth estimation, offering a novel approach for combining visual and tactile information in skin diagnosis.
研究不足
The method has limitations in reconstructing relatively shallower wrinkles, removing high-frequency noise while preserving skin surface detail, and fully restoring global skin shape. Further research is needed on EPI characteristics, detailed wrinkle observation with a microscope, and complementary cost function building.
1:Experimental Design and Method Selection:
The study uses a light field camera (Lytro 1st generation) to capture raw lenslet images, which are decoded into sub-aperture images. A Generative Adversarial Network (GAN)-based super-resolution method is applied to enhance image resolution. Depth estimation involves lens distortion correction, sub-pixel shifted image generation via phase shift theorem, cost-volume building with separate local and global cost functions, multi-label optimization, hole filling, and merging of disparity maps.
2:Sample Selection and Data Sources:
Own dataset of skin images captured with the Lytro camera, as no existing light-field skin datasets were available.
3:List of Experimental Equipment and Materials:
Lytro camera (1st generation), computer with Intel i7
4:00 GHz CPU, NVIDIA GeForce GTX 1060 3 GB GPU, 32 GB RAM, Python and MATLAB software. Experimental Procedures and Operational Workflow:
Capture raw lenslet image, decode into sub-aperture images, correct distortions, apply GAN super-resolution, compute local and global disparity maps using SAD and GRAD cost functions, refine with hole filling, merge maps, and perform texture mapping for 3D reconstruction.
5:Data Analysis Methods:
Qualitative comparison with state-of-the-art methods (bicubic, deep denoising super-resolution, and other depth estimation algorithms), using visual assessment of super-resolved images and disparity maps.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容