研究目的
To develop a novel stereo vision algorithm for surround view fisheye cameras that can accurately detect crossing pedestrians at intersections, overcoming the limitations of conventional stereo camera technologies.
研究成果
The proposed algorithm successfully integrates machine learning techniques to improve the classification performance for stereo matching in fisheye cameras, achieving a high pedestrian tracking rate of 96.0% with accurate position detection. It outperforms Faster R-CNN in detecting crossing pedestrians at intersections.
研究不足
The study acknowledges the 'black box' nature of machine learning algorithms as a concern, particularly in correctly classifying image patch pairs with considerable appearance differences due to fisheye distortion and other factors.
1:Experimental Design and Method Selection:
The study proposes a machine learning-based stereo vision algorithm combining D-Brief and NCC with SVM for stereo matching between image patches in fisheye cameras.
2:Sample Selection and Data Sources:
Over 300 scenes of crossing pedestrians and bicycles while turning at intersections were captured on public roads in Japanese city and rural areas.
3:List of Experimental Equipment and Materials:
High resolution fisheye cameras with 5 mega pixels (2590×1942), 180 degrees of field of view, and Equidistance projection type.
4:Experimental Procedures and Operational Workflow:
Images from front and side fisheye cameras were captured, feature points and amounts were calculated, stereo matching was performed, and pedestrians were classified using Random Forest.
5:Data Analysis Methods:
The algorithm's performance was evaluated using actual images, comparing tracking rates, false tracking rates, correct detection rates, and position errors with Faster R-CNN.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容