研究目的
To propose a novel neural network-based method for remote sensing image matching that addresses the challenges of large size, high resolution, and complex structure in RS images, aiming to achieve higher accuracy and efficiency compared to traditional methods.
研究成果
The proposed two-branch neural network with adaptive sample selection and superpixel-based strategies effectively addresses the complexities of RS image matching, achieving subpixel accuracy and robustness. Future work will focus on reducing information loss and improving key point distribution uniformity.
研究不足
The method relies on sufficient training samples, which can be difficult to obtain for RS data. The distribution of detected key points is not always uniform, and the computational time is higher than some traditional methods due to the large feature dimension. Additionally, the network may lose some neighborhood information during training, affecting reliability.
1:Experimental Design and Method Selection:
The study uses a two-branch neural network model inspired by siamese networks, transforming image matching into a two-class classification problem. It involves unsupervised feature extraction with convolutional deep belief networks (CDBNs) and supervised matching with fully connected layers, incorporating spatial pyramid pooling (SPP) for fixed-dimensional vectors.
2:Sample Selection and Data Sources:
Samples are extracted from RS image pairs, with key points detected in difference of Gaussian (DoG) scale space. Positive and negative samples are formed based on coarse affine transformation parameters, using an adaptive sample selection strategy (AS-SS) to determine patch sizes. Data sets include Canada, Yellow River, and MS_Canada RS images.
3:List of Experimental Equipment and Materials:
HP-Z840 Workstation with TITAN X 12-GB GPU and 64-G memory, Caffe for network training, MATLAB R2014a for other operations.
4:Experimental Procedures and Operational Workflow:
Key steps include sample extraction, network training in two stages (unsupervised feature extraction and supervised matching), and application of superpixel-based strategies (Sp-SGS and Sp-OSM) for efficient and accurate matching.
5:Data Analysis Methods:
Performance metrics include overall error (OE), overall accuracy (OA), Kappa statistic, number of matching pairs (Nred), root-mean-square error (rmsall), and other measures like rmsLOO, pquad, BPP(1.0), Skew, Scat, and φ for comprehensive evaluation.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容