- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
A CNN With Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification
摘要： Recently, researchers have shown the powerful ability of deep methods with multilayers to extract high-level features and to obtain better performance for hyperspectral image classification. However, a common problem of traditional deep models is that the learned deep models might be suboptimal because of the limited number of training samples, especially for the image with large intraclass variance and low interclass variance. In this paper, novel convolutional neural networks (CNNs) with multiscale convolution (MS-CNNs) are proposed to address this problem by extracting deep multiscale features from the hyperspectral image. Moreover, deep metrics usually accompany with MS-CNNs to improve the representational ability for the hyperspectral image. However, the usual metric learning would make the metric parameters in the learned model tend to behave similarly. This similarity leads to obvious model’s redundancy and, thus, shows negative effects on the description ability of the deep metrics. Traditionally, determinantal point process (DPP) priors, which encourage the learned factors to repulse from one another, can be imposed over these factors to diversify them. Taking advantage of both the MS-CNNs and DPP-based diversity-promoting deep metrics, this paper develops a CNN with multiscale convolution and diversified metric to obtain discriminative features for hyperspectral image classification. Experiments are conducted over four real-world hyperspectral image data sets to show the effectiveness and applicability of the proposed method. Experimental results show that our method is better than original deep models and can produce comparable or even better classification performance in different hyperspectral image data sets with respect to spectral and spectral–spatial features.
关键词： deep metric learning,determinantal point process (DPP),image classification,multiscale features,Convolutional neural network (CNN),hyperspectral image
更新于2025-09-23 15:23:52
-
Image-based 3D model retrieval using manifold learning
摘要： We propose a new framework for image-based three-dimensional (3D) model retrieval. We first model the query image as a Euclidean point. Then we model all projected views of a 3D model as a symmetric positive definite (SPD) matrix, which is a point on a Riemannian manifold. Thus, the image-based 3D model retrieval is reduced to a problem of Euclid-to-Riemann metric learning. To solve this heterogeneous matching problem, we map the Euclidean space and SPD Riemannian manifold to the same high-dimensional Hilbert space, thus shrinking the great gap between them. Finally, we design an optimization algorithm to learn a metric in this Hilbert space using a kernel trick. Any new image descriptors, such as the features from deep learning, can be easily embedded in our framework. Experimental results show the advantages of our approach over the state-of-the-art methods for image-based 3D model retrieval.
关键词： Model retrieval,Metric learning,Hilbert space,Riemannian manifold,Euclidean space
更新于2025-09-23 15:22:29
-
Metric Learning for Patch-Based 3-D Image Registration
摘要： Patch-based image registration is a challenging problem in visual geometry, the crucial component of which is the selection of an appropriate similarity measure. The similarity measure participates in the objective calculation of the pose optimization, which determines the optimization convergence performance. In this paper, we propose learning a similarity metric of patches from reference and target images such that the pairwise patches with a small projection error receive high similarity scores. To achieve this objective, we designed and trained the classification, regression, and rank networks separately based on self-collected data sets. The network can directly output the projection error according to the patches, which is sensitive to the deviation of the pose transformation. We also designed evaluation criteria and validated the superior performance of the network's outputs compared with the performance of traditional methods, such as the sum of absolute difference and the sum of squared differences.
关键词： neural network,Image registration,pose optimization,metric learning
更新于2025-09-23 15:22:29
-
Hyperspectral Target Detection via Adaptive Information—Theoretic Metric Learning with Local Constraints
摘要： By using the high spectral resolution, hyperspectral images (HSIs) provide significant information for target detection, which is of great interest in HSI processing. However, most classical target detection methods may only perform well based on certain assumptions. Simultaneously, using limited numbers of target samples and preserving the discriminative information is also a challenging problem in hyperspectral target detection. To overcome these shortcomings, this paper proposes a novel adaptive information-theoretic metric learning with local constraints (ITML-ALC) for hyperspectral target detection. The proposed method firstly uses the information-theoretic metric learning (ITML) method as the objective function for learning a Mahalanobis distance to separate similar and dissimilar point-pairs without certain assumptions, needing fewer adjusted parameters. Then, adaptively local constraints are applied to shrink the distances between samples of similar pairs and expand the distances between samples of dissimilar pairs. Finally, target detection decision can be made by considering both the threshold and the changes between the distances before and after metric learning. Experimental results demonstrate that the proposed method can obviously separate target samples from background ones and outperform both the state-of-the-art target detection algorithms and the other classical metric learning methods.
关键词： target detection,hyperspectral image,local constraints,metric learning
更新于2025-09-10 09:29:36
-
[IEEE 2018 25th IEEE International Conference on Image Processing (ICIP) - Athens, Greece (2018.10.7-2018.10.10)] 2018 25th IEEE International Conference on Image Processing (ICIP) - Fused Discriminative Metric Learning for Low Resolution Pedestrian Detection
摘要： Low resolution (LR) is one of the most challenging factor in pedestrian detection. In this paper, we propose a fused discriminative metric learning (F-DML) approach for low resolution pedestrian detection without explicit super resolution. We firstly learn a discriminative high resolution (HR) feature space as target space. Then, an optimal Mahanalobis metric is learned to transform the LR feature space into a new LR classification space, which largely preserves the discriminative structure of the HR feature space. Finally, a weighted K-nearest neighbors classifier is applied in the LR classification space which inherits good discrimination from HR feature space. A new training strategy is proposed to find the fewest and most representative LR-HR exemplars. In addition, we build a new dataset for the evaluation of low resolution pedestrian detection methods. Extensive experimental results demonstrate that the proposed approach performs favorably against the state-of-the-art methods.
关键词： Metric learning,Pedestrian detection,Low resolution
更新于2025-09-09 09:28:46
-
Hierarchical Metric Learning for Optical Remote Sensing Scene Categorization
摘要： We address the problem of scene classification from optical remote sensing (RS) images based on the paradigm of hierarchical metric learning. Ideally, supervised metric learning strategies learn a projection from a set of training data points so as to minimize intraclass variance while maximizing the interclass separability to the class label space. However, standard metric learning techniques do not incorporate the class interaction information in learning the transformation matrix, which is often considered to be a bottleneck while dealing with fine-grained visual categories. As a remedy, we propose to organize the classes in a hierarchical fashion by exploring their visual similarities and subsequently learn separate distance metric transformations for the classes present at the nonleaf nodes of the tree. We employ an iterative maximum-margin clustering strategy to obtain the hierarchical organization of the classes. Experiment results obtained on the large-scale NWPU-RESISC45 and the popular UC-Merced data sets demonstrate the efficacy of the proposed hierarchical metric learning-based RS scene recognition strategy in comparison to the standard approaches.
关键词： optical remote sensing (RS),Maximum margin clustering (MMC),metric learning
更新于2025-09-04 15:30:14