- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Deep structure tensor graph search framework for automated extraction and characterization of retinal layers and fluid pathology in retinal SD-OCT scans
摘要： Maculopathy is a group of retinal disorders that affect macula and cause severe visual impairment if not treated in time. Many computer-aided diagnostic methods have been proposed over the past that automatically detect macular diseases. However, to our best knowledge, no literature is available that provides an end-to-end solution for analyzing healthy and diseased macular pathology. This paper proposes a vendor-independent deep convolutional neural network and structure tensor graph search-based segmentation framework (CNN-STGS) for the extraction and characterization of retinal layers and fluid pathology, along with 3-D retinal profiling. CNN-STGS works by first extracting nine layers from an optical coherence tomography (OCT) scan. Afterward, the extracted layers, combined with a deep CNN model, are used to automatically segment cyst and serous pathology, followed by the autonomous 3-D retinal profiling. CNN-STGS has been validated on publicly available Duke datasets (containing a cumulative of 42,281 scans from 439 subjects) and Armed Forces Institute of Ophthalmology dataset (containing 4,260 OCT scans of 51 subjects), which are acquired through different OCT machinery. The performance of the CNN-STGS framework is validated through the marked annotations, and it significantly outperforms the existing solutions in various metrics. The proposed CNN-STGS framework achieved a mean Dice coefficient of 0.906 for segmenting retinal fluids, along with an accuracy of 98.75% for characterizing cyst and serous fluid from diseased retinal OCT scans.
关键词： convolutional neural network (CNN),Optical coherence tomography (OCT),maculopathy,ophthalmology,graph search
更新于2025-09-23 15:23:52
-
SCN: Switchable Context Network for Semantic Segmentation of RGB-D Images
摘要： Context representations have been widely used to profit semantic image segmentation. The emergence of depth data provides additional information to construct more discriminating context representations. Depth data preserves the geometric relationship of objects in a scene, which is generally hard to be inferred from RGB images. While deep convolutional neural networks (CNNs) have been successful in solving semantic segmentation, we encounter the problem of optimizing CNN training for the informative context using depth data to enhance the segmentation accuracy. In this paper, we present a novel switchable context network (SCN) to facilitate semantic segmentation of RGB-D images. Depth data is used to identify objects existing in multiple image regions. The network analyzes the information in the image regions to identify different characteristics, which are then used selectively through switching network branches. With the content extracted from the inherent image structure, we are able to generate effective context representations that are aware of both image structures and object relationships, leading to a more coherent learning of semantic segmentation network. We demonstrate that our SCN outperforms state-of-the-art methods on two public datasets.
关键词： Context representation,convolutional neural network (CNN),RGB-D images,semantic segmentation
更新于2025-09-23 15:23:52
-
A CNN With Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification
摘要： Recently, researchers have shown the powerful ability of deep methods with multilayers to extract high-level features and to obtain better performance for hyperspectral image classification. However, a common problem of traditional deep models is that the learned deep models might be suboptimal because of the limited number of training samples, especially for the image with large intraclass variance and low interclass variance. In this paper, novel convolutional neural networks (CNNs) with multiscale convolution (MS-CNNs) are proposed to address this problem by extracting deep multiscale features from the hyperspectral image. Moreover, deep metrics usually accompany with MS-CNNs to improve the representational ability for the hyperspectral image. However, the usual metric learning would make the metric parameters in the learned model tend to behave similarly. This similarity leads to obvious model’s redundancy and, thus, shows negative effects on the description ability of the deep metrics. Traditionally, determinantal point process (DPP) priors, which encourage the learned factors to repulse from one another, can be imposed over these factors to diversify them. Taking advantage of both the MS-CNNs and DPP-based diversity-promoting deep metrics, this paper develops a CNN with multiscale convolution and diversified metric to obtain discriminative features for hyperspectral image classification. Experiments are conducted over four real-world hyperspectral image data sets to show the effectiveness and applicability of the proposed method. Experimental results show that our method is better than original deep models and can produce comparable or even better classification performance in different hyperspectral image data sets with respect to spectral and spectral–spatial features.
关键词： deep metric learning,determinantal point process (DPP),image classification,multiscale features,Convolutional neural network (CNN),hyperspectral image
更新于2025-09-23 15:23:52
-
High Efficient Deep Feature Extraction and Classification of Spectral-Spatial Hyperspectral Image Using Cross Domain Convolutional Neural Networks
摘要： Recently, numerous remote sensing applications highly depend on the hyperspectral image (HSI). HSI classification, as a fundamental issue, has attracted increasing attention and become a hot topic in the remote sensing community. We implemented a regularized convolutional neural network (CNN), which adopted dropout and regularization strategies to address the overfitting problem of limited training samples. Although many kinds of the literature have confirmed that it is an effective way for HSI classification to integrate spectrum with spatial context, the scaling issue is not fully exploited. In this paper, we propose a high efficient deep feature extraction and the classification method for the spectral-spatial HSI, which can make full use of multiscale spatial feature obtained by guided filter. The proposed approach is the first attempt to lean a CNN for spectral and multiscale spatial features. Compared to its counterparts, experimental results show that the proposed method can achieve 3% improvement in accuracy, according to various datasets such as Indian Pines, Pavia University, and Salinas.
关键词： Convolutional neural network (CNN),hyperspectral image (HSI) classification,guided filter,spectral-spatial fusion
更新于2025-09-23 15:22:29
-
Hyperspectral Coastal Wetland Classification Based on a Multiobject Convolutional Neural Network Model and Decision Fusion
摘要： The phenomenon of spectral aliasing exists for coastal wetland object types, which leads to class mixing. This letter proposes a multiobject convolutional neural network (CNN) decision fusion classification method for hyperspectral images of coastal wetlands. This method adopts decision fusion based on fuzzy membership rules applied to single-object CNN classification to obtain higher classification accuracy. Experimental results demonstrate the effectiveness of the proposed method for the six object types, including water, tidal flat, reed, and other vegetation types. The overall accuracy of the decision fusion classification method based on fuzzy membership is 82.11%, which is 3.33% and 6.24% higher than those of single-object feature band CNN and support vector machine methods. The classification method based on multiobject CNN decision fusion inherits the characteristics of single-object feature bands of the CNN, making it a practical approach to image classification under the challenging conditions in which class mixing occurs.
关键词： decision fusion,convolutional neural network (CNN),hyperspectral image,Classification
更新于2025-09-23 15:22:29
-
Road Segmentation Based on Hybrid Convolutional Network for High-Resolution Visible Remote Sensing Image
摘要： Road segmentation plays an important role in many applications, such as intelligent transportation system and urban planning. Various road segmentation methods have been proposed for visible remote sensing images, especially the popular convolutional neural network-based methods. However, high-accuracy road segmentation from high-resolution visible remote sensing images is still a challenging problem due to complex background and multiscale roads in these images. To handle this problem, a hybrid convolutional network (HCN), fusing multiple subnetworks, is proposed in this letter. The HCN contains a fully convolutional network, a modi?ed U-Net, and a VGG subnetwork; these subnetworks obtain a coarse-grained, a medium-grained, and a ?ne-grained road segmentation map. Moreover, the HCN uses a shallow convolutional subnetwork to fuse these multigrained segmentation maps for ?nal road segmentation. Bene?tting from multigrained segmentation, our HCN shows impressing results in processing both multiscale roads and complex background. Four testing indicators, including pixel accuracy, mean accuracy, mean region intersection over union (IU), and frequency weighted IU, are computed to evaluate the proposed HCN on two testing data sets. Compared with ?ve state-of-the-art road segmentation methods, our HCN has higher segmentation accuracy than them.
关键词： high-resolution visible remote sensing image,Convolutional neural network (CNN),road segmentation
更新于2025-09-23 15:21:21
-
[IEEE 2018 25th IEEE International Conference on Image Processing (ICIP) - Athens, Greece (2018.10.7-2018.10.10)] 2018 25th IEEE International Conference on Image Processing (ICIP) - Convolutional Neural Network for Blind Mesh Visual Quality Assessment Using 3D Visual Saliency
摘要： In this work, we propose a convolutional neural network (CNN) framework to estimate the perceived visual quality of 3D meshes without having access to the reference. The proposed CNN architecture is fed by small patches selected carefully according to their level of saliency. To do so, the visual saliency of the 3D mesh is computed, then we render 2D projections from the 3D mesh and its corresponding 3D saliency map. Afterward, the obtained views are split to obtain 2D small patches that pass through a saliency filter to select the most relevant patches. Experiments are conducted on two MVQ assessment databases, and the results show that the trained CNN achieves good rates in terms of correlation with human judgment.
关键词： blind mesh visual quality assessment,Convolutional neural network (CNN),mesh visual saliency
更新于2025-09-23 15:21:01
-
Real-time penetration state monitoring using convolutional neural network for laser welding of tailor rolled blanks
摘要： In this paper, an innovative monitoring system capable of diagnosing the penetration state during the laser welding process is introduced, which consists of two main blocks: a coaxial visual monitoring platform and a penetration state diagnosis unit. The platform can capture coaxial images of the interaction zone during the laser welding through a partially transmitting mirror and a high-speed camera. An image dataset representing four welding states was created for training and validation. The unit mainly consists of an embedded power-efficient computing TX2 and image processing algorithms based on a convolution neural network (CNN). Experiment results show that the platform can stably capture state-of-the-art welding images. The CNN used for a diagnosis of the penetration state is optimized using an optimal network structure and hyperparameters, applying a super-Gaussian function to initialize the weights of the convolutional layer. Its latency on TX2 is less than 2 ms, satisfying the real-time requirement. During the real laser welding of tailor-rolled blanks, a penetration state diagnosis with an accuracy of 94.6 % can be achieved even if the illumination changes significantly. The similar accuracy between the validating set and a real laser welding demonstrates that the proposed monitoring system has strong robustness. The precision and recall ratios of the CNN are higher than those of other methods such as a histogram of oriented gradients and local binary pattern.
关键词： Laser welding,Coaxial visual monitoring,Penetration state diagnosis,Convolutional neural network (CNN),Tailor-rolled blank
更新于2025-09-23 15:19:57
-
A multi-faceted CNN architecture for automatic classification of mobile LiDAR data and an algorithm to reproduce point cloud samples for enhanced training
摘要： Mobile Laser Scanning (MLS) data of outdoor environment are typically characterised by occlusion, noise, clutter, large data size and high quantum of information which makes their classification a challenging problem. This paper presents three deep Convolutional Neural Network (CNN) architectures in three dimension (3D), namely single CNN (SCN), multi-faceted CNN (MFC) and MFC with reproduction (MFCR) for automatic classification of MLS data. The MFC uses multiple facets of an MLS sample as inputs to different SCNs, thus providing additional information during classification. The MFC, once trained, is used to reproduce additional samples with the help of existing samples. The reproduced samples are employed to further refine the MFC training parameters, thus giving a new method called MFCR. The three architectures are evaluated on an ensemble of 3D outdoor MLS data consisting of four classes, i.e. tree, pole, house and ground covered with low vegetation along with car samples from KITTI dataset. The total accuracy and kappa values of classifications reached up to (i) 86.0% and 81.3% for the SCN (ii) 94.3% and 92.4% for the MFC and (iii) 96.0% and 94.6% for the MFCR, respectively. The paper has demonstrated the use of multiple facets to significantly improve classification accuracy over the SCN. Finally, a unique approach has been developed for reproduction of samples which has shown potential to improve the accuracy of classification. Unlike previous works on the use of CNN for structured point cloud of indoor objects, this work shows the utility of different proposed CNN architectures for classification of varieties of outdoor objects, viz., tree, pole, house and ground which are captured as unstructured point cloud by MLS.
关键词： Sample reproduction,Mobile Laser Scanning (MLS),Automatic classification,Convolutional Neural Network (CNN)
更新于2025-09-19 17:15:36
-
Deep Convolutional Neural Network for HEp-2 Fluorescence Intensity Classification
摘要： Indirect ImmunoFluorescence (IIF) assays are recommended as the gold standard method for detection of antinuclear antibodies (ANAs), which are of considerable importance in the diagnosis of autoimmune diseases. Fluorescence intensity analysis is very often complex, and depending on the capabilities of the operator, the association with incorrect classes is statistically easy. In this paper, we present a Convolutional Neural Network (CNN) system to classify positive/negative fluorescence intensity of HEp-2 IIF images, which is important for autoimmune diseases diagnosis. The method uses the best known pre-trained CNNs to extract features and a support vector machine (SVM) classifier for the final association to the positive or negative classes. This system has been developed and the classifier was trained on a database implemented by the AIDA (AutoImmunité, Diagnostic Assisté par ordinateur) project. The method proposed here has been tested on a public part of the same database, consisting of 2080 IIF images. The performance analysis showed an accuracy of fluorescent intensity around 93%. The results have been evaluated by comparing them with some of the most representative state-of-the-art works, demonstrating the quality of the system in the intensity classification of HEp-2 images.
关键词： autoimmune diseases,accuracy,SVM,receiver operating characteristic (ROC) curve,Convolutional Neural Network (CNN),IIF images
更新于2025-09-19 17:15:36