- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Blind image quality assessment with hierarchy: Degradation from local structure to deep semantics
摘要： Though blind image quality assessment (BIQA) is highly desired in perceptual-oriented image processing systems, it is extremely difficult to design a reliable BIQA method. With the help of the prior knowledge, the human visual system (HVS) hierarchically perceives the quality degradation during the visual recognition. Inspired by this, we suggest different levels of distortion generate individual degradations on hierarchical features, and propose to consider the degradations on both low and high level features for quality prediction. By mimicking the orientation selectivity (OS) mechanism in the primary visual cortex, an OS based local structure is designed for low-level visual information representation. At the meantime, the deep residual network, which possesses multiple levels for feature integration, is employed to extract the deep semantics for high-level visual content representation. By fusing the local structure and the deep semantics, a hierarchical feature set is acquired. Next, the correlations between the degradations of image qualities and their corresponding hierarchical feature sets are analyzed, and a novel hierarchical feature degradation (HFD) based BIQA (HFD-BIQA) method is built. Experimental results on the legacy and wild image quality assessment databases demonstrate the prediction accuracy of the proposed HFD-BIQA method, and verify that the HFD-BIQA performs highly consistent with the subjective perception.
关键词： Local structure,Deep semantics,Hierarchical feature degradation,Blind image quality assessment
更新于2025-09-23 15:23:52
-
Delving Deeper Into Color Space
摘要： So far, color-naming studies have relied on a rather limited set of color stimuli. Most importantly, stimuli have been largely limited to highly saturated colors. Because of this, little is known about how people categorize less saturated colors and, more generally, about the structure of color categories as they extend across all dimensions of color space. This article presents the results from a large Internet-based color-naming study that involved color stimuli ranging across all available chroma levels in Munsell space. These results help answer such questions as how English speakers name a more complex color set, whether English speakers use so-called basic color terms (BCTs) more frequently for more saturated colors, how they use non-BCTs in comparison with BCTs, whether non-BCTs are highly consensual in less saturated parts of the solid, how deep inside color space basic color categories extend, or how they behave on the chroma dimension.
关键词： semantics,cognition,color,chroma,Munsell,saturation,categorization
更新于2025-09-23 15:22:29
-
Blind Image Quality Assessment with Semantic Information
摘要： No-reference (NR) image quality assessment (IQA) aims to evaluate the quality of an image without reference image, which is greatly desired in the automatic visual signal processing system. Distortions degrade the visual contents and affect the semantics acquisition during the process of human perception. Although the existing methods evaluate the quality of images based on the structure, texture, or statistical characteristics, and deliver high quality prediction accuracy, they do not take the spatial semantics into account. From the perspective of human perception, distortions decrease the structural semantics that represent the structural information, and disturb the spatial semantics that describe the contents of images. Therefore, we attempt to measure the image quality by its degradation of semantics in an image. To extract the semantics of an image, a semantic network is proposed. The network contains convolutional neural networks (CNN) and Long Short-Term Memory (LSTM) that correspond to structural semantics and spatial semantics, respectively. CNN can be regarded as a coarse imitation of human visual mechanism to obtain the structural information, and LSTM can express the contents of an image. Then, by measuring the degradations of different semantics on images, a novel NR IQA is introduced. The proposed approach is evaluated on the databases of LIVE, CSIQ, TID2013, and LIVE multiply distorted database as well as LIVE in the wild image quality challenge database, and the results show superior performance to other state-of-the-art NR IQA methods. Furthermore, we explore the generalization capability of the proposed approach, and the experimental results indicate the proposed approach has a high robustness.
关键词： spatial semantics,No-reference image quality assessment,structural semantics,human perception,semantic network
更新于2025-09-09 09:28:46