Blind Image Quality Assessment via Deep Learning 论文

2014IEEE Transactions on Neural Networks and Learning Systems引用 376
Image and Video Quality AssessmentAdvanced Image Fusion TechniquesVisual Attention and Saliency Detection

详细信息

发表期刊/会议
IEEE Transactions on Neural Networks and Learning Systems
发表日期
2014-08-06
发表年份
2014

关键词

Image and Video Quality AssessmentAdvanced Image Fusion TechniquesVisual Attention and Saliency Detection

摘要

This paper investigates how to blindly evaluate the visual quality of an image by learning rules from linguistic descriptions. Extensive psychological evidence shows that humans prefer to conduct evaluations qualitatively rather than numerically. The qualitative evaluations are then converted into the numerical scores to fairly benchmark objective image quality assessment (IQA) metrics. Recently, lots of learning-based IQA models are proposed by analyzing the mapping from the images to numerical ratings. However, the learnt mapping can hardly be accurate enough because some information has been lost in such an irreversible conversion from the linguistic descriptions to numerical scores. In this paper, we propose a blind IQA model, which learns qualitative evaluations directly and outputs numerical scores for general utilization and fair comparison. Images are represented by natural scene statistics features. A discriminative deep model is trained to classify the features into five grades, corresponding to five explicit mental concepts, i.e., excellent, good, fair, poor, and bad. A newly designed quality pooling is then applied to convert the qualitative labels into scores. The classification framework is not only much more natural than the regression-based models, but also robust to the small sample size problem. Thorough experiments are conducted on popular databases to verify the model's effectiveness, efficiency, and robustness.