SUR-Net: Predicting the Satisfied User Ratio Curve for Image Compression with Deep Learning

Date

2019-06

Advisors

Journal Title

Journal ISSN

ISSN

Volume Title

Publisher

IEEE

Type

Conference

Peer reviewed

Yes

Abstract

The Satisfied User Ratio (SUR) curve for a lossy image compression scheme, e.g., JPEG, characterizes the probability distribution of the Just Noticeable Difference (JND) level, the smallest distortion level that can be perceived by a subject. We propose the first deep learning approach to predict such SUR curves. Instead of the direct approach of regressing the SUR curve itself for a given reference image, our model is trained on pairs of images, original and compressed. Relying on a Siamese Convolutional Neural Network (CNN), feature pooling, a fully connected regression-head, and transfer learning, we achieved a good prediction performance. Experiments on the MCL-JCI dataset showed a mean Bhattacharyya distance between the predicted and the original JND distributions of only 0.072.

Description

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

Keywords

Satisfied User Ratio, Just Noticeable Difference, Convolutional Neural Network, Deep Learning

Citation

C. Fan, H. Lin, V. Hosu, Y. Zhang, Q. Jiang, R. Hamzaoui, D. Saupe, (2019) SUR-Net: Predicting the satisfied user ratio curve for image compression with deep learning. In: Proc. 11th International Conference on Quality of Multimedia Experience (QoMEX), Berlin, June 2019.

Rights

Research Institute