Review — LIU4K: A Comprehensive Benchmark for Single Image Compression Artifact Reduction (Codec Filtering)

LIU4K, Large-Scale Ideal Ultra high-definition 4K, A New 4K Image Dataset is Proposed

Example images sampled from LIU4K. (a) Training set. (b) Testing set.
  • A summary of state-of-the-art single image filtering approaches are also reviewed and evaluated using both full reference and no reference metric for objective and subjective quality measurement respectively.

Outline

  1. LIU4K: Large-Scale Ideal Ultra high-definition 4K
  2. Summary of State-Of-The-Art Single Image Filtering Approaches
  3. Benchmarking

1. LIU4K: Large-Scale Ideal Ultra high-definition 4K

Dataset Summary

1.1. High-resolution definition

  • Compared to previous datasets, the resolution of the images in LIU4K is 2848×4288, offering abundant materials for testing and evaluating the performance on 4K/8K display devices.

1.2. Large-scale.

  • The training, testing, and validation images include 1,500, 200, and 80 4K images, which is much more than in previous datasets.

1.3. Diversified and complex signals

The statistical comparison of different testing sets

1.4. High visual quality

  • LIU4K wins in general purpose non-reference metrics (ENIQA and NIQE).

2. Summary of State-Of-The-Art Single Image Filtering Approaches

Milestones in the history of compressed image restoration methods
  • Most previous works are based on these two standards: JPEG and HEVC.
  • Deep learning approaches are more likely to focus in this story.
The technical improvement pathway for deep learning-based compression artifacts removal and codec loop filters

2.1. Deep Learning-Based JPEG Artifacts Removal

  • The works fall into two main streams: better network architectures (2–1) and better utilization of DCT domain information (2–2).
  • Besides network improvement, some works try to embed traditional priors or constraints into deep networks.
  • Below shows PSNR that improved across the years.
Recent evolution of deep learning-based JPEG artifacts removal

2.2. Deep Learning-Based Loop Filter Methods (HEVC)

  • There are still a lot of works summarized in the paper.

3. Benchmarking

  • For JPEG artifact reduction, the models are trained on the training of LIU4K.
  • For loop filters, the models are trained on the training sets of both BSD500 and LIU4K. During the training phase, 80 additional 4K images are used as LIU4K validation set.
  • ARCNN is modified/enhanced for better convergence.
Objective Evaluation
  • But it cannot obtain good results for NIQE and BRISQUE, which are no-reference metrics.
MOS Scores
  • It is observed that, DMCNN, MemNet, and PRN achieve overall superior visual quality than other methods.
Examples of restored results for a compressed image utilizing HM from LIU4K (QF = 10).
  • The summarization and experiments are in very details. I’m just here to introduce there is a paper summarizing the JPEG and HEVC filtering works.

PhD, Researcher. I share what I've learnt and done. :) My LinkedIn: https://www.linkedin.com/in/sh-tsang/, My Paper Reading List: https://bit.ly/33TDhxG

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store