Task-Aware Image Downscaling

Examples of task-aware downscaling(TAD). TAD preserves important information of original images at the downscaling stage. It can be used for efficient image restoration.

Image downscaling is one of the most classical problems in computer vision that aims to preserve the visual appearance of the original image when it is resized to a smaller scale. Upscaling a small image back to its original size is a difficult and ill-posed problem due to information loss that arises in the downscaling process. In this paper, we present a novel technique called task-aware image downscaling to support an upscaling task. We propose an auto-encoder-based framework that enables joint learning of the downscaling network and the upscaling network to maximize the restoration performance. Our framework is efficient, and it can be generalized to handle an arbitrary image resizing operation.

Experimental results show that our task-aware downscaled images greatly improve the performance of the existing state-of-the-art super-resolution methods. In addition, realistic images can be recovered by recursively applying our scaling model up to an extreme scaling factor of x128. We also validate our model’s generalization capability by applying it to the task of image colorization.

Comparison with the SotA Image Super-Resolution Method
Bicubic LR
  • Before
  • After
EDSR+ vs. TAU(Ours)
[x4 scaling]
slide the image to compare
TAD LR(Ours)
author = {Kim, Heewon and Choi, Myungsub and Lim, Bee and Lee, Kyoung Mu},
title = {Task-Aware Image Downscaling},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}