Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration 论文

2016IEEE Transactions on Pattern Analysis and Machine Intelligence引用 1381
Advanced Image Processing TechniquesImage and Signal Denoising MethodsDigital Holography and Microscopy

详细信息

发表期刊/会议
IEEE Transactions on Pattern Analysis and Machine Intelligence
发表日期
2016-08-01
发表年份
2016

关键词

Advanced Image Processing TechniquesImage and Signal Denoising MethodsDigital Holography and Microscopy

摘要

Image restoration is a long-standing problem in low-level computer vision with many interesting applications. We describe a flexible learning framework based on the concept of nonlinear reaction diffusion models for various image restoration problems. By embodying recent improvements in nonlinear diffusion models, we propose a dynamic nonlinear reaction diffusion model with time-dependent parameters (i.e., linear filters and influence functions). In contrast to previous nonlinear diffusion models, all the parameters, including the filters and the influence functions, are simultaneously learned from training data through a loss based approach. We call this approach TNRD-Trainable Nonlinear Reaction Diffusion. The TNRD approach is applicable for a variety of image restoration tasks by incorporating appropriate reaction force. We demonstrate its capabilities with three representative applications, Gaussian image denoising, single image super resolution and JPEG deblocking. Experiments show that our trained nonlinear diffusion models largely benefit from the training of the parameters and finally lead to the best reported performance on common test datasets for the tested applications. Our trained models preserve the structural simplicity of diffusion models and take only a small number of diffusion steps, thus are highly efficient. Moreover, they are also well-suited for parallel computation on GPUs, which makes the inference procedure extremely fast.