Turbulence-degraded video restoration based on non-convexity optimization and dynamical adaptive filtering

Jun-shan LI; Ya-wei YANG; Zi-jiang ZHU; Jiao ZHANG; Yao-hua DENG

doi:10.3788/YJYXS20173206.0482

您当前的位置：

首页 >

文章列表页 >

Turbulence-degraded video restoration based on non-convexity optimization and dynamical adaptive filtering

Image Processing | 更新时间：2020-07-07

- Turbulence-degraded video restoration based on non-convexity optimization and dynamical adaptive filtering
- Chinese Journal of Liquid Crystals and Displays Vol. 32, Issue 6, Pages: 482-490(2017)
- 作者机构：
  
  1.广东外语外贸大学南国商学院, 广东广州 510545
  2.火箭军工程大学信息工程系, 陕西西安 710025
  3.中国人民解放军96215部队, 广西柳州 545616
  4.广东工业大学机电工程学院, 广东广州 510006
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20173206.0482
  CLC： TP391
- Received：17 January 2017，
  
  Accepted：21 February 2017，
  
  Published：05 June 2017
- 稿件说明：
移动端阅览
Jun-shan LI, Ya-wei YANG, Zi-jiang ZHU, et al. Turbulence-degraded video restoration based on non-convexity optimization and dynamical adaptive filtering[J]. Chinese journal of liquid crystals and displays, 2017, 32(6): 482-490.
DOI：

Jun-shan LI, Ya-wei YANG, Zi-jiang ZHU, et al. Turbulence-degraded video restoration based on non-convexity optimization and dynamical adaptive filtering[J]. Chinese journal of liquid crystals and displays, 2017, 32(6): 482-490. DOI： 10.3788/YJYXS20173206.0482.

摘要

针对目标探测器在大气中高速飞行时受湍流干扰，导致光学系统接收到的视频/图像产生像素偏移、模糊、信噪比降低等问题，本文对湍流退化视频/图像复原的复杂性及复原方法进行了研究，提出了一种基于非凸势函数优化与动态自适应滤波的湍流退化视频复原方法。首先，研究了湍流退化视频的求和与去模糊框架，并通过利用非刚性配准方法对刚性全局配准方法进行改进，进一步缩小了模糊核的尺度；然后，在计算机视觉的非凸优化框架下，构建了图像解卷积的非凸性算法，有效地解决了图像解卷积难题；最后，结合湍流退化视频自身特点，对超分辨率视频复原的动态自适应滤波框架进行了扩展与改进，使其适用于湍流退化视频的复原。仿真实验结果表明，本文方法的复原效果不仅有较大提升，而且实现了对湍流退化视频序列的动态自适应复原。

Abstract

The video/image received by optical system suffers degradation such as pixel deviation

blurring and signal to noise ratio reduction

when the target detector flies at high speed in the atmosphere is affected by turbulent interference. In this paper

the complexity of turbulence-degraded image restoration and deblurring methods are studied

and a video restoration method based on non-convexity optimization and dynamical adaptive filtering method is proposed. Firstly

we study the sum and deblur framework of turbulence-degraded video. By improving the rigid global registration with non-rigid local registration

the scale of blur kernel can be narrowed. Secondly

a non-convexity deconvolution algorithm is constructed based on the non-convexity optimization framework

which can solve the difficulty of image deconvolution problem effectively. Finally

dynamic adaptive filtering framework of video super-resolution recovery is expanded with the characteristics of turbulence-degraded. Simulation experiment results show that the proposed method can not only improve the quality of restored image

but also implement dynamic self-adaptive restoration of turbulence-degraded video.

关键词

Keywords

references

张姣, 李俊山, 杨亚威.结合仿射变换和多层B样条配准的湍流畸变图像校正[J].光学精密工程, 2015, 23(3):846-854.

ZHANG J, LI J S, YANG Y W. Turbulence distorted image correction using affine transformation and multilevel B-spline registration [J]. Optics and Precision Engineering, 2015, 23(3): 846-854. (in Chinese)

KHOSHABEH R, CHAN S H, NGUYEN T Q. Spatio-temporal consistency in video disparity estimation [C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. Prague: IEEE, 2011: 885-888.

ROGGEMANN M C, WELSH B. Imaging Through Turbulence [M]. Boca Raton: CRC Press, 1996.

BATES R H T, CADY F M. Towards true imaging by wideband speckle interferometry [J].Optics Communications, 1980, 32(3): 365-369.

GAL R, KIRYATI N, SOCHEN N. Progress in the restoration of image sequences degraded by atmospheric turbulence [J].Pattern Recognition Letters, 2014, 48: 8-14.

GILLES J, DAGOBERT T, FRANCHIS C D. Atmospheric turbulence restoration by diffeomorphic image registration and blind deconvolution [M]//BLANC-TALON J, BOURENNANE S, PHILIPS W, et al. Advanced Concepts for Intelligent Vision Systems. Berlin Heidelberg: Springer, 2008: 400-409.

VESE LM, GUYADER C L. Variational Methods in Image Processing [M]. London: Chapman & Hall/CRC, 2015.

FRASER D, THORPE G, LAMBERT A. Atmospheric turbulence visualization with wide-area motion-blur restoration [J].Journal of the Optical Society of America A, 1999, 16(7): 1751-1758.

LAZARIDIS G, PETROU M. Image registration using the Walsh transform [J].IEEE Transactions on Image Processing, 2006, 15(8): 2343-2357.

GEMAN S, GEMAN D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 1984, PAMI-6(6): 721-741.

MUMFORD D, SHAH J. Optimal approximations by piecewise smooth functions and associated variational problems [J].Communications on Pure and Applied Mathematics, 1989, 42(5): 577-685.

BLACK M J, RANGARAJAN A. On the unification of line processes, outlier rejection, and robust statistics with applications in early vision [J].International Journal of Computer Vision, 1996, 19(1): 57-91.

PERONA P, MALIK J. Scale-space and edge detection using anisotropic diffusion [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 629-639.

HUANG J G, MUMFORD D. Statistics of natural images and models [C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Fort Collins, CO, USA: IEEE, 1999, 1: 1541.

HAZAN E, LEVY K Y, SHALEV-SHWARTZ S. On graduated optimization for stochastic non-convex problems[C]//Proceedings of the 33rd International Conference on Machine Learning. New York, NY, USA: JMLR, 2016.

BLAKE A, ZISSERMAN A.Visual Reconstruction [M]. Cambridge, Mass.: MIT Press, 1987.

GEMAN D, REYNOLDS G. Constrained restoration and the recovery of discontinuities [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(3): 367-383.

NIKOLOVA M, CHAN R H. The equivalence of half-quadratic minimization and the gradient linearization iteration [J]. IEEE Transactions on Image Processing, 2007, 16(6): 1623-1627.

CANDÈS E J, WAKIN M B, BOYD S P. Enhancing sparsity by reweighted l 1 minimization [J]. Journal of Fourier Analysis and Applications, 2008, 14(5/6): 877-905.

CHEN X J, ZHOU W J. Convergence of the reweighted l 1 minimization algorithm for l 1 -l 2 minimization [J]. Computational Optimization and Applications, 2014, 59(1/2): 47-61.

韩玉兵, 吴乐南.基于自适应滤波的视频序列超分辨率重建[J].计算机学报, 2006, 29(4):642-647.

HAN Y B, WU L N. Super resolution reconstruction of video sequence based on adaptive filter [J].Chinese Journal of Computer, 2006, 29(4): 642-674 (in Chinese)

BROX T, BRUHN A, PAPENBERG N, et al. High accuracy optical flow estimation based on a theory for warping [C]//Proceedings of the European Conference on Computer Vision. Berlin Heidelberg: Springer, 2004: 25-36.

OCHS P, DOSOVITSKIY A, BROX T, et al. An iterated L1 algorithm for non-smooth non-convex optimization in computer vision [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Portland: IEEE, 2013: 1759-1766.

KUNISCH K, POCK T. A bilevel optimization approach for parameter learning in variational models [J].SIAM Journal on Imaging Sciences, 2013, 6(2): 938-983.

CHAMBOLLE A, POCK T. A first-order primal-dual algorithm for convex problems with applications to imaging [J].Journal of Mathematical Imaging and Vision, 2011, 40(1): 120-145.

WANG Y L, YANG J F, YIN WT, et al. A new alternating minimization algorithm for total variation image reconstruction [J]. SIAM Journal on Imaging Sciences, 2008, 1(3): 248-272.

DABOV K, FOI A, KATKOVNIK V, et al. Image restoration by sparse 3D transform-domain collaborative filtering [C]//Proceedings of SPIE 6812, Image Processing: Algorithms and Systems Ⅵ. San Jose, CA: SPIE, 2008: 2080-2095.

王素玉, 卓力, 沈兰荪, 等.一种简单有效的视频序列超分辨率复原算法[J].北京工业大学学报, 2009, 35(6):742-747.

WANG S Y, ZHUO L, SHEN L S, et al. A simple & effective video sequence super-resolution algorithm[J]. Journal of Beijing University of Technology, 2009, 35(6): 742-747. (in Chinese)

PARK S C, PARK M K, KANG M G. Super-resolution image reconstruction: a technical overview [J].IEEE Signal Processing Magazine, 2003, 20(3): 21-36.

XU L, ZHENG S C, JIA J Y. Unnatural L0 sparse representation for natural image deblurring [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Portland: IEEE, 2013: 1107-1114.

CHAN S H, NGUYEN T Q. LCD motion blur: modeling, analysis, and algorithm [J]. IEEE Transactions on Image Processing, 2011, 20(8): 2352-2365.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Compressed wavefront sensing based on deep neural network for atmospheric turbulence

Progress of degraded image restoration methods

Atmospheric turbulence image denoising algorithm based on wavelet-domain curvelet transform

Related Author

HU Li-fa

YU Lin

WU Jing-jing

YANG Yan-yan

JIANG Lü

FENG Jia-hao

HU Qi-li

HUA Sheng-xiao

Related Institution

School of Science， Jiangnan University

Key Laboratory of Electro-Optical Countermeasures Test & Evaluation Technology

Jiangsu Provincial Research Center of Light Industry Opto-Electronic Engineering and Technology

The Institute of Information Science & Technology, South China Business College, Guangdong University of Foreign Studies

Unit of People's Liberation Army

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰