基于多尺度残差网络的CT图像超分辨率重建

吴磊; 吕国强; 赵晨; 盛杰超; 冯奇斌

doi:10.3788/YJYXS20193410.1006

您当前的位置：

首页 >

文章列表页 >

基于多尺度残差网络的CT图像超分辨率重建

图像处理 | 更新时间：2020-08-12

- 基于多尺度残差网络的CT图像超分辨率重建
- CT image super-resolution reconstruction based on multi-scale residual network
- 液晶与显示 2019年34卷第10期页码：1006-1012
- 作者机构：
  
  1.合肥工业大学特种显示技术国家工程实验室现代显示技术省部共建国家重点实验室光电技术研究院, 安徽合肥 230009
  2.合肥工业大学电子科学与应用物理学院, 安徽合肥 230009
  3.合肥工业大学仪器科学与光电工程学院, 安徽合肥 230009
- 作者简介：
  
  [ "吴磊(1994—), 男, 安徽利辛人, 硕士研究生, 2017年于安徽工程大学获得学士学位, 主要从事超分辨率重建、液晶显示以及深度学习等方面的研究。E-mail:wulei@mail.hfut.edu.cn" ]
  [ "冯奇斌(1970—), 女, 天津人, 博士, 副教授, 硕士生导师, 2006年于维也纳工业大学获得博士学位, 主要从事立体显示、LED背光等方面的研究。E-mail:fengqibin@hfut.edu.cn" ]
- 基金信息：
  
  安徽省科技重大专项(17030901053);Anhui Province Science and Technology Major Project(17030901053)
- DOI：10.3788/YJYXS20193410.1006
  中图分类号： TP391.4
- 收稿日期：2019-06-13，
  
  录用日期：2019-8-18，
  
  纸质出版日期：2019-10-05
- 稿件说明：
移动端阅览
吴磊, 吕国强, 赵晨, 等. 基于多尺度残差网络的CT图像超分辨率重建[J]. 液晶与显示, 2019,34(10):1006-1012.

Lei WU, Guo-qiang LYU, Chen ZHAO, et al. CT image super-resolution reconstruction based on multi-scale residual network[J]. Chinese journal of liquid crystals and displays, 2019, 34(10): 1006-1012.
吴磊, 吕国强, 赵晨, 等. 基于多尺度残差网络的CT图像超分辨率重建[J]. 液晶与显示, 2019,34(10):1006-1012. DOI： 10.3788/YJYXS20193410.1006.

Lei WU, Guo-qiang LYU, Chen ZHAO, et al. CT image super-resolution reconstruction based on multi-scale residual network[J]. Chinese journal of liquid crystals and displays, 2019, 34(10): 1006-1012. DOI： 10.3788/YJYXS20193410.1006.

摘要

为了将超分辨率重建算法应用于医学影像领域，提升各类医学影像的分辨率，针对当前主流算法网络结构和分辨率提升倍数的尺度单一性问题，提出了一种应用于CT图像的多尺度残差网络模型。首先，通过级联多层残差块构建模型框架，残差块内采用3种尺度的卷积核提取低分辨率图像的细节特征。然后，将特征图融合在一个维度进行特征映射和数据降维，并将多尺度特征信息导入下一残差块。最后，将网络学习到的残差图与低分辨率图像融合，重建高分辨率图像。采用经过多种放大倍数处理的CT图像对网络进行混合训练，实现了一个模型可以同时支持多种倍数的分辨率提升。实验结果表明：在2，3，4倍放大因子下，该模型重建的CT图像PSNR平均较VDSR算法高0.87，0.83，1.16 dB。因此，本文模型有效提升了CT图像的超分辨率重建效果，更锐利地恢复了其细节特征，同时大大提升了算法实用性。

Abstract

In order to apply the super-resolution reconstruction algorithm to the field of medical imaging and improve the resolution of various medical images

a multi-scale residual network model applied to CT images is proposed for the problem of the singleness of the network structure and the resolution multiplier of the current mainstream algorithm. Firstly

the model framework is built by cascading multi-level residual blocks

and the convolution kernels of three scales are used in the residual block to extract the detailed features of low-resolution images. Then

the feature map is fused in one dimension for feature mapping and data dimensionality reduction

and the multi-scale feature information is imported into the next residual block. Finally

the residual map calculated by the network is merged with the low-resolution image to reconstruct the high-resolution image. The network is trained by CT images processed by multiple magnifications

and so that a model can support multiple resolution enhancements at the same time. The experimental results show that under the 2

and 4 times magnification factors

the PSNR of the reconstructed CT image is 0.87

0.83

1.16 dB higher than the VDSR algorithm. Therefore

the model of this paper effectively improves the super-resolution reconstruction effect of CT images

restores its detailed features more sharply

and greatly improves the practicality of the algorithm.

关键词

Keywords

references

GAO Y X, LI H J, DONG J W, et al . A deep convolutional network for medical image super-resolution[C]// Proceedings of 2017 Chinese Automation Congress ( CAC ) Jinan, China: IEEE, 2017: 5310-5315.

CHEN H G, HE X H, TENG Q Z, et al . Single image super resolution using local smoothness and nonlocal self-similarity priors[J]. Signal Processing : Image Communication , 2016, 43: 68-81.

ZHANG H Y, ZHANG L P, SHEN H F. A blind super-resolution reconstruction method considering image registration errors[J]. International Journal of Fuzzy Systems , 2015, 17(2): 353-364.

ZHANG L, WU X L. An edge-guided image interpolation algorithm via directional filtering and data fusion[J]. IEEE Transactions on Image Processing , 2006, 15(8): 2226-2238.

BÄTZ M, EICHENSEER A, SEILER J, et al . Hybrid super-resolution combining example-based single-image and interpolation-based multi-image reconstruction approaches[C]// Proceedings of 2015 IEEE International Conference on Image Processing ( ICIP ). Quebec City, QC, Canada: IEEE, 2015: 58-62.

KIM K I, KWON Y. Single-image super-resolution using sparse regression and natural image prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2010, 32(6): 1127-1133.

TIMOFTE R, DE V, VAN GOOL L. Anchored neighborhood regression for fast example-based super-resolution[C]// Proceedings of 2013 IEEE International Conference on Computer Vision . Sydney, NSW, Australia: IEEE, 2013: 1920-1927.

HUANG J B, SINGH A, AHUJA N. Single image super-resolution from transformed self-exemplars[C]// Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition . Boston, MA, USA: IEEE, 2015: 5197-5206.

FREEMAN W T, JONES T R, PASZTOR E C. Example-based super-resolution[J]. IEEE Computer Graphics and Applications , 2002, 22(2): 56-65.

YANG J C, WRIGHT J, HUANG T, et al . Image super-resolution via sparse representation[J]. IEEE Transactions on Image Processing , 2010, 19(11): 2861-2873.

DONG C, LOY C C, HE K M, et al . Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2016, 38(2): 295-307.

DONG C, LOY C C, TANG X. Accelerating the super-resolution convolutional neural network[C]// Proceedings of the 14th European Conference on Computer Vision . Amsterdam, Netherlands: Springer, 2016: 391-407.

KIM J, LEE J K, LEE K M. Accurate image super-resolution using very deep convolutional networks[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas, NV, USA: IEEE, 2016: 1646-1654.

席志红, 侯彩燕, 袁昆鹏, 等.基于深层残差网络的加速图像超分辨率重建[J].光学学报, 2019, 39(2):0210003.

XI Z H, HOU C Y, YUAN K P, et al . Super-resolution reconstruction of accelerated image based on deep residual network[J]. Acta Optica Sinica , 2019, 39(2): 0210003. (in Chinese)

陈清江, 张雪, 柴昱洲.基于卷积神经网络的图像去雾算法[J].液晶与显示, 2019, 34(2):220-227.

CHEN Q J, ZHANG X, CHAI Y Z. Image defogging algorithms based on multiscale convolution neural network[J]. Chinese Journal of Liquid Crystals and Displays , 2019, 34(2): 220-227. (in Chinese)

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于多级联递进卷积结构的图像去雨算法

无人机绝对视觉定位的研究进展

基于自适应遮挡恢复与拓扑姿态双向感知的三维手部重建方法

基于Mamba-2的视频快照压缩成像重构方法