Design of real-time color image acquisition system based on FPGA

LI Hua; ZHU Bo

doi:10.3788/YJYXS20142902.0258

您当前的位置：

首页 >

文章列表页 >

Design of real-time color image acquisition system based on FPGA

Table of contents | 更新时间：2020-08-12

- Design of real-time color image acquisition system based on FPGA
- Chinese Journal of Liquid Crystals and Displays Vol. 29, Issue 2, Pages: 258-265(2014)
- 作者机构：
  
  1. 中国科学院西安光学精密机械研究所,陕西西安,710119
  2. 商洛学院,陕西商洛,726000
  3. 西安交通大学-西安光学精密机械研究所空间视觉联合实验室,陕西西安,710049
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20142902.0258
  CLC： TP274
- Received：14 June 2013，
  
  Revised：22 July 2013，
  
  Published：05 March 2014
- 稿件说明：
移动端阅览
李华, 朱波. 基于FPGA的彩色图像实时采集系统设计[J]. 液晶与显示, 2014,29(2): 258-265

LI Hua, ZHU Bo. Design of real-time color image acquisition system based on FPGA[J]. , 2014,29(2): 258-265
李华, 朱波. 基于FPGA的彩色图像实时采集系统设计[J]. 液晶与显示, 2014,29(2): 258-265 DOI： 10.3788/YJYXS20142902.0258.

LI Hua, ZHU Bo. Design of real-time color image acquisition system based on FPGA[J]. , 2014,29(2): 258-265 DOI： 10.3788/YJYXS20142902.0258.

摘要

为了从单片Bayer格式图像探测器获取高质量实时彩色图像，研究并设计了一套基于FPGA硬件的彩色图像实时采集系统。介绍了针对MT9M011图像探测器的寄存器配置时序的设计。重点研究了影响彩色图像质量的Bayer格式图像去马赛克算法，该算法首先对Bayer格式原图进行二阶拉普拉斯修正，利用色差和梯度关系确定丢失的绿色分量，再结合给定像素周围的4个色差进行插值计算，分别得到丢失的红色分量和蓝色分量，从而完成彩色图像的恢复。设计了基于千兆以太网（GigE）的图像传输机制，使系统数据吞吐率大大提高。实验数据表明，系统插值算法在峰值信噪比（PSNR）方面相比双线性插值，R、G、B三通道均提高约15 dB左右，图像目视细节丰富，伪彩色得到有效抑制；在分辨率为1 2801 024、帧频为15 f/s的情况下，可以实时输出全彩色图像。目前，系统已经工程应用，其优异表现满足了项目实际需要。

Abstract

In order to obtain high quality real-time full color image with a single image sensor coated with Bayer CFA

this paper researches and designs an improved real-time color image acquisition system based on FPGA. Firstly

design of MT9M011 sensor registers setting timing is introduced. And then

the paper pays key attention to demosaicking algorithm which is critical to the color image quality.The proposed demosaicking algorithm adopts the second-order Laplacian interpolation filter to the Bayer pattern image

and combines with chrominance and gradient for choosing the missing green samples.After the green channel has been reconstructed

we interpolate R and B as the average of the four nearest neighbors. By now

the full color image is reconstructed. Finally

GigE based image transmission is implemented to improve the image throughput. Experimental results proved that on average the improvement is 15 dB over the Bilinear Algorithm (BI) in PSNR and it produces visually more pleasant color images details with color artifacts greatly suppressed. Real-time 1 2801 024 resolution color image read-out could be achieved at speed 15 f/s. Now

the design is successfully used in our camera system

the perfect restoration quality and effectiveness meets the requirement of system design.

关键词

Keywords

references

Bayer B E.Color imaging array:US Patent, 3 971 065[P].1975-03-05.[2] 王暕来, 杨春玲. 基于最大类间方差法的图像分割系统的设计与实现[EB/OL].http://www.altera.com.cn/education/univ/local/events/articles/july08-3.pdf. Wang J L, Yang C L.Implementation of image segmentation system based on Otsu method[EB/OL].http://www.altera.com.cn/education/univ/local/events/articles/july08-3.pdf.[3] Henrique S M, He L W, Ross C. High-quality linear interpolation for demosaicing of bayer-patterned color images[C].IEEE International Conference on Acoustics, Quebec, Canada:Speech and Signal Processing:2004:485-488.[4] Adams J E, Hamilton J F.Adaptive color plane interpolation in single color electronic camera:US Patent, 5 506 619[P].1996-04-14.[5] Zhang L, Wu X L. Color demosaicking via directional linear minimum mean square-error estimation[J].IEEE Transactions on Image Processing, 2005, 14(12): 2167-2178.[6] Zhang L, Wu X L, Antoni B, et al. Color demosaicking by local directional interpolation and nonlocal adaptive thresholding[J].Journal of Electronic Imaging, 2011, 20(2):203016(1-16).[7] Daniele M, Stefano A, Giancarlo C. Demosaicing with directional filtering and a posteriori decision[J].IEEE Transactions on Image Processing, 2007, 16(1):132-141.[8] Zhang L, Dong W S, Wu X L, et al.Spatial-temporal color video reconstruction from noisy CFA sequence[J].IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(6):838-847.[9] 朱波, 汶德胜, 王飞, 等. 应用字典学习算法改善Bayer格式图像彩色恢复效果[J]. 电子与信息学报, 2013, 35(4): 8-16. Zhu B, Wen D S, Wang F, et al. Improvement of Bayer-pattern demosaicking with dictionary learning algorithm[J].Jounal of Electronics & Information Technology, 2013, 35(4): 8-16. (in Chinese)[10] 张传胜. 基于SOPC的通用液晶屏人机交互系统GUI的设计[J]. 液晶与显示, 2013, 28(2):250-254. Zhang C S.Design of man-machine interaction systems based on LCD screen of SOPC[J].Chinese Journal of Liquid Crystals and Displays, 2013, 28(2):250-254. (in Chinese)[11] 王静轩, 尹传历. 基于DSP和FPGA的嵌入式实时图像增强系统[J]. 液晶与显示, 2013, 28(3):459-463. Wang J X, Yin C L.Embedded color image enhancement system based on DSP and FPGA[J].Chinese Journal of Liquid Crystals and Displays, 2013, 28(3):459-463. (in Chinese)[12] Micron Inc.MT9M011 datasheet[OL].[2004-01-05].http://www.ic5.cn/p_MT9M011_nzw.html.[13] 朱波, 汶德胜, 王飞. 改进的Bayer插值算法及其硬件实现[J]. 光电子激光, 2013, 24(6): 1211-1218. Zhu B, Wen D S, Wang F.Improved bayer-pattern demosaicking and its hardware design[J].Journal of OptoelectronicsLaser, 2012, 24(6): 1211-1218. (in Chinese)[14] Kolta R W B, Aly H A, Fakhr W. A hybrid demosaicking algorithm using frequency domain and wavelet methods[C]//International Conference on Image Information Processing, 2011:1-6.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Design of heterogeneous FPGA hardware accelerator based on CNN

Design and implementation of piecewise approximation bilateral filtering algorithm based on FPGA

Design of serial bus data distribution chip for LED display

Design of multi-channel real-time video processing system based on FPGA

Adaptive night scene enhancement system design and implementation based on FPGA

Related Author

JI Haolin

XU Wei

PIAO Yongjie

WU Xiaobin

GAO Tan

LIU Shiyu

ZHAO Xiadong

WEN Pan

Related Institution

Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences

University of Chinese Academy of Sciences

Key Laboratory of Space-based Dynamic & Rapid Optical Imaging Technology， Chinese Academy of Sciences

School of Microelectronics， Shanghai University

Key Laboratory of Advanced Display and System Applications of Ministry of Education， Shanghai University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰