基于Hadoop的交通视频大数据监控方案

李晓蕾

doi:10.37188/YJYXS20203511.1204

您当前的位置：

首页 >

文章列表页 >

基于Hadoop的交通视频大数据监控方案

图像处理 | 更新时间：2020-10-30

- 基于Hadoop的交通视频大数据监控方案
- Big video monitoring scheme of traffic video based on Hadoop
- 液晶与显示 2020年35卷第11期页码：1204-1209
- 作者机构：
  
  宁波财经学院, 浙江宁波 315175
- 作者简介：
  
  [ "李晓蕾(1981-), 女, 浙江宁波人, 硕士, 副教授, 2010年于浙江大学获得硕士学位, 主要从事数据挖掘、算法等方面的研究。E-mail:lixiaolei11291129@163.com" ]
- 基金信息：
  
  浙江省基础公益研究项目(LQ20F020025)
- DOI：10.37188/YJYXS20203511.1204
  中图分类号： TP274
- 收稿日期：2019-12-17，
  
  修回日期：2020-03-04，
  
  录用日期：2020-3-4，
  
  纸质出版日期：2020-11-05
- 稿件说明：
移动端阅览
李晓蕾. 基于Hadoop的交通视频大数据监控方案[J]. 液晶与显示, 2020,35(11):1204-1209.

Xiao-lei LI. Big video monitoring scheme of traffic video based on Hadoop[J]. Chinese journal of liquid crystals and displays, 2020, 35(11): 1204-1209.
李晓蕾. 基于Hadoop的交通视频大数据监控方案[J]. 液晶与显示, 2020,35(11):1204-1209. DOI： 10.37188/YJYXS20203511.1204.

Xiao-lei LI. Big video monitoring scheme of traffic video based on Hadoop[J]. Chinese journal of liquid crystals and displays, 2020, 35(11): 1204-1209. DOI： 10.37188/YJYXS20203511.1204.

摘要

为了解决海量交通视频数据的监控和分析问题，本文对Hadoop大数据背景下的交通视频监控技术进行了深入研究，提出了基于交通视频数据的异常检测算法的设计方案，实现了交通数据的实时更新和异常分析，同时针对海量交通监控视频，设计了基于Hadoop组件MapReduce的并行实现算法，并通过浙江省某市的实际交通数据验证算法的有效性和准确性。经过实验证明，本文算法可以有效计算出交通拥堵情况和异常情况，相对于传统方案，本文方案可以聚焦10 min范围内的时间粒度对交通情况进行实时分析，相对于传统的分布式计算模型，本文的方案10 min延迟可以控制在2.1 s，比传统方案延迟降低了81%，基本满足交通视频监控的实时和细颗粒度等要求。

Abstract

In order to solve the problem of monitoring and analyzing massive traffic video data

the in-depth research on traffic video surveillance technology in the context of hadoop big data is conducted

and a design scheme of anomaly jam detection algorithm is proposed based on traffic video data to realize traffic real-time data update and anomaly analysis. At the same time

for the massive traffic monitoring video

a parallel implementation algorithm is designed based on Hadoop component MapReduce. Finally

the effectiveness and accuracy of the algorithm is verified by actual traffic data of a city in Zhejiang Province. The algorithm in this paper can effectively calculate the traffic congestion and abnormal conditions. Compared with the traditional scheme

this scheme can focus on the time granularity in the range of 10 min to analyze the traffic situation in real time. Compared with the traditional distributed computing model

the 10 minute delay of this scheme can be controlled at 2.1 s

which is 81% lower than the traditional scheme

which basically meets the real-time

fine-grained requirements for traffic video surveillance requirements.

关键词

Keywords

references

许乐 . 自动化系统视频图数据格式分析 . 科技视界 , 2016 . ( 17 ): 81 - 82 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hqsgkj201617063 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hqsgkj201617063 .

L XU . Analysis of video data format of automation system . Science & Technology Vision , 2016 . ( 17 ): 81 - 82 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hqsgkj201617063 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=hqsgkj201617063 .

毛建森 , 屈玉福 . 基于压缩感知的变尺度目标跟踪技术 . 液晶与显示 , 2016 . 31 ( 5 ): 497 - 505 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705452&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705452&Fpath=&index=-1&l=zh .

J S MAO , Y F QU . Tracking of variable scale object based on compressive sensing . Chinese Journal of Liquid Crystals and Displays , 2016 . 31 ( 5 ): 497 - 505 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705452&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705452&Fpath=&index=-1&l=zh .

钱方 , 孙涛 , 郭劲 , 等 . 采用图像特征的激光干扰跟踪效果评估 . 液晶与显示 , 2014 . 29 ( 5 ): 805 - 811 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1700469&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1700469&Fpath=&index=-1&l=zh .

F QIAN , T SUN , J GUO , 等 . Assessment of laser-dazzling effects on tracking through image feature measurements . Chinese Journal of Liquid Crystals and Displays , 2014 . 29 ( 5 ): 805 - 811 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1700469&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1700469&Fpath=&index=-1&l=zh .

陈莹 , 朱明 , 刘剑 , 等 . 高斯混合模型自适应微光图像增强 . 液晶与显示 , 2015 . ( 2 ): 300 - 309 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1702170&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1702170&Fpath=&index=-1&l=zh .

Y CHEN , M ZHU , J LIU , 等 . Automatic low light level image enhancement using Gaussian mixture modeling . Chinese Journal of Liquid Crystals and Displays , 2015 . ( 2 ): 300 - 309 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1702170&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1702170&Fpath=&index=-1&l=zh .

周晨卉 , 王生进 , 丁晓青 . 基于局部特征级联分类器和模板匹配的行人检测 . 中国图象图形学报 , 2010 . 15 ( 5 ): 824 - 829 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201005018 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201005018 .

C H ZHOU , S J WANG , X Q DING . Pedestrian detection based on partial feature and model matching . Journal of Image and Graphics , 2010 . 15 ( 5 ): 824 - 829 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201005018 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=zgtxtxxb-a201005018 .

江鹏宇 , 杨耀权 , 彭蹦 . 一种用于电力监控的行人运动检测与跟踪算法 . 电力科学与工程 , 2019 . 35 ( 6 ): 31 - 36 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dlqb201906005 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dlqb201906005 .

P Y JIANG , Y Q YANG , B PENG . A pedestrian motion detection and tracking algorithm for electrical power monitoring . Electric Power Science and Engineering , 2019 . 35 ( 6 ): 31 - 36 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dlqb201906005 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dlqb201906005 .

毕莎莎 , 陈清华 . 基于Hadoop视频转码缓存策略的研究 . 计算机工程与设计 , 2015 . ( 3 ): 683 - 686, 692 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjgcysj201503024 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjgcysj201503024 .

S S BI , Q H CHEN . Caching strategies based on video transcoding using Hadoop . Computer Engineering and Design , 2015 . ( 3 ): 683 - 686, 692 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjgcysj201503024 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjgcysj201503024 .

刘云恒 , 刘耀宗 . 基于Hadoop的公安视频大数据的处理方法 . 计算机科学 , 2016 . 43 ( S1 ): 448 - 451, 475 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjkx2016z1105 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjkx2016z1105 .

Y H LIU , Y Z LIU . Hadoop-based public security video big data processing method . Computer Science , 2016 . 43 ( S1 ): 448 - 451, 475 . http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjkx2016z1105 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjkx2016z1105 .

连彬彬 , 黄风华 , 谢小烽 , 等 . 基于云计算与GPU的大数据挖掘比较 . 电子技术与软件工程 , 2017 . ( 13 ): 182 - 184 . http://www.cqvip.com/QK/80675X/201713/672511496.html http://www.cqvip.com/QK/80675X/201713/672511496.html .

B B LIAN , F H HUANG , X F XIE , 等 . Comparison of big data mining based on cloud computing and GPU . Electronic Technology and Software Engineering , 2017 . ( 13 ): 182 - 184 . http://www.cqvip.com/QK/80675X/201713/672511496.html http://www.cqvip.com/QK/80675X/201713/672511496.html .

韩红霞 , 孙航 , 张海波 . 基于FPGA的视频与通讯数据融合设计 . 液晶与显示 , 2015 . ( 6 ): 987 - 991 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705132&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705132&Fpath=&index=-1&l=zh .

H X HAN , H SUN , H B ZHANG . Composition design of communication data and video data based on FPGA . Chinese Journal of Liquid Crystals and Displays , 2015 . ( 6 ): 987 - 991 . http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705132&Fpath=&index=-1&l=zh http://cjlcd.lightpublishing.cn/thesisDetails?columnId=1705132&Fpath=&index=-1&l=zh .

C R KUMAR , S SUGUNA . Visual semantic based 3D video retrieval system using HDFS . KSII Transactions on Internet and Information Systems , 2016 . 10 ( 8 ): 3806 - 3825 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于FPGA的Winograd算法卷积神经网络加速器设计与实现

基于FPGA实现CT图像重建加速的设计