3 D human-machine interaction based on human eye detection

Zhao-hong XUE; Zi-han SUN; Ze-rui CHENG; Heng FANG; Zi-zhao HUANG; Jiao-yang LI; Zhi-gang CAI; Jia-hui HUANG

doi:10.3788/YJYXS20183311.0958

您当前的位置：

首页 >

文章列表页 >

3 D human-machine interaction based on human eye detection

Image Processing | 更新时间：2020-08-12

- 3 D human-machine interaction based on human eye detection
- Chinese Journal of Liquid Crystals and Displays Vol. 33, Issue 11, Pages: 958-964(2018)
- 作者机构：
  
  1.中山大学电子与信息工程学院, 广东广州 510275
  2.中山大学物理学院物理实验教学中心, 广东广州 510275
- 作者简介：
- 基金信息：
- DOI：10.3788/YJYXS20183311.0958
  CLC： TN27
- Received：12 April 2018，
  
  Accepted：16 July 2018，
  
  Published：05 November 2018
- 稿件说明：
移动端阅览
Zhao-hong XUE, Zi-han SUN, Ze-rui CHENG, et al. 3 D human-machine interaction based on human eye detection[J]. Chinese journal of liquid crystals and displays, 2018, 33(11): 958-964.
DOI：

Zhao-hong XUE, Zi-han SUN, Ze-rui CHENG, et al. 3 D human-machine interaction based on human eye detection[J]. Chinese journal of liquid crystals and displays, 2018, 33(11): 958-964. DOI： 10.3788/YJYXS20183311.0958.

摘要

随着3D显示技术的逐渐成熟，越来越多基于3D显示技术的产品被应用于各个领域，例如3D电影、裸眼3D电视、体感交互式系统和影像教学等。基于3D显示的人机交互系统也是近年来越来越热门的研究方向，但是却没有高效地利用深度信息作为交互的线索，因此本文提出将3D显示与体感交互结合，实现立体人机交互的虚拟键盘，让用户只需点击屏幕前方键盘的图像即可进行对应按键信息的录入和编辑，其帧率可达10.6 fps。针对3D显示中用户视角偏离会导致按键的像在视觉上的偏移，容易造成误输入的问题，在系统中整合人眼检测功能，修正因视角偏离带来按键定位误差，从而实现了准确率100%的字符输入交互功能。

Abstract

With the growing of 3D display

more and more products based on 3D display are used in various fields

for example

3D movies

auto-stereoscopic television

3D surgery

etc. Human-computer interaction (HCI) system based on 3D display is also a popular research direction in recent years. However

most of these systems don't use depth information as a clue for interaction which limit interaction orientation into a 2D plane. To extend control on depth direction

a novel HCI system based on 3D display is presented. The system shows a keyboard style interaction interface by a 3D monitor

and uses binocular cameras to acquire the gesture and positions of the user's hand and fingers which can input information to the computer. And the system input frame rate can reach 10.6 fps. For problem that the movement of the user will cause the image of the button in his vision to be shifted correspondingly

which may cause incorrect input the human eye detection is integrated into the system. By the optimization of user's viewing angle calibration

we can correct button's positioning error

thus achieve a great accuracy of character input 100%.

关键词

Keywords

references

王琼华, 邓欢.集成成像3D拍摄与显示方法[J].液晶与显示, 2014, 29(2):153-158.

WANG Q H, DENG H. 3D pickup and display method of integral imaging[J]. Chinese Journal of Liquid Crystals and Displays , 2014, 29(2):153-158. (in Chinese)

LUEDER E. 3D显示技术[M]. 余宏生, 王彤彤, 梅军进, 译. 北京: 电子工业出版社, 2016.

LUEDER E. 3 D display [M]. YU H S, WANG T T, MEI J J, trans. Beijing: Publishing House of Electronics Industry, 2016.

孙博.裸眼3D显示技术的现状与发展[J].科技传播, 2017, 9(21):115-116.

SUN B. Present situation and development of naked eye 3D display technology[J]. Public Communication of Science & Technology , 2017, 9(21):115-116.

林孜铠, 戴思璋, 梁浩文, 等.基于混合颜色空间与码本背景减除的虚拟触控优化技术[J].液晶与显示, 2015, 30(4):722-728.

LIN Z K, DAI S Z, LIANG H W, et al . Touch technology based on mixed color space and codebook background difference[J]. Chinese Journal of Liquid Crystals and Displays , 2015, 30(4):722-728. (in Chinese)

张超, 王琼华, 李大海, 等.从平面图生成多视点自由立体显示视差图的研究[J].液晶与显示, 2009, 24(2):258-261.

ZHANG C, WANG Q H, LI D H, et al . Capture of parallax image from 2D images for multi-view auto-stereoscopic display[J]. Chinese Journal of Liquid Crystals and Displays , 2009, 24(2):258-261. (in Chinese)

刘江华, 陈佳品, 程君实.双目视觉平台的研究[J].机器人技术与应用, 2002(1):36-40.

LIU J H, CHEN J P, CHENG J S. Research on binocular vision platform[J]. Robot Technique and Application , 2002(1):36-40. (in Chinese)

林岱昆, 梁伟棠, 梁浩文, 等.基于人脸跟踪的时空无缝裸眼3D显示技术研究[J].电视技术, 2015, 39(5):70-73, 77.

LIN D K, LIANG W T, LIANG H W, et al . Spatially and temporally seamless autostereoscopic display technology research based on face-tracking[J]. Video Engineering , 2015, 39(5):70-73, 77. (in Chinese)

龙伶敏. 基于Adaboost的人脸检测方法及眼睛定位算法研究[D]. 成都: 电子科技大学, 2008. http://cdmd.cnki.com.cn/Article/CDMD-10614-2008122744.htm

LONGL M. Face detection method and eye location algorithm based on Adaboost[D]. Chengdu: University of Electronic Science and Technology of China, 2008. (in Chinese)

胡涛, 冯玉娜, 王亚丹, 等. 一种人脸三庭五眼自动定位及比例确定方法: 中国, 104021550B[P]. 2017-01-18.

HU T, FENG Y N, WANG Y D, et al . A method of automatic location and proportion determination of three faces and five eyes in human faces: CN, 104021550B[P]. 2017-01-18. (in Chinese)

张华坤, 王敏, 罗开, 等.三庭五眼的最佳定点探索[J].医学与哲学:B, 2017, 38(5):64-69.

ZHANG H K, WANG M, LUO K, et al . A study of the best fixed-point of facial proportions[J]. Medicine & Philosophy:B , 2017, 38(5):64-69. (in Chinese)

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Face detection algorithm based on LVQ neural network model

Face detection algorithm based on skin color location

Human eye locating and tracking using space-time context and random forest

Visual saliency based gray-to-gray crosstalk evaluation in stereoscopic displays

Related Author

Yan WANG

Meng QI

Guo-jun LIN

Ming-zhong YANG

Ming-ju CHEN

Mei XIE

Lin-tao LIU

Xue-ying DONG

Related Institution

School of Electronics Engineering, Chengdu Technological University

School of Automation & Information Engineering, Sichuan University of Science & Engineering

School of Electronic Engineering, University of Electronic Science and Technology of China

Research Institute Electronic Science and Technology, University of Electronic Science and Technology of China

College of Big Data and Information Engineering, Guizhou University

AI问答

Address：No.3888 Dong Nanhu Road, Changchun, Jilin, China 130033 Postal code：130033
Tel：0431-86176059 Email：yjxs@ciomp.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 吉ICP备11002662号-17 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰