{"defaultlang":"zh","titlegroup":{"articletitle":[{"lang":"zh","data":[{"name":"text","data":"基于人眼检测优化的立体人机交互技术的研究"}]},{"lang":"en","data":[{"name":"text","data":"3 D human-machine interaction based on human eye detection"}]}]},"contribgroup":{"author":[{"name":[{"lang":"zh","surname":"薛","givenname":"钊鸿","namestyle":"eastern","prefix":""},{"lang":"en","surname":"XUE","givenname":"Zhao-hong","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff1","text":"1"}],"role":["first-author"],"bio":[{"lang":"zh","text":["薛钊鸿(1993-), 男, 广东江门人, 硕士研究生, 主要从事图像处理技术及应用的研究。E-mail:xue_zhaohong@qq.com"],"graphic":[],"data":[[{"name":"text","data":"薛钊鸿(1993-), 男, 广东江门人, 硕士研究生, 主要从事图像处理技术及应用的研究。E-mail:"},{"name":"text","data":"xue_zhaohong@qq.com"}]]}],"email":"xue_zhaohong@qq.com","deceased":false},{"name":[{"lang":"zh","surname":"孙","givenname":"梓瀚","namestyle":"eastern","prefix":""},{"lang":"en","surname":"SUN","givenname":"Zi-han","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff1","text":"1"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"成","givenname":"泽锐","namestyle":"eastern","prefix":""},{"lang":"en","surname":"CHENG","givenname":"Ze-rui","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff1","text":"1"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"方","givenname":"衡","namestyle":"eastern","prefix":""},{"lang":"en","surname":"FANG","givenname":"Heng","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff2","text":"2"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"黄","givenname":"梓钊","namestyle":"eastern","prefix":""},{"lang":"en","surname":"HUANG","givenname":"Zi-zhao","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff1","text":"1"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"李","givenname":"佼洋","namestyle":"eastern","prefix":""},{"lang":"en","surname":"LI","givenname":"Jiao-yang","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff2","text":"2"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"蔡","givenname":"志岗","namestyle":"eastern","prefix":""},{"lang":"en","surname":"CAI","givenname":"Zhi-gang","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff2","text":"2"}],"role":[],"deceased":false},{"name":[{"lang":"zh","surname":"王","givenname":"嘉辉","namestyle":"eastern","prefix":""},{"lang":"en","surname":"HUANG","givenname":"Jia-hui","namestyle":"western","prefix":""}],"stringName":[],"aff":[{"rid":"aff2","text":"2"}],"role":["corresp"],"corresp":[{"rid":"cor1","lang":"zh","text":"王嘉辉, E-mail: wangjh@mail.sysu.edu.cn","data":[{"name":"text","data":"王嘉辉, E-mail: wangjh@mail.sysu.edu.cn"}]}],"bio":[{"lang":"zh","text":["王嘉辉(1979-), 男, 广东广州人, 博士, 实验师, 2009年于中山大学获得硕士学位, 2014年于中山大学获得博士学位, 主要从事3D显示、图像处理方面研究。E-mail: wangjh@mail.sysu.edu.cn"],"graphic":[],"data":[[{"name":"text","data":"王嘉辉(1979-), 男, 广东广州人, 博士, 实验师, 2009年于中山大学获得硕士学位, 2014年于中山大学获得博士学位, 主要从事3D显示、图像处理方面研究。E-mail: "},{"name":"text","data":"wangjh@mail.sysu.edu.cn"}]]}],"email":"wangjh@mail.sysu.edu.cn","deceased":false}],"aff":[{"id":"aff1","intro":[{"lang":"zh","label":"1","text":"中山大学 电子与信息工程学院, 广东 广州 510275","data":[{"name":"text","data":"中山大学 电子与信息工程学院, 广东 广州 510275"}]},{"lang":"en","label":"1","text":"School of Electronics and Information Technology, SunYat-sen University, Guangzhou 510275, China","data":[{"name":"text","data":"School of Electronics and Information Technology, SunYat-sen University, Guangzhou 510275, China"}]}]},{"id":"aff2","intro":[{"lang":"zh","label":"2","text":"中山大学 物理学院 物理实验教学中心, 广东 广州 510275","data":[{"name":"text","data":"中山大学 物理学院 物理实验教学中心, 广东 广州 510275"}]},{"lang":"en","label":"2","text":"Physics Experiment Teaching Center, School of Physics, Sun Yat-sen University, Guangzhou 510275, China","data":[{"name":"text","data":"Physics Experiment Teaching Center, School of Physics, Sun Yat-sen University, Guangzhou 510275, China"}]}]}]},"abstracts":[{"lang":"zh","data":[{"name":"p","data":[{"name":"text","data":"随着3D显示技术的逐渐成熟，越来越多基于3D显示技术的产品被应用于各个领域，例如3D电影、裸眼3D电视、体感交互式系统和影像教学等。基于3D显示的人机交互系统也是近年来越来越热门的研究方向，但是却没有高效地利用深度信息作为交互的线索，因此本文提出将3D显示与体感交互结合，实现立体人机交互的虚拟键盘，让用户只需点击屏幕前方键盘的图像即可进行对应按键信息的录入和编辑，其帧率可达10.6 fps。针对3D显示中用户视角偏离会导致按键的像在视觉上的偏移，容易造成误输入的问题，在系统中整合人眼检测功能，修正因视角偏离带来按键定位误差，从而实现了准确率100%的字符输入交互功能。"}]}]},{"lang":"en","data":[{"name":"p","data":[{"name":"text","data":"With the growing of 3D display, more and more products based on 3D display are used in various fields, for example, 3D movies, auto-stereoscopic television, 3D surgery, etc. Human-computer interaction (HCI) system based on 3D display is also a popular research direction in recent years. However, most of these systems don't use depth information as a clue for interaction which limit interaction orientation into a 2D plane. To extend control on depth direction, a novel HCI system based on 3D display is presented. The system shows a keyboard style interaction interface by a 3D monitor, and uses binocular cameras to acquire the gesture and positions of the user's hand and fingers which can input information to the computer. And the system input frame rate can reach 10.6 fps. For problem that the movement of the user will cause the image of the button in his vision to be shifted correspondingly, which may cause incorrect input the human eye detection is integrated into the system. By the optimization of user's viewing angle calibration, we can correct button's positioning error, thus achieve a great accuracy of character input 100%."}]}]}],"keyword":[{"lang":"zh","data":[[{"name":"text","data":"视角偏离修正"}],[{"name":"text","data":"立体显示"}],[{"name":"text","data":"人机交互"}],[{"name":"text","data":"人脸检测"}],[{"name":"text","data":"瞳孔位置估算"}]]},{"lang":"en","data":[[{"name":"text","data":"visual angle deviation correction"}],[{"name":"text","data":"3D display"}],[{"name":"text","data":"human-machine interaction"}],[{"name":"text","data":"face detection"}],[{"name":"text","data":"pupil position estimation"}]]}],"highlights":[],"body":[{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"1"}],"title":[{"name":"text","data":"引言"}],"level":"1","id":"s1"}},{"name":"p","data":[{"name":"text","data":"近年来，随着立体(3D)显示技术取得突破进展，3D技术和产品正革命性地影响和改变人们的沟通、工作和生活方式"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"blockXref","data":{"data":[{"name":"xref","data":{"text":"1","type":"bibr","rid":"b1","data":[{"name":"text","data":"1"}]}},{"name":"text","data":"-"},{"name":"xref","data":{"text":"3","type":"bibr","rid":"b3","data":[{"name":"text","data":"3"}]}}],"rid":["b1","b2","b3"],"text":"1-3","type":"bibr"}},{"name":"text","data":"]"}]},{"name":"text","data":"。3D显示能提供精确的视觉深度线索，尤其是高分辨率、低串扰的3D显示更是深度信息的优秀载体。"}]},{"name":"p","data":[{"name":"text","data":"体感技术也是近年来热门的新兴信息技术，在医疗卫生、金融保密、教育、游戏娱乐、零售等众多领域都有广泛的应用前景。但现在的体感技术在输入距离较长、无法充分利用深度信息进行交互等问题上有待继续提高。将3D显示与体态感技术相结合，可在传统平面体感技术的基础上增加纵深方向的交互操作维度，不仅能覆盖较近的工作距离，而且更符合用户日常的操作习惯，有利于实现复杂、精细的操作。"}]},{"name":"p","data":[{"name":"text","data":"有鉴于此，本文提出了一种利用3D显示为载体的新型人机交互技术——虚拟键盘"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"xref","data":{"text":"4","type":"bibr","rid":"b4","data":[{"name":"text","data":"4"}]}},{"name":"text","data":"]"}]},{"name":"text","data":"，将需要交互的键盘的图像浮在屏幕前方显示。用户不用接触任何辅助器件，只需手指凌空点击键盘的像，即可输入和编辑字符。同时针对因3D显示引发的视角偏离造成手指定位误差问题，加入人眼检测定位进行修正，从而实现了具有纵深感、接近自然运动习惯的信息交互。"}]}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"2"}],"title":[{"name":"text","data":"实验原理"}],"level":"1","id":"s2"}},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"2.1"}],"title":[{"name":"text","data":"双目视差差生立体视觉"}],"level":"2","id":"s2-1"}},{"name":"p","data":[{"name":"text","data":"3D屏幕是本文立体人机交互系统的显示载体。生理学研究表明，人眼对于客观物体的深度感知最主要来源于视差"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"xref","data":{"text":"5","type":"bibr","rid":"b5","data":[{"name":"text","data":"5"}]}},{"name":"text","data":"]"}]},{"name":"text","data":"。3D显示就是利用两幅图像间视差，模拟出物体浮出屏幕的立体感。假设在屏幕上显示了目标的左右视角两幅子图像。这两幅子图像可被眼镜分光后传输到左右眼。由于大脑的融合作用，即可产生目标出现在屏幕前方的立体感。而目标出屏距离"},{"name":"italic","data":[{"name":"text","data":"z"}]},{"name":"text","data":"遵从以下表示："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"1"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773449&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773449&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773449&type=middle"}}}],"id":"yjyxs-33-11-958-E1"}}]},{"name":"p","data":[{"name":"text","data":"式中，观众到观察屏距离为"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"，左右两幅视差图像间距是"},{"name":"italic","data":[{"name":"text","data":"S"}]},{"name":"text","data":"，瞳距为"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"。因此，在实验中，我们利用了快门眼镜式3D屏幕显示交互场景的两幅子图像，将需要互动的目标物浮出屏幕前方，供用户进行操作。"}]},{"name":"fig","data":{"id":"Figure1","caption":[{"lang":"zh","label":[{"name":"text","data":"图1"}],"title":[{"name":"text","data":"视差关系演示图"}]},{"lang":"en","label":[{"name":"text","data":"Fig 1"}],"title":[{"name":"text","data":"Parallax relationship diagram"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773457&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773457&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773457&type=middle"}]}}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"2.2"}],"title":[{"name":"text","data":"双目摄像还原世界坐标"}],"level":"2","id":"s2-2"}},{"name":"p","data":[{"name":"text","data":"双目视觉则是一种实现目标精确定位重要技术。它模仿人的双眼，通过两枚摄像头从不同视角拍摄同一目标，并根据目标像点在左右两个摄像头中的图像坐标还原目标在真实空间中的世界坐标，可视为立体显示的逆过程"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"xref","data":{"text":"6","type":"bibr","rid":"b6","data":[{"name":"text","data":"6"}]}},{"name":"text","data":"]"}]},{"name":"text","data":"。实验中，我们将两个摄像头沿水平线的45°放置，且摄像头所处的平面与交互画面所在的像平面重合，其结构如"},{"name":"xref","data":{"text":"图 2","type":"fig","rid":"Figure2","data":[{"name":"text","data":"图 2"}]}},{"name":"text","data":"所示。系统利用此结构实时检测指尖并计算其世界坐标，再将指尖的世界坐标和各个按钮的像的世界坐标范围进行匹配，寻找出点击的按键，即可完成信息的输入。"}]},{"name":"fig","data":{"id":"Figure2","caption":[{"lang":"zh","label":[{"name":"text","data":"图2"}],"title":[{"name":"text","data":"系统使用的双45°双目摄像结构原理图"}]},{"lang":"en","label":[{"name":"text","data":"Fig 2"}],"title":[{"name":"text","data":"Double 45°binocular camera structure diagram used in the system"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773464&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773464&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773464&type=middle"}]}},{"name":"p","data":[{"name":"text","data":"以两摄像机连线的中点为直角坐标系"},{"name":"italic","data":[{"name":"text","data":"XOY"}]},{"name":"text","data":"坐标原点，如"},{"name":"xref","data":{"text":"图 2","type":"fig","rid":"Figure2","data":[{"name":"text","data":"图 2"}]}},{"name":"text","data":"所示，摄像机的像平面与水平面成45°角，摄像机1和2的坐标分别为"},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"0"}]},{"name":"text","data":", 0)和"},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"2"}]},{"name":"text","data":"(-"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"0"}]},{"name":"text","data":", 0)。摄像机像平面的"},{"name":"italic","data":[{"name":"text","data":"y"},{"name":"sub","data":[{"name":"text","data":"u"}]}]},{"name":"text","data":"坐标体现了指尖在"},{"name":"italic","data":[{"name":"text","data":"z"}]},{"name":"text","data":"轴方向的深度，用于确定图像中的指尖位置；"},{"name":"italic","data":[{"name":"text","data":"x"},{"name":"sub","data":[{"name":"text","data":"u"}]}]},{"name":"text","data":"坐标可用于求出指尖在"},{"name":"italic","data":[{"name":"text","data":"XOY"}]},{"name":"text","data":"平面的坐标"},{"name":"italic","data":[{"name":"text","data":"P(x, y)"}]},{"name":"text","data":"."}]},{"name":"p","data":[{"name":"text","data":"当指尖处于"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"text","data":"点时，由小孔摄像机模型下的理想透视投影变换可知，摄像机1的位置"},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"0"}]},{"name":"text","data":", 0)与"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"text","data":"点在摄像机1的像点("},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"u1"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"sub","data":[{"name":"text","data":"u1"}]},{"name":"text","data":")以及交互画面像平面内的"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"x, y"}]},{"name":"text","data":")三点共线，由几何关系得到："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"2"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773471&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773471&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773471&type=middle"}}}],"id":"yjyxs-33-11-958-E2"}}]},{"name":"p","data":[{"name":"text","data":"式中："},{"name":"italic","data":[{"name":"text","data":"x"},{"name":"sub","data":[{"name":"text","data":"u1"}]}]},{"name":"text","data":"为"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"text","data":"点在摄像机1的像点的横坐标(坐标原点为像平面中心)；"},{"name":"italic","data":[{"name":"text","data":"f"}]},{"name":"text","data":"为摄像机的焦距；点A是直线O"},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"P与摄像机2的法线的交点，点H为两摄像机法线的交点，有几何关系可知∠"},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"italic","data":[{"name":"text","data":"H"}]},{"name":"text","data":"  "},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"2"}]},{"name":"text","data":"为直角。再由摄像机与水平面成45°角，可求得："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"3"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773478&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773478&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773478&type=middle"}}}],"id":"yjyxs-33-11-958-E3"}}]},{"name":"p","data":[{"name":"text","data":"其中：A点坐标应满足O"},{"name":"sub","data":[{"name":"text","data":"2"}]},{"name":"text","data":"H的直线方程，故可得到："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"4"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773490&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773490&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773490&type=middle"}}}],"id":"yjyxs-33-11-958-E4"}}]},{"name":"p","data":[{"name":"text","data":"则由两已知点"},{"name":"italic","data":[{"name":"text","data":"A"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"A"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"sub","data":[{"name":"text","data":"A"}]},{"name":"text","data":"), "},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"0"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"sub","data":[{"name":"text","data":"0"}]},{"name":"text","data":")可得到直线O"},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"P的方程如下："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"5"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773497&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773497&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773497&type=middle"}}}],"id":"yjyxs-33-11-958-E5"}}]},{"name":"p","data":[{"name":"text","data":"同理，可求出直线O"},{"name":"sub","data":[{"name":"text","data":"2"}]},{"name":"text","data":"P的方程如下"}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"6"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773503&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773503&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773503&type=middle"}}}],"id":"yjyxs-33-11-958-E6"}}]},{"name":"p","data":[{"name":"text","data":"综上，由直线O"},{"name":"sub","data":[{"name":"text","data":"1"}]},{"name":"text","data":"P与直线O"},{"name":"sub","data":[{"name":"text","data":"2"}]},{"name":"text","data":"P均过点P，将式(5)与(6)两式联立，则可以根据P点在摄像机1、2的像点横坐标"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"u1"}]},{"name":"text","data":"，"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"sub","data":[{"name":"text","data":"u2"}]},{"name":"text","data":"，求出P点在虚拟触摸屏内的坐标P("},{"name":"italic","data":[{"name":"text","data":"x, y"}]},{"name":"text","data":")。"}]}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"2.3"}],"title":[{"name":"text","data":"视角修正"}],"level":"2","id":"s2-3"}},{"name":"p","data":[{"name":"text","data":"根据3D成像原理，我们在3D屏幕上显示分属左右眼的两幅视差子图像。由"},{"name":"xref","data":{"text":"图 3","type":"fig","rid":"Figure3","data":[{"name":"text","data":"图 3"}]}},{"name":"text","data":"可知，用户在不同的视角下，所看到的目标像点P具有不同的位置，所以在实际工作中，需要对用户视角进行实时检测，并修正各按钮的像的边沿世界坐标范围。"}]},{"name":"fig","data":{"id":"Figure3","caption":[{"lang":"zh","label":[{"name":"text","data":"图3"}],"title":[{"name":"text","data":"不同视角下目标像点的偏移情况"}]},{"lang":"en","label":[{"name":"text","data":"Fig 3"}],"title":[{"name":"text","data":"Target image point in the case of different visual angles offset"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773511&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773511&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773511&type=middle"}]}},{"name":"p","data":[{"name":"text","data":"用户双眼平视屏幕中心时，双眼连线中点在屏幕上的投影为"},{"name":"italic","data":[{"name":"text","data":"XYZ"}]},{"name":"text","data":"坐标系的坐标原点"},{"name":"italic","data":[{"name":"text","data":"O"}]},{"name":"text","data":"，其中"},{"name":"italic","data":[{"name":"text","data":"XOY"}]},{"name":"text","data":"为屏幕平面，"},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"text","data":"轴垂直于屏幕指向用户。设像点坐标为"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":").对应屏幕上的两点"},{"name":"italic","data":[{"name":"text","data":"P"},{"name":"sub","data":[{"name":"text","data":"L"}]}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"L"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"L"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"sub","data":[{"name":"text","data":"L"}]},{"name":"text","data":")和"},{"name":"italic","data":[{"name":"text","data":"P"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":")。设左右眼所看到的图像在屏幕上的位差"},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"L"}]},{"name":"text","data":"-"},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":"="},{"name":"italic","data":[{"name":"text","data":"S"}]},{"name":"text","data":", 用户瞳距为"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"，与屏幕距离为"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"，成像示意图如"},{"name":"xref","data":{"text":"图 3","type":"fig","rid":"Figure3","data":[{"name":"text","data":"图 3"}]}},{"name":"text","data":"所示。"}]},{"name":"p","data":[{"name":"text","data":"当用户平视屏幕中心时，由图"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"text","data":"("},{"name":"italic","data":[{"name":"text","data":"a"}]},{"name":"text","data":")的相似三角形关系，得到图像出屏距离"},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":"与位差"},{"name":"italic","data":[{"name":"text","data":"S"}]},{"name":"text","data":"、瞳距"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"以及观察距离"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"有关，具体表达式为："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"7"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773519&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773519&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773519&type=middle"}}}],"id":"yjyxs-33-11-958-E7"}}]},{"name":"p","data":[{"name":"text","data":"而得到像点的横坐标"},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":"和纵坐标"},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":"由屏幕对应点的横坐标"},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"R"}]},{"name":"text","data":"、瞳距"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"以及位差"},{"name":"italic","data":[{"name":"text","data":"S"}]},{"name":"text","data":"决定，与观察距离"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"无关，具体表达式为："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"8"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773529&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773529&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773529&type=middle"}}}],"id":"yjyxs-33-11-958-E8"}}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"9"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773536&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773536&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773536&type=middle"}}}],"id":"yjyxs-33-11-958-E9"}}]},{"name":"p","data":[{"name":"text","data":"当用户往水平(即"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"text","data":")方向偏离屏幕中心，不再直视时，光路如"},{"name":"xref","data":{"text":"图 3 (b)","type":"fig","rid":"Figure3","data":[{"name":"text","data":"图 3 (b)"}]}},{"name":"text","data":"所示，根据几何三角关系，可以求得出屏距离的公式如下："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"10"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773544&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773544&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773544&type=middle"}}}],"id":"yjyxs-33-11-958-E10"}}]},{"name":"p","data":[{"name":"text","data":"可见，"},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":"与直视屏幕中心时一致。由于用户只是侧视，所以纵坐标"},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":"的对应关系也与直视屏幕中心时一致。像点横坐标"},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"P"}]},{"name":"text","data":"受到视角偏移量(即视差子图像中心线与瞳距中心线的间距)、瞳距"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"以及位差"},{"name":"italic","data":[{"name":"text","data":"S"}]},{"name":"text","data":"有关，与观察距离"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"无关。最后进行坐标变换，设定世界坐标系"},{"name":"italic","data":[{"name":"text","data":"X’Y’Z’"}]},{"name":"text","data":"的原点为屏幕左下角。若双眼平视时，双眼连线中点在屏幕上的投影的计算机坐标为("},{"name":"italic","data":[{"name":"text","data":"X"}]},{"name":"sub","data":[{"name":"text","data":"O"}]},{"name":"text","data":", "},{"name":"italic","data":[{"name":"text","data":"Y"}]},{"name":"sub","data":[{"name":"text","data":"O"}]},{"name":"text","data":"), 则视角偏离后的像点横坐标修正公式为："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"11"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773550&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773550&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773550&type=middle"}}}],"id":"yjyxs-33-11-958-E11"}}]},{"name":"p","data":[{"name":"text","data":"同理，当用户往竖直(即"},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"text","data":")方向偏离屏幕中心，不再直视时，其视角偏离后的像点纵坐标修正公式为："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"12"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773557&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773557&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773557&type=middle"}}}],"id":"yjyxs-33-11-958-E12"}}]},{"name":"p","data":[{"name":"text","data":"由于像点出屏的深度坐标不受横纵坐标的影响，所以他它无需修正，表达式为："}]},{"name":"p","data":[{"name":"dispformula","data":{"label":[{"name":"text","data":"13"}],"data":[{"name":"math","data":{"graphicsData":{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773563&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773563&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773563&type=middle"}}}],"id":"yjyxs-33-11-958-E13"}}]},{"name":"p","data":[{"name":"text","data":"根据上述的普适性修正公式，我们即可对不同视角下的像点偏离进行校正，从而减少人机互动位置的误差。"}]}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"2.4"}],"title":[{"name":"text","data":"人脸检测与瞳孔估算"}],"level":"2","id":"s2-4"}},{"name":"p","data":[{"name":"text","data":"前述内容提到用户视角的偏离会导致目标像点随之偏移，所以在交互过程中先需要检测用户人脸位置，然后求得双目瞳孔的世界坐标，进而计算出观看距离"},{"name":"italic","data":[{"name":"text","data":"L"}]},{"name":"text","data":"，结合上述两者才能完成目标像点在不同视角下的修正。"}]},{"name":"p","data":[{"name":"text","data":"本系统基于开发时间和运算时间的综合考虑，采用了Haar特征作为目标特征值，利用Adaboost以及Cascade算法进行分类器训练的方式实现人脸检测的功能"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"xref","data":{"text":"7","type":"bibr","rid":"b7","data":[{"name":"text","data":"7"}]}},{"name":"text","data":"]"}]},{"name":"text","data":"。训练人脸识别分类器的图像往往是毫无遮挡、曝光良好、轮廓清晰的标准正面人脸，经由这些样本所训练得到的分类器同样只能用来识别不存在面部遮挡的人脸，这与系统中由于佩戴快门式3D眼镜造成的双目遮挡相矛盾。所以，在实验中，我们在人脸检测的基础上，采用三庭五眼的先验法则实现瞳孔位置的推算。所谓三庭五眼"},{"name":"sup","data":[{"name":"text","data":"["},{"name":"blockXref","data":{"data":[{"name":"xref","data":{"text":"8","type":"bibr","rid":"b8","data":[{"name":"text","data":"8"}]}},{"name":"text","data":"-"},{"name":"xref","data":{"text":"10","type":"bibr","rid":"b10","data":[{"name":"text","data":"10"}]}}],"rid":["b8","b9","b10"],"text":"8-10","type":"bibr"}},{"name":"text","data":"]"}]},{"name":"text","data":"指的是根据统计学得出的人五官在人脸面上的统计分布规律，如"},{"name":"xref","data":{"text":"图 4","type":"fig","rid":"Figure4","data":[{"name":"text","data":"图 4"}]}},{"name":"text","data":"所示。根据三庭五眼的规律能简单高效地确定出双目区域在检测得到的人脸区域中的大致位置。"}]},{"name":"fig","data":{"id":"Figure4","caption":[{"lang":"zh","label":[{"name":"text","data":"图4"}],"title":[{"name":"text","data":"三庭五眼原理示意图"}]},{"lang":"en","label":[{"name":"text","data":"Fig 4"}],"title":[{"name":"text","data":"Schematic diagram of the five eyes of the three tribunals"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773571&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773571&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773571&type=middle"}]}},{"name":"p","data":[{"name":"text","data":"由于人眼瞳距基本在60~65 mm之前，不同人的双眼瞳距差距较小，实际工作中取平均值62 mm为瞳距"},{"name":"italic","data":[{"name":"text","data":"D"}]},{"name":"text","data":"，这样根据前置摄像头所拍摄到的图像及人眼推算，就可以进行观看距离"},{"name":"italic","data":[{"name":"text","data":"Z"}]},{"name":"text","data":"的粗定位，并且还原出用户双眼中心的世界坐标。"}]}]}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"3"}],"title":[{"name":"text","data":"系统搭建"}],"level":"1","id":"s3"}},{"name":"p","data":[{"name":"text","data":"本文搭建的基于人眼跟踪优化的立体人机交互系统——虚拟键盘，实物图如"},{"name":"xref","data":{"text":"图 5","type":"fig","rid":"Figure5","data":[{"name":"text","data":"图 5"}]}},{"name":"text","data":"所示，由2个工业摄像机、1个带3D显示功能的手提电脑及其3D眼镜组成。"}]},{"name":"fig","data":{"id":"Figure5","caption":[{"lang":"zh","label":[{"name":"text","data":"图5"}],"title":[{"name":"text","data":"基于人眼跟踪优化的立体人机交互系统与工作原理"}]},{"lang":"en","label":[{"name":"text","data":"Fig 5"}],"title":[{"name":"text","data":"3D human-machine interaction system and working principle based on human eye tracking"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773577&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773577&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773577&type=middle"}]}},{"name":"p","data":[{"name":"text","data":"用户戴上3D眼镜，可看到浮出显示器的人机交互画面——1个12宫格键盘(键值为数字0~9、退格和回车)。当用户用手指点击交互画面中的按键时，可在2个摄像机采集的图像中分别检测到指尖并得到指尖的图像坐标，计算出指尖在虚拟触摸屏平面内的坐标。"}]},{"name":"p","data":[{"name":"text","data":"同时，手提电脑前置摄像头会实时采集用户的位置，检测出用户的人脸的区域，结合三庭五眼的先验知识，估算出瞳孔的世界坐标。根据两个瞳孔的世界坐标，系统可以给出每个按键的世界坐标范围修正值。利用按键修正后的世界坐标范围与指尖的世界坐标匹配，即可确认指尖点击的按键值。最后通过手提电脑的屏幕刷新显示，就可在输入框中显示出点击的按键值。"}]},{"name":"table","data":{"id":"Table1","caption":[{"lang":"zh","label":[{"name":"text","data":"表1"}],"title":[{"name":"text","data":"系统关键部件列表"}]},{"lang":"en","label":[{"name":"text","data":"Table 1"}],"title":[{"name":"text","data":"List of key system"}]}],"note":[],"table":[{"head":[[{"align":"center","data":[{"name":"text","data":"名称"}]},{"align":"center","data":[{"name":"text","data":"型号"}]},{"align":"center","data":[{"name":"text","data":"参数"}]}]],"body":[[{"align":"center","data":[{"name":"text","data":"手提电脑"}]},{"align":"center","data":[{"name":"text","data":"华硕G51J 3D"}]},{"align":"center","data":[{"name":"text","data":"i7 720QM，4G内存，Nvidia时分式3D显示技术，前置摄像头200万像素"}]}],[{"align":"center","data":[{"name":"text","data":"工业摄像头"}]},{"align":"center","data":[{"name":"text","data":"大恒HV1303UC"}]},{"align":"center","data":[{"name":"text","data":"15fps@130万像素，USB2.0"}]}],[{"align":"center","data":[{"name":"text","data":"3D眼镜"}]},{"align":"center","data":[{"name":"text","data":"Nvidia 3D Vision"}]},{"align":"center","data":[{"name":"text","data":"液晶镜片，单眼刷新率60 Hz"}]}],[{"align":"center","data":[{"name":"text","data":"交互画面"}]},{"align":"center","data":[{"name":"text","data":"自行绘制键盘"}]},{"align":"center","data":[{"name":"text","data":"内容：数字0至9，退格和回车；出屏距离：8 cm，按钮尺寸：4 cm×3 cm"}]}]],"foot":[]}]}}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"4"}],"title":[{"name":"text","data":"实验结果"}],"level":"1","id":"s4"}},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"4.1"}],"title":[{"name":"text","data":"人机交互实验结果"}],"level":"2","id":"s4-1"}},{"name":"p","data":[{"name":"text","data":"本项目所研发的立体人机交互系统将虚拟键盘的影像在屏幕前方进行立体显示，能让用户凭借手指凌空点击虚拟键盘的立体影像即可准确、实时地完成数字0至9的输入和屏幕刷新显示，也可以通过对退格键和回车键的点击，实现输入字符的删去和回车换行。其字符输入速率可达到10.6 fps。"}]},{"name":"p","data":[{"name":"text","data":"为了验证用户的点击准确性，我们让5名用户在8个视角(观看距离50 cm，视角选择为右侧视：0°、8°、16°和23°；俯视0°、8°、16°和19°)下，对每个按键点击10次。每次点击后计算指尖点击位置世界坐标和交互画面中对应按键的中心位置世界坐标的偏移量，综合5名用户平均值得到每个按钮的点击偏移量。偏移量小于按键的边缘范围时，表示用户仍点在按键内，完成正确输入；反之，则认为点击了其他按键，引起了误输入。"}]},{"name":"p","data":[{"name":"text","data":"在未加入视差修正算法前，用户的交互准确性结果，即点击位置与按键中心位置的误差关系如"},{"name":"xref","data":{"text":"图 6","type":"fig","rid":"Figure6","data":[{"name":"text","data":"图 6"}]}},{"name":"text","data":"所示。当用户正对屏幕(即视角在水平和俯仰方向均为0°)时，手指点击位置与按键中心理论位置两者世界坐标在"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"text","data":"和"},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"text","data":"方向的差距小，能实现100%正确的输入；但是用户观看位置逐渐偏移时，随着人眼偏移角度的增大，指尖点击位置与系统算出的按键中心的偏差也在增大。特别是"},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"text","data":"坐标的偏移，可以看到当俯视角大于16°时，指尖点击位置已经超出了对应按键范围，造成了很高的错误点击率。因此，证明需要在系统中加入人眼的定位对按键在不同视角下的位置范围加以校正。"}]},{"name":"fig","data":{"id":"Figure6","caption":[{"lang":"zh","label":[{"name":"text","data":"图6"}],"title":[{"name":"text","data":"用户点击位置误差与观看角度的关系"}]},{"lang":"en","label":[{"name":"text","data":"Fig 6"}],"title":[{"name":"text","data":"Relationship between user click position error and visual angle"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773582&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773582&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773582&type=middle"}]}}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"4.2"}],"title":[{"name":"text","data":"按键视差修正效果"}],"level":"2","id":"s4-2"}},{"name":"p","data":[{"name":"text","data":"按照前述的原理，我们利用三庭五眼的先验知识，对人眼的瞳孔加以定位，其效果如"},{"name":"xref","data":{"text":"图 7","type":"fig","rid":"Figure7","data":[{"name":"text","data":"图 7"}]}},{"name":"text","data":"所示。根据两个瞳孔的图像坐标和瞳距的均值，可以计算出用户所在视角下每个按钮的边缘世界坐标范围。由于每个按钮的尺寸较大，所以尽管瞳孔世界坐标推算有一定误差，导致每个按钮的边缘世界坐标范围受到影响，但是仍在可以接受的范围内。"},{"name":"xref","data":{"text":"图 8","type":"fig","rid":"Figure8","data":[{"name":"text","data":"图 8"}]}},{"name":"text","data":"所示为经过视差修正后，用户在不同视角下点击位置与按键中心位置的误差关系。可以发现，不管在"},{"name":"italic","data":[{"name":"text","data":"x"}]},{"name":"text","data":"或者"},{"name":"italic","data":[{"name":"text","data":"y"}]},{"name":"text","data":"方向，点击位置与按键中心位置的差距明显减小，并都局限在修正后的边缘范围内，证明在侧视角0~23°/俯仰角在0~19°以内，因用户视角带来的视差均能得到良好修正，实现100%的点击成功率。"}]},{"name":"fig","data":{"id":"Figure7","caption":[{"lang":"zh","label":[{"name":"text","data":"图7"}],"title":[{"name":"text","data":"基于三庭五眼先验法则双目定位结果图"}]},{"lang":"en","label":[{"name":"text","data":"Fig 7"}],"title":[{"name":"text","data":"Binocular positioning result graph based on three courts and five eyes"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773587&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773587&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773587&type=middle"}]}},{"name":"fig","data":{"id":"Figure8","caption":[{"lang":"zh","label":[{"name":"text","data":"图8"}],"title":[{"name":"text","data":"视差修正后点击准确性的优化结果"}]},{"lang":"en","label":[{"name":"text","data":"Fig 8"}],"title":[{"name":"text","data":"Optimum results of click accuracy after parallax correction"}]}],"subcaption":[],"note":[],"graphics":[{"print":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773592&type=","small":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773592&type=small","big":"http://html.publish.founderss.cn/rc-pub/api/common/picture?pictureId=1773592&type=middle"}]}}]}]},{"name":"sec","data":[{"name":"sectitle","data":{"label":[{"name":"text","data":"5"}],"title":[{"name":"text","data":"结论"}],"level":"1","id":"s5"}},{"name":"p","data":[{"name":"text","data":"本文提出一种利用3D显示作为载体的立体体感技术——虚拟键盘，让用户可在屏幕前方的虚拟交互画面中，通过手指的凌空点击实现简单字符的输入和编辑，其帧率达到10.6 fps，满足实时工作的速度要求。由于使用过程中，用户视角改变将带来视差偏移，并导致误输入问题，所以我们基于人脸检测和瞳孔估算的方法的修正方法，利用三庭五眼先验法则推算因为3D眼镜遮蔽而无法直观检测的用户双眼瞳孔所在的世界坐标，并以此为据，对各个按键边缘的世界坐标范围进行修正。实验结果表明，经过修正后，用户在较大的视角范围(侧视角0~23°/俯仰角在0~19°)内的点击位置与与按键中心位置的误差的偏离度和离散度均明显减小，消除了误输入的可能性，可实现100%的点击成功率。"}]}]}],"footnote":[],"reflist":{"title":[{"name":"text","data":"参考文献"}],"data":[{"id":"b1","label":"1","citation":[{"lang":"zh","text":[{"name":"text","data":"王琼华, 邓欢.集成成像3D拍摄与显示方法[J].液晶与显示, 2014, 29(2):153-158."}]},{"lang":"en","text":[{"name":"text","data":"WANG Q H, DENG H. 3D pickup and display method of integral imaging[J]."},{"name":"italic","data":[{"name":"text","data":"Chinese Journal of Liquid Crystals and Displays"}]},{"name":"text","data":", 2014, 29(2):153-158. (in Chinese)"}]}]},{"id":"b2","label":"2","citation":[{"lang":"zh","text":[{"name":"text","data":"LUEDER E. 3D显示技术[M]. 余宏生, 王彤彤, 梅军进, 译. 北京: 电子工业出版社, 2016."}]},{"lang":"en","text":[{"name":"text","data":"LUEDER E. 3"},{"name":"italic","data":[{"name":"text","data":"D display"}]},{"name":"text","data":"[M]. YU H S, WANG T T, MEI J J, trans. Beijing: Publishing House of Electronics Industry, 2016."}]}]},{"id":"b3","label":"3","citation":[{"lang":"zh","text":[{"name":"text","data":"孙博.裸眼3D显示技术的现状与发展[J].科技传播, 2017, 9(21):115-116."}]},{"lang":"en","text":[{"name":"text","data":"SUN B. Present situation and development of naked eye 3D display technology[J]."},{"name":"italic","data":[{"name":"text","data":"Public Communication of Science & Technology"}]},{"name":"text","data":", 2017, 9(21):115-116."}]}]},{"id":"b4","label":"4","citation":[{"lang":"zh","text":[{"name":"text","data":"林孜铠, 戴思璋, 梁浩文, 等.基于混合颜色空间与码本背景减除的虚拟触控优化技术[J].液晶与显示, 2015, 30(4):722-728."}]},{"lang":"en","text":[{"name":"text","data":"LIN Z K, DAI S Z, LIANG H W, "},{"name":"italic","data":[{"name":"text","data":"et al"}]},{"name":"text","data":". Touch technology based on mixed color space and codebook background difference[J]."},{"name":"italic","data":[{"name":"text","data":"Chinese Journal of Liquid Crystals and Displays"}]},{"name":"text","data":", 2015, 30(4):722-728. (in Chinese)"}]}]},{"id":"b5","label":"5","citation":[{"lang":"zh","text":[{"name":"text","data":"张超, 王琼华, 李大海, 等.从平面图生成多视点自由立体显示视差图的研究[J].液晶与显示, 2009, 24(2):258-261."}]},{"lang":"en","text":[{"name":"text","data":"ZHANG C, WANG Q H, LI D H, "},{"name":"italic","data":[{"name":"text","data":"et al"}]},{"name":"text","data":". Capture of parallax image from 2D images for multi-view auto-stereoscopic display[J]."},{"name":"italic","data":[{"name":"text","data":"Chinese Journal of Liquid Crystals and Displays"}]},{"name":"text","data":", 2009, 24(2):258-261. (in Chinese)"}]}]},{"id":"b6","label":"6","citation":[{"lang":"zh","text":[{"name":"text","data":"刘江华, 陈佳品, 程君实.双目视觉平台的研究[J].机器人技术与应用, 2002(1):36-40."}]},{"lang":"en","text":[{"name":"text","data":"LIU J H, CHEN J P, CHENG J S. Research on binocular vision platform[J]."},{"name":"italic","data":[{"name":"text","data":"Robot Technique and Application"}]},{"name":"text","data":", 2002(1):36-40. (in Chinese)"}]}]},{"id":"b7","label":"7","citation":[{"lang":"zh","text":[{"name":"text","data":"林岱昆, 梁伟棠, 梁浩文, 等.基于人脸跟踪的时空无缝裸眼3D显示技术研究[J].电视技术, 2015, 39(5):70-73, 77."}]},{"lang":"en","text":[{"name":"text","data":"LIN D K, LIANG W T, LIANG H W, "},{"name":"italic","data":[{"name":"text","data":"et al"}]},{"name":"text","data":". Spatially and temporally seamless autostereoscopic display technology research based on face-tracking[J]."},{"name":"italic","data":[{"name":"text","data":"Video Engineering"}]},{"name":"text","data":", 2015, 39(5):70-73, 77. (in Chinese)"}]}]},{"id":"b8","label":"8","citation":[{"lang":"zh","text":[{"name":"text","data":"龙伶敏. 基于Adaboost的人脸检测方法及眼睛定位算法研究[D]. 成都: 电子科技大学, 2008."},{"name":"uri","data":{"text":[{"name":"text","data":"http://cdmd.cnki.com.cn/Article/CDMD-10614-2008122744.htm"}]}}]},{"lang":"en","text":[{"name":"text","data":"LONGL M. Face detection method and eye location algorithm based on Adaboost[D]. Chengdu: University of Electronic Science and Technology of China, 2008. (in Chinese)"}]}]},{"id":"b9","label":"9","citation":[{"lang":"zh","text":[{"name":"text","data":"胡涛, 冯玉娜, 王亚丹, 等. 一种人脸三庭五眼自动定位及比例确定方法: 中国, 104021550B[P]. 2017-01-18."}]},{"lang":"en","text":[{"name":"text","data":"HU T, FENG Y N, WANG Y D, "},{"name":"italic","data":[{"name":"text","data":"et al"}]},{"name":"text","data":". A method of automatic location and proportion determination of three faces and five eyes in human faces: CN, 104021550B[P]. 2017-01-18. (in Chinese)"}]}]},{"id":"b10","label":"10","citation":[{"lang":"zh","text":[{"name":"text","data":"张华坤, 王敏, 罗开, 等.三庭五眼的最佳定点探索[J].医学与哲学:B, 2017, 38(5):64-69."}]},{"lang":"en","text":[{"name":"text","data":"ZHANG H K, WANG M, LUO K, "},{"name":"italic","data":[{"name":"text","data":"et al"}]},{"name":"text","data":". A study of the best fixed-point of facial proportions[J]."},{"name":"italic","data":[{"name":"text","data":"Medicine & Philosophy:B"}]},{"name":"text","data":", 2017, 38(5):64-69. (in Chinese)"}]}]}]},"response":[],"contributions":[],"acknowledgements":[],"conflict":[],"supportedby":[],"articlemeta":{"doi":"10.3788/YJYXS20183311.0958","clc":[[{"name":"text","data":"TN27"}]],"dc":[],"publisherid":"yjyxs-33-11-958","citeme":[],"fundinggroup":[{"lang":"zh","text":[{"name":"text","data":"广东省自然科学基金（No.2015A030310388）与（No.2016A030313333）"}]},{"lang":"en","text":[{"name":"text","data":"Supported by Doctoral Start-up Fund of Natural Science Foundation of Guangdong Province (No.2015A030310388); Natural Science Foundation of Guangdong Province (No.2016A030313333)"}]}],"history":{"received":"2018-04-12","accepted":"2018-07-16","ppub":"2018-11-05","opub":"2020-06-16"},"copyright":{"data":[{"lang":"zh","data":[{"name":"text","data":"版权所有©《液晶与显示》编辑部2018"}],"type":"copyright"},{"lang":"en","data":[{"name":"text","data":"Copyright ©2018 Chinese Journal of Liquid Crystals and Displays. All rights reserved."}],"type":"copyright"}],"year":"2018"}},"appendix":[],"type":"research-article","ethics":[],"backSec":[],"supplementary":[],"journalTitle":"液晶与显示","issue":"11","volume":"33","originalSource":[]}