CN101308400A

CN101308400A - Novel human-machine interaction device based on eye-motion and head motion detection

Info

Publication number: CN101308400A
Application number: CNA2007100408595A
Authority: CN
Inventors: 肖斌; 张幂; 马梅方
Original assignee: Individual
Current assignee: Individual
Priority date: 2007-05-18
Filing date: 2007-05-18
Publication date: 2008-11-19

Abstract

The invention discloses a computer system equipment real-time control system through detecting the eye and head movement signals; the control system amplifies an EOG signal; then through noise elimination treatment, the control system extracts and analyzes the related information of eye movement track in the EOG signal, and adds head movement compensation to achieve more accurate positioning so as to make real-time control on the computer system and equipment. The control system replaces the traditional human-computer interaction mode through button, switch, keyboard, mouse and other external devices, thereby having a strong sense of novelty and utility.

Description

Based on eye movement and the moving novel human-machine interaction device that detects of head

Affiliated technical field

The present invention relates to bio-science and computer science, a kind of combination detects eye motion and head movement comes the man-machine interaction method of equipment novelties such as control computer system thereby designed.

Technical background

Computing and control system many times needs people's intervention and instructs our the needed task of just finishing, and traditional man-machine interaction method comprises methods such as using switch, button, mouse, keyboard, trace ball.But under some situation, these technology are unable or do not reach requirement, for example man-machine interaction of physically disabled's man-machine interaction and virtual reality with incapability.

Vision system is an of paramount importance part among the mankind sensory system.Studies show that in the process of people and external world interaction, have the information more than 80% to obtain by vision system.If utilize vision system to realize man-machine interaction, will be very efficient and natural so.

Human vision system can be regarded as by a series of unusual ingenious and precise opticals and electrical devices to be formed, and one of them very important characteristic has dynamic adjustment function accurately exactly.After receiving extraneous feedback signal, brain can be adjusted the position of eyeball and optical characteristics automatically to obtain best imaging effect.In oculomotor process, can produce measurable potential change, be called eye electricity (Electro-Oculogram is called for short EOG).As shown in Figure 1, when human eye rotated, we just can obtain corresponding electro-ocular signal, and the angle of this electro-ocular signal and eyes deflection has a dull line style relation.Electro-ocular signal is carried out amplification filtering and analyzes, can obtain oculomotor track.Utilize this principle, just can utilize the motion of eyeball that the system interaction interface is directly operated, realize the mutual of human brain and computing machine.

General EOG control device does not comprise the device that detects head movement, so the user must pass through certain means fixing head, could accurately locate sight line.After adding the device that detects head movement, the definite of sight line will become more accurate.When people's sight line is all moved with head, the sight line that only relies on eye movement to obtain will effectively be compensated.

In the time of among controlled computer equipment system (for example automobile in the motion) also is in motion, we also need a kind of method to determine the motion of equipment.At this time, we can install several acceleration transducers equally additional and cooperate several gyroscopes to detect the motion of controlled system on equipment, thereby determine the relative motion of people and controlled device, are used to proofread and correct the sight calculations error that is caused by equipment moving.

Summary of the invention

So, we have designed a cover and have detected eye movement and the moving signal realization real-time control system to computer system device, to the EOG signal amplify with denoising Processing after, eye movement relevant information is wherein carried out extracting and analysis, and the adding head movement compensates more accurately locatees, and controls in real time in order to equipment that department of computer science is unified.This system has replaced traditional external equipments such as button, switch, keyboard, mouse that pass through to carry out interactive means, and very strong novelty and practicality are arranged.

Description of drawings

Fig. 1: EOG schematic diagram:

Fig. 2; EOG signal measured drawing

Fig. 3: testing stand is synoptic diagram fixedly

Fig. 4: system architecture diagram

Embodiment

This human-computer interactive control equipment of our design comprises eye movement signal detection module, a moving signal detection module, signal processing module, and control module, controlled device motion detection block, as shown in Figure 4.Wherein the key component in an eye movement signal detection module and the moving signal detection module is installed on the shelf, and precision need have been installed 5-7 EOG signal detection electrode and one or more sensor acceleration as required on this shelf.

An eye movement and a moving signal detection module are installed by testing stand, and the moving mounting points that detects of corresponding eye electrode and head is seen Fig. 3.

The left-right rotation that the eye movement signal detection module detects eyes is to carry out with departing from of two oculocentric electrodes (electrode 3) signal intensity by the right and left electrode (electrode 1,7) signal intensity.Carry out with the departing from of two oculocentric electrodes (electrode 3) intensity by two groups of upper/lower electrodes (

electrode

2,3,5,6) during the rotation up and down of eyes.

Moving signal detection module is by installing the motion that acceleration transducer and gyroscope detect head in the appropriate location of head.

Signal processing module by simulating signal amplify, the filtering part, the A/D conversion portion, the pattern extraction unit is grouped into, and is the manageable digital signal of control module with an eye movement and the moving analog signal conversion of head.

Control module is based on eye movement signal, a moving signal controlled device motion detection block, and through geometric transformation, compensation and correction obtain the movable information of people's sight line, and then convert the control signal to equipment such as computing machines to.Because control module can't accurately be known the relative position of user and controlled device at the beginning, comes match control corresponding initial parameter so we have prepared a wizard program, and it can also improve precision through repeatedly training.

The controlled device motion detection block adopts several acceleration transducers to cooperate several gyroscopes according to application need, relative fixed on equipment, the signal of collecting device motion.

Applied scene is exactly that the user carries our device of design and carries out computation.Computer mouse will move along with the focus point of eye sight line, the user can be selectively with the click of nodding and operation such as nictation comes analog mouse.

The another one applied scene is user's equipment that can use us to the operating of vehicle-mounted computer interface, and under this uses, the vehicle-mounted computer on the automobile will need to install the relative motion that the relevant acceleration sensor is determined head.

Claims

1. one kind based on an eye movement and the moving novel human-machine interaction device that detects of head, by the eye movement signal detection module, and a moving signal detection module, signal processing module and control module, controlled device motion detection block.It is characterized in that,, through signal Processing and calculating, obtain people's sight line mobile message, and then equipment such as computer system are controlled, realize man-machine interaction based on people's an eye movement signal and a moving signal.

2. control module according to claim 1 is characterized in that, based on eye movement signal and a moving signal and controlled device motor message, through geometric transformation, compensation and correction obtain the movable information of people's sight line, and then convert the control signal to equipment such as computing machines to.

3. eye movement signal detection module according to claim 1 is characterized in that, by being placed on 5 to 7 groups of electrodes of facial ad-hoc location, gathers the electro-ocular signal of the eye movement generation of simple eye or eyes.

4. based on claim 2 and claim 3,, complement each other, and then calculate the sight line focus, improve the control signal precision according to the movements binocular signal.

5. according to claim 1 moving signal detection module is characterized in that, according to the control needs of precision and cost, uses several acceleration transducers to cooperate several gyroscopes, is fixed on the ad-hoc location of head, gathers the head motor message.

6. signal processing module according to claim 1 is characterized in that, by simulating signal amplification, filtration module, and the A/D modular converter, the pattern extraction module is formed, and is the manageable digital signal of control module with an eye movement and the moving analog signal conversion of head.

7. the equipment moving detection module of telling according to claim 1 is characterized in that, according to application need, adopts several acceleration transducers to cooperate several gyroscopes, relative fixed on equipment, the signal of collecting device motion.