Embodiment
The present invention is described in further detail below in conjunction with accompanying drawing.
The embodiment of the invention is to increase the vision capture technology on mobile communication terminal, obtains the focus message of visual focus by the focus of catching user's eyes, and mobile communication terminal is carried out user's target control according to described focus information then.
Fig. 1 is the schematic flow diagram of exchange method of the mobile communication terminal of the embodiment of the invention one.This flow chart may further comprise the steps:
Step 11, obtain the focus information of visual focus;
Step 12, carry out the target action according to described focus information.
In the embodiment of the invention, comprise the position of target in the reception interface that user's vision watches attentively in the described focus information, just the position of the target paid close attention to of user's visual focus.For example, the user wishes to use the message function in the mobile communication terminal, and at this moment, user's visual focus focuses on the message function item on the reception interface.The focus information of the visual focus that gets access to according to step 11 is the information that comprises the position of message function item.Then, according to step 12, enter into message function according to above-mentioned focus information execution.
Fig. 2 is the schematic flow diagram of exchange method of the mobile communication terminal of the embodiment of the invention two.As shown in Figure 2, comprise following:
Step S201, obtain the focus information of visual focus.
Herein, user's eyes are watched the content of controlling in the reception interface attentively.
Step S202, judge according to described focus information whether described visual focus is positioned at zone of control, if the result who judges then is transferred to step S204 for not being positioned at zone of control; If the result who judges is for being positioned at zone of control, execution in step S203 then.Zone of control is meant the zone that can receive vision control that sets in advance in the mobile communication terminal.For example, under ideal case, a certain concrete function zone can be a zone of control in the interface, but the electric weight display message just is set to uncontrollable zone.
Step S204, catch visual focus again, up to getting access to the focus information of visual focus at zone of control.
Step S203, judge that whether described focus information satisfies the treatment conditions that pre-set.If described focus information does not satisfy the treatment conditions set in advance, then execution in step S205, described focus information is not handled; If satisfy, then execution in step S206.Also can comprise the time span value that user's vision is watched the target of reception interface attentively in the described focus information, described treatment conditions comprise, whether the time span value in the described focus information is in the scope of this time span value that sets in advance etc.Herein, described treatment conditions can pre-set as required accordingly.
Step S206, described focus information is handled according to normal interactive mode, generated control messages.In embodiments of the present invention, described normal interactive mode (being called manual interactive mode again) refers to that the user is to the manual operation of mobile communication terminal keyboard/touch-screen in the prior art, and normal interactive mode is treated to the information processing that mobile communication terminal produces manual operation in the prior art.
Step 207, carry out the target action according to described control information.
In embodiments of the present invention, for mobile communication terminal, carry out example with mobile phone.According to the exchange method of above-mentioned mobile communication terminal, for the input of the different kinds of business in the mobile phone, the user controls the action of execution target with eyes and is exemplified below:
One, human eye control realizes the function of mobile phone and the selection/cancellation of content.
Under open state, correlation function or content choice item that the user watches attentively on the mobile phone reception interface reach certain hour, get access to the focus information of visual focus, mobile phone is converted into control information after this focus information is handled, and this control information makes mobile phone carry out the action that changes a certain concrete function or content over to according to user's requirement; The cancellation function that the cancellation of function or content is not to use the person to watch attentively on the display interface of mobile phone equally reaches certain hour.
Two, the input of human eye control realization information.
The user controls mobile phone and enters the input function state, and the virtual inputting interface of keyboard type can be arranged on mobile phone reception interface under the input function state, and the user adopts to watch attentively to choose and finishes input.The process that the user finishes once input comprises as follows: the user watches attentively needs the character imported in the virtual inputting interface in the reception interface; Catch the focus information of user's visual focus; Described focus information is sent to processing, carry out input according to described focus information.Except the above-mentioned this function that is similar to is chosen the vision of mode and is chosen the dummy keyboard input, can also application specific at the vision input method of vision capture.
This use vision capture technology realizes the mutual method of user and mobile phone, can be so that the non-mobile phone of closely controlling of user reduces the radiation to human brain; Increased the convenience that the user controls simultaneously; Also can make things convenient for the disabled person that the function and the input of mobile phone are controlled.
In embodiments of the present invention, utilize the vision capture technology to obtain the focus information of visual focus, realize that this pattern of mobile phone interaction is called as the vision capture interactive mode thereby carry out the target action according to described focus information.The embodiment of the invention can also be supported other mobile phone interaction patterns, and be supported in the handoff functionality under the distinct interaction pattern except supporting the vision capture interactive mode.This function that can switch interactive mode mutually can increase the flexibility of user's operation, increases user's enjoyment sense.The mode that embodiment of the invention interactive mode switches can have following two kinds:
One, the concrete interactive mode in the choice of dynamical function menu
For example, mobile phone is given tacit consent to a kind of interactive mode, and supports to comprise in the special function menu different interactive modes for choosing.The process that switches to other interactive modes from the vision capture interactive mode is as follows: the user watches interactive mode handoff functionality item the reception interface attentively, at this moment a plurality of interactive modes occur for you to choose in the reception interface, and the user watches one of them interactive mode attentively; Use the vision capture technology to catch the focus information of this visual focus; Described focus information is handled, generated control information, described control information is the interactive mode handover information; Carry out to switch according to described interactive mode handover information control mobile phone and enter user's vision and watch the concrete interactive mode of choosing attentively from current interactive mode.
This mode switch can be to switch to other interactive modes from the vision capture interactive mode, also can be to switch to the vision capture interactive mode from other interactive modes.From current interactive mode for other switch to the vision capture interactive mode and said process similar.
Two, combination in advance is provided with the interactive mode of each concrete function item
Mobile phone can make up voluntarily under any one interactive mode the interactive mode use that the concrete function item uses is set, its process is as follows: the user is watching the concrete function item in the reception interface attentively, catch the focus information of this visual focus, described focus information is handled, the interactive mode that uses according to the set in advance described concrete function item of described focus information inquiry in its processing procedure generates control information; Change concrete function over to according to described control information execution, and carry out the interactive mode that switches to the described concrete function item use that sets in advance from current interactive mode.
For example, current phone is in manual interactive mode, is provided with to enter phone directory and choose entertainment content by the vision capture interactive mode, reads short message by manual interactive mode, and other function is used other interactive mode.When the user selects to read short message, do not switch interactive mode, and the user is when selecting to enter phone directory, when execution is transferred to phonebook function according to controlling of user, can carry out interactive mode and switch, carry out and switch to manual interactive mode from current interactive mode according to setting in advance.
In embodiments of the present invention, eyeball control camera is focused automatically in the time of can also realizing that mobile communication terminal is taken pictures by the vision capture technology.The schematic flow diagram of Fig. 3 method that to be diagram focus automatically according to the vision control camera of the embodiment of the invention.The camera that the embodiment of the invention the realizes eyeball control mobile communication terminal process of the method for focusing automatically is: when occurring treating filmed image on the display screen of mobile communication terminal, the user watches the image part of wishing the object of focusing on the shooting interface of described display screen attentively; Obtain the focus information of visual focus, described focus information comprises the information of the particular location of visual focus; Then described focus information is handled, in the processing procedure, can be divided into fixing N zone taking the interface, can generate the corresponding control information of focusing automatically for each different zone according to what pre-set; According to this control information the camera of mobile communication terminal is focused automatically.Above-mentioned to be divided into a fixing N zone be in order to cooperate the photograph focusing in the existing shooting technology taking the interface, thereby consistent or compatible with existing shooting technology in the use.
The embodiment of the invention also provides a kind of interactive device of mobile communication terminal.Fig. 4 is the schematic block diagram of interactive device of the mobile communication terminal of the embodiment of the invention three.As shown in Figure 4, described device comprises: vision capture unit 10 is used to obtain the focus information of visual focus; Information process unit 20 is used for carrying out the target action according to described focus information control.
The user is watching the target in the reception interface of mobile communication terminal attentively, and this visual focus of target that users watch attentively is caught in vision capture unit 10, analyzes then and obtains focus information.This information of position that comprises target in the reception interface that vision watches attentively in the described focus information.
In embodiments of the present invention, with the mobile phone is example, described device realizes that the course of work of mobile phone interaction is exemplified below: when a mobile phone user wishes to edit short message, the user watches the concrete function item in the menu bar attentively, vision capture unit 10 obtains the focus information of this visual focus, send information process unit 20 to, 20 pairs of described focus informations of described information process unit are handled, generate control information, make mobile phone carry out and enter the concrete function of being watched attentively, mobile phone enters into the short message editing state then.In the embodiment of the invention, the user also can use described device to realize concrete character/literal input.
Fig. 5 is the schematic block diagram according to information process unit 20 among Fig. 4 of the embodiment of the invention.As shown in Figure 5, described information process unit 20 comprises: receiving element 210 is used to receive described focus information; Analytic unit 230 is used for described focus information is handled, and generates control information; Performance element 250 is used for carrying out the target action according to described control information.
As shown in Figure 5, described information process unit 20 also comprises: focal position judging unit 270, judge according to described focus information whether described visual focus is positioned at zone of control, and generation judged result, when judged result when not being positioned at zone of control, send described judged result to vision capture unit 10, described vision capture unit 10 need be caught visual focus again and be obtained focus information, when judged result when being positioned at zone of control, send described judged result to described analytic unit 230.In embodiments of the present invention, zone of control is meant the zone that can receive vision control that sets in advance in the mobile communication terminal.For example, under ideal case, a certain concrete function zone can be a zone of control in the interface, but the electric weight display message just is set to uncontrollable zone.
As shown in Figure 5, comprise in the described analytic unit 230: handle judging unit 231, be used to judge whether described focus information satisfies treatment conditions, and produce the result who judges; Information generating unit 232, be used for when described judged result when satisfying treatment conditions, described focus information is equally carried out analyzing and processing according to normal interactive mode handles, generate described control information.Herein, described treatment conditions can pre-set as required accordingly.In embodiments of the present invention, described normal interactive mode (being called manual interactive mode again) refers to that the user is to the manual operation of mobile communication terminal keyboard/touch-screen in the prior art, and normal interactive mode is treated to the information processing that mobile communication terminal produces manual operation in the prior art.
At last, described performance element 250 is carried out the target action according to described control information.
In embodiments of the present invention, described device can also be supported other interactive modes, and be supported in the handoff functionality under the distinct interaction pattern except supporting the vision capture interactive mode.Support this function that can switch interactive mode mutually can increase the flexibility of user's operation, increase user's enjoyment sense.Fig. 6 is the schematic block diagram according to the realization interactive mode device for switching of the embodiment of the invention.The mode that embodiment of the invention interactive mode switches comprises following two kinds:
One, the concrete interactive mode in the choice of dynamical function menu
As shown in Figure 6, performance element 250 in the device of the embodiment of the invention also comprises interactive mode switch unit 251, be used for when the control information of described analytic unit generation is the interactive mode handover information, carry out switching to another interactive mode according to described interactive mode handover information control from current interactive mode.This mode switch can be to switch to other interactive modes from the vision capture interactive mode, also can be to switch to the vision capture interactive mode from other interactive modes.Described device supports that under arbitrary current interactive mode comprising different interactive modes in the special function menu chooses, for example, current interactive mode is the vision capture interactive mode, the user watches the interactive mode handoff functionality item in the reception interface attentively, at this moment can show on the reception interface that different interactive modes is for choosing, the user is watching manual interactive mode wherein attentively, information process unit 20 is passed to after getting access to the focus information of this visual focus in vision capture unit 10,230 pairs of described focus informations of the analytic unit of information process unit 20 carry out generating control information after the analyzing and processing, and described control information is the interactive mode handover information; Interactive mode switch unit 251 in the described performance element 250 is carried out from current vision capture mode switch to manual interactive mode according to described interactive mode handover information.
Two, combination in advance is provided with the interactive mode of each concrete function item
As shown in Figure 6, comprise also in the device of the embodiment of the invention that interactive mode is provided with unit 30, be used to set in advance the interactive mode that the concrete function item of mobile communication terminal uses.The user can make up the interactive mode of operation that a class function or content are set voluntarily under any one interactive mode.For example, the user is watching the concrete function item in the reception interface attentively, and this concrete function item uses a kind of in certain interactive mode for certain function items that unit 30 sets in advance is set by interactive mode.Video capture unit 10 obtains the focus information of above-mentioned visual focus, in the process that 230 pairs of described focus informations of analytic unit in the information process unit 20 are handled, the interactive mode that the concrete function item that sets in advance according to described focus information inquiry uses generates corresponding control information at last.Performance element 250 is carried out according to described control information and is changed concrete function over to, and interactive mode switch unit 251 is wherein carried out the interactive mode that switches to the concrete function item use that sets in advance from current interactive mode according to described control information.
In embodiments of the present invention, described device can also realize on mobile communication terminal that eyeball control camera focuses automatically, its process is as follows: when occurring treating filmed image on the display screen of mobile communication terminal, the user watches the image part of wishing the object of focusing on the shooting interface of described display screen attentively; Vision capture unit 10 obtains the focus information of visual focus, and described focus information comprises the information of the particular location of visual focus; 20 pairs of described focus informations of information process unit are handled, in the processing procedure, information process unit 20 is divided into fixing N zone according to what pre-set taking the interface, can generate the corresponding control information of focusing automatically for each different zone; Performance element 250 is focused to the camera of mobile communication terminal automatically according to this control information.
The embodiment of the invention also provides a kind of mobile communication terminal, and it comprises:
The interactive device of mobile communication terminal, described device further comprises:
The vision capture unit is used to catch visual focus information;
Information process unit is used for carrying out the target action according to described focus information control.
Wherein, comprise in the described information process unit: receiving element is used to receive described focus information; Analytic unit is used for described focus information is handled, and generates control information; Performance element is used for carrying out the target action according to described control information.Described performance element comprises: the interactive mode switch unit, be used for when the control information of described analytic unit generation is the interactive mode handover information, and carry out switching to another interactive mode from current interactive mode according to described interactive mode handover information.
At last, one of ordinary skill in the art will appreciate that all or part of step that realizes in the foregoing description method is to instruct relevant hardware to finish by program, described program can be stored in the computer read/write memory medium, and this program comprises the steps: when carrying out
Obtain the focus information of visual focus;
Carry out the target action according to described focus information control.
Described according to the action of focus information control execution target, further comprise:
Described focus information is handled, generated control messages;
Carry out the target action according to described control messages.
Described storage medium can for, as ROM/RAM, magnetic disc, CD etc.
Certainly, the above is a preferred implementation of the present invention, should be understood that; for those skilled in the art; under the prerequisite that does not break away from the principle of the invention, can also make some improvements and modifications, these improvements and modifications also are considered as protection scope of the present invention.