US20130036388A1 - Moving a graphical selector - Google Patents
Moving a graphical selector Download PDFInfo
- Publication number
- US20130036388A1 US20130036388A1 US13/250,675 US201113250675A US2013036388A1 US 20130036388 A1 US20130036388 A1 US 20130036388A1 US 201113250675 A US201113250675 A US 201113250675A US 2013036388 A1 US2013036388 A1 US 2013036388A1
- Authority
- US
- United States
- Prior art keywords
- graphical
- increment
- gesture
- gesture input
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Definitions
- the disclosure relates to moving a graphical selector.
- Computing devices often have a display device that displays a graphical selector, such as a cursor or a pointer controlled by a mouse or other input device, which may be used to interact with other displayed elements.
- a graphical selector such as a cursor or a pointer controlled by a mouse or other input device
- a user may wish to move the graphical selector to a desired location on the display device.
- the display device is a presence-sensitive device, such as a touch screen, the user may attempt to move the graphical selector by placing a finger over the desired location.
- a method includes activating, by a computing device, a graphical key that is displayed with a presence-sensitive interface of the computing device. Upon activation of the graphical key, the method also includes receiving gesture input corresponding to a directional gesture using the presence-sensitive interface of the computing device and moving a graphical selector displayed with the presence-sensitive interface from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- a tangible computer-readable medium comprising instructions for causing a programmable processor to perform operations including activating, by a computing device, a graphical key that is displayed with a presence-sensitive interface of the computing device.
- the instructions further include upon activation of the graphical key, receiving gesture input corresponding to a directional gesture using the presence-sensitive interface of the computing device.
- the instructions also include moving a graphical selector displayed by the computing device from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- a computing device includes one or more processors.
- the computing device may also include an input device that receives gesture input corresponding to a directional gesture and an output device that displays a graphical selector.
- the computing device further includes means for moving the graphical selector from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- FIG. 1A is a block diagram illustrating an example of a computing device that may execute one or more applications and display a graphical key for moving a graphical selector, in accordance with one or more aspects of the present disclosure.
- FIG. 1B is a block diagram illustrating further details of one example of the graphical key shown in FIG. 1A , in accordance with one or more aspects of the present disclosure.
- FIG. 2 is a block diagram illustrating further details of one example of the computing device shown in FIG. 1A , in accordance with one or more aspects of the present disclosure.
- FIG. 3 is a flow chart illustrating an example method that may be performed by a computing device to provide graphical key functionality, in accordance with one or more aspects of the present disclosure.
- FIG. 4 is a diagram illustrating one example of a graphical selector controlled by a graphical key in an image environment, in accordance with one or more aspects of the present disclosure.
- Techniques of the present disclosure allow a computing device to implement a graphical key on a graphical user interface (GUI) of a computing device that moves a graphical selector based on detected user gestures.
- GUI graphical user interface
- the graphical selector e.g., a cursor or pointer
- the movement of the graphical selector on the display may be defined in specific increments based on properties of the gesture, which may include, for example, a duration, type, displacement, or speed of the gesture.
- the computing device When the computing device has a relatively small screen (such as a mobile phone, tablet computer, or other mobile device), it may be difficult for a user to precisely pinpoint the location of the graphical selector.
- the present disclosure maximizes screen real estate (e.g., by reducing four or more directional arrow keys to a single graphical key) and provides more precise movement of a graphical selector on small and medium size presence-sensitive screens where user input is often provided using a finger.
- a user performs a swipe-left gesture, e.g., a swipe motion starting at the graphical key and moving to the left, to cause a cursor in a textual environment to move one character to the left.
- a fling-down gesture e.g., a fling motion starting at the graphical key and moving downward, causes the cursor to move downward one line.
- the movement of the cursor is based on or proportional to the distance traveled of the gesture, e.g., a relatively longer gesture (e.g., a length of the gesture may be equal to or more than a length threshold) moves the cursor over by an entire word while a relatively shorter gesture (e.g., a length of the gesture may be less than a length threshold) moves the cursor a single character.
- the movement of the cursor is based on or proportional to the speed of the gesture, e.g., a fast upward gesture moves the cursor up to the top of a current paragraph, up to the top of a preceding paragraph, or up to the top of the textual environment.
- the magnitude of the cursor movement may be based on the duration that the user presses the graphical key before release.
- This functionality may be provided via adding a graphical key to a graphical keyboard.
- Other examples overlay the functionality onto a pre-existing key of a graphical keyboard, for example, onto a space bar.
- a tap made at the space bar adds a space to the text
- a swipe gesture performed originating at the space bar moves the cursor based on a vector (e.g., magnitude and direction) of the gesture.
- the present disclosure can also apply outside of the textual environment, e.g., in a pictorial context.
- FIG. 1 is a block diagram illustrating an example of a computing device 2 that may execute one or more applications (e.g., keyboard application 8 ) and display a graphical key 18 for moving a graphical selector 24 , in accordance with one or more aspects of the present disclosure.
- Computing device 2 may, in some examples, include, be, or be part of a portable computing device (e.g., a mobile phone, netbook, laptop, personal data assistant (PDA), tablet device, portable gaming device, portable media player, e-book reader, or a watch) as well as a non-portable device (e.g., a desktop computer).
- a portable computing device e.g., a mobile phone, netbook, laptop, personal data assistant (PDA), tablet device, portable gaming device, portable media player, e-book reader, or a watch
- a non-portable device e.g., a desktop computer.
- computing device 2 is described as a portable or mobile device that a user 14 can carry, such as a laptop, smartphone, or tablet device, but aspects of this disclosure should not be considered limited to such devices.
- a portable or mobile device that a user 14 can carry, such as a laptop, smartphone, or tablet device, but aspects of this disclosure should not be considered limited to such devices.
- computing device 2 is more fully described in FIG. 2 , discussed below.
- Computing device 2 may include an input/output (I/O) device 12 (e.g., a presence- or touch-sensitive device).
- I/O device 12 may be a presence-sensitive screen capable of detecting gestures made proximate to the presence-sensitive screen.
- I/O device 12 may be a touch-based interface capable of receiving touch input from a user 14 (e.g., touch screen, track pad, track point, or the like).
- I/O device 12 may comprise a display device 20 .
- User 14 may interact with display device 20 , for example, by performing touch input on I/O device 12 .
- I/O device 12 is described as a touch-sensitive device 12 , but aspects of this disclosure should not be considered limited to such devices. In other examples, techniques disclosed herein are applied to a presence-sensitive device.
- Computing device 2 includes a user input module 6 that, when executed, may provide functionality to computing device 2 to receive and interpret user input.
- Computing device 2 further includes keyboard application 8 that, when executed, may provide functionality to computing device 2 to provide graphical key 18 .
- Keyboard application 8 may also provide signals to display device 20 to display information related to gesture input.
- User input module 6 may also provide signals related to user input to keyboard application 8 .
- Keyboard application 8 may include a graphical key module 10 .
- Graphical key module 10 provides computing device 2 with capabilities to display graphical key 18 that may be used to move graphical selector 24 .
- graphical key module 10 provides capabilities to move graphical selector 24 by a selected increment from a first graphical location 26 to a second graphical location 28 (as shown in FIG. 1B ).
- keyboard application 8 contains further modules having additional capabilities.
- Display device 12 of first computing device 2 may display text 22 , graphical selector 24 , and graphical key 18 .
- Graphical key 18 may be a graphical representation of a virtual button or icon, for example, a touch target. Graphical key 18 may be an image having any shape, size, coloration, or style that is displayed on display device 20 .
- display device 20 may also display a graphical keyboard 4 .
- graphical key 18 is part of graphical keyboard 4 .
- graphical key 18 is a functionality overlaid on a pre-existing key in graphical keyboard 4 .
- graphical key 18 is not part of graphical keyboard 4 .
- graphical key 18 is located at any location of display device 20 .
- graphical key 18 is overlaid on top of graphical keyboard 4 .
- At least part of computing device 2 may be operating in a textual environment, for example, where display device 20 may display text 22 .
- graphical selector 24 may be a text cursor.
- user 14 may have input (e.g., via typing or handwriting), for example, the words “To Whom it May Concern: This lettwr is in regard to”.
- User 14 may have noticed that “letter” was misspelled “lettwr” and wish to correct the error.
- User 14 may tap touch-sensitive device 12 in order to place graphical selector 24 next to the “w”. Typically, touching anywhere in the text will relocate the graphical selector 24 .
- touch-sensitive device 12 in order to precisely locate graphical selector 24 in order to replace the “w” with an “e” may be difficult.
- touch-sensitive device 12 may be small relative to an input implement such as a finger, thus it is likely that graphical selector 24 may be repositioned within the vicinity of “w” instead of next to it.
- graphical selector 24 may be placed at first graphical location 26 when user 14 taps in the vicinity of the “w” on touch-sensitive device 12 .
- user 14 may activate graphical key 18 in order to precisely move graphical selector 24 .
- User 14 may tap graphical key 18 to activate it, for example.
- graphical key 18 may be active at all times when it is displayed.
- User 14 may perform a swipe gesture originating from graphical key 18 in order to reposition graphical selector 24 . As shown in FIG. 1B , user 14 performs a swipe gesture to move graphical selector 24 to the left, next to the “w”.
- graphical key 18 may be displayed sometimes or at all times when operating computing device 2 .
- graphical key 18 may only be displayed when computing device 2 is operating in an environment pertaining to the graphical key 18 .
- graphical key 18 may be displayed to move a cursor when user 14 is operating in a text-based environment.
- graphical key 18 may be displayed whenever graphical selector 24 is also displayed.
- graphical key 18 may be displayed when graphical keyboard 4 is also displayed.
- graphical key 18 may be displayed upon activation of a mode (e.g., activating a mode button) to initiate movement of graphical selector 24 .
- a mode e.g., activating a mode button
- FIG. 1B is a block diagram illustrating further details of one example of graphical key 18 shown in FIG. 1A , in accordance with one or more aspects of the present disclosure.
- user 14 touches graphical key 18 with a finger or other implement and drags the touch in a manner recognized by graphical key module 10 to move graphical selector 24 one character or space to the left.
- user 14 performs gesture input 16 , which may be a swipe to the left that begins at graphical key 18 . Examples of a swipe gesture may include touching touch-sensitive device 12 anywhere and dragging the touch before releasing it. Examples of a gesture input originating at graphical key 18 may include a swipe gesture that begins with a touch over graphical key 18 .
- Graphical key module 10 may interpret gesture input 16 as a command to move graphical selector 24 by an increment 29 to a second graphical location 28 .
- graphical key module 10 of keyboard application 8 may detect at least one property of gesture input 16 .
- user input module 6 may detect at least one property of gesture input 16 and provide a signal related to the at least one property to keyboard application 8 .
- keyboard application 8 interprets gesture input 16 as corresponding to one or more increments 29 in one or more directions.
- keyboard application 8 may move graphical selector 24 based on the at least one property of gesture input 16 .
- Properties of the gesture input 16 may, for example, include a direction of the gesture input 16 , a displacement of the gesture input 16 , a speed of the gesture input, a width of the gesture input 16 , duration graphical key 18 is pressed, or any other property.
- a width of the gesture input 16 may related to a length of the gesture input 16 in a direction orthogonal to a direction of a larger movement.
- a width of a touch-based input may correspond to the width of a finger of user 14 that is making gesture input 16 .
- a width of a touch-based input from a finger may be larger than a width of a touch-based input from a stylus.
- the time that graphical key 18 is pressed before a fling or swipe gesture is made is used to determine how much graphical selector 24 is moved. For example, a shorter touch and fling may move graphical selector 24 a first distance, whereas a longer touch before a fling may move graphical selector 24 a second distance larger than the first distance.
- increment 29 may be one letter, character, or space. In other examples, increment 29 may be a word, a line, a sentence, a paragraph, a predetermined number of characters, or combinations thereof. In other environments, such as a pictorial environment, increment 29 may be another amount or quantity, for example, a pixel or a selected distance across display device 20 . In some examples, increment 29 may be a specific amount in a discrete environment, for example, a space in a text-based environment or a pixel in a pictorial environment. In examples where the environment is continuous, increment 29 may not be a discrete amount, such as, for example, in a mathematical graphing environment.
- FIG. 2 is a block diagram illustrating further details of one example of computing device 2 shown in FIG. 1 .
- FIG. 2 illustrates only one particular example of computing device 2 , and many other example embodiments of computing device 2 may be used in other instances.
- computing device 2 includes one or more processors 30 , memory 32 , a network interface 34 , one or more storage devices 36 , one or more input devices 38 , one or more output devices 40 , and one or more batteries or other power sources 42 .
- Computing device 2 also includes an operating system 44 , which may include user input module 6 executable by computing device 2 .
- Computing device 2 may include one or more applications 46 and keyboard application 8 .
- Keyboard application 8 may include graphical key module 10 executable by computing device 2 .
- Operating system 44 , applications 46 , and keyboard application 8 are also executable by computing device 2 .
- Each of components 30 , 32 , 34 , 36 , 38 , 40 , 42 , 44 , 46 , 6 , 8 , and 10 may be interconnected (physically, communicatively, and/or operatively) for inter-component communications.
- Processors 30 may be configured to implement functionality and/or process instructions for execution in computing device 2 .
- Processors 30 may be capable of processing instructions stored in memory 32 or instructions stored on storage devices 36 .
- Memory 32 may be configured to store information within computing device 2 during operation. Memory 32 may, in some examples, be described as a non-transitory or tangible computer-readable storage medium. In some examples, memory 32 is a temporary memory, meaning that a primary purpose of memory 32 is not long-term storage. Memory 32 may also, in some examples, be described as a volatile memory, meaning that memory 32 does not maintain stored contents when the computer is turned off. Examples of volatile memories include random access memories (RAM), dynamic random access memories (DRAM), static random access memories (SRAM), and other forms of volatile memories known in the art. In some examples, memory 32 may be used to store program instructions for execution by processors 30 . Memory 32 may be used by software or applications running on computing device 2 (e.g., one or more of applications 46 ) to temporarily store information during program execution.
- RAM random access memories
- DRAM dynamic random access memories
- SRAM static random access memories
- memory 32 may be used to store program instructions for execution by processors 30 . Memory 32 may be used by software or applications running on computing device 2 (e
- Storage devices 36 may also include one or more non-transitory or tangible computer-readable storage media. Storage devices 36 may be configured to store larger amounts of information than memory 32 . Storage devices 36 may further be configured for long-term storage of information. In some examples, storage devices 36 may include non-volatile storage elements. Examples of such non-volatile storage elements may include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories. In one example, storage device 36 contains a database that includes a mapping of properties of gesture inputs (such as gesture input 16 ) to increments (such as increment 29 ). In such an example, graphical key module 10 may access the database stored in storage device 36 when interpreting gesture input 16 .
- Computing device 2 also includes a network interface 34 .
- Computing device 2 may utilize network interface 34 to communicate with external devices via one or more networks.
- network interface 34 may correspond to an interface for receiving data from computing devices (e.g., computing devices 22 and 24 of FIG. 1 ).
- Network interface 34 may be a network interface card, such as an Ethernet card, configured to communication over, for example, Ethernet, transmission control protocol (TCP), Internet protocol (IP), asynchronous transfer mode (ATM), or other network communication protocols.
- TCP transmission control protocol
- IP Internet protocol
- ATM asynchronous transfer mode
- network interface 34 may be an optical transceiver, a radio frequency transceiver, or any other type of device that can send and receive information.
- Network interfaces 34 may include Bluetooth®, 3G and WiFi® radios in mobile computing devices as well as USB.
- Network interface 34 may be configured to connect to a wide-area network such as the Internet, a local-area network (LAN), an enterprise network, a wireless network, a cellular network, a telephony network, a Metropolitan area network (e.g., Wi-Fi, WAN, or WiMAX), one or more other types of networks, or a combination of two or more different types of networks (e.g., a combination of a cellular network and the Internet).
- computing device 2 may utilize network interface 34 to wirelessly communicate with an external device or other networked computing device.
- Computing device 2 may also include one or more input devices 38 .
- Input device 38 may be configured to receive input from user 14 through tactile, audio, or video input.
- Examples of input device 38 may include a touch-sensitive display, mouse, a keyboard, a voice responsive system, a microphone, a video camera, or any other type of device for detecting a command from user 14 .
- One or more output devices 40 may also be included in computing device 2 , e.g., display device 12 .
- Output device 40 may be configured to provide output to user 14 using tactile, audio, or video stimuli.
- Output device 40 may include a touch-sensitive display, a sound card, a video graphics adapter card, or any other type of device for converting a signal into an appropriate form understandable to humans or machines.
- Additional examples of output device 40 may include a speaker, a cathode ray tube (CRT) monitor, a liquid crystal display (LCD), or any other type of device that can provide output to user 14 .
- CTR cathode ray tube
- LCD liquid crystal display
- Computing device 2 may include one or more batteries or other power sources 42 , which may be rechargeable and provide power to computing device 2 .
- the one or more batteries 42 may be made from nickel-cadmium, lithium-ion, or any other suitable material.
- the one or more power sources 42 are located external to computing device 2 .
- the one or more batteries 42 may be rechargeable and/or computing device 2 may be powered via a power connection.
- Computing device 2 may include operating system 44 .
- Operating system 44 may control the operation of components of computing device 2 .
- operating system 44 may facilitate the interaction of application 46 or keyboard application 8 with processors 30 , memory 32 , network interface 34 , storage device 36 , input device 38 , output device 40 , and battery 42 .
- Examples of operating system 44 may include Android®, Apple iOS®, Blackberry® OS, Symbian OS®, Linux®, Microsoft Windows Phone 7®, or the like.
- Keyboard application 8 may additionally include graphical key module 10 , which may be executed as part of operating system 44 .
- graphical key module 10 may be implemented or executed by other components of computing device 2 .
- Graphical key module 10 may process gesture input, e.g., gesture input 16 , and may provide a graphical key 18 for display device 20 to display.
- graphical key module 10 may receive input from a component such as processors 30 , memory 32 , network interface 34 , storage devices 36 , one or more output devices 40 , battery 42 , or operating system 44 .
- graphical key module 10 may perform additional processing on gesture input 16 or graphical selector 24 .
- graphical key module 10 may transmit input to an application, e.g., application 46 , or other component in computing device 2 .
- Any applications, e.g., application 46 or keyboard application 8 , implemented within or executed by computing device 2 may be implemented or contained within, operable by, executed by, and/or be operatively/communicatively coupled to components of computing device 2 , e.g., processors 30 , memory 32 , network interface 34 , and/or storage devices 36 .
- FIG. 3 is a flow chart illustrating a example method 50 that may be performed by a computing device to provide functionality of a graphical key, in accordance with one or more aspects of the present disclosure.
- method 50 may be performed by computing device 2 as shown in FIG. 1 or 2 .
- method 50 may move a graphical selector by at least one increment based on at least one property of a gesture input.
- Method 50 includes activating a graphical key that is displayed with a touch-based interface of a computing device ( 52 ).
- user 14 activates graphical key 18 by touching the graphical key with a finger or other device.
- graphical key 18 may be deactivated when a touch that activated direction key 18 is released.
- tapping graphical key 18 may activate and deactivate graphical key 18 .
- a graphical key mode may be toggled by a swipe gesture made anywhere on display device 20 (that is, not only those originating at graphical key 18 ). In such an example, a swipe gesture performed anywhere on touch-based device 12 may be used to move graphical selector 24 while computing device 2 is operating in the graphical key mode.
- the graphical key mode may be toggled by tapping graphical key 18 .
- method 50 may further include receiving gesture input corresponding to a directional gesture using the touch-based interface of the computing device ( 54 ).
- the gesture input corresponding to a directional gesture may be a swipe motion originating at the graphical key, for example, gesture input 16 originating at graphical key 18 .
- gesture input 16 may be a swipe motion that does not originate at graphical key 18 .
- Method 50 may further include moving a graphical selector displayed by the computing device from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input ( 56 ).
- graphical selector 24 may be moved from first graphical location 26 to second graphical location 28 based on a direction of gesture input 16 . That is, the distance graphical selector 24 is moved, and in what direction graphical selector 24 is moved, may be based on one or more properties of gesture input 16 .
- gesture input 16 is a swipe gesture to the left. Therefore, graphical key module 10 moves graphical selector 24 at least one increment to the left.
- the property of gesture input 16 may be a direction of gesture input 16 .
- graphical selector 24 may be moved in a direction related to the direction of gesture input 16 (left, as shown in FIG. 1B ).
- graphical selector 24 may be moved in another direction based on a direction of the directional gesture, such as, but not limited to left, right, up, down, or diagonal.
- a property of the gesture input 16 may be a displacement of gesture input 16 .
- the distance from a location where gesture input 16 is initiated (for example, where a touch begins) to a location where gesture input 16 is completed (for example, where the touch is released) is used to determine how far to move graphical selector 24 . That is, graphical key module 10 may select which increment 29 or how many increments 29 to move graphical selector 24 by based on the displacement of gesture input 16 .
- the displacement threshold may be set to be approximately 1 centimeter (cm).
- a directional gesture is less than approximately 1 cm, graphical selector 24 may be moved by one letter, space, or character in a direction corresponding to the directional gesture.
- graphical selector 24 may be moved by one word in a direction corresponding to the directional gesture.
- other increments and thresholds may be implemented.
- a property of gesture input 16 may be a speed of the gesture input 16 .
- graphical selector 24 may be moved by a first increment when the speed of gesture input 16 is below a speed threshold and may be moved by a second increment when the speed of the gesture input 16 is above or equal to the speed threshold.
- the second increment may be larger than the first increment.
- graphical selector 24 may be moved by a letter, space, character, or line in a direction corresponding to the direction of gesture input 16 .
- graphical selector 24 may be moved by a word or paragraph in a direction corresponding to the direction of gesture input 16 .
- other increments and thresholds may be implemented.
- gesture input 16 may be used in determining how to move graphical selector 24 .
- which increment 29 , and how many increments 29 graphical selector 24 moves may be based on the duration that user 14 presses graphical key 16 before releasing it.
- graphical selector 24 may be moved by one or more selected increments.
- the number of selected increments may be proportional to at least one property of the gesture input. That is, the number of operations performed by graphical key module 10 in response to gesture input 16 may increase with the displacement of gesture input 16 .
- graphical key module 10 may move graphical selector 24 by one increment for every approximate 1 cm of displacement of gesture input 16 .
- graphical key module 10 may move graphical selector 24 by four increments in the direction of gesture input 16 .
- a location of graphical selector 24 is updated real-time during performance of the directional gesture. In other examples, graphical selector 24 is not moved until completion of the directional gesture.
- a directional gesture may be fragmented into a plurality of sub-gestures.
- Moving the graphical selector 24 may include moving the graphical selector according to one or more properties of each sub-gesture. For example, when the directional gesture is not an approximately linear gesture input, but rather a curved input, the curve may be fragmented into approximately linear sub-gestures. Each of these sub-gestures may be treated as a separate gesture input 16 .
- the plurality of sub-gestures is placed into a chronological order of inputs, wherein graphical selector 24 is moved sequentially in the chronological order of inputs.
- non-linear directional gestures may result in an approximately curving motion of graphical selector 24 .
- graphical key 18 may be a pre-existing key of graphical keyboard 4 , wherein directional functionality is overlaid on the pre-existing key.
- the pre-existing key of graphical keyboard 4 may be a space bar.
- Activating graphical key 18 may include performing a swipe gesture originating at the space bar.
- the response of graphical key 18 may be user configurable. That is, user 14 may select what properties of gesture input 16 are recognized and how those properties are used to move graphical selector 24 .
- This user configurable information may be stored in a mapping database in storage device 36 .
- computing device 2 may operate at least partially in a textual environment.
- graphical selector 24 may be a text cursor.
- an increment may be one of a space, a letter, a word, a line, a sentence, a paragraph, and combinations thereof.
- computing device 2 may operate at least partially in a pictorial or image environment.
- graphical selector 24 may be a pointer.
- an increment may be one of a single pixel, a selected number of pixels, a block, an image segment, and combinations thereof.
- FIG. 4 provides one example of graphical key functionality in a pictorial environment.
- FIG. 4 is a diagram illustrating one example of a graphical selector controlled by a graphical key in an image environment, in accordance with one or more aspects of the present disclosure.
- display device 20 may display a pixilated image 70 .
- the graphical selector may be a pointer 74 .
- FIG. 4 shows at least a portion of display device 20 at two different time instances.
- the first time instance is indicated by the solid line of pointer 74 - 1 and the second time instance is indicated by the dashed line of pointer 74 - 2 .
- pointer 74 - 1 is located at first graphical location 72 , and is pointing to first selected pixel 76 .
- a user such as user 14 , activates a graphical key to move pointer 74 - 1 to a second geographical location 78 in the second time instance.
- pointer 74 - 2 is moved 4 pixels in an upper-right diagonal direction. Pointer 74 - 2 now selects second selected pixel 80 .
- a short or slow gesture may move pointer 74 one pixel, row, or column in a direction corresponding to the gesture
- a long or fast gesture may move pointer 74 by two or more pixels, rows, or columns in a direction corresponding to the gesture.
- Techniques of the present disclosure may provide a graphical key that may be used to precisely locate a graphical selector displayed on a computing device.
- the graphical selector may be moved from a first graphical location to a second graphical location by at least one selected increment based on a property of a gesture input. For example, a short or slow gesture may move the graphical selector one character or line in a direction corresponding to the gesture, while a long or fast gesture may move the graphical selector one word or paragraph in a direction corresponding to the gesture. This allows a user to finely move a graphical selector, even when a touch-sensitive screen of the computing device is relatively small compared with the implement used to touch the touch-sensitive screen.
- processors including one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuitry, as well as any combinations of such components.
- DSPs digital signal processors
- ASICs application specific integrated circuits
- FPGAs field programmable gate arrays
- processors may generally refer to any of the foregoing logic circuitry, alone or in combination with other logic circuitry, or any other equivalent circuitry.
- a control unit including hardware may also perform one or more of the techniques of this disclosure.
- Such hardware, software, and firmware may be implemented within the same device or within separate devices to support the various techniques described herein.
- any of the described units, modules or components may be implemented together or separately as discrete but interoperable logic devices. Depiction of different features as modules or units is intended to highlight different functional aspects and does not necessarily imply that such modules or units are realized by separate hardware, firmware, or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware, firmware, or software components, or integrated within common or separate hardware, firmware, or software components.
- Techniques described herein may also be embodied or encoded in an article of manufacture including a computer-readable storage medium encoded with instructions. Instructions embedded or encoded in an article of manufacture including an encoded computer-readable storage medium, may cause one or more programmable processors, or other processors, to implement one or more of the techniques described herein, such as when instructions included or encoded in the computer-readable storage medium are executed by the one or more processors.
- Computer readable storage media may include random access memory (RAM), read only memory (ROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), flash memory, a hard disk, a compact disc ROM (CD-ROM), a floppy disk, a cassette, magnetic media, optical media, or other computer readable media.
- RAM random access memory
- ROM read only memory
- PROM programmable read only memory
- EPROM erasable programmable read only memory
- EEPROM electronically erasable programmable read only memory
- flash memory a hard disk, a compact disc ROM (CD-ROM), a floppy disk, a cassette, magnetic media, optical media, or other computer readable media.
- an article of manufacture may comprise one or more computer-readable storage media.
- computer-readable storage media may comprise non-transitory media.
- the term “non-transitory” may indicate that the storage medium is not embodied in a carrier wave or a propagated signal.
- a non-transitory storage medium may store data that can, over time, change (e.g., in RAM or cache).
Abstract
Description
- This application is a continuation of U.S. application Ser. No. 13/117,924, filed May 27, 2011, the entire contents of which are incorporated herein by reference.
- The disclosure relates to moving a graphical selector.
- Computing devices often have a display device that displays a graphical selector, such as a cursor or a pointer controlled by a mouse or other input device, which may be used to interact with other displayed elements. A user may wish to move the graphical selector to a desired location on the display device. When the display device is a presence-sensitive device, such as a touch screen, the user may attempt to move the graphical selector by placing a finger over the desired location.
- In one example, a method includes activating, by a computing device, a graphical key that is displayed with a presence-sensitive interface of the computing device. Upon activation of the graphical key, the method also includes receiving gesture input corresponding to a directional gesture using the presence-sensitive interface of the computing device and moving a graphical selector displayed with the presence-sensitive interface from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- In another example, a tangible computer-readable medium comprising instructions for causing a programmable processor to perform operations including activating, by a computing device, a graphical key that is displayed with a presence-sensitive interface of the computing device. The instructions further include upon activation of the graphical key, receiving gesture input corresponding to a directional gesture using the presence-sensitive interface of the computing device. The instructions also include moving a graphical selector displayed by the computing device from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- In yet another example, a computing device includes one or more processors. The computing device may also include an input device that receives gesture input corresponding to a directional gesture and an output device that displays a graphical selector. The computing device further includes means for moving the graphical selector from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input.
- The details of one or more aspects of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the disclosure will be apparent from the description and drawings, and from the claims.
-
FIG. 1A is a block diagram illustrating an example of a computing device that may execute one or more applications and display a graphical key for moving a graphical selector, in accordance with one or more aspects of the present disclosure. -
FIG. 1B is a block diagram illustrating further details of one example of the graphical key shown inFIG. 1A , in accordance with one or more aspects of the present disclosure. -
FIG. 2 is a block diagram illustrating further details of one example of the computing device shown inFIG. 1A , in accordance with one or more aspects of the present disclosure. -
FIG. 3 is a flow chart illustrating an example method that may be performed by a computing device to provide graphical key functionality, in accordance with one or more aspects of the present disclosure. -
FIG. 4 is a diagram illustrating one example of a graphical selector controlled by a graphical key in an image environment, in accordance with one or more aspects of the present disclosure. - In accordance with common practice, the various described features are not drawn to scale and are drawn to emphasize features relevant to the present disclosure. Like reference characters denote like elements throughout the figures and text.
- Techniques of the present disclosure allow a computing device to implement a graphical key on a graphical user interface (GUI) of a computing device that moves a graphical selector based on detected user gestures. In response to a swipe or fling gesture originating from the graphical key, the graphical selector (e.g., a cursor or pointer) may be moved to a new location on a display based on properties of the user gesture. The movement of the graphical selector on the display may be defined in specific increments based on properties of the gesture, which may include, for example, a duration, type, displacement, or speed of the gesture. When the computing device has a relatively small screen (such as a mobile phone, tablet computer, or other mobile device), it may be difficult for a user to to precisely pinpoint the location of the graphical selector. The present disclosure maximizes screen real estate (e.g., by reducing four or more directional arrow keys to a single graphical key) and provides more precise movement of a graphical selector on small and medium size presence-sensitive screens where user input is often provided using a finger.
- For example, a user performs a swipe-left gesture, e.g., a swipe motion starting at the graphical key and moving to the left, to cause a cursor in a textual environment to move one character to the left. In another example, a fling-down gesture, e.g., a fling motion starting at the graphical key and moving downward, causes the cursor to move downward one line. In some examples, the movement of the cursor is based on or proportional to the distance traveled of the gesture, e.g., a relatively longer gesture (e.g., a length of the gesture may be equal to or more than a length threshold) moves the cursor over by an entire word while a relatively shorter gesture (e.g., a length of the gesture may be less than a length threshold) moves the cursor a single character. In other examples, the movement of the cursor is based on or proportional to the speed of the gesture, e.g., a fast upward gesture moves the cursor up to the top of a current paragraph, up to the top of a preceding paragraph, or up to the top of the textual environment. In still other examples, the magnitude of the cursor movement may be based on the duration that the user presses the graphical key before release.
- This functionality may be provided via adding a graphical key to a graphical keyboard. Other examples overlay the functionality onto a pre-existing key of a graphical keyboard, for example, onto a space bar. In such examples, a tap made at the space bar adds a space to the text, while a swipe gesture performed originating at the space bar moves the cursor based on a vector (e.g., magnitude and direction) of the gesture. The present disclosure can also apply outside of the textual environment, e.g., in a pictorial context.
-
FIG. 1 is a block diagram illustrating an example of acomputing device 2 that may execute one or more applications (e.g., keyboard application 8) and display agraphical key 18 for moving agraphical selector 24, in accordance with one or more aspects of the present disclosure.Computing device 2 may, in some examples, include, be, or be part of a portable computing device (e.g., a mobile phone, netbook, laptop, personal data assistant (PDA), tablet device, portable gaming device, portable media player, e-book reader, or a watch) as well as a non-portable device (e.g., a desktop computer). For purposes of illustration only, in this disclosure,computing device 2 is described as a portable or mobile device that auser 14 can carry, such as a laptop, smartphone, or tablet device, but aspects of this disclosure should not be considered limited to such devices. One example ofcomputing device 2 is more fully described inFIG. 2 , discussed below. -
Computing device 2 may include an input/output (I/O) device 12 (e.g., a presence- or touch-sensitive device). In some examples, I/O device 12 may be a presence-sensitive screen capable of detecting gestures made proximate to the presence-sensitive screen. In other examples, I/O device 12 may be a touch-based interface capable of receiving touch input from a user 14 (e.g., touch screen, track pad, track point, or the like). In some examples, I/O device 12 may comprise adisplay device 20.User 14 may interact withdisplay device 20, for example, by performing touch input on I/O device 12. For purposes of illustration only, in this disclosure, I/O device 12 is described as a touch-sensitive device 12, but aspects of this disclosure should not be considered limited to such devices. In other examples, techniques disclosed herein are applied to a presence-sensitive device. -
Computing device 2 includes auser input module 6 that, when executed, may provide functionality to computingdevice 2 to receive and interpret user input.Computing device 2 further includeskeyboard application 8 that, when executed, may provide functionality to computingdevice 2 to providegraphical key 18.Keyboard application 8 may also provide signals to displaydevice 20 to display information related to gesture input.User input module 6 may also provide signals related to user input tokeyboard application 8. -
Keyboard application 8 may include agraphical key module 10.Graphical key module 10, in various instances, providescomputing device 2 with capabilities to displaygraphical key 18 that may be used to movegraphical selector 24. For example,graphical key module 10 provides capabilities to movegraphical selector 24 by a selected increment from a firstgraphical location 26 to a second graphical location 28 (as shown inFIG. 1B ). In other examples,keyboard application 8 contains further modules having additional capabilities. -
Display device 12 offirst computing device 2 may displaytext 22,graphical selector 24, and graphical key 18. Graphical key 18 may be a graphical representation of a virtual button or icon, for example, a touch target. Graphical key 18 may be an image having any shape, size, coloration, or style that is displayed ondisplay device 20. In one example,display device 20 may also display agraphical keyboard 4. In some examples, graphical key 18 is part ofgraphical keyboard 4. In other examples, graphical key 18 is a functionality overlaid on a pre-existing key ingraphical keyboard 4. In additional examples, graphical key 18 is not part ofgraphical keyboard 4. In alternative examples, graphical key 18 is located at any location ofdisplay device 20. In another example, graphical key 18 is overlaid on top ofgraphical keyboard 4. - At least part of
computing device 2 may be operating in a textual environment, for example, wheredisplay device 20 may displaytext 22. In such an example,graphical selector 24 may be a text cursor. As shown inFIG. 1A ,user 14 may have input (e.g., via typing or handwriting), for example, the words “To Whom it May Concern: This lettwr is in regard to”.User 14 may have noticed that “letter” was misspelled “lettwr” and wish to correct the error.User 14 may tap touch-sensitive device 12 in order to placegraphical selector 24 next to the “w”. Typically, touching anywhere in the text will relocate thegraphical selector 24. However, touching touch-sensitive device 12 in order to precisely locategraphical selector 24 in order to replace the “w” with an “e” may be difficult. For example, touch-sensitive device 12 may be small relative to an input implement such as a finger, thus it is likely thatgraphical selector 24 may be repositioned within the vicinity of “w” instead of next to it. For example,graphical selector 24 may be placed at firstgraphical location 26 whenuser 14 taps in the vicinity of the “w” on touch-sensitive device 12. - In order to place
graphical selector 24 in the desired location (in this example, on either side of the “w”),user 14 may activate graphical key 18 in order to precisely movegraphical selector 24.User 14 may tap graphical key 18 to activate it, for example. Alternatively, graphical key 18 may be active at all times when it is displayed.User 14 may perform a swipe gesture originating from graphical key 18 in order to repositiongraphical selector 24. As shown inFIG. 1B ,user 14 performs a swipe gesture to movegraphical selector 24 to the left, next to the “w”. - In some examples, graphical key 18 may be displayed sometimes or at all times when operating
computing device 2. In one example, graphical key 18 may only be displayed when computingdevice 2 is operating in an environment pertaining to thegraphical key 18. For example, graphical key 18 may be displayed to move a cursor whenuser 14 is operating in a text-based environment. As another example, graphical key 18 may be displayed whenevergraphical selector 24 is also displayed. In another example, graphical key 18 may be displayed whengraphical keyboard 4 is also displayed. In yet another example, graphical key 18 may be displayed upon activation of a mode (e.g., activating a mode button) to initiate movement ofgraphical selector 24. -
FIG. 1B is a block diagram illustrating further details of one example of graphical key 18 shown inFIG. 1A , in accordance with one or more aspects of the present disclosure. InFIG. 1B ,user 14 touches graphical key 18 with a finger or other implement and drags the touch in a manner recognized by graphicalkey module 10 to movegraphical selector 24 one character or space to the left. In this example,user 14 performsgesture input 16, which may be a swipe to the left that begins at graphical key 18. Examples of a swipe gesture may include touching touch-sensitive device 12 anywhere and dragging the touch before releasing it. Examples of a gesture input originating at graphical key 18 may include a swipe gesture that begins with a touch over graphical key 18. - Graphical
key module 10 may interpret gesture input 16 as a command to movegraphical selector 24 by anincrement 29 to a secondgraphical location 28. In some examples, graphicalkey module 10 ofkeyboard application 8 may detect at least one property ofgesture input 16. In another example,user input module 6 may detect at least one property ofgesture input 16 and provide a signal related to the at least one property tokeyboard application 8. Based on the at least one property ofgesture input 16,keyboard application 8 interpretsgesture input 16 as corresponding to one ormore increments 29 in one or more directions. In response,keyboard application 8 may movegraphical selector 24 based on the at least one property ofgesture input 16. - Properties of the
gesture input 16 may, for example, include a direction of thegesture input 16, a displacement of thegesture input 16, a speed of the gesture input, a width of thegesture input 16, duration graphical key 18 is pressed, or any other property. In one example where thegesture input 16 is a touch-based input, a width of thegesture input 16 may related to a length of thegesture input 16 in a direction orthogonal to a direction of a larger movement. For example, a width of a touch-based input may correspond to the width of a finger ofuser 14 that is makinggesture input 16. For example, a width of a touch-based input from a finger may be larger than a width of a touch-based input from a stylus. In another example, the time that graphical key 18 is pressed before a fling or swipe gesture is made is used to determine how muchgraphical selector 24 is moved. For example, a shorter touch and fling may move graphical selector 24 a first distance, whereas a longer touch before a fling may move graphical selector 24 a second distance larger than the first distance. - In the text-based example of
FIG. 1B ,increment 29 may be one letter, character, or space. In other examples,increment 29 may be a word, a line, a sentence, a paragraph, a predetermined number of characters, or combinations thereof. In other environments, such as a pictorial environment,increment 29 may be another amount or quantity, for example, a pixel or a selected distance acrossdisplay device 20. In some examples,increment 29 may be a specific amount in a discrete environment, for example, a space in a text-based environment or a pixel in a pictorial environment. In examples where the environment is continuous,increment 29 may not be a discrete amount, such as, for example, in a mathematical graphing environment. -
FIG. 2 is a block diagram illustrating further details of one example ofcomputing device 2 shown inFIG. 1 .FIG. 2 illustrates only one particular example ofcomputing device 2, and many other example embodiments ofcomputing device 2 may be used in other instances. - As shown in the specific example of
FIG. 2 ,computing device 2 includes one ormore processors 30,memory 32, anetwork interface 34, one ormore storage devices 36, one ormore input devices 38, one ormore output devices 40, and one or more batteries orother power sources 42.Computing device 2 also includes anoperating system 44, which may includeuser input module 6 executable by computingdevice 2.Computing device 2 may include one ormore applications 46 andkeyboard application 8.Keyboard application 8 may include graphicalkey module 10 executable by computingdevice 2.Operating system 44,applications 46, andkeyboard application 8 are also executable by computingdevice 2. Each ofcomponents -
Processors 30 may be configured to implement functionality and/or process instructions for execution incomputing device 2.Processors 30 may be capable of processing instructions stored inmemory 32 or instructions stored onstorage devices 36. -
Memory 32 may be configured to store information withincomputing device 2 during operation.Memory 32 may, in some examples, be described as a non-transitory or tangible computer-readable storage medium. In some examples,memory 32 is a temporary memory, meaning that a primary purpose ofmemory 32 is not long-term storage.Memory 32 may also, in some examples, be described as a volatile memory, meaning thatmemory 32 does not maintain stored contents when the computer is turned off. Examples of volatile memories include random access memories (RAM), dynamic random access memories (DRAM), static random access memories (SRAM), and other forms of volatile memories known in the art. In some examples,memory 32 may be used to store program instructions for execution byprocessors 30.Memory 32 may be used by software or applications running on computing device 2 (e.g., one or more of applications 46) to temporarily store information during program execution. -
Storage devices 36 may also include one or more non-transitory or tangible computer-readable storage media.Storage devices 36 may be configured to store larger amounts of information thanmemory 32.Storage devices 36 may further be configured for long-term storage of information. In some examples,storage devices 36 may include non-volatile storage elements. Examples of such non-volatile storage elements may include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories. In one example,storage device 36 contains a database that includes a mapping of properties of gesture inputs (such as gesture input 16) to increments (such as increment 29). In such an example, graphicalkey module 10 may access the database stored instorage device 36 when interpretinggesture input 16. -
Computing device 2 also includes anetwork interface 34.Computing device 2 may utilizenetwork interface 34 to communicate with external devices via one or more networks. In one example,network interface 34 may correspond to an interface for receiving data from computing devices (e.g.,computing devices FIG. 1 ).Network interface 34 may be a network interface card, such as an Ethernet card, configured to communication over, for example, Ethernet, transmission control protocol (TCP), Internet protocol (IP), asynchronous transfer mode (ATM), or other network communication protocols. In other examples,network interface 34 may be an optical transceiver, a radio frequency transceiver, or any other type of device that can send and receive information. - Examples of such network interfaces 34 may include Bluetooth®, 3G and WiFi® radios in mobile computing devices as well as USB.
Network interface 34 may be configured to connect to a wide-area network such as the Internet, a local-area network (LAN), an enterprise network, a wireless network, a cellular network, a telephony network, a Metropolitan area network (e.g., Wi-Fi, WAN, or WiMAX), one or more other types of networks, or a combination of two or more different types of networks (e.g., a combination of a cellular network and the Internet). In some examples,computing device 2 may utilizenetwork interface 34 to wirelessly communicate with an external device or other networked computing device. -
Computing device 2 may also include one ormore input devices 38.Input device 38 may be configured to receive input fromuser 14 through tactile, audio, or video input. Examples ofinput device 38 may include a touch-sensitive display, mouse, a keyboard, a voice responsive system, a microphone, a video camera, or any other type of device for detecting a command fromuser 14. - One or
more output devices 40 may also be included incomputing device 2, e.g.,display device 12.Output device 40 may be configured to provide output touser 14 using tactile, audio, or video stimuli.Output device 40 may include a touch-sensitive display, a sound card, a video graphics adapter card, or any other type of device for converting a signal into an appropriate form understandable to humans or machines. Additional examples ofoutput device 40 may include a speaker, a cathode ray tube (CRT) monitor, a liquid crystal display (LCD), or any other type of device that can provide output touser 14. -
Computing device 2 may include one or more batteries orother power sources 42, which may be rechargeable and provide power tocomputing device 2. The one ormore batteries 42 may be made from nickel-cadmium, lithium-ion, or any other suitable material. In other examples, the one ormore power sources 42 are located external tocomputing device 2. The one ormore batteries 42 may be rechargeable and/orcomputing device 2 may be powered via a power connection. -
Computing device 2 may includeoperating system 44.Operating system 44 may control the operation of components ofcomputing device 2. For example,operating system 44 may facilitate the interaction ofapplication 46 orkeyboard application 8 withprocessors 30,memory 32,network interface 34,storage device 36,input device 38,output device 40, andbattery 42. Examples ofoperating system 44 may include Android®, Apple iOS®, Blackberry® OS, Symbian OS®, Linux®, Microsoft Windows Phone 7®, or the like. -
Keyboard application 8 may additionally include graphicalkey module 10, which may be executed as part ofoperating system 44. In other cases, graphicalkey module 10 may be implemented or executed by other components ofcomputing device 2. Graphicalkey module 10 may process gesture input, e.g.,gesture input 16, and may provide a graphical key 18 fordisplay device 20 to display. Additionally, graphicalkey module 10 may receive input from a component such asprocessors 30,memory 32,network interface 34,storage devices 36, one ormore output devices 40,battery 42, oroperating system 44. In some cases, graphicalkey module 10 may perform additional processing ongesture input 16 orgraphical selector 24. In other cases, graphicalkey module 10 may transmit input to an application, e.g.,application 46, or other component incomputing device 2. - Any applications, e.g.,
application 46 orkeyboard application 8, implemented within or executed by computingdevice 2 may be implemented or contained within, operable by, executed by, and/or be operatively/communicatively coupled to components ofcomputing device 2, e.g.,processors 30,memory 32,network interface 34, and/orstorage devices 36. -
FIG. 3 is a flow chart illustrating aexample method 50 that may be performed by a computing device to provide functionality of a graphical key, in accordance with one or more aspects of the present disclosure. For example,method 50 may be performed by computingdevice 2 as shown inFIG. 1 or 2. In one example,method 50 may move a graphical selector by at least one increment based on at least one property of a gesture input. -
Method 50 includes activating a graphical key that is displayed with a touch-based interface of a computing device (52). For example,user 14 activates graphical key 18 by touching the graphical key with a finger or other device. In one example, graphical key 18 may be deactivated when a touch that activated direction key 18 is released. In other examples, tapping graphical key 18 may activate and deactivategraphical key 18. In another example, a graphical key mode may be toggled by a swipe gesture made anywhere on display device 20 (that is, not only those originating at graphical key 18). In such an example, a swipe gesture performed anywhere on touch-baseddevice 12 may be used to movegraphical selector 24 while computingdevice 2 is operating in the graphical key mode. In one example, the graphical key mode may be toggled by tappinggraphical key 18. - Upon activation of the graphical key,
method 50 may further include receiving gesture input corresponding to a directional gesture using the touch-based interface of the computing device (54). For example, the gesture input corresponding to a directional gesture may be a swipe motion originating at the graphical key, for example,gesture input 16 originating at graphical key 18. In other examples,gesture input 16 may be a swipe motion that does not originate at graphical key 18. -
Method 50 may further include moving a graphical selector displayed by the computing device from a first graphical location to a second graphical location by at least one selected increment based on a property of the gesture input (56). For example,graphical selector 24 may be moved from firstgraphical location 26 to secondgraphical location 28 based on a direction ofgesture input 16. That is, the distancegraphical selector 24 is moved, and in what directiongraphical selector 24 is moved, may be based on one or more properties ofgesture input 16. For example, as shown inFIG. 1B ,gesture input 16 is a swipe gesture to the left. Therefore, graphicalkey module 10 movesgraphical selector 24 at least one increment to the left. - For example, the property of
gesture input 16 may be a direction ofgesture input 16. In such an example,graphical selector 24 may be moved in a direction related to the direction of gesture input 16 (left, as shown inFIG. 1B ). In other examples,graphical selector 24 may be moved in another direction based on a direction of the directional gesture, such as, but not limited to left, right, up, down, or diagonal. - In another example, a property of the
gesture input 16 may be a displacement ofgesture input 16. For example, the distance from a location wheregesture input 16 is initiated (for example, where a touch begins) to a location wheregesture input 16 is completed (for example, where the touch is released) is used to determine how far to movegraphical selector 24. That is, graphicalkey module 10 may select whichincrement 29 or howmany increments 29 to movegraphical selector 24 by based on the displacement ofgesture input 16. - For example, when the displacement of
gesture input 16 is below a displacement threshold, graphicalkey module 10 selects an increment of a first amount. Similarly, when the displacement ofgesture input 16 is equal to or above the displacement threshold, graphicalkey module 10 selects an increment of a second amount, wherein the second amount is larger than the first amount. For example, the displacement threshold may be set to be approximately 1 centimeter (cm). Whenever a directional gesture is less than approximately 1 cm,graphical selector 24 may be moved by one letter, space, or character in a direction corresponding to the directional gesture. In contrast, whenever a directional gesture is equal to or greater than approximately 1 cm,graphical selector 24 may be moved by one word in a direction corresponding to the directional gesture. In other examples, other increments and thresholds may be implemented. - In another example, a property of
gesture input 16 may be a speed of thegesture input 16. In such an example,graphical selector 24 may be moved by a first increment when the speed ofgesture input 16 is below a speed threshold and may be moved by a second increment when the speed of thegesture input 16 is above or equal to the speed threshold. In such an example, the second increment may be larger than the first increment. For example, when the speed ofgesture input 16 is relatively slow,graphical selector 24 may be moved by a letter, space, character, or line in a direction corresponding to the direction ofgesture input 16. Likewise, when the speed ofgesture input 16 is relatively quick,graphical selector 24 may be moved by a word or paragraph in a direction corresponding to the direction ofgesture input 16. In other examples, other increments and thresholds may be implemented. - In other examples, other properties of
gesture input 16 may be used in determining how to movegraphical selector 24. For example, whichincrement 29, and howmany increments 29,graphical selector 24 moves may be based on the duration thatuser 14 presses graphical key 16 before releasing it. - In further examples,
graphical selector 24 may be moved by one or more selected increments. In such an example, the number of selected increments may be proportional to at least one property of the gesture input. That is, the number of operations performed by graphicalkey module 10 in response to gesture input 16 may increase with the displacement ofgesture input 16. For example, graphicalkey module 10 may movegraphical selector 24 by one increment for every approximate 1 cm of displacement ofgesture input 16. In such an example, whengesture input 16 corresponds to a directional gesture of approximately 4.3 cm, graphicalkey module 10 may movegraphical selector 24 by four increments in the direction ofgesture input 16. In some examples, a location ofgraphical selector 24 is updated real-time during performance of the directional gesture. In other examples,graphical selector 24 is not moved until completion of the directional gesture. - In some examples, a directional gesture may be fragmented into a plurality of sub-gestures. Moving the
graphical selector 24 may include moving the graphical selector according to one or more properties of each sub-gesture. For example, when the directional gesture is not an approximately linear gesture input, but rather a curved input, the curve may be fragmented into approximately linear sub-gestures. Each of these sub-gestures may be treated as aseparate gesture input 16. In one example, the plurality of sub-gestures is placed into a chronological order of inputs, whereingraphical selector 24 is moved sequentially in the chronological order of inputs. In another example, non-linear directional gestures may result in an approximately curving motion ofgraphical selector 24. - In another example, graphical key 18 may be a pre-existing key of
graphical keyboard 4, wherein directional functionality is overlaid on the pre-existing key. In one example, the pre-existing key ofgraphical keyboard 4 may be a space bar. Activating graphical key 18 may include performing a swipe gesture originating at the space bar. - In one example, the response of graphical key 18 may be user configurable. That is,
user 14 may select what properties ofgesture input 16 are recognized and how those properties are used to movegraphical selector 24. This user configurable information may be stored in a mapping database instorage device 36. - In some examples,
computing device 2 may operate at least partially in a textual environment. In such a textual environment,graphical selector 24 may be a text cursor. Similarly, an increment may be one of a space, a letter, a word, a line, a sentence, a paragraph, and combinations thereof. In other examples,computing device 2 may operate at least partially in a pictorial or image environment. In such an image environment,graphical selector 24 may be a pointer. Likewise, an increment may be one of a single pixel, a selected number of pixels, a block, an image segment, and combinations thereof.FIG. 4 provides one example of graphical key functionality in a pictorial environment. -
FIG. 4 is a diagram illustrating one example of a graphical selector controlled by a graphical key in an image environment, in accordance with one or more aspects of the present disclosure. In the example ofFIG. 4 ,display device 20 may display apixilated image 70. In this example, the graphical selector may be a pointer 74. -
FIG. 4 shows at least a portion ofdisplay device 20 at two different time instances. The first time instance is indicated by the solid line of pointer 74-1 and the second time instance is indicated by the dashed line of pointer 74-2. In the first time instance, pointer 74-1 is located at firstgraphical location 72, and is pointing to first selectedpixel 76. A user, such asuser 14, activates a graphical key to move pointer 74-1 to a secondgeographical location 78 in the second time instance. As shown, pointer 74-2 is moved 4 pixels in an upper-right diagonal direction. Pointer 74-2 now selects second selectedpixel 80. - In another example, a short or slow gesture may move pointer 74 one pixel, row, or column in a direction corresponding to the gesture, while a long or fast gesture may move pointer 74 by two or more pixels, rows, or columns in a direction corresponding to the gesture.
- Techniques of the present disclosure may provide a graphical key that may be used to precisely locate a graphical selector displayed on a computing device. The graphical selector may be moved from a first graphical location to a second graphical location by at least one selected increment based on a property of a gesture input. For example, a short or slow gesture may move the graphical selector one character or line in a direction corresponding to the gesture, while a long or fast gesture may move the graphical selector one word or paragraph in a direction corresponding to the gesture. This allows a user to finely move a graphical selector, even when a touch-sensitive screen of the computing device is relatively small compared with the implement used to touch the touch-sensitive screen.
- Techniques described herein may be implemented, at least in part, in hardware, software, firmware, or any combination thereof. For example, various aspects of the described embodiments may be implemented within one or more processors, including one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or any other equivalent integrated or discrete logic circuitry, as well as any combinations of such components. The term “processor” or “processing circuitry” may generally refer to any of the foregoing logic circuitry, alone or in combination with other logic circuitry, or any other equivalent circuitry. A control unit including hardware may also perform one or more of the techniques of this disclosure.
- Such hardware, software, and firmware may be implemented within the same device or within separate devices to support the various techniques described herein. In addition, any of the described units, modules or components may be implemented together or separately as discrete but interoperable logic devices. Depiction of different features as modules or units is intended to highlight different functional aspects and does not necessarily imply that such modules or units are realized by separate hardware, firmware, or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware, firmware, or software components, or integrated within common or separate hardware, firmware, or software components.
- Techniques described herein may also be embodied or encoded in an article of manufacture including a computer-readable storage medium encoded with instructions. Instructions embedded or encoded in an article of manufacture including an encoded computer-readable storage medium, may cause one or more programmable processors, or other processors, to implement one or more of the techniques described herein, such as when instructions included or encoded in the computer-readable storage medium are executed by the one or more processors. Computer readable storage media may include random access memory (RAM), read only memory (ROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), flash memory, a hard disk, a compact disc ROM (CD-ROM), a floppy disk, a cassette, magnetic media, optical media, or other computer readable media. In some examples, an article of manufacture may comprise one or more computer-readable storage media.
- In some examples, computer-readable storage media may comprise non-transitory media. The term “non-transitory” may indicate that the storage medium is not embodied in a carrier wave or a propagated signal. In certain examples, a non-transitory storage medium may store data that can, over time, change (e.g., in RAM or cache).
- Various aspects of the disclosure have been described. Aspects or features of examples described herein may be combined with any other aspect or feature described in another example. These and other embodiments are within the scope of the following claims.
Claims (21)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/250,675 US8656315B2 (en) | 2011-05-27 | 2011-09-30 | Moving a graphical selector |
DE202012005481U DE202012005481U1 (en) | 2011-05-27 | 2012-05-25 | Move a graphic selector |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/117,924 US8826190B2 (en) | 2011-05-27 | 2011-05-27 | Moving a graphical selector |
US13/250,675 US8656315B2 (en) | 2011-05-27 | 2011-09-30 | Moving a graphical selector |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/117,924 Continuation US8826190B2 (en) | 2011-05-27 | 2011-05-27 | Moving a graphical selector |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130036388A1 true US20130036388A1 (en) | 2013-02-07 |
US8656315B2 US8656315B2 (en) | 2014-02-18 |
Family
ID=47228741
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/250,675 Expired - Fee Related US8656315B2 (en) | 2011-05-27 | 2011-09-30 | Moving a graphical selector |
Country Status (2)
Country | Link |
---|---|
US (1) | US8656315B2 (en) |
DE (1) | DE202012005481U1 (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130342452A1 (en) * | 2012-06-21 | 2013-12-26 | Research In Motion Limited | Electronic device including touch-sensitive display and method of controlling a position indicator |
US8656315B2 (en) | 2011-05-27 | 2014-02-18 | Google Inc. | Moving a graphical selector |
US8656296B1 (en) | 2012-09-27 | 2014-02-18 | Google Inc. | Selection of characters in a string of characters |
US20140195959A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd. | Apparatus and method for providing a virtual keypad |
US8826190B2 (en) | 2011-05-27 | 2014-09-02 | Google Inc. | Moving a graphical selector |
US20140306897A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Virtual keyboard swipe gestures for cursor movement |
US20140306899A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Multidirectional swipe key for virtual keyboard |
US9032322B2 (en) | 2011-11-10 | 2015-05-12 | Blackberry Limited | Touchscreen keyboard predictive display and generation of a set of characters |
US20150189215A1 (en) * | 2013-12-27 | 2015-07-02 | Sony Corporation | Control device, control method, and program |
US9116552B2 (en) | 2012-06-27 | 2015-08-25 | Blackberry Limited | Touchscreen keyboard providing selection of word predictions in partitions of the touchscreen keyboard |
US9122672B2 (en) | 2011-11-10 | 2015-09-01 | Blackberry Limited | In-letter word prediction for virtual keyboard |
US20150268854A1 (en) * | 2014-03-20 | 2015-09-24 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US9310889B2 (en) | 2011-11-10 | 2016-04-12 | Blackberry Limited | Touchscreen keyboard predictive display and generation of a set of characters |
WO2016060501A1 (en) * | 2014-10-15 | 2016-04-21 | Samsung Electronics Co., Ltd. | Method and apparatus for providing user interface |
KR20160044396A (en) * | 2014-10-15 | 2016-04-25 | 삼성전자주식회사 | A method and apparatus for providing a user interface |
US20160313888A1 (en) * | 2015-04-27 | 2016-10-27 | Ebay Inc. | Graphical user interface for distraction free shopping on a mobile device |
US9804777B1 (en) | 2012-10-23 | 2017-10-31 | Google Inc. | Gesture-based text selection |
US9864515B1 (en) * | 2014-10-24 | 2018-01-09 | Google Llc | Virtual joystick on a touch-sensitive screen |
US9910588B2 (en) | 2012-02-24 | 2018-03-06 | Blackberry Limited | Touchscreen keyboard providing word predictions in partitions of the touchscreen keyboard in proximate association with candidate letters |
US10310706B2 (en) * | 2015-06-23 | 2019-06-04 | Qingdao Hisense Electronics Co., Ltd. | System and methods for touch target presentation |
US11068156B2 (en) * | 2015-12-09 | 2021-07-20 | Banma Zhixing Network (Hongkong) Co., Limited | Data processing method, apparatus, and smart terminal |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9292161B2 (en) * | 2010-03-24 | 2016-03-22 | Microsoft Technology Licensing, Llc | Pointer tool with touch-enabled precise placement |
US9317196B2 (en) | 2011-08-10 | 2016-04-19 | Microsoft Technology Licensing, Llc | Automatic zooming for text selection/cursor placement |
EP2776908A4 (en) | 2011-11-09 | 2015-07-15 | Blackberry Ltd | Touch-sensitive display method and apparatus |
US20140109016A1 (en) * | 2012-10-16 | 2014-04-17 | Yu Ouyang | Gesture-based cursor control |
Citations (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5880411A (en) * | 1992-06-08 | 1999-03-09 | Synaptics, Incorporated | Object position detector with edge motion feature and gesture recognition |
US5903229A (en) * | 1996-02-20 | 1999-05-11 | Sharp Kabushiki Kaisha | Jog dial emulation input device |
US20050134578A1 (en) * | 2001-07-13 | 2005-06-23 | Universal Electronics Inc. | System and methods for interacting with a control environment |
US20060026535A1 (en) * | 2004-07-30 | 2006-02-02 | Apple Computer Inc. | Mode-based graphical user interfaces for touch sensitive input devices |
US20060048071A1 (en) * | 2004-08-30 | 2006-03-02 | Microsoft Corp. | Scrolling web pages using direct interaction |
US20060187216A1 (en) * | 2002-04-11 | 2006-08-24 | Synaptics, Inc. | Closed-loop sensor on a solid-state object position detector |
US7098896B2 (en) * | 2003-01-16 | 2006-08-29 | Forword Input Inc. | System and method for continuous stroke word-based text input |
US20070236475A1 (en) * | 2006-04-05 | 2007-10-11 | Synaptics Incorporated | Graphical scroll wheel |
US20080316183A1 (en) * | 2007-06-22 | 2008-12-25 | Apple Inc. | Swipe gestures for touch screen keyboards |
US20090058823A1 (en) * | 2007-09-04 | 2009-03-05 | Apple Inc. | Virtual Keyboards in Multi-Language Environment |
US20090064045A1 (en) * | 2007-09-04 | 2009-03-05 | Christopher Tremblay | Low memory rendering of graphical objects |
US20090178008A1 (en) * | 2008-01-06 | 2009-07-09 | Scott Herz | Portable Multifunction Device with Interface Reconfiguration Mode |
US20090213134A1 (en) * | 2003-04-09 | 2009-08-27 | James Stephanick | Touch screen and graphical user interface |
US20100013852A1 (en) * | 2008-07-18 | 2010-01-21 | Asustek Computer Inc. | Touch-type mobile computing device and displaying method applied thereto |
US20100134425A1 (en) * | 2008-12-03 | 2010-06-03 | Microsoft Corporation | Manipulation of list on a multi-touch display |
US20100214237A1 (en) * | 2009-02-23 | 2010-08-26 | Research In Motion Limited | Touch-sensitive display and method of controlling same |
US20100287486A1 (en) * | 2009-05-07 | 2010-11-11 | Microsoft Corporation | Correction of typographical errors on touch displays |
US20110083105A1 (en) * | 2009-10-06 | 2011-04-07 | Samsung Electronics Co. Ltd. | List-editing method and mobile device adapted thereto |
US20110193788A1 (en) * | 2010-02-10 | 2011-08-11 | Apple Inc. | Graphical objects that respond to touch or motion input |
US20110231789A1 (en) * | 2010-03-19 | 2011-09-22 | Research In Motion Limited | Portable electronic device and method of controlling same |
US20110239153A1 (en) * | 2010-03-24 | 2011-09-29 | Microsoft Corporation | Pointer tool with touch-enabled precise placement |
US20110273379A1 (en) * | 2010-05-05 | 2011-11-10 | Google Inc. | Directional pad on touchscreen |
US20120192117A1 (en) * | 2011-01-24 | 2012-07-26 | Migos Charles J | Device, Method, and Graphical User Interface with a Dynamic Gesture Disambiguation Threshold |
US8482521B2 (en) * | 2007-10-05 | 2013-07-09 | Gvbb Holdings S.A.R.L. | Pointer controlling apparatus |
Family Cites Families (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4566000A (en) | 1983-02-14 | 1986-01-21 | Prime Computer, Inc. | Image display apparatus and method having virtual cursor |
US5327161A (en) | 1989-08-09 | 1994-07-05 | Microtouch Systems, Inc. | System and method for emulating a mouse input device with a touchpad input device |
US5666113A (en) | 1991-07-31 | 1997-09-09 | Microtouch Systems, Inc. | System for using a touchpad input device for cursor control and keyboard emulation |
US5523775A (en) | 1992-05-26 | 1996-06-04 | Apple Computer, Inc. | Method for selecting objects on a computer display |
US5953541A (en) | 1997-01-24 | 1999-09-14 | Tegic Communications, Inc. | Disambiguating system for disambiguating ambiguous input sequences by displaying objects associated with the generated input sequences in the order of decreasing frequency of use |
KR100327209B1 (en) | 1998-05-12 | 2002-04-17 | 윤종용 | Software keyboard system using the drawing of stylus and method for recognizing keycode therefor |
US7032171B1 (en) | 1998-12-31 | 2006-04-18 | International Business Machines Corporation | System and method for selecting and processing information in an electronic document |
US7293231B1 (en) | 1999-03-18 | 2007-11-06 | British Columbia Ltd. | Data entry for personal computing devices |
US7750891B2 (en) | 2003-04-09 | 2010-07-06 | Tegic Communications, Inc. | Selective input system based on tracking of motion parameters of an input device |
US7030863B2 (en) | 2000-05-26 | 2006-04-18 | America Online, Incorporated | Virtual keyboard system with automatic correction |
JP4519381B2 (en) | 1999-05-27 | 2010-08-04 | テジック コミュニケーションズ インク | Keyboard system with automatic correction |
ATE457486T1 (en) | 2000-07-21 | 2010-02-15 | Speedscript Ag | METHOD FOR A SPEEDY TYPING SYSTEM AND SPEEDY TYPING DEVICE |
US6704034B1 (en) | 2000-09-28 | 2004-03-09 | International Business Machines Corporation | Method and apparatus for providing accessibility through a context sensitive magnifying glass |
US6891551B2 (en) | 2000-11-10 | 2005-05-10 | Microsoft Corporation | Selection handles in editing electronic documents |
US20030234766A1 (en) | 2001-02-15 | 2003-12-25 | Hildebrand Alfred P. | Virtual image display with virtual keyboard |
JP3971907B2 (en) | 2001-09-17 | 2007-09-05 | アルプス電気株式会社 | Coordinate input device and electronic device |
US6956979B2 (en) | 2001-10-04 | 2005-10-18 | International Business Machines Corporation | Magnification of information with user controlled look ahead and look behind contextual information |
US7042443B2 (en) | 2001-10-11 | 2006-05-09 | Woodard Scott E | Speed Writer program and device with Speed Writer program installed |
US9213443B2 (en) | 2009-02-15 | 2015-12-15 | Neonode Inc. | Optical touch screen systems using reflected light |
US7075520B2 (en) | 2001-12-12 | 2006-07-11 | Zi Technology Corporation Ltd | Key press disambiguation using a keypad of multidirectional keys |
US7151530B2 (en) | 2002-08-20 | 2006-12-19 | Canesta, Inc. | System and method for determining an input selected by a user through a virtual interface |
US7199786B2 (en) | 2002-11-29 | 2007-04-03 | Daniel Suraqui | Reduced keyboards system using unistroke input and having automatic disambiguating and a recognition method using said system |
CN1717648A (en) | 2002-11-29 | 2006-01-04 | 皇家飞利浦电子股份有限公司 | User interface with displaced representation of touch area |
US7251367B2 (en) | 2002-12-20 | 2007-07-31 | International Business Machines Corporation | System and method for recognizing word patterns based on a virtual keyboard layout |
US7453439B1 (en) | 2003-01-16 | 2008-11-18 | Forward Input Inc. | System and method for continuous stroke word-based text input |
SG135918A1 (en) | 2003-03-03 | 2007-10-29 | Xrgomics Pte Ltd | Unambiguous text input method for touch screens and reduced keyboard systems |
US7571393B2 (en) | 2003-04-15 | 2009-08-04 | Microsoft Corporation | Method for navigation between elements on a page of content in a handheld device |
US20050076300A1 (en) | 2003-10-02 | 2005-04-07 | International Business Machines Corporation | Block marker system |
US7250938B2 (en) | 2004-01-06 | 2007-07-31 | Lenovo (Singapore) Pte. Ltd. | System and method for improved user input on personal computing devices |
US7706616B2 (en) | 2004-02-27 | 2010-04-27 | International Business Machines Corporation | System and method for recognizing word patterns in a very large vocabulary based on a virtual keyboard layout |
US20060005151A1 (en) | 2004-07-02 | 2006-01-05 | Adobe Systems | Graphical interface for adjustment of text selections |
US7508324B2 (en) | 2004-08-06 | 2009-03-24 | Daniel Suraqui | Finger activated reduced keyboard and a method for performing text input |
US20060176283A1 (en) | 2004-08-06 | 2006-08-10 | Daniel Suraqui | Finger activated reduced keyboard and a method for performing text input |
CN101014927A (en) | 2004-09-14 | 2007-08-08 | 诺基亚公司 | Method for using indicating device |
WO2006036887A2 (en) | 2004-09-28 | 2006-04-06 | Yost David A | Improved system of gui text cursor, caret, and selection |
US7683889B2 (en) | 2004-12-21 | 2010-03-23 | Microsoft Corporation | Pressure based selection |
US8036878B2 (en) | 2005-05-18 | 2011-10-11 | Never Wall Treuhand GmbH | Device incorporating improved text input mechanism |
TWI307854B (en) | 2005-09-30 | 2009-03-21 | Hon Hai Prec Ind Co Ltd | Apparatus and method for controlling a cursor |
US7659887B2 (en) | 2005-10-20 | 2010-02-09 | Microsoft Corp. | Keyboard with a touchpad layer on keys |
US7877685B2 (en) | 2005-12-29 | 2011-01-25 | Sap Ag | Persistent adjustable text selector |
KR100813062B1 (en) | 2006-05-03 | 2008-03-14 | 엘지전자 주식회사 | Portable Terminal And Method Of Displaying Text Using Same |
KR100897806B1 (en) | 2006-05-23 | 2009-05-15 | 엘지전자 주식회사 | Method for selecting items and terminal therefor |
US8421602B2 (en) | 2006-09-13 | 2013-04-16 | Savant Systems, Llc | Remote control unit for a programmable multimedia controller |
US8570278B2 (en) | 2006-10-26 | 2013-10-29 | Apple Inc. | Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker |
US20080307350A1 (en) | 2007-06-09 | 2008-12-11 | Alessandro Francesco Sabatelli | Method and Apparatus for Improved Desktop Arrangement |
US9274698B2 (en) | 2007-10-26 | 2016-03-01 | Blackberry Limited | Electronic device and method of controlling same |
US20090189862A1 (en) | 2008-01-24 | 2009-07-30 | Viberg Daniel | Method, computer program product and device for text editing |
US8650507B2 (en) | 2008-03-04 | 2014-02-11 | Apple Inc. | Selecting of text using gestures |
CN101266520B (en) | 2008-04-18 | 2013-03-27 | 上海触乐信息科技有限公司 | System for accomplishing live keyboard layout |
US8619048B2 (en) | 2008-08-08 | 2013-12-31 | Moonsun Io Ltd. | Method and device of stroke based user input |
US8356059B2 (en) | 2008-11-14 | 2013-01-15 | Microsoft Corporation | Method and system for rapid and cost-effective development of user generated content |
US8584031B2 (en) | 2008-11-19 | 2013-11-12 | Apple Inc. | Portable touch screen device, method, and graphical user interface for using emoji characters |
US8756534B2 (en) | 2009-03-16 | 2014-06-17 | Apple Inc. | Methods and graphical user interfaces for editing on a multifunction device with a touch screen display |
US20100293460A1 (en) | 2009-05-14 | 2010-11-18 | Budelli Joe G | Text selection method and system based on gestures |
US8135582B2 (en) | 2009-10-04 | 2012-03-13 | Daniel Suraqui | Keyboard system and method for global disambiguation from classes with dictionary database from first and last letters |
US8365059B2 (en) | 2009-11-03 | 2013-01-29 | Oto Technologies, Llc | E-reader semantic text manipulation |
US9069416B2 (en) | 2010-03-25 | 2015-06-30 | Google Inc. | Method and system for selecting content using a touchscreen |
US20110320978A1 (en) | 2010-06-29 | 2011-12-29 | Horodezky Samuel J | Method and apparatus for touchscreen gesture recognition overlay |
US20120013541A1 (en) | 2010-07-14 | 2012-01-19 | Research In Motion Limited | Portable electronic device and method of controlling same |
US8918734B2 (en) | 2010-07-28 | 2014-12-23 | Nuance Communications, Inc. | Reduced keyboard with prediction solutions when input is a partial sliding trajectory |
US10503255B2 (en) | 2010-12-02 | 2019-12-10 | Immersion Corporation | Haptic feedback assisted text manipulation |
US20120185787A1 (en) | 2011-01-13 | 2012-07-19 | Microsoft Corporation | User interface interaction behavior based on insertion point |
US20120268387A1 (en) | 2011-04-19 | 2012-10-25 | Research In Motion Limited | Text indicator method and electronic device |
US8656315B2 (en) | 2011-05-27 | 2014-02-18 | Google Inc. | Moving a graphical selector |
US8826190B2 (en) | 2011-05-27 | 2014-09-02 | Google Inc. | Moving a graphical selector |
US8661339B2 (en) | 2011-05-31 | 2014-02-25 | Apple Inc. | Devices, methods, and graphical user interfaces for document manipulation |
CN105955617B (en) | 2011-06-03 | 2019-07-12 | 谷歌有限责任公司 | For selecting the gesture of text |
US9323415B2 (en) | 2011-06-29 | 2016-04-26 | Nokia Technologies Oy | Apparatus and associated methods related to touch sensitive displays |
US9317196B2 (en) | 2011-08-10 | 2016-04-19 | Microsoft Technology Licensing, Llc | Automatic zooming for text selection/cursor placement |
-
2011
- 2011-09-30 US US13/250,675 patent/US8656315B2/en not_active Expired - Fee Related
-
2012
- 2012-05-25 DE DE202012005481U patent/DE202012005481U1/en not_active Expired - Lifetime
Patent Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5880411A (en) * | 1992-06-08 | 1999-03-09 | Synaptics, Incorporated | Object position detector with edge motion feature and gesture recognition |
US5903229A (en) * | 1996-02-20 | 1999-05-11 | Sharp Kabushiki Kaisha | Jog dial emulation input device |
US20080016467A1 (en) * | 2001-07-13 | 2008-01-17 | Universal Electronics Inc. | System and methods for interacting with a control environment |
US20050134578A1 (en) * | 2001-07-13 | 2005-06-23 | Universal Electronics Inc. | System and methods for interacting with a control environment |
US20060187216A1 (en) * | 2002-04-11 | 2006-08-24 | Synaptics, Inc. | Closed-loop sensor on a solid-state object position detector |
US7098896B2 (en) * | 2003-01-16 | 2006-08-29 | Forword Input Inc. | System and method for continuous stroke word-based text input |
US20090213134A1 (en) * | 2003-04-09 | 2009-08-27 | James Stephanick | Touch screen and graphical user interface |
US20060026535A1 (en) * | 2004-07-30 | 2006-02-02 | Apple Computer Inc. | Mode-based graphical user interfaces for touch sensitive input devices |
US20060048071A1 (en) * | 2004-08-30 | 2006-03-02 | Microsoft Corp. | Scrolling web pages using direct interaction |
US20070236475A1 (en) * | 2006-04-05 | 2007-10-11 | Synaptics Incorporated | Graphical scroll wheel |
US20080316183A1 (en) * | 2007-06-22 | 2008-12-25 | Apple Inc. | Swipe gestures for touch screen keyboards |
US20090058823A1 (en) * | 2007-09-04 | 2009-03-05 | Apple Inc. | Virtual Keyboards in Multi-Language Environment |
US20090064045A1 (en) * | 2007-09-04 | 2009-03-05 | Christopher Tremblay | Low memory rendering of graphical objects |
US8482521B2 (en) * | 2007-10-05 | 2013-07-09 | Gvbb Holdings S.A.R.L. | Pointer controlling apparatus |
US20090178008A1 (en) * | 2008-01-06 | 2009-07-09 | Scott Herz | Portable Multifunction Device with Interface Reconfiguration Mode |
US20100013852A1 (en) * | 2008-07-18 | 2010-01-21 | Asustek Computer Inc. | Touch-type mobile computing device and displaying method applied thereto |
US20100134425A1 (en) * | 2008-12-03 | 2010-06-03 | Microsoft Corporation | Manipulation of list on a multi-touch display |
US20100214237A1 (en) * | 2009-02-23 | 2010-08-26 | Research In Motion Limited | Touch-sensitive display and method of controlling same |
US20100287486A1 (en) * | 2009-05-07 | 2010-11-11 | Microsoft Corporation | Correction of typographical errors on touch displays |
US20110083105A1 (en) * | 2009-10-06 | 2011-04-07 | Samsung Electronics Co. Ltd. | List-editing method and mobile device adapted thereto |
US20110193788A1 (en) * | 2010-02-10 | 2011-08-11 | Apple Inc. | Graphical objects that respond to touch or motion input |
US20110231789A1 (en) * | 2010-03-19 | 2011-09-22 | Research In Motion Limited | Portable electronic device and method of controlling same |
US20110239153A1 (en) * | 2010-03-24 | 2011-09-29 | Microsoft Corporation | Pointer tool with touch-enabled precise placement |
US20110273379A1 (en) * | 2010-05-05 | 2011-11-10 | Google Inc. | Directional pad on touchscreen |
US20120192117A1 (en) * | 2011-01-24 | 2012-07-26 | Migos Charles J | Device, Method, and Graphical User Interface with a Dynamic Gesture Disambiguation Threshold |
Non-Patent Citations (2)
Title |
---|
De Silva et al; Human Factors Evaluation of a Vision-Based Facial Gesture Interface; © 2003; IEEE; 8 pages * |
Farooq et al; A Keystroke and Pointer Control Input Interface for Wearable Computers; © 2006; IEEE; 10 pages. * |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8656315B2 (en) | 2011-05-27 | 2014-02-18 | Google Inc. | Moving a graphical selector |
US8826190B2 (en) | 2011-05-27 | 2014-09-02 | Google Inc. | Moving a graphical selector |
US9032322B2 (en) | 2011-11-10 | 2015-05-12 | Blackberry Limited | Touchscreen keyboard predictive display and generation of a set of characters |
US9310889B2 (en) | 2011-11-10 | 2016-04-12 | Blackberry Limited | Touchscreen keyboard predictive display and generation of a set of characters |
US9122672B2 (en) | 2011-11-10 | 2015-09-01 | Blackberry Limited | In-letter word prediction for virtual keyboard |
US9910588B2 (en) | 2012-02-24 | 2018-03-06 | Blackberry Limited | Touchscreen keyboard providing word predictions in partitions of the touchscreen keyboard in proximate association with candidate letters |
US20130342452A1 (en) * | 2012-06-21 | 2013-12-26 | Research In Motion Limited | Electronic device including touch-sensitive display and method of controlling a position indicator |
US9116552B2 (en) | 2012-06-27 | 2015-08-25 | Blackberry Limited | Touchscreen keyboard providing selection of word predictions in partitions of the touchscreen keyboard |
US8656296B1 (en) | 2012-09-27 | 2014-02-18 | Google Inc. | Selection of characters in a string of characters |
US9804777B1 (en) | 2012-10-23 | 2017-10-31 | Google Inc. | Gesture-based text selection |
US20140195959A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd. | Apparatus and method for providing a virtual keypad |
US9146672B2 (en) * | 2013-04-10 | 2015-09-29 | Barnes & Noble College Booksellers, Llc | Multidirectional swipe key for virtual keyboard |
US20140306899A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Multidirectional swipe key for virtual keyboard |
US20140306897A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Virtual keyboard swipe gestures for cursor movement |
US10362258B2 (en) * | 2013-12-27 | 2019-07-23 | Sony Corporation | Information processing to control a movement of a focus displayed on a display screen |
US20150189215A1 (en) * | 2013-12-27 | 2015-07-02 | Sony Corporation | Control device, control method, and program |
US20150268854A1 (en) * | 2014-03-20 | 2015-09-24 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US10261686B2 (en) * | 2014-03-20 | 2019-04-16 | Lg Electronics Inc. | Mobile terminal and control method thereof |
WO2016060501A1 (en) * | 2014-10-15 | 2016-04-21 | Samsung Electronics Co., Ltd. | Method and apparatus for providing user interface |
KR20160044396A (en) * | 2014-10-15 | 2016-04-25 | 삼성전자주식회사 | A method and apparatus for providing a user interface |
US11079895B2 (en) | 2014-10-15 | 2021-08-03 | Samsung Electronics Co., Ltd. | Method and apparatus for providing user interface |
KR102160105B1 (en) * | 2014-10-15 | 2020-09-25 | 삼성전자주식회사 | A method and apparatus for providing a user interface |
US9864515B1 (en) * | 2014-10-24 | 2018-01-09 | Google Llc | Virtual joystick on a touch-sensitive screen |
US20160313888A1 (en) * | 2015-04-27 | 2016-10-27 | Ebay Inc. | Graphical user interface for distraction free shopping on a mobile device |
US10310706B2 (en) * | 2015-06-23 | 2019-06-04 | Qingdao Hisense Electronics Co., Ltd. | System and methods for touch target presentation |
US11068156B2 (en) * | 2015-12-09 | 2021-07-20 | Banma Zhixing Network (Hongkong) Co., Limited | Data processing method, apparatus, and smart terminal |
Also Published As
Publication number | Publication date |
---|---|
US8656315B2 (en) | 2014-02-18 |
DE202012005481U1 (en) | 2012-10-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8826190B2 (en) | Moving a graphical selector | |
US8656315B2 (en) | Moving a graphical selector | |
US11487426B2 (en) | Apparatus and method for cursor control and text selection and editing based on gesture-based touch inputs received in a virtual keyboard display area | |
US8584049B1 (en) | Visual feedback deletion | |
US10437360B2 (en) | Method and apparatus for moving contents in terminal | |
US9875023B2 (en) | Dial-based user interfaces | |
US9304656B2 (en) | Systems and method for object selection on presence sensitive devices | |
US8248385B1 (en) | User inputs of a touch sensitive device | |
US20130342452A1 (en) | Electronic device including touch-sensitive display and method of controlling a position indicator | |
EP2605119B1 (en) | Touch input method and apparatus of portable terminal | |
US9043733B2 (en) | Weighted N-finger scaling and scrolling | |
US20120026077A1 (en) | Mapping trackpad operations to touchscreen events | |
US8640046B1 (en) | Jump scrolling | |
US20130326392A1 (en) | Portable electronic device including a placeholder for an entry field and method of controlling same | |
EP2787429B1 (en) | Method and apparatus for inputting text in electronic device having touchscreen | |
US20140354554A1 (en) | Touch Optimized UI | |
US9652141B2 (en) | Portable electronic device including touch-sensitive display and method of controlling same | |
US20170075543A1 (en) | Portable electronic device including touch-sensitive display and method of controlling selection of information | |
US11029824B2 (en) | Method and apparatus for moving input field | |
CN110199253B (en) | Dynamic space key | |
KR20140021896A (en) | Method for providing searching for playing point of multimedia application and an electronic device thereof | |
US9244612B1 (en) | Key selection of a graphical keyboard based on user input posture | |
US10235043B2 (en) | Keyboard for use with a computing device | |
EP2669779B1 (en) | Portable electronic device including touch-sensitive display and method of controlling same | |
US9804777B1 (en) | Gesture-based text selection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GOOGLE INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KIRKPATRICK, FICUS;REEL/FRAME:027247/0510 Effective date: 20110518 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: GOOGLE LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044101/0299 Effective date: 20170929 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20220218 |