US20140184509A1 - Hand held pointing device with roll compensation - Google Patents

Hand held pointing device with roll compensation Download PDF

Info

Publication number
US20140184509A1
US20140184509A1 US13/732,748 US201313732748A US2014184509A1 US 20140184509 A1 US20140184509 A1 US 20140184509A1 US 201313732748 A US201313732748 A US 201313732748A US 2014184509 A1 US2014184509 A1 US 2014184509A1
Authority
US
United States
Prior art keywords
axis
rotational
acceleration
processing unit
accelerometer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/732,748
Inventor
Michael Mathews
Walter M. Mason
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Movea SA
Original Assignee
Movea SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Movea SA filed Critical Movea SA
Priority to US13/732,748 priority Critical patent/US20140184509A1/en
Assigned to MOVEA SA reassignment MOVEA SA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MATHEWS, MICHAEL, MASON, WALTER M
Publication of US20140184509A1 publication Critical patent/US20140184509A1/en
Priority to US15/008,141 priority patent/US9870070B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383Signal control means within the pointing device

Definitions

  • Pointing devices allow users to move a curser or other indicators on a computer display in response to the user's movement.
  • a normal computer mouse pointing device converts horizontal movement over a planar surface in two dimensions into corresponding curser movement on a computer screen.
  • the mouse includes a sensor that is typically a laser or roller ball sensor that detects movement over a surface.
  • Motion detecting mechanisms include gyroscopes that detect rotational movement of the pointing device and accelerometers that detect linear movement.
  • the gyroscopes and accelerometers emit signals that correspond to the movements of the pointing device and are used to control the movement of a cursor on the computer screen.
  • a problem with existing three dimensional pointing devices is that if the user naturally holds the device at an angle offset from horizontal, the movement of the pointing device results in a cursor movement that is offset by roll angle, i.e., horizontal movement of the pointing device held at a roll angle results in angled movement of the cursor on the computer screen.
  • Some pointing devices are able to provide roll compensation for the natural hand position of the user.
  • a problem with existing roll compensated pointing devices is that they utilize a very complex trigonometric matrix algorithm which requires high powered processors that draw a significant amount of electrical power. Since the pointing device is preferably a cordless device, the portable batteries used to operate the more powerful processor may require frequent recharging or replacement.
  • What is needed is an improved pointing device that performs roll compensation in a more energy efficient manner so that an inexpensive low powered processor can be used and battery live can be substantially improved.
  • the present invention is directed towards a three dimensional pointing device that uses a low powered processor to calculate an algebraic roll compensation algorithm using data from accelerometers and rotational sensors.
  • the inventive pointing device is less expensive to produce and much more energy efficient than the prior art.
  • the pointing device has a transverse X axis that extends across the width of the pointing device, a Y axis that extends along the center axis of the pointing device, and a vertical Z axis that extends up from the center of the pointing device.
  • the pointing device In order to detect movement, the pointing device includes accelerometers which detect gravity and acceleration in the X, Y, and Z directions and gyroscopes which measure the rotational velocity of the pointing device about the X axis in pitch and the Z axis in yaw.
  • the accelerometers and gyroscopes are coupled to a microprocessor that converts the accelerometer and gyroscope signals into roll compensated cursor control signals that are used to move a cursor on a display screen that is coupled to an electronic device.
  • the pointing device can also include one or more buttons and a scroll wheel which can also be used to interact with a software user interface.
  • the pointing device can have a transmitter system so the pointing device output signals can be transmitted to an electronic device through a wireless interface such as radio frequency or infrared optical signals.
  • the user can use the pointing device to control software by moving the cursor to a target location on the computer screen by moving the inventive pointing device vertically and horizontally in a three dimensional space. The user can then actuate controls on the visual display by clicking a button on the pointing device or rolling the scroll wheel.
  • the vertical Z direction accelerometer would sense all of the gravitational force and the horizontal X and Y direction accelerometers would not detect any gravitational force.
  • the pointing device is generally held by the user with some roll, portions of the gravitational force are detected by the X, Y and Z direction accelerometers.
  • the pointing device dynamically detects the natural roll of the user's hand position based upon the X, Y and Z direction accelerometers signals and continuously updates the roll adjusted cursor control output signals.
  • the roll correction factors X comp and Y comp for horizontal and vertical movements of the inventive pointing device are represented by the algebraic algorithms:
  • a x is the acceleration in the X direction and A Z is the acceleration in the Z.
  • additional calculations are performed to provide compensation to the cursor movement X comp and Y comp for the pitch movement of the pointing device, user induced acceleration, and variations in the temperature of the pointing device.
  • the Z axis gyroscope As the pointing device is rotated in pitch, the Z axis gyroscope is angled away from a vertical orientation. This decreases the detection of rotational velocity about the Z axis and reduces the X comp value.
  • the pointing device detects the pitch angle and increases the correction factors X comp to compensate for the pitch angle.
  • User induced acceleration is caused by the offset positions of the accelerometers from the center of rotation of the pointing device. As the user moves the pointing device, the accelerometers detect rotational movement of the pointing device. In an embodiment, the system calculates the rotational acceleration at the accelerometers and adjusts the accelerometer output signals to compensate for the rotational acceleration. In another embodiment, the system calculates the centripetal acceleration at the accelerometers and adjusts the accelerometer signals accordingly. By removing the user induced rotational accelerations, the gravitational component of the accelerometer signals can be isolated to accurately detect the roll of the pointing device.
  • Temperature compensation may be required where motion sensor outputs are altered by variations in temperature. Temperature compensation is performed by detecting changes in the temperature of the pointing device and applying a corrective factor to the motion sensor signals if a change in temperature is detected.
  • the pointing device includes a temperature transducer that periodically detects the temperature. If a substantial change in temperature is detected, temperature correction factors are applied to the rotational sensors outputs.
  • the processor is a 16 bit RISC (Reduced Instruction Set Computer) processor that operates at about 4 MHz. Under these operating conditions, the batteries used to power the processor of the inventive pointing device may last for several months of service. This is a significant improvement over a pointing device that uses a trigonometry or matrix based roll compensating algorithm that requires a more powerful processor operating at 12-16 MHz and consuming much more energy.
  • RISC Reduced Instruction Set Computer
  • FIG. 1 illustrates a pointing device in an X, Y, Z coordinate system
  • FIG. 2 illustrates a block diagram of the inventive pointing device
  • FIG. 3 illustrates a pointing device used with an electronic device having a visual display
  • FIG. 4 illustrates a pointing device that does not have roll compensation and a visual display
  • FIG. 5 illustrates a pointing device at a roll angle with acceleration signals A X and A Z graphically illustrated
  • FIG. 6 illustrates a pointing device at a roll angle with rotational velocity signals R X and R Z graphically illustrated
  • FIG. 7 illustrates a cross section top view of the pointing device.
  • FIG. 1 an embodiment of a hand held motion sensing pointing device 101 is illustrated.
  • the pointing device 101 moves within a three dimensional Cartesian coordinate system defined by the X, Y and Z axes which are perpendicular to each other.
  • the center point of the X, Y and Z coordinate system is the center of rotation of the pointing device 101 .
  • the X axis 105 extends across the width of the pointing device 101 , the Y axis 107 extending along the center axis and the Z axis 109 extending up from the center of the pointing device 101 .
  • the frame of reference for the pointing device 101 is known as the “body frame of reference.”
  • the pointing device 101 may include X, Y and Z direction accelerometers 111 , 112 , 113 that are each mounted orthogonal to each other and detect acceleration and gravity in the X, Y and Z directions.
  • the X, Y and Z direction accelerometers output the acceleration values, A X , A Y and A Z that correspond to each directional component of acceleration for the pointing device 101 .
  • the pointing device 101 also includes an X axis gyroscope 115 and Z axis gyroscope 117 that measure the rotational velocity.
  • the X axis gyroscope 115 detects the rotational velocity of the pointing device 101 in pitch about the X axis 105 and a Z axis gyroscope 117 detects the rotational velocity yaw about the Z axis 109 .
  • the movement is generally a combination of translation detected by the accelerometers 111 , 112 , 113 and the rotation is detected by the X axis and Z axis gyroscopes 115 , 1179 . Because the hand, wrist and arm move about joints, vertical movement of the pointing device will cause a rotational velocity about the X axis 105 and horizontal movement will cause rotational velocity about the Z axis 109 .
  • the X, Y and Z accelerometers 111 , 112 , 113 and the X axis and Z axis rotation sensors 115 , 117 are coupled to the processor 205 .
  • a temperature sensor 217 may be coupled to the processor 205 which is used to perform temperature signal corrections which will be discussed later.
  • Additional input devices may be coupled to the processor 205 including: mouse buttons 209 and a scroll wheel 211 .
  • the processor 205 may also perform additional signal processing including, calibration, conversion, filtering etc.
  • the processor 205 performs the roll compensation for the pointing device in a manner described below and produces corrected cursor control signals that are forwarded with button/scroll wheel signals to a transmitter 215 that sends the signals to a receiver coupled to an electronic device having a display.
  • the pointing device 101 detects movement and transmits cursor control signals to a receiver 151 that is coupled to an electronic device 157 having a visual display 161 .
  • the visual display 161 has an X and Y axis coordinate system which are used describe the position and movement of the cursor 163 on the visual display 161 which is known as the “user frame of reference.” Rotation of the pointing device 101 about the X axis 105 causes movement of the cursor 163 in the vertical Y direction of the visual display 161 and rotation about the Z axis 109 causes horizontal X movement of the cursor 163 .
  • the speed of the cursor 163 movement is proportional to the magnitude of the rotational velocities.
  • the cursor 163 movement when rotation of the pointing device 101 is stopped, the cursor 163 movement also stopped.
  • a scaling process can be applied to the cursor 163 movement signals.
  • movement control signals for a cursor 163 are described, in other embodiments, the inventive system and method can be used to control the movement of any other type of object or marker on any type of visual display.
  • both the X axis gyroscope and the Z axis gyroscope will detect rotational velocities and the cursor 163 will move at an angle in the X and Y directions rather than only in a Y vertical direction of the visual display 161 .
  • the inventive pointing device provides roll compensate so that the cursor will move based upon the movement of the pointing device regardless of the roll angle that the user holds the pointing device.
  • the X and Z direction accelerometers will both detect some of the gravitational acceleration and emit acceleration signals A X and A Z .
  • the roll angle ⁇ A of the pointing device also alters the rotational velocity outputs R X and R Z from the X axis and X axis gyroscopes.
  • the angle formed by magnitudes of the R X and R Z rotational components is represented by ⁇ R .
  • the pointing device 101 if the pointing device 101 is moved in rotation diagonally, with equal rotational velocities up in pitch and counter clockwise in yaw, the pointing device should emit a R X rotation signal 621 and a R Z rotation signal 623 that are equal in magnitude. However, the roll of the pointing device causes the magnitudes to be shifted which increases the R Z rotation 625 and decreases the R X rotation 627 while the vector sum R XZ remains constant.
  • the basic roll compensation equations for X comp and Y comp for the inventive pointing device are used to provide roll correct the X and Y motion signals for a cursor on a visual display.
  • the X comp and Y comp correction factors are based upon the vector sum of the rotational velocities, R XZ and the sin and cos of the sum of the angle of the acceleration components ⁇ A and angle of the rotational velocity components ⁇ R .
  • the basic roll compensation equations are:
  • the sin and cos functions represent the geometric relationship of a right triangle.
  • the perpendicular sides of the right triangle are represented by the magnitudes of A x and A z .
  • the length of the third side is A XZ which equals [A X 2 +A Z 2 ] 1/2 .
  • the angle ⁇ A is between the sides A X and A XZ .
  • X comp R XZ *[A z /A XZ *R x /R XZ +A x /A XZ *R z /R XZ ]
  • Y comp R XZ *[A x /A XZ *R x /R XZ ⁇ A z /A XZ *R z /R XZ ]
  • the simplified roll compensation algorithm provides several benefits.
  • X comp and Y comp are calculated with greatly reduced computational requirements and greatly reduces the energy required to perform the calculations.
  • a low powered processor can be used which consumes very little electrical power and allows the pointing device to operate for much longer periods of time with portable batteries, extending the battery life between recharging or replacement.
  • the low powered processor is also a much less expensive component than higher powered processors.
  • the cost of production of the inventive pointing device can be significantly reduced.
  • the inventive algebraic based roll compensating pointing device has many benefits over a pointing device that uses a trigonometry based roll compensation algorithm.
  • the algebraic X comp and Y comp algorithms are constantly being calculated to respond to all detected movement.
  • the motion sensors are constantly sampled and the values of A X , A Z , R X and R Z are constantly updated. This sampling may occur when the pointing device is moving and stationary.
  • the accelerometers and rotation sensors are sampled about once every 2 milliseconds. Because sensor reading error can occur, the system may include a mechanism for eliminating suspect data points.
  • the system utilizes a sampling system in which four readings are obtained for each sensor and the high and low values are discarded.
  • the two middle sensor readings for A X , A Y , A Z , R X and R Z are then averaged and forwarded to the processor to calculate X comp and Y comp . Since the X comp and Y comp calculations are performed once for every four sensor readings, the report time for the sensors can be approximately every 8 milliseconds.
  • the X comp value is corrected for the pitch of the pointing device.
  • the Z axis rotational sensor is angled away from a vertical orientation and detected Z axis rotational velocity R Z is reduced.
  • a Y Since A Y is aligned horizontally, the gravitational force is small and A XYZ /A XZ is approximately 1.0 when the pointing device is horizontal.
  • the A Y signal will increase as the pointing device is rotated in pitch away from horizontal so A XYZ /A XZ will also increase in value with increased pitch.
  • the pitch correction is applied to X comp in the equations below:
  • a correction factor is not required for Y comp .
  • the X axis rotational sensor is aligned with the X axis and detects the pitch rotational velocity about the X axis.
  • Y comp is not reduced when the pointing device is moved in pitch. Since pitch does not alter Y comp the pitch correction is not applied to Y comp .
  • Another correction that can be applied to the pointing device is correction for user induced rotational acceleration that can be detected by the accelerometers. Because the accelerometers are not located precisely at the center of the pointing device, rotation of the pointing device causes user induced acceleration that is detected by the accelerometers and results in errors in the accelerometer output signals A X , A Y and A Z .
  • the user induced acceleration can include rotational acceleration and centripetal acceleration. By dynamically detecting and calculating these accelerations, the inventive system can remove the user induced accelerations by applying correction factors to output signals A X , A Y and A Z . The gravitational force detected by the accelerometers can then be isolated, resulting in a more accurate roll compensation calculation.
  • the rotational acceleration is ⁇ R/ ⁇ time and can be determined by detecting the difference in velocity between each rotational sensor sample and dividing this difference by the sample time.
  • the fulcrum arm length l can each be different for each of the X, Y and Z accelerometers and may be represented by l X , l Y and l Z respectively. Since the X, Y and Z accelerometers only detect acceleration in one direction, the fulcrum arm lengths are the distances between the accelerometer and an axis of rotation that is perpendicular to the detection direction.
  • the linear acceleration of the X direction accelerometer 111 is calculated by multiplying the rotational acceleration 321 of the pointing device 101 about the Z axis by the length l X 323 of the fulcrum arm.
  • the fulcrum arm length l X 323 is equal to the perpendicular length from the Z axis 327 to a line 329 passing through the X direction accelerometer 111 in the X direction. Note that the length l X 323 is perpendicular to both the line 329 and the Z axis 327 .
  • the linear acceleration of the Z direction accelerometer is the rotational acceleration of the pointing device about the X axis multiplied by the fulcrum arm length l Z , which is the perpendicular length from the X axis to a line passing through the Z direction accelerometer in the Z direction.
  • l Z the perpendicular length from the X axis to a line passing through the Z direction accelerometer in the Z direction.
  • the user induced rotational acceleration is subtracted from the detected acceleration based upon the equations:
  • a Xcorrected A X ⁇ R Z / ⁇ time* l X
  • a Zcorrected A Z ⁇ R X / ⁇ time* l Z
  • a Ycorrected A X ⁇ R X / ⁇ time*l Y1 ⁇ R Z / ⁇ time*l Y2 , where l Y1 is the perpendicular length from the X axis to a line passing through the Y direction accelerometer in the Y direction and l Y2 is the perpendicular length from the Z axis to the line passing through the Y direction accelerometer in the Y direction. Since the A Y is only used in the pitch correction calculations and likely to be small in magnitude, the A Ycorrected calculation may not have a significant influence on the X comp and Y comp calculations and may not be required.
  • a X , A Y and A Z can also be altered by centripetal acceleration due to the offset of the accelerometers from the center of rotation.
  • the value of “r” is the offset distance of the accelerometer about the axis of rotation.
  • the centripetal acceleration can have two separate components.
  • the centripetal accelerations of the Y accelerometer can be caused by rotation R X 2 and R Z 2 .
  • the radius is the distance of the accelerometer from the axis of rotation.
  • the centripetal accelerations are calculated and used to correct the X comp and Y comp calculations. However, in general, the centripetal acceleration will be very small in comparison to the rotational acceleration and can be omitted from the accelerometer correction equations.
  • the pointing device can have a temperature sensor 217 that provides a temperature signal to the processor 205 .
  • the detected temperature can be stored in memory 219 and a corresponding temperature correction factor can be applied to the outputs of the rotational sensors, R X and R Z .
  • the processor 205 can be configured to check the temperature periodically and if the temperature has changed significantly from the stored temperature, a new temperature correction factor can be applied to the rotation velocity signals. In an embodiment, the temperature is checked every 5 minutes and a new temperature correction value is applied when the temperature has changed by more than 2 degree Centigrade.
  • the inventive motion detection system can be designed with paired components that have an inverse reaction to temperature.
  • the rotational velocity output signals from the rotational sensors may increase as the temperature increases.
  • These rotational sensors may be paired with regulators that decrease the rotational output readings with increases in temperature. Since these paired components have an opposite effect on the signal, the net effect of temperature variations on the output rotational signals is reduced. While a temperature correction may still be required, the influence of temperature changes is reduced which makes the system more stable.
  • the inventive pointing device may also automatically perform sensor calibration.
  • the system may detect when the accelerometers A X and A Z are producing a steady output which indicates that the pointing device is stationary. During this time, the outputs of the gyroscopes R X and R Z should be zero since the pointing device is not in rotation.
  • the inventive pointing device may perform a calibration process to correct any rotational R X and R Z output errors. These correction offsets can be stored in memory 219 and used to adjust the outputs of the rotational sensors until the calibration process is performed again.
  • the inventive roll compensation pointing device uses a 16 bit RISC (Reduced Instruction Set Computer) processor that operates at about 4 MHz.
  • RISC Reduced Instruction Set Computer
  • Commonly available consumer batteries such as one or more 1.5 Volt AA or AAA sized batteries can power the inventive pointing device for several months or longer without recharging. This is a significant improvement over a pointing device that uses a trigonometry based roll compensating algorithm that requires a more powerful processor operating at 12-16 MHz, consumes much more energy and may require more frequent recharging or replacement of batteries.
  • the pointing device can include additional energy saving features.
  • the processor of the pointing device may detect that the accelerometers are emitting steady output signals and/or the rotational sensors are emitting zero rotational velocity signals. If these sensor outputs remain for an extended period of time, the processor may cause the pointing device to be shut off or go into a sleep mode.
  • the user may have to press a button on the pointing device or the pointing device may detect movement.
  • the processor may apply power to the pointing device components. Since the accelerometers and gyroscopes only require about 250 milliseconds to become operational, the delay in response may be insignificant and unnoticed by the user.

Abstract

A pointing device includes accelerometers and rotational sensors that are coupled to a processor. The processor samples the accelerometers and rotational sensors to detect gravity and pointing device motion and uses algebraic algorithms to calculate roll compensated cursor control signals. The processor transmits the cursor control signals to a receiver that is coupled to an electronic device that moves the cursor on the visual display.

Description

    CROSS REFERENCE TO RELATED APPLICATION
  • This patent application is a continuation of U.S. patent application Ser. No. 13/112,742, “Hand Held Pointing Device With Roll Compensation,” filed May 20, 2011, which is a continuation of U.S. patent application Ser. No. 12/147,811, “Hand Held Pointing Device With Roll Compensation,” filed Jun. 27, 2008. U.S. patent application Ser. Nos. 13/112,742 and 12/147,811 are hereby incorporated by reference in their entirety.
  • BACKGROUND
  • Pointing devices allow users to move a curser or other indicators on a computer display in response to the user's movement. A normal computer mouse pointing device converts horizontal movement over a planar surface in two dimensions into corresponding curser movement on a computer screen. The mouse includes a sensor that is typically a laser or roller ball sensor that detects movement over a surface.
  • Other types of pointing devices have been designed which operate in three dimensional space and do not require the detection of movement over a surface. Motion detecting mechanisms include gyroscopes that detect rotational movement of the pointing device and accelerometers that detect linear movement. The gyroscopes and accelerometers emit signals that correspond to the movements of the pointing device and are used to control the movement of a cursor on the computer screen. A problem with existing three dimensional pointing devices is that if the user naturally holds the device at an angle offset from horizontal, the movement of the pointing device results in a cursor movement that is offset by roll angle, i.e., horizontal movement of the pointing device held at a roll angle results in angled movement of the cursor on the computer screen.
  • Some pointing devices are able to provide roll compensation for the natural hand position of the user. However, a problem with existing roll compensated pointing devices is that they utilize a very complex trigonometric matrix algorithm which requires high powered processors that draw a significant amount of electrical power. Since the pointing device is preferably a cordless device, the portable batteries used to operate the more powerful processor may require frequent recharging or replacement.
  • What is needed is an improved pointing device that performs roll compensation in a more energy efficient manner so that an inexpensive low powered processor can be used and battery live can be substantially improved.
  • SUMMARY OF THE INVENTION
  • The present invention is directed towards a three dimensional pointing device that uses a low powered processor to calculate an algebraic roll compensation algorithm using data from accelerometers and rotational sensors. The inventive pointing device is less expensive to produce and much more energy efficient than the prior art. The pointing device has a transverse X axis that extends across the width of the pointing device, a Y axis that extends along the center axis of the pointing device, and a vertical Z axis that extends up from the center of the pointing device. In order to detect movement, the pointing device includes accelerometers which detect gravity and acceleration in the X, Y, and Z directions and gyroscopes which measure the rotational velocity of the pointing device about the X axis in pitch and the Z axis in yaw.
  • The accelerometers and gyroscopes are coupled to a microprocessor that converts the accelerometer and gyroscope signals into roll compensated cursor control signals that are used to move a cursor on a display screen that is coupled to an electronic device. The pointing device can also include one or more buttons and a scroll wheel which can also be used to interact with a software user interface. The pointing device can have a transmitter system so the pointing device output signals can be transmitted to an electronic device through a wireless interface such as radio frequency or infrared optical signals. The user can use the pointing device to control software by moving the cursor to a target location on the computer screen by moving the inventive pointing device vertically and horizontally in a three dimensional space. The user can then actuate controls on the visual display by clicking a button on the pointing device or rolling the scroll wheel.
  • If the pointing device is held stationary in a purely horizontal orientation, the vertical Z direction accelerometer would sense all of the gravitational force and the horizontal X and Y direction accelerometers would not detect any gravitational force. However, since the pointing device is generally held by the user with some roll, portions of the gravitational force are detected by the X, Y and Z direction accelerometers. To perform roll compensation, the pointing device dynamically detects the natural roll of the user's hand position based upon the X, Y and Z direction accelerometers signals and continuously updates the roll adjusted cursor control output signals. The roll correction factors Xcomp and Ycomp for horizontal and vertical movements of the inventive pointing device are represented by the algebraic algorithms:

  • X comp =[A z *R x +A x *R z ]/A XZ

  • Y comp =[A x *R x −A z *R z ]/A XZ
  • Where, Ax is the acceleration in the X direction and AZ is the acceleration in the Z. AXZ is the vector sum of AX and AZ, solved by the equation, AXZ=[AX 2+AZ 2]1/2 where Rx is the rotational pitch velocity about the X axis and Rz is the rotational yaw velocity about the Z axis. Because the system dynamically detects roll, the inventive system continuously updates the roll compensation and automatically adjusts to the hand roll of any user.
  • In embodiments of the inventive pointing device, additional calculations are performed to provide compensation to the cursor movement Xcomp and Ycomp for the pitch movement of the pointing device, user induced acceleration, and variations in the temperature of the pointing device. As the pointing device is rotated in pitch, the Z axis gyroscope is angled away from a vertical orientation. This decreases the detection of rotational velocity about the Z axis and reduces the Xcomp value. In an embodiment, the pointing device detects the pitch angle and increases the correction factors Xcomp to compensate for the pitch angle.
  • User induced acceleration is caused by the offset positions of the accelerometers from the center of rotation of the pointing device. As the user moves the pointing device, the accelerometers detect rotational movement of the pointing device. In an embodiment, the system calculates the rotational acceleration at the accelerometers and adjusts the accelerometer output signals to compensate for the rotational acceleration. In another embodiment, the system calculates the centripetal acceleration at the accelerometers and adjusts the accelerometer signals accordingly. By removing the user induced rotational accelerations, the gravitational component of the accelerometer signals can be isolated to accurately detect the roll of the pointing device.
  • Temperature compensation may be required where motion sensor outputs are altered by variations in temperature. Temperature compensation is performed by detecting changes in the temperature of the pointing device and applying a corrective factor to the motion sensor signals if a change in temperature is detected. In an embodiment, the pointing device includes a temperature transducer that periodically detects the temperature. If a substantial change in temperature is detected, temperature correction factors are applied to the rotational sensors outputs.
  • Since the roll correction and other compensation equations use very simple algebraic algorithms, a basic processor that requires very little electrical energy can be used in the inventive pointing device. In an embodiment, the processor is a 16 bit RISC (Reduced Instruction Set Computer) processor that operates at about 4 MHz. Under these operating conditions, the batteries used to power the processor of the inventive pointing device may last for several months of service. This is a significant improvement over a pointing device that uses a trigonometry or matrix based roll compensating algorithm that requires a more powerful processor operating at 12-16 MHz and consuming much more energy.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates a pointing device in an X, Y, Z coordinate system;
  • FIG. 2 illustrates a block diagram of the inventive pointing device;
  • FIG. 3 illustrates a pointing device used with an electronic device having a visual display;
  • FIG. 4 illustrates a pointing device that does not have roll compensation and a visual display;
  • FIG. 5 illustrates a pointing device at a roll angle with acceleration signals AX and AZ graphically illustrated;
  • FIG. 6 illustrates a pointing device at a roll angle with rotational velocity signals RX and RZ graphically illustrated; and
  • FIG. 7 illustrates a cross section top view of the pointing device.
  • DETAILED DESCRIPTION
  • With reference to FIG. 1, an embodiment of a hand held motion sensing pointing device 101 is illustrated. The pointing device 101 moves within a three dimensional Cartesian coordinate system defined by the X, Y and Z axes which are perpendicular to each other. The center point of the X, Y and Z coordinate system is the center of rotation of the pointing device 101. The X axis 105 extends across the width of the pointing device 101, the Y axis 107 extending along the center axis and the Z axis 109 extending up from the center of the pointing device 101. The frame of reference for the pointing device 101 is known as the “body frame of reference.”
  • The pointing device 101 may include X, Y and Z direction accelerometers 111, 112, 113 that are each mounted orthogonal to each other and detect acceleration and gravity in the X, Y and Z directions. The X, Y and Z direction accelerometers output the acceleration values, AX, AY and AZ that correspond to each directional component of acceleration for the pointing device 101. The total acceleration is the vector sum AXYZ of AX, AY and AZ, which is represented by the equation AXYZ=[AX 2+AY 2+AZ 2]1/2.
  • The pointing device 101 also includes an X axis gyroscope 115 and Z axis gyroscope 117 that measure the rotational velocity. The X axis gyroscope 115 detects the rotational velocity of the pointing device 101 in pitch about the X axis 105 and a Z axis gyroscope 117 detects the rotational velocity yaw about the Z axis 109.
  • When a user moves the pointing device 101, the movement is generally a combination of translation detected by the accelerometers 111, 112, 113 and the rotation is detected by the X axis and Z axis gyroscopes 115, 1179. Because the hand, wrist and arm move about joints, vertical movement of the pointing device will cause a rotational velocity about the X axis 105 and horizontal movement will cause rotational velocity about the Z axis 109.
  • With reference to FIG. 2, a block diagram of the inventive pointing device components is illustrated. The X, Y and Z accelerometers 111, 112, 113 and the X axis and Z axis rotation sensors 115, 117 are coupled to the processor 205. In addition to the acceleration and rotation sensors, a temperature sensor 217 may be coupled to the processor 205 which is used to perform temperature signal corrections which will be discussed later. Additional input devices may be coupled to the processor 205 including: mouse buttons 209 and a scroll wheel 211. The processor 205 may also perform additional signal processing including, calibration, conversion, filtering etc. The processor 205 performs the roll compensation for the pointing device in a manner described below and produces corrected cursor control signals that are forwarded with button/scroll wheel signals to a transmitter 215 that sends the signals to a receiver coupled to an electronic device having a display.
  • With reference to FIG. 3, the pointing device 101 detects movement and transmits cursor control signals to a receiver 151 that is coupled to an electronic device 157 having a visual display 161. The visual display 161 has an X and Y axis coordinate system which are used describe the position and movement of the cursor 163 on the visual display 161 which is known as the “user frame of reference.” Rotation of the pointing device 101 about the X axis 105 causes movement of the cursor 163 in the vertical Y direction of the visual display 161 and rotation about the Z axis 109 causes horizontal X movement of the cursor 163. The speed of the cursor 163 movement is proportional to the magnitude of the rotational velocities. Thus, when rotation of the pointing device 101 is stopped, the cursor 163 movement also stopped. In order to properly coordinate the movements of the pointing device 101 and the cursor 163 movement on the display 161 screen, a scaling process can be applied to the cursor 163 movement signals. Although movement control signals for a cursor 163 are described, in other embodiments, the inventive system and method can be used to control the movement of any other type of object or marker on any type of visual display.
  • As discussed in the background, people naturally hold objects at a slight roll angle about the Y axis rather than in a perfectly horizontal orientation. When a pointing device that does not provide roll compensation is held at an angle, the accelerometers and gyroscopes within the pointing device are all offset by the roll angle relative to the ground. This roll angle causes the outputs of the accelerometers and gyroscopes in the pointing device to be offset by the roll angle. With reference to FIG. 4, if the pointing device 101 is held at a roll angle θA and moved in rotation about a horizontal axis, both the X axis gyroscope and the Z axis gyroscope will detect rotational velocities and the cursor 163 will move at an angle in the X and Y directions rather than only in a Y vertical direction of the visual display 161.
  • In order to solve this problem, the inventive pointing device provides roll compensate so that the cursor will move based upon the movement of the pointing device regardless of the roll angle that the user holds the pointing device. With reference to FIG. 5, if the pointing device 101 is held at a roll angle θA, the X and Z direction accelerometers will both detect some of the gravitational acceleration and emit acceleration signals AX and AZ. By comparing the magnitudes of the acceleration signals AX and AZ components, the roll angle θA of the pointing device 101 can be calculated by the equation θA=arc tan(AX/AZ). Another value required for the roll compensation calculation is the vector sum of AX and AZ which is defined by the equation AXZ=[AX 2=AZ 2]1/2.
  • The roll angle θA of the pointing device also alters the rotational velocity outputs RX and RZ from the X axis and X axis gyroscopes. The angle formed by magnitudes of the RX and RZ rotational components is represented by θR. Like roll angle θA, the rotational component angle θR is calculated by the equation θR=arc tan(RX/RZ). The vector sum of RX and RZ rotation components is calculated by the equation, RXZ=(RX 2+RZ 2)1/2. With reference to FIG. 6, if the pointing device 101 is moved in rotation diagonally, with equal rotational velocities up in pitch and counter clockwise in yaw, the pointing device should emit a RX rotation signal 621 and a RZ rotation signal 623 that are equal in magnitude. However, the roll of the pointing device causes the magnitudes to be shifted which increases the RZ rotation 625 and decreases the RX rotation 627 while the vector sum RXZ remains constant.
  • The basic roll compensation equations for Xcomp and Ycomp for the inventive pointing device are used to provide roll correct the X and Y motion signals for a cursor on a visual display. The Xcomp and Ycomp correction factors are based upon the vector sum of the rotational velocities, RXZ and the sin and cos of the sum of the angle of the acceleration components θA and angle of the rotational velocity components θR. The basic roll compensation equations are:

  • X comp =R XZ*sin(θAR)

  • Y comp =R XZ*cos(θAR)
  • While it is possible to calculate the sin and cos of (θAR), these trigonometry calculations are fairly difficult and requires a substantial amount of processing power. Thus, a pointing device performing this calculation requires a powerful microprocessor and a larger power supply to operate the microprocessor. In order to create a more efficient roll compensation pointing device, the sin and cos functions are simplified. The basic Xcomp and Ycomp equations are converted into the equivalent equations below:

  • sin(θAR)=sin(θA)*cos(θR)+cos(θA)*sin(θR)

  • cos(θAR)=cos(θA)*cos(θR)−sin(θA)*sin(θR)
  • With reference to FIG. 5, the sin and cos functions represent the geometric relationship of a right triangle. In an example, the perpendicular sides of the right triangle are represented by the magnitudes of Ax and Az. The length of the third side is AXZ which equals [AX 2+AZ 2]1/2. The angle θA is between the sides AX and AXZ. The sin and cos functions can be replaced by the triangular ratios: sin θA=AZ/AXZ, cos θA=AX/AXZ, sin θR=Rz/RXZ and cos θR=RX/RXZ. By substituting these sin and cos equivalents into the Xcomp and Ycomp equations, the simplified Xcomp and Ycomp equations become:)

  • X comp =R XZ *[A z /A XZ *R x /R XZ +A x /A XZ *R z /R XZ]

  • Y comp =R XZ *[A x /A XZ *R x /R XZ −A z /A XZ *R z /R XZ]
  • The equations are further simplified to:)

  • X comp =[A z *R x +A x *R z ]/A XZ

  • Y comp =[A x *R x −A z *R z ]/A XZ
  • The simplified roll compensation algorithm provides several benefits. By using these purely algebraic algorithms for the roll compensation cursor signals, Xcomp and Ycomp, are calculated with greatly reduced computational requirements and greatly reduces the energy required to perform the calculations. A low powered processor can be used which consumes very little electrical power and allows the pointing device to operate for much longer periods of time with portable batteries, extending the battery life between recharging or replacement. The low powered processor is also a much less expensive component than higher powered processors. Thus, the cost of production of the inventive pointing device can be significantly reduced. In sum, the inventive algebraic based roll compensating pointing device has many benefits over a pointing device that uses a trigonometry based roll compensation algorithm.
  • When the inventive pointing device is used, the algebraic Xcomp and Ycomp algorithms are constantly being calculated to respond to all detected movement. In order to respond immediately to all intended movements, the motion sensors are constantly sampled and the values of AX, AZ, RX and RZ are constantly updated. This sampling may occur when the pointing device is moving and stationary. In an embodiment, the accelerometers and rotation sensors are sampled about once every 2 milliseconds. Because sensor reading error can occur, the system may include a mechanism for eliminating suspect data points. In an embodiment, the system utilizes a sampling system in which four readings are obtained for each sensor and the high and low values are discarded. The two middle sensor readings for AX, AY, AZ, RX and RZ are then averaged and forwarded to the processor to calculate Xcomp and Ycomp. Since the Xcomp and Ycomp calculations are performed once for every four sensor readings, the report time for the sensors can be approximately every 8 milliseconds.
  • While the basic roll compensation correction system and method has been described above, additional adjustment can be applied to the inventive pointing device to further correct potential errors in the Xcomp and Ycomp cursor control signals. In an embodiment, the Xcomp value is corrected for the pitch of the pointing device. As the pointing device is rotated away from a horizontal orientation in pitch, the Z axis rotational sensor is angled away from a vertical orientation and detected Z axis rotational velocity RZ is reduced. In order to correct the Xcomp value for pitch, the correction factor AXYZ/AXZ is applied. Where AXYZ=[AX 2+AY 2+AZ 2]1/2 and AXZ=[AX 2+AZ 2]1/2. Since AY is aligned horizontally, the gravitational force is small and AXYZ/AXZ is approximately 1.0 when the pointing device is horizontal. The AY signal will increase as the pointing device is rotated in pitch away from horizontal so AXYZ/AXZ will also increase in value with increased pitch. The pitch correction is applied to Xcomp in the equations below:)

  • X comp =[A z *R x +A x *R z ]/A XZ *[A XYZ /A XZ]
  • In contrast to the pitch correction for the Xcomp, a correction factor is not required for Ycomp. The X axis rotational sensor is aligned with the X axis and detects the pitch rotational velocity about the X axis. Thus, Ycomp is not reduced when the pointing device is moved in pitch. Since pitch does not alter Ycomp the pitch correction is not applied to Ycomp.
  • Another correction that can be applied to the pointing device is correction for user induced rotational acceleration that can be detected by the accelerometers. Because the accelerometers are not located precisely at the center of the pointing device, rotation of the pointing device causes user induced acceleration that is detected by the accelerometers and results in errors in the accelerometer output signals AX, AY and AZ. The user induced acceleration can include rotational acceleration and centripetal acceleration. By dynamically detecting and calculating these accelerations, the inventive system can remove the user induced accelerations by applying correction factors to output signals AX, AY and AZ. The gravitational force detected by the accelerometers can then be isolated, resulting in a more accurate roll compensation calculation.
  • The rotational acceleration is detected by the accelerometers when there is a change in the rotational velocity of the pointing device. Since the accelerometers are not located at the center of rotation of the pointing device, any rotational acceleration will cause linear acceleration of the accelerometers based on the equation, A=ΔR/Δtime*l. The rotational acceleration is ΔR/Δtime and can be determined by detecting the difference in velocity between each rotational sensor sample and dividing this difference by the sample time. The fulcrum arm length l, can each be different for each of the X, Y and Z accelerometers and may be represented by lX, lY and lZ respectively. Since the X, Y and Z accelerometers only detect acceleration in one direction, the fulcrum arm lengths are the distances between the accelerometer and an axis of rotation that is perpendicular to the detection direction.
  • With reference to FIG. 7, a top view of the pointing device 101 is shown. The linear acceleration of the X direction accelerometer 111 is calculated by multiplying the rotational acceleration 321 of the pointing device 101 about the Z axis by the length lX 323 of the fulcrum arm. The fulcrum arm length lX 323 is equal to the perpendicular length from the Z axis 327 to a line 329 passing through the X direction accelerometer 111 in the X direction. Note that the length lX 323 is perpendicular to both the line 329 and the Z axis 327. Similarly, the linear acceleration of the Z direction accelerometer is the rotational acceleration of the pointing device about the X axis multiplied by the fulcrum arm length lZ, which is the perpendicular length from the X axis to a line passing through the Z direction accelerometer in the Z direction. In some cases, it can be difficult to determine the exact fulcrum arm lengths lX and lZ, and approximate lengths can be used to calculate rotational acceleration. In an embodiment, the user induced rotational acceleration is subtracted from the detected acceleration based upon the equations:

  • A Xcorrected =A X −ΔR Z/Δtime*l X

  • A Zcorrected =A Z −ΔR X/Δtime*l Z
  • These calculations do not account for rotation about the Y axis because the inventive pointing device may not include a Y axis rotational sensor. However, since RY is likely to be 0, then ΔRY/Δtime=0 and the effects of Y axis rotational acceleration are negligible and not necessary for the AXcorrected and AZcorrected calculations. It is also possible to calculation AYcorrected=AX−ΔRX/Δtime*lY1−ΔRZ/Δtime*lY2, where lY1 is the perpendicular length from the X axis to a line passing through the Y direction accelerometer in the Y direction and lY2 is the perpendicular length from the Z axis to the line passing through the Y direction accelerometer in the Y direction. Since the AY is only used in the pitch correction calculations and likely to be small in magnitude, the AYcorrected calculation may not have a significant influence on the Xcomp and Ycomp calculations and may not be required.
  • The values of AX, AY and AZ can also be altered by centripetal acceleration due to the offset of the accelerometers from the center of rotation. The centripetal calculations are based around the equation Acentripetal=R2*radius. The value of “r” is the offset distance of the accelerometer about the axis of rotation. The centripetal acceleration can have two separate components. For Example, the centripetal accelerations of the Y accelerometer can be caused by rotation RX 2 and RZ 2. The radius is the distance of the accelerometer from the axis of rotation. In an embodiment, the centripetal accelerations are calculated and used to correct the Xcomp and Ycomp calculations. However, in general, the centripetal acceleration will be very small in comparison to the rotational acceleration and can be omitted from the accelerometer correction equations.
  • Another factor that can alter the output of the accelerometers and rotations sensors is temperature. With reference to FIG. 2, a block diagram of the pointing device components is illustrated. In order to compensate for the effects of temperature, the pointing device can have a temperature sensor 217 that provides a temperature signal to the processor 205. The detected temperature can be stored in memory 219 and a corresponding temperature correction factor can be applied to the outputs of the rotational sensors, RX and RZ. The processor 205 can be configured to check the temperature periodically and if the temperature has changed significantly from the stored temperature, a new temperature correction factor can be applied to the rotation velocity signals. In an embodiment, the temperature is checked every 5 minutes and a new temperature correction value is applied when the temperature has changed by more than 2 degree Centigrade.
  • In order to minimize the required temperature correction factors, the inventive motion detection system can be designed with paired components that have an inverse reaction to temperature. For example, the rotational velocity output signals from the rotational sensors may increase as the temperature increases. These rotational sensors may be paired with regulators that decrease the rotational output readings with increases in temperature. Since these paired components have an opposite effect on the signal, the net effect of temperature variations on the output rotational signals is reduced. While a temperature correction may still be required, the influence of temperature changes is reduced which makes the system more stable.
  • The inventive pointing device may also automatically perform sensor calibration. During the operation of the pointing device, the system may detect when the accelerometers AX and AZ are producing a steady output which indicates that the pointing device is stationary. During this time, the outputs of the gyroscopes RX and RZ should be zero since the pointing device is not in rotation. In an embodiment, the inventive pointing device may perform a calibration process to correct any rotational RX and RZ output errors. These correction offsets can be stored in memory 219 and used to adjust the outputs of the rotational sensors until the calibration process is performed again.
  • Since the correction factors are calculated using a very simple algebraic algorithm, a basic processor that requires very little electrical energy can be used. In an embodiment, the inventive roll compensation pointing device uses a 16 bit RISC (Reduced Instruction Set Computer) processor that operates at about 4 MHz. Commonly available consumer batteries such as one or more 1.5 Volt AA or AAA sized batteries can power the inventive pointing device for several months or longer without recharging. This is a significant improvement over a pointing device that uses a trigonometry based roll compensating algorithm that requires a more powerful processor operating at 12-16 MHz, consumes much more energy and may require more frequent recharging or replacement of batteries.
  • In other embodiments, the pointing device can include additional energy saving features. When the pointing device 101 is not being used, it can be automatically switched off or placed in low energy consumption stand-by mode. In an embodiment, the processor of the pointing device may detect that the accelerometers are emitting steady output signals and/or the rotational sensors are emitting zero rotational velocity signals. If these sensor outputs remain for an extended period of time, the processor may cause the pointing device to be shut off or go into a sleep mode. In order to restart the pointing device, the user may have to press a button on the pointing device or the pointing device may detect movement. In response, the processor may apply power to the pointing device components. Since the accelerometers and gyroscopes only require about 250 milliseconds to become operational, the delay in response may be insignificant and unnoticed by the user.
  • Though the foregoing invention has been described in detail for purposes of clarity of understanding, it will be apparent that various changes and modifications may be practiced within the scope of the appended claims. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the spirit and scope of the present invention.

Claims (35)

What is claimed is:
1. A pointing system for controlling movement of a cursor on an electronic display comprising:
a first rotational sensor providing a first rotational velocity signal RX for rotational movement about a first axis;
a second rotational sensor providing a second rotational velocity signal RZ for rotational movement about a second axis;
a first accelerometer providing a first acceleration signal AX in response to a acceleration in a first direction along the first axis;
a second accelerometer providing a second acceleration signal AZ in response to a acceleration in a second direction along the second axis; and
a processing unit that calculates roll-compensated cursor movement signals Xcomp and Ycomp from RX, RZ, AX and AZ, wherein the processing unit does not use any trigonometric computation in the calculating steps.
2. The pointing device of claim 1 further comprising:
a receiver associated with the electronic display; and
a transmitter for transmitting signals to the receiver.
3. The pointing system of claim 1 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX and AZ and processing the plurality of reading for each of RX, RZ, AX and AZ before the processing unit receives RX, RZ, AX and AZ from the sampling system.
4. The pointing system of claim 1 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX and AZ and discarding some of the plurality of reading for each of RX, RZ, AX and AZ before the processing unit receives RX, RZ, AX and AZ from the sampling system.
5. The pointing system of claim 1 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX and AZ and discarding suspect readings from the plurality of reading for each of RX, RZ, AX and AZ that are a highest reading or a lowest reading from the plurality of reading for each of RX, RZ, AX and AZ before the processing unit receives RX, RZ, AX and AZ from the sampling system.
6. The pointing system of claim 1 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX and AZ and calculates averages readings from the plurality of reading for each of RX, RZ, AX and AZ before the processing unit receives the averages of RX, RZ, AX and AZ from the sampling system.
7. The pointing system of claim 1 wherein the sampling system receives a plurality of reading for each of RX, RZ, AX and AZ, and the sampling system discards some of the plurality of reading for each of RX, RZ, AX and AZ.
8. The pointing system of claim 1 further comprising:
a memory coupled to the processing unit for storing correction offsets for the first rotational sensor and the second rotational sensor.
9. The pointing system of claim 8 wherein the correction offsets for the first rotational sensor and the second rotational sensor are calculated from error signals from the first rotational sensor and the second rotational sensor that are detected when the first accelerometer signal AX from the first accelerometer and the second acceleration signal AZ from the second accelerometer are steady output signals.
10. The pointing system of claim 1, wherein the processing unit is a 16 bit reduced instruction set computer processor (RISC).
11. The pointing system of claim 1, wherein the processing unit operates at a frequency of 4 MHz or less.
12. The pointing system of claim 1, further comprising:
a pair of 1.5 volt AA or AAA size battery for providing electrical power to the processing unit.
13. The pointing system of claim 1, wherein the first acceleration signal AX is corrected for rotational acceleration of the first accelerometer about the second axis by the equation: AXcorrected=AX−ΔRZ/Δtime*lX and the second acceleration signal AZ is corrected for rotational acceleration of the second accelerometer about the first axis by the equation:

A Zcorrected =A Z −ΔR X/Δtime*l Z and
wherein ΔRX/Δtime is a rotational acceleration about the first axis, ΔRZ/Δtime is a rotational acceleration about the second axis, lX is a perpendicular length between a line through the first accelerometer in the first direction and the second axis and lZ is a perpendicular length between a line through the second accelerometer in the second direction and the first axis.
14. The pointing system of claim 1, wherein the processing unit calculates a vector sum AXZ of AX and AZ and roll-compensated cursor movement signals Xcomp and Ycomp with the equations:)

X comp =[A X *R X +A Z *R Z ]/A XZ; and

Y comp =[A X *R Z −A Z *R X ]/A XZ.
15. A pointing system for controlling movement of a cursor on an electronic display comprising:
a first rotational sensor providing a first rotational velocity signal RX for rotational movement about a first axis;
a second rotational sensor providing a second rotational velocity signal RZ for rotational movement about a second axis;
a first accelerometer providing a first acceleration signal AX in response to a acceleration in a first direction along the first axis;
a second accelerometer providing a second acceleration signal AZ in response to a acceleration in a second direction along the second axis;
a third accelerometer providing a third acceleration signal AY in response to a acceleration in a third direction along a third axis, and a processing unit that calculates pitch-and-roll-compensated cursor movement signals Xcomp and Ycomp from RX, RZ, AX, AY, and AZ, wherein the processing unit does not use any trigonometric computation in the calculating steps.
16. The pointing system of claim 15 further comprising:
a receiver associated with the electronic display; and
a transmitter for transmitting signals to the receiver.
17. The pointing system of claim 15 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX, AY and AZ and processing the plurality of reading for each of RX, RZ, AX, AY and AZ before the processing unit receives RX, RZ, AX, AY and AZ from the sampling system.
18. The pointing system of claim 15 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX, AY and AZ and discarding some of the plurality of reading for each of RX, RZ, AX, AY and AZ before the processing unit receives RX, RZ, AX, AY and AZ from the sampling system.
19. The pointing system of claim 15 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX, AY and AZ and discarding suspect readings from the plurality of reading for each of RX, RZ, AX, AY and AZ that are a highest reading or a lowest reading from the plurality of reading for each of RX, RZ, AX, AY and AZ before the processing unit receives RX, RZ, AX, AY and AZ from the sampling system.
20. The pointing system of claim 15 further comprising:
a sampling system for receiving a plurality of reading for each of RX, RZ, AX, AY and AZ and calculates averages readings from the plurality of reading for each of RX, RZ, AX, AY and AZ before the processing unit receives the averages of RX, RZ, AX, AY and AZ from the sampling system.
21. The pointing system of claim 15 wherein the sampling system receives a plurality of reading for each of RX, RZ, AX, AY and AZ, and the sampling system discards some of the plurality of reading for each of RX, RZ, AX, AY and AZ.
22. The pointing system of claim 15 further comprising:
a memory coupled to the processing unit for storing correction offsets for the first rotational sensor and the second rotational sensor.
23. The pointing system of claim 22 wherein the correction offsets are calculated from error signals from the first rotational sensor and the second rotational sensor that are detected when the first accelerometer signal AX from the first accelerometer, the second acceleration signal AZ from the second accelerometer and the third acceleration signal AY from the third accelerometer are steady output signals.
24. The pointing system of claim 15, wherein the processing unit is a 16 bit reduced instruction set computer processor (RISC).
25. The pointing system of claim 15, wherein the processing unit operates at a frequency of 4 MHz or less.
26. The pointing system of claim 15, further comprising:
a pair of 1.5 volt AA or AAA size battery for providing electrical power to the processing unit.
27. The pointing system of claim 15, wherein the first acceleration signal AX is corrected for rotational acceleration of the first accelerometer about the second axis by the equation: AXcorrected=AX−ΔRZ/Δtime*lX and the second acceleration signal AZ is corrected for rotational acceleration of the second accelerometer about the first axis by the equation:

A Zcorrected =A Z −ΔR X/Δtime*l Z and
wherein ΔRX/Δtime is a rotational acceleration about the first axis, ΔRZ/Δtime is a rotational acceleration about the second axis, lX is a perpendicular length between a line through the first accelerometer in the first direction and the second axis and lZ is a perpendicular length between a line through the second accelerometer in the second direction and the first axis.
28. The pointing system of claim 15, wherein the processing unit calculates a vector sum AXZ of AX and AZ, a vector sum AXYZ of AX, AY and AZ, and roll-compensated cursor movement signals with the equations:

X comp =[A X *R X +A Z *R Z ]/A XZ *A XYZ /A XZ; and

Y comp =[A X *R Z −A Z *R X ]/A XZ.
29. A pointing system for controlling movement of a cursor on an electronic display comprising:
a processing unit containing executable instructions for: (a) receiving a first rotational velocity signal RX, a second rotational velocity signal RZ, a first acceleration signal AX in response to an acceleration in a first direction along the first axis and a second acceleration signal AZ in response to an acceleration in a second direction along the second axis, and (b) calculating roll-compensation cursor movement signals Xcomp and Ycomp using roll-compensation algorithms that do not include trigonometry functions and using signals RX, RZ, AX, and AZ and the vector sum AXZ as inputs to the roll-compensation algorithms.
30. The pointing system of claim 29, further comprising:
a receiver associated with the electronic display; and
a transmitter for transmitting signals to the receiver.
31. The pointing system of claim 29, wherein the processing unit is a 16 bit reduced instruction set computer processor (RISC).
32. The pointing system of claim 29, wherein the processing unit operates at a frequency of 4 MHz or less.
33. The pointing system of claim 29, further comprising:
a pair of 1.5 volt AA or AAA size battery for providing electrical power to the processing unit.
34. The pointing system of claim 29, wherein the first acceleration signal AX is corrected for rotational acceleration of the first accelerometer about the second axis by the equation: AXcorrected=AX−ΔRZ/Δtime*lX and the second acceleration signal AZ is corrected for rotational acceleration of the second accelerometer about the first axis by the equation:

A Zcorrected =A Z −ΔR X/Δtime*l Z and
wherein ΔRX/Δtime is a rotational acceleration about the first axis, ΔRZ/Δtime is a rotational acceleration about the second axis, lX is a perpendicular length between a line through the first accelerometer in the first direction and the second axis and lZ is a perpendicular length between a line through the second accelerometer in the second direction and the first axis.
35. The pointing system of claim 29, wherein the processing unit calculates a vector sum AXZ of AX and AZ and roll-compensated cursor movement signals Xcomp and Ycomp with the equations:

X comp =[A X *R X +A Z *R Z ]/A XZ; and

Y comp =[A X *R Z −A Z *R X ]/A XZ.
US13/732,748 2008-06-27 2013-01-02 Hand held pointing device with roll compensation Abandoned US20140184509A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/732,748 US20140184509A1 (en) 2013-01-02 2013-01-02 Hand held pointing device with roll compensation
US15/008,141 US9870070B2 (en) 2008-06-27 2016-01-27 Hand held pointing device with roll compensation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/732,748 US20140184509A1 (en) 2013-01-02 2013-01-02 Hand held pointing device with roll compensation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/112,742 Continuation US8442798B2 (en) 2008-06-27 2011-05-20 Hand held pointing device with roll compensation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/008,141 Continuation US9870070B2 (en) 2008-06-27 2016-01-27 Hand held pointing device with roll compensation

Publications (1)

Publication Number Publication Date
US20140184509A1 true US20140184509A1 (en) 2014-07-03

Family

ID=51016612

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/732,748 Abandoned US20140184509A1 (en) 2008-06-27 2013-01-02 Hand held pointing device with roll compensation
US15/008,141 Active US9870070B2 (en) 2008-06-27 2016-01-27 Hand held pointing device with roll compensation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/008,141 Active US9870070B2 (en) 2008-06-27 2016-01-27 Hand held pointing device with roll compensation

Country Status (1)

Country Link
US (2) US20140184509A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170168081A1 (en) * 2015-12-14 2017-06-15 Movea Device for Analyzing the Movement of a Moving Element and Associated Method
CN107436692A (en) * 2016-05-25 2017-12-05 何舒平 A kind of air mouse control method based on gyro sensor
US20190384421A1 (en) * 2013-06-06 2019-12-19 Bryan A. Cook Latency masking systems and methods
WO2020264507A1 (en) * 2019-06-28 2020-12-30 Ceva Technologies, Inc. Methods, apparatus and systems using motion of various input devices for controlling consumer devices
US11112861B2 (en) * 2017-03-08 2021-09-07 Robert Bosch Gmbh Determination of a spatial orientation
CN114280332A (en) * 2021-12-31 2022-04-05 成都路行通信息技术有限公司 Three-axis acceleration sensor correction method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070132733A1 (en) * 2004-06-08 2007-06-14 Pranil Ram Computer Apparatus with added functionality
US20080174550A1 (en) * 2005-02-24 2008-07-24 Kari Laurila Motion-Input Device For a Computing Terminal and Method of its Operation
US20090167723A1 (en) * 2007-12-31 2009-07-02 Wah Yiu Kwong Input devices
US20100321291A1 (en) * 2007-12-07 2010-12-23 Sony Corporation Input apparatus, control apparatus, control system, control method, and handheld apparatus
US20120274560A1 (en) * 2011-04-29 2012-11-01 Yanis Caritu Pointing device

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5440326A (en) 1990-03-21 1995-08-08 Gyration, Inc. Gyroscopic pointer
US5181181A (en) 1990-09-27 1993-01-19 Triton Technologies, Inc. Computer apparatus input device for three-dimensional information
US5453758A (en) 1992-07-31 1995-09-26 Sony Corporation Input apparatus
US5902968A (en) 1996-02-20 1999-05-11 Ricoh Company, Ltd. Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movement
SE512719C2 (en) 1997-06-10 2000-05-02 Lars Gustaf Liljeryd A method and apparatus for reducing data flow based on harmonic bandwidth expansion
US20030158699A1 (en) 1998-12-09 2003-08-21 Christopher P. Townsend Orientation sensor
US7707082B1 (en) 1999-05-25 2010-04-27 Silverbrook Research Pty Ltd Method and system for bill management
US6634207B1 (en) 2000-10-10 2003-10-21 Litton Systems, Inc. Accelerometer compensation in an inertial navigation system
US7031875B2 (en) 2001-01-24 2006-04-18 Geo Vector Corporation Pointing systems for addressing objects
WO2005109847A2 (en) 2004-04-30 2005-11-17 Hillcrest Laboratories, Inc. Methods and devices for identifying users based on tremor
ES2664472T3 (en) 2004-04-30 2018-04-19 Idhl Holdings, Inc. Free space signaling devices with tilt compensation and improved ease of use
EP1759529A4 (en) 2004-04-30 2009-11-11 Hillcrest Lab Inc Free space pointing devices and method
WO2007007227A2 (en) 2005-07-11 2007-01-18 Philips Intellectual Property & Standards Gmbh Method of controlling a control point position on a command area and method for control of a device
TWI291890B (en) * 2005-12-13 2008-01-01 Ind Tech Res Inst Electric device with motion detection ability
EP1804154A3 (en) * 2005-12-27 2012-08-08 Poston Timothy Computer input device enabling three degrees of freedom and related input and feedback methods
TWI317498B (en) 2006-12-12 2009-11-21 Ind Tech Res Inst Inertial input apparatus with six-axial detection ability and the opearting method thereof
US8010313B2 (en) 2008-06-27 2011-08-30 Movea Sa Hand held pointing device with roll compensation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070132733A1 (en) * 2004-06-08 2007-06-14 Pranil Ram Computer Apparatus with added functionality
US20080174550A1 (en) * 2005-02-24 2008-07-24 Kari Laurila Motion-Input Device For a Computing Terminal and Method of its Operation
US20100321291A1 (en) * 2007-12-07 2010-12-23 Sony Corporation Input apparatus, control apparatus, control system, control method, and handheld apparatus
US20090167723A1 (en) * 2007-12-31 2009-07-02 Wah Yiu Kwong Input devices
US20120274560A1 (en) * 2011-04-29 2012-11-01 Yanis Caritu Pointing device

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190384421A1 (en) * 2013-06-06 2019-12-19 Bryan A. Cook Latency masking systems and methods
US20170168081A1 (en) * 2015-12-14 2017-06-15 Movea Device for Analyzing the Movement of a Moving Element and Associated Method
US10156907B2 (en) * 2015-12-14 2018-12-18 Invensense, Inc. Device for analyzing the movement of a moving element and associated method
CN107436692A (en) * 2016-05-25 2017-12-05 何舒平 A kind of air mouse control method based on gyro sensor
US11112861B2 (en) * 2017-03-08 2021-09-07 Robert Bosch Gmbh Determination of a spatial orientation
WO2020264507A1 (en) * 2019-06-28 2020-12-30 Ceva Technologies, Inc. Methods, apparatus and systems using motion of various input devices for controlling consumer devices
US11947739B2 (en) 2019-06-28 2024-04-02 Ceva Technologies, Inc. Methods, apparatus and systems using motion of various input devices for controlling consumer devices
CN114280332A (en) * 2021-12-31 2022-04-05 成都路行通信息技术有限公司 Three-axis acceleration sensor correction method

Also Published As

Publication number Publication date
US20160139687A1 (en) 2016-05-19
US9870070B2 (en) 2018-01-16

Similar Documents

Publication Publication Date Title
US8010313B2 (en) Hand held pointing device with roll compensation
US9870070B2 (en) Hand held pointing device with roll compensation
US11016116B2 (en) Correction of accumulated errors in inertial measurement units attached to a user
KR101123338B1 (en) A Movement Sensing Apparatus of an Object
EP2702465B1 (en) Improved pointing device
US10318015B2 (en) Information processing for controlling movement of displayed object
US20150247729A1 (en) System and method for device bearing estimation
CN101606119A (en) Input media, control device, control system, control method and hand-held device
US10345928B2 (en) Touch sensitive processing method, apparatus and system for calibrating pressure value to stylus
US10222908B2 (en) Touch sensitive processing method, apparatus and system for setting palm rejection area
JP2004288188A (en) Pen type input system using magnetic sensor, and its trajectory restoration method
KR20110068340A (en) In-door positioning apparatus and method based on inertial sensor
JP2010078376A (en) Bearing detection method and apparatus and travel history calculation method and apparatus
US20080074641A1 (en) Precise, no-contact, position sensing using imaging
US8510079B2 (en) Systems and methods for an advanced pedometer
JP3763435B2 (en) Attitude angle detector
KR101402667B1 (en) Rotation angle measuring system for excavator
JP3797661B2 (en) Attitude angle detector
JP6550906B2 (en) Method and apparatus for measuring inclination, electronic device and program
JP2010157157A (en) Input device, controller, handheld device, control system, and control method
WO2023092767A1 (en) Calibration control method, apparatus and device for sound box, and readable storage medium
TWI534659B (en) 3d pointing device and method for compensating movement thereof
KR20090081122A (en) step counting apparatus embedded in the mobile tools and step counting method using step counting apparatus
EP2503302A3 (en) Calibration and correction of a gyroscope
JP2016042879A (en) Stride measuring system

Legal Events

Date Code Title Description
AS Assignment

Owner name: MOVEA SA, FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATHEWS, MICHAEL;MASON, WALTER M;SIGNING DATES FROM 20080627 TO 20080630;REEL/FRAME:029555/0605

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION