DE10124242A1 - Equipment and method for checking persons deportment when exercising against expert data stored in data processing unit - Google Patents

Abstract

On the person's body markers (30), pressure (16) and acceleration sensors (18) are fitted and video cameras (14) monitor body movements. Their signals are recorded with a data processing unit (20) which has a monitor and loudspeakers (26) for conveying information to the person. The unit has an expert data bank (22) for comparison of the signals from the sensors and markers to determine whether any body movements are performed correctly. A microphone (38) can be used to monitor sound when a musical instrument is played.

Description

The invention relates to a device for Hal control of a person, with at least one recording unit for posture detection, according to the preamble of claim 1. Further relates the invention relates to a corresponding process ren.

Devices and methods of the aforementioned Kind are already known. They serve, for example to learn complex movements, such as tan Zen, yoga, aerobics, gymnastics, golf, tennis, Ka rate, musical instruments and the like. The learning such complex movements are carried out in be known way with the help of a course program lung, for example by a personal teacher, or in the form of instructions in books, video pro gram or the like. Especially with books and video programs often face errors drawing inaccuracies in the movement guidance by the person so that the learner may be questioned, given given if due to incorrect loads, also health damage to the person can. A teacher is especially at kom plex and fast movements in their Possibility of a correct and complete movement limited analysis. Incorrect loads on the moving person often show up first  afterwards, i.e. after completing the exercise, to Example using a video recording or based on of treadmill analysis by professionals. There is one personal trainers are also often proportionate expensive and not always available. Even with everyday movements, like walking or running, it can often due to learned or other circumstances acquired physical disabilities come that can lead to long-term health problems NEN. Furthermore, such harmful Effects from static postural shocks the (motionless or poor body position) of a person.

It is an object of the invention, a device and a corresponding method of the aforementioned Kind of creating a reliable and fast Allow posture control by one person.

To solve the problem, a device with the features of claim 1 proposed that is characterized by the fact that one is an expert database and for posture data evaluation electronic data processing equipment unit is provided with the recording unit and with one to transmit at least one posture-relevant information to the person who connected information output unit is. Here, a respective body is kept position of the person in a static position (un moved) or during a dynamic movement understood the same. It can be ru position and body movements of one  Person in a reliable and fast manner troll, the person himself part of a ge closed loop. In dependency of Expert database can have different attitudes controls, for example for various exercises sports. Favorable wise it is now possible to have an automated and individualized posture control of a person to ensure by means of a device. In the It can be information to be transmitted to the person for example, a posture-related evaluator tion or a movement instruction. Fer It is conceivable that not the person directly undergoes posture control, but for example one held by the person Exercise machine (tennis racket, golf club or similar Liches) regarding its positioning and / or Movement is controlled for indirect posture control of the same person.

An additional advantage is an acoustic open acquisition unit provided with the data processing unit for sound data evaluation is. The acoustic recording unit can, for example wise be a microphone, by means of which sound ten are recordable. This enables, for example a sound data and posture controlled Erler a musical instrument by means of a device tung. The sound data evaluation can be indirect also used for posture control become.  

The receiving unit advantageously contains min at least a sensor for capturing posture relevant data. Sensors are particularly suitable reliable and fast detection of posture-relevant data. Furthermore, they are in a relatively simple way with the electro African data processing unit operatively connectable.

The sensor can be used as a pressure sensor or as an accelerator be formed sensor. It is therefore possible Lich, a variety of different types of sensors to collect data relevant to keeping hen. Pressure sensors can, for example, in a Shoe sole of the person for the inclusion of data in loading train on the body adjust load of the same can be arranged. Are suitable for example FSR (ForceSensingResitor) sensors, which consist of three thin polymer films and their electrical resistance depending on the force introduced on their surface countries. They are particularly suitable because of their relatively small installation volume, their high Service life and their low purchase costs. For example, there may be a plurality of pressure rings sensors are arranged as a matrix and by means of A / D converter operatively connected to a microcontroller his. The individual sensors of the sensor matrix who which is preferably time-coded. At a Typical application will be 9 to 16, for example Pressure sensors used. Stay with one target resolution of 10 ms approx 0.1 to 1 ms time to the posture data of the individual sensors and to wan analog / digital spindles. The conversion time is sufficient to complete  available, inexpensive microcontroller systems put. In this way it is possible to use a plurality of pressure sensors to gain, which with knowledge of the body weight and shoe size of the person conclusions allow on the so-called "body weight pressure".

According to a possible embodiment, the Recording unit on at least one video camera. It is therefore possible by means of a Sen sensors alternative or additional video camera an optical posture control of a person respectively. If necessary, two or more rere video cameras that are at a fixed distance are arranged for stereo-optical up taking posture data or movement data of a person. Favorable Traditional video cameras can be used wisely come that generate analog video data.

According to a preferred embodiment at least one optical marking element for loading attachment to the person is provided. Such op Table marking elements are made on suitable (movement relevant) places of the person attached and serve to facilitate data evaluation and thus also to reduce the necessary Computing power. The markings are preferred designed in such a way that it is clear even then are identifiable if only parts of are visible to them. For example wise markings of different diameters, ver different distances from the video camera, different  Colors and / or different flashing frequencies from LEDs.

The information output unit is advantageous as Transmitter for optical and / or acoustic and / or tactile signals formed. Optical signals can be emitted by means of LEDs, for example while acoustic signals, for example, by means of a buzzer can be generated or be preferred are natural speech signals. tactile Signals can take the form of a vibration, for example be delivered. A natural voice response can be made using one or more traditional Loudspeakers. There is also a Kombina tion on different signal forms possible in order fast and reliable posture-relevant information to be able to transmit information to the person.

The data processing unit advantageously contains a data transmission system and / or a Data entry system. The data transfer can be designed such that a Da transmission for electronic data processing unit using a special PCI plug-in card or using a USB bus. On Data entry system can, for example, a keyboard be.

According to a possible embodiment, the front direction as a compact and mobile assembly forms. The device should be as small as possible be trained so that they can easily be used for a Person portable and possibly also as "stand alone "unit can be used. Since the demands on  the electronic data processing unit in particular especially when used exclusively of pressure sensors in relation to their computing power are relatively small, it is possible that required hardware components so small to train and fit it to a person that they do not interfere with the same Exercise, for example, a sporting movement represent. It is therefore advantageously possible Lich, expert knowledge in a relatively small and easily transportable (mobile) unit integrate that an evaluation of the determined Posture data is possible in real time and corresponds quickly send the relevant information to the person can be communicated.

To achieve the object, a method for checking the posture of a person is also proposed, which has the following method steps according to claim 11:

• - Creation of an expert database in an elec tronic data processing unit;
• - Determination of person-relevant posture data by means of a recording unit;
• - Transfer of the husbandry data to the data processing processing unit by means of a data transmission system;
• - Creation of at least one posture-relevant In formation by means of the data processing unit;  
• - Transmission of the information to the person by means of an information output unit.

This procedure enables the achievement of the Regarding the device advantages mentioned above.

The posture data are preferably by means of a optical and / or acoustic recording unit and / or determined by means of sensors. This will quick and reliable posture control allows a person without necessarily on to have to resort to a human expert sen.

According to a preferred embodiment variant the determined husbandry data in the data processing unit analyzed for subsequent Deriving parameters associated with data in the Ex Personal database can be compared for creation at least one posture relevant information for the person. The method can advantageously by means of a suitable choice of an expert database versatile for posture control of a person be set.

Preferably, information is given attitude reaction as a criterion for people assessment and to create a customized Information creation used. Thus, on hand the way how fast or how well a corrective postural response by a per a realization has been gained be about the respective mental and body condition of the same person. For example  knowledge can be gained in this way about coordination or trai state of the corresponding person. Thereby the tutorial can automatically apply to the in adjust individual circumstances of a person and thus an undesirable overwhelming of the same Avoid person by using the Automa an interruption of the exercise, for example initiates.

Further advantageous embodiments of the invention result from the description.

The invention is described in one embodiment below Example based on an associated drawing explained in more detail. In one figure there is one Device schematically Darge provides.

The figure shows a schematic illustration of a person, generally designated 10 , on whom a posture control is carried out by means of a device 12 . The device 12 has a recording unit which serves for the detection of posture and which consists of two video cameras 14 , a microphone 28 , pressure sensors 16 and acceleration sensors 18 . The recording unit is operatively connected to an electronic data processing unit 20 which has an expert database 22 . The electronic data processing unit 20 serves to evaluate the posture data of the person 10 transmitted by the recording unit. In this attitude relevant means of the expert database 22 information is created, which by means of a mationsausgabeeinheit infor which includes a monitor 24, and two speakers 26 are transmitted to the person 10th The speakers 26 are connected to the data processing unit 20 (double arrows 38 ). The electronic data processing unit 20 has a data transmission system (double arrows 32 ) and a data entry system 34 . The data can thus be transmitted to the electronic data processing unit 20 by means of data carriers, by manual input and / or by online transmission (for example the Internet). The transmission of posture-relevant data by means of the recording unit (video cameras 14 , pressure sensors 16 , acceleration sensors 18 , microphone 28 ) to the electronic data processing unit 20 can take place by means of suitable data transmission lines (double arrows 34 , 36 ) or also wirelessly. To create reliable data by means of the video camera 14 , a plurality of optical marking elements 30 are attached to the person 10 .

The device 12 is used to determine data relating to a particular body position, body movement and body strain (posture) of a person 10 by means of the recording unit, to supply these posture-relevant data to the expert database 22 of the electronic data processing unit 20 and from this easily and generally understandable information or to give instructions and to output them to the person 10 performing a sporting exercise, for example. It is thus formed with a closed control loop in the form of a "bio-feedback process". It is advantageously possible, for example, to control movement sequences of a person 10 in the form of a bio-feedback loop, to report dangerous situations and / or to give complex course and training instructions. This is done in electronic form using a computer (electronic data processing unit 20 ), so that the use of a human teacher or experts can be dispensed with.

The electronic data processing unit 20 according to the exemplary embodiment can be a commercially available computer (PC with at least 200 MHz and at least 64 MB Ram). The optical data recorded by means of the video cameras 14 is digitized in the form of analog video data by means of so-called frame grabbers into 8-bit wide data and then instructed in the electronic data processing unit 20 , in which the further evaluation takes place using suitable software. Alternatively, the evaluation can also be carried out on fast 16-bit microcontrollers (not shown). Depending on requirements, further posture data of the body of the person 10 can additionally or alternatively be recorded by means of pressure sensors 16 and / or acceleration sensors 18 . Standard sensors can be used here. The attitude data determined by the sensors are recorded and stored by means of a microcontroller system. In the case of acceleration sensors, the data determined are relatively complex, so that the actual data analysis is carried out by means of a neural network which has been appropriately trained on a third-party computer. The weighting factors determined after training the network are then transferred to the microcontroller system.

For example, pressure distribution data are obtained by means of the pressure sensors 16 , which are first standardized to the so-called body weight pressure by means of knowledge of body weight and shoe size of the person 10 and are stored in the electronic data processing unit 20 . EEProms or flash memory cards serve as memory. The capacity is large enough to store a possible running distance of 10 to 20 km, for example. The storage is used either for statistical purposes or for subsequent evaluation on a PC. The time course of the pressure distribution of the shoe sole is used to analyze the different gait phases (initial contact, load response, medium-sized companies, terminal position, swing phase). Evaluation of rolling behavior). These secondary parameters form a multi-dimensional feature vector, by means of which a database in which the actual expert knowledge is stored is now queried. Such an expert database can store information about dangerous situations as well as training instructions.

When using optical marking elements 30 on the person, the markings recorded by the video cameras 14 are recognized by a so-called threshold operation by the electronic data processing unit 20 , released and their coordinates are calculated. By Ver same coordinates each of the same points in two corresponding receiving images of the two simultaneously receiving video cameras 14, the third dimension may be at a known distance of the Vi deokameras 14 calculated. The respective position of person 10 is calculated from knowledge of the spatial position of these markings. These posture-relevant data are standardized and compared with the expert database 22 . The position of the person 10 per learning unit is stored exactly there. Depending on the deviation, corresponding information or instructions are now created for the exercising person 10 . The information or instructions are transmitted to the person 10 by means of the information output unit (monitor 24 and / or loudspeaker 26 ). The information or instructions are preferably transmitted using natural language voice output. The person 10 receives correction instructions, for example, until a corresponding correct exercise position has been assumed exactly. Then you can proceed to the next part of the course.

The structure of the expert database 22 is explained on the basis of a stereo-optical determination of the body posture of the person 10 by means of video cameras 14 . It also applies analogously to the evaluation and analysis of the pressure distribution via a running shoe (pressure sensors 16 ).

From the stereo optical image data the Win kel, which the various attached to the body Form, compute and markers among themselves saved. The markings are placed that the resulting angle of position of joints (for example knees, hips) chen. A body position is achieved through a Kombina tion of these different marking angles defined. For each of these different mar angle (e.g. left arm, right Arm, left leg, right leg, head, hip, etc.) there is an entry in a table. The current len marking angles are with the corresponding Compare specifications in the table. All lie Angle within a predetermined tolerance at the line number defined in the same line kept going. Certain criteria such as time, Exceeding / falling below lead to a alternative line number is continued. If the measured marking angle from the specification in from the table, text instructions will appear hand of line and marker specific text identifiers generated.

Each row in this table corresponds to one Specification for a specific posture. In the there are various columns in addition to these specifications additional for the individual marking angles Auxiliary entries. The entire entries can be roughly divide into four different groups: one or several so-called default groups, one or several extreme value groups, one time limit group and a branch group (see Table 1). at Additional groups can be defined as required.  

Table 1

Structure of a data line

Each default group consists of a valid flag, a lower and upper limit for the angle, two different text identifiers, one priority value and a value for transitions (see table 2). The valid flag decides whether the whole group is active and is thus observed or not (don't care state). The top and bottom Limit defines the tolerance range, within an angle of which is recognized as matching becomes. If the measured marking angle is outside half of this tolerance range is a text output generated. The text identifier defines the type the instruction to be generated (for example "lifting" or "Lower", "Stretch", "Bend", etc.). The Text identifier exists twice, depending on whether the Angle is too large or too small. If the measured angle of several default groups at the same time are outside their tolerance ranges and thus several text outputs are generated decides an associated priority value over which mel is issued. Defi the number of transitions How often the valid angle range is left allowed (the practitioner shakes back and forth) before the termination criterion has been reached.

The extreme value group is the same as the default group with the difference that the entries in it are be used to protect against health hazards  To warn body positions. In the time limit group there is an entry for the average Time required to adopt the posture should. Exceeding this value fulfills this Termination criterion. A second time indicates how long the attitude should be maintained. The Branch group regulates in which line as to continue next. There is a Line number in case all conditions are met and one reason that the termination criterion rium is fulfilled. It can be both one solute jump or to call a subpro act gramms. Accordingly there is an entry which corresponds to a return statement.

Table 2

Establishment of a default or extreme value group

The possibility of defining subroutines ren, there are different possibilities for the actual course of the tutorial. The ge The entire program can be integrated into a single program large table and is saved by the Compu ter program called exactly once, the total run is in the table. On the other hand, the Learning material but also in various smaller days bark encoded by the computer program be called several times. This is useful especially for the formation of loops and the like  on. In this case, the overall process is in the Order of the calls of the tables from the main pro gram of the computer.

The generation of the text instructions depends on the one hand on the text identifier of the default group and on the other hand on the deviations of the measured marking angle from the target value. The text identifier identifies the text to be output more or less directly. There are two identifiers because the instruction text depends on whether the measured value is above or below the tolerance range. If the tolerance range is not reached in several default groups, in the simplest case the priority field decides whose instructions are to be issued. In the event of large or small deviations of the setpoint from the actual value, the output text is modified accordingly ("very", "still a little" etc.). In order to make the output text more natural, text generation using fuzzy logic with corresponding rules can be generated from several default groups with their text ID, priorities and deviations from the setpoint (if text ID ₁ is up and text ID ₂ is forward and priority _{1 is} equal) up, then straighten up text). If the termination criterion is met, for example due to the time being exceeded, the program continues at a different and perhaps "easier" point in the sequence program.

A movement can be done by exactly one or more different lines can be defined. The more ver assign different lines per movement sequence  the more precise instructions can be given become. For example, taking the Basic position of an exercise through several lines de be financed. For example, the first would only be the trunk position can be entered per line, the The rest would be in don't care condition. In a second Row would add arm to arm position position must be entered. On the next line the leg could be added to this line would have entries for the three default groups Body, arm and leg position at the same time. A ver leave the tolerance range within the fuselage The default group would automatically contain a text generate according to the text identifier of this line. If the arm area is also left at the same time, in the simplest case, the priority Value about which message is generated. can for example the leg position in the third step will not be reached after the time limit expires with which the termination criterion is generated and the program will continue at another point. Alterna tively, the program can be repeated on the same Position, but with a changed difficulty Level to be continued. This level can do it all Default values, such as the tolerance range, modify. If the skill of the practitioner after after a certain time, his Le also rises vel on and therefore the specifications must be more precise being held. The principle of difficulty Levels simplifies and reduces the tables quite considerably.

The principle of the program is based on the fact that (One-time) coding of the learning program itself  relatively complex, but the execution for it all the more is easier and therefore faster. This will be there by accomplishing every necessary sub-process with its own column entry in the table is represented. The resulting Ta belle is very extensive, but can by the fixed format can be easily evaluated. Every one contract in a column controls an action, ver comparable to a micro program on a compu ter. A disadvantage of this method is that it is relative large memory requirement of the table. When monitoring assumption of 10 marking angles approx. 200 bytes / line and thus approx. 200 kB at 1000 lines. But this is the case with today available memory sizes is not a problem.

The type of encoding of the specifications above presented table has the additional advantage that the evaluation can be easily parallelized can. Each default group monitors the corresponding Appropriate inputs completely independent of the others and generates the appropriate instructions. Only in The final step is the individual results summarized to an overall result, in one most technical case about the existing priorities. Due to the simple structure, the evaluation could - if necessary - completely by your own Hardware logic (PAL modules) take place. Easier it would be to have a separate Mi for each default group to use the krocontroller (pic controller) which Deliver results to a central controller.

When used for pressure sensors, the win kel tolerance ranges by other parameters, for  Example pressure values, replaced. The tutorial be is made up of much less different lines, so the available EEProm area sufficient. Is a more extensive tutorial wishes, so instead of a simple meal extension due to the simple parallelism evaluation - as discussed above - better one or more additional microcontrollers turned on be set. In addition to the memory ver administration greatly increases the evaluation speed.

By means of the device 12 is thus a reliable, fast and learning-friendly posture control on a person, for example when exercising from a sporting exercise or when learning a musical instrument, without having to resort to a human expert.

Claims (14)

1. Device for checking the posture of a person, with at least one for posture detection, is used for the recording unit, characterized in that an electronic data processing unit is provided which has an expert database ( 22 ) and is used for posture data evaluation ( 20 ) and which is connected to the recording unit ( 14 , 16 , 18 , 28 ) and with a for transmitting at least one attitude-relevant information to the person ( 10 ) the nenden information output unit ( 24 , 26 ) is connected. 2. Device according to claim 1, characterized in that in addition an acoustic recording unit ( 28 ) is provided, which is operatively connected to the data processing unit ( 20 ) for sound data evaluation. 3. Device according to one of the preceding claims, characterized in that the receiving unit ( 14 , 16 , 18 , 28 ) has at least one sensor ( 16 , 18 ) for detecting posture-relevant data. 4. Device according to one of the preceding claims, characterized in that the sensor ( 16 , 18 ) is designed as a pressure sensor ( 16 ) or as an acceleration sensor ( 18 ). 5. Device according to one of the preceding claims, characterized in that the recording unit ( 14 , 16 , 18 , 28 ) has at least one video camera ( 14 ). 6. Device according to one of the preceding claims, characterized in that at least one optical marking element ( 30 ) is provided for fastening to the person ( 10 ). 7. Device according to one of the preceding claims, characterized in that the information output unit ( 24 , 26 ) is formed as a transmitter for optical and / or acoustic and / or tactile signals. 8. Device according to one of the preceding An sayings, characterized in that the acu tical signals are speech signals. 9. Device according to one of the preceding claims, characterized in that the data processing unit ( 20 ) has a data transmission system ( 32 ) and / or a data input system ( 34 ). 10. Device according to one of the preceding An sayings, characterized in that they as a com compact and mobile assembly is formed. 11. A method for checking the posture of a person, in particular by means of a device according to one of the preceding claims, with the following procedural steps:

• - Creation of an expert database ( 22 ) in an electronic data processing unit ( 20 );
• - Determining person-relevant posture data ( 10 ) by means of a recording unit ( 14 , 16 , 18 , 28 );
• - Transferring the posture data to the data processing unit ( 20 ) by means of a data transfer system ( 34 , 36 );
• - Creating at least one posture-relevant information using the data processing unit ( 20 );
• - Transmission of the information to the person ( 10 ) by means of an information output unit ( 24 , 26 ).

12. The method according to any one of the preceding claims, characterized in that the posture data are determined by means of an optical and / or acoustic recording unit ( 14 , 28 ) and / or by means of sensors ( 16 , 18 ). 13. The method according to any one of the preceding claims, characterized in that the determined posture data are analyzed in the data processing unit ( 20 ) for the subsequent derivation of parameters which are compared with data in the expert database ( 22 ) to create at least one posture-relevant information for the Person ( 10 ). 14. The method according to any one of the preceding claims che, characterized in that one on an In formation reaction as a criterion  to assess people and to create a adapted information creation becomes.