WO1995010835A1

WO1995010835A1 - Video control system

Info

Publication number: WO1995010835A1
Application number: PCT/JP1994/001668
Authority: WO
Inventors: Yoshitaka Yaginuma
Original assignee: Mitsubishi Nuclear Fuel Co.
Priority date: 1993-10-08
Filing date: 1994-10-06
Publication date: 1995-04-20
Also published as: JPH07111070A; AU7822194A

Abstract

An inexpensive video control system which has a simple constitution and is suitable for home use. A part of video signals containing a plurality of frames of image information is converted to control data corresponding to operation instructions at timings to be generated, and recorded in a VTR 22. The recorded video signals are reproduced by means of a reproducing device and the control data contained in the video signals are detected by means of a control circuit (33). The circuit (33) supplies the control data to a controlled system (50) and the controlled system (50) operates in harmony with reproduced images or music. The controlled system (50) can be anything as far as they operate in accordance with the control data, for example, a lighting facility, mobile display for exhibition.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video control system suitable for performing various controls in accordance with reproduced images of, for example, a video tape recorder (VTR). BACKGROUND ART Conventionally, there has been known a system for controlling the brightness of lighting, the movement of displays (for example, dolls, etc.), etc., in accordance with reproduced images and music in shows and various events. .

However, such systems are generally large-scale, and the equipment itself is expensive (several million yen) due to the special circumstances of being used for events. DISCLOSURE OF THE INVENTION An object of the present invention is to provide a video control system which is a simple and inexpensive system and suitable for home use.

Therefore, in the first invention, the replacement means replaces a part of the video signal including image information of a plurality of frames with the control data corresponding to the event command at the timing to be generated. and recording means for recording the video signal replaced by the replacing means. According to this invention, the control data corresponding to the event command can be replaced with a part of the video signal at the timing to be generated and recorded. It becomes possible to use video equipment for Therefore, this invention can be implemented at low cost and in a simple manner with minimal addition. can be configured to

A second invention is characterized in that, in the first invention, the control data is a control command to a controlled object that operates in synchronization with the reproduction progress state of the video signal, This makes it possible to record in the video signal the control data for causing the object to be controlled to operate in harmony with the progress of reproduction.

In the third invention, a detection means for detecting predetermined control data from a video signal including image information of a plurality of frames, and when the control data is detected by the detection means, the control data is detected. and extracting means for extracting and outputting data from the video signal. According to the present invention, a video signal partly replaced with control data can be output at the timing to be generated.

As with invention 1, it is possible to use conventional home video equipment. Therefore, the present invention can be constructed inexpensively and simply with a minimum addition. A fourth invention is based on the third invention, further comprising means for sequentially sampling and holding the image signals of a plurality of frames, and when the control data is detected by the detection means, holding is performed in the video signal before the detection. It is characterized by loading and outputting. As a result, the video signal corresponding to the recording position of the control data is not output and is held immediately before the detection of the control data, so that the display can be prevented from being suddenly disturbed based on the video signal of the control data. can be eliminated.

A fifth invention is characterized in that, in the third invention, the control data is a control command to a controlled object that operates in synchronization with the reproduction progress state of the video signal, Therefore, it is possible to extract from the video signal the control data that causes the object to be controlled to act in harmony with the progress of the reproduction.

A sixth invention is based on the fifth invention, comprising display means for displaying a display based on the video signal from which the control data has been extracted by the extraction means, detecting the behavior of a person viewing the display by the display means, action detection means for outputting data corresponding to the action; storage means for pre-storing data corresponding to the action to be performed; and data stored by the storage means is read out and output by the action detection means. It is characterized by comprising comparing means for comparing with data, and notifying means for notifying to that effect when the comparison by the comparing means indicates disagreement. As a result, the display means If the person viewing the display does not take appropriate action in response to the playback progress, it is possible to notify that fact.

A seventh invention is characterized in that, in the sixth invention, reading control of the video signal including the image information of the plurality of frames is performed based on the data output by the action detection means, This makes it possible to cue to the image information to be shifted to next and to control the playback state in accordance with the behavior of the viewer. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1(a) is a block diagram showing the configuration of a recording device in a video control system of one embodiment according to the present invention, and FIG. 1(b) is a playback device in the same embodiment. FIG. 2 is a block diagram showing the configuration of;

FIG. 2 is a block diagram showing an example of a playback device of the video control system according to the invention.

FIG. 3 is a block diagram showing the configuration when the playback device of the video control system according to the present invention is used as a simulator. BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1(a) is a block diagram showing the configuration of a recording device 10 in a video control system according to the present invention.

In this figure, 11 is an input terminal for inputting a video signal (for example, based on the NTSC color system) reproduced by VTR21. The video signal supplied to this input terminal 11 is displayed on the monitor 23 for confirmation by the operator, converted into a digital signal by an A/D converter (not shown), and stored in the memory 12. It is designed to be written sequentially at a predetermined timing.

Reference numeral 13 denotes a control circuit, which includes a CPU (Central Processing Unit), a R0M that stores a program for controlling the operation of the CPU, etc., and a memory 12. It controls the dressing, data transfer and replacement, and also controls the input/output of the FDD (Floppy Disk Drive) 14 and keyboard 15. Here, the replacement means of the present application is composed of the memory 12 and the control circuit 13 .

The FDD 14 stores a data file in which control data instructing the operation of a controlled object (to be described later) is filed. It is designed to be read as appropriate by operation.

The data read out from the memory 12 is reconverted into a video signal by a DZA converter (not shown) and recorded as, for example, a cassette videotape by the VTR 22. Here, VTRs 21 and 22 are of the type commonly used at home.

The data file is not limited to the FDD14, but can be configured and supplied from a hard disk or from an external device via an interface (eg RS-232C). You can '

Next, the configuration of the playback device 30 in the video control system according to the present invention will be described with reference to FIG.

In this figure, 31 is an input terminal for inputting a video signal reproduced by a normal VTR (not shown). Here, this video signal is a signal recorded by a VTR22.

A video signal supplied to the input terminal 31 is converted into a digital signal by an A/D conversion section (not shown) and sequentially written into the memory 32 at a predetermined timing. ing.

33 is a control circuit, which consists of a CPU and a ROM for storing programs and the like for controlling the operation of this CPU. It controls the detection of whether or not this memory is addressed, the transfer and replacement of data, and so on. 34 is an FDD for pre-storing files to be described later. The data read out from the memory 32 is reconverted into a video signal by a D/A conversion section (not shown) and displayed on the monitor 42 . This monitor 42, for example, a projector, a CRT, or the like, is selected according to the state of use.

On the other hand, 50 is a controlled object that performs various operations in response to control data. child In this application, for example, the following is assumed as the controlled object 50 of

① Display

Exhibit displays used in shows and other events, more specifically, those with various movable mechanisms such as dolls and models. In order to raise the attention of the audience, it is desirable to be able to perform fine movements.

② Surrounding indoor environment

Lighting brightness 'color, mirror ball rotation speed' direction, etc. It mainly changes the atmosphere of the surrounding environment.

③ Simulator

For driving lessons, simulation training for emergencies, nuclear reactor operation, etc.

In other words, the object to be controlled 50 may be any object that performs some action in accordance with a reproduced image (or music), or any object that requires some action. It should be noted that in this case, it may be regarded not as the controlled object 50 but as the entire playback device (described later).

Next, the operation of the embodiment configured as described above will be described.

First, the operation of the recording device 10 shown in FIG. 1(a) will be described.

In the recording device 10, the video signal supplied to the input terminal 11 is converted into a digital signal, then sequentially written to the memory 12, read out after a predetermined time has passed, and converted into an analog signal. Recorded by VTR 2 2 after being reconverted to the mouth signal

By operating the keyboard 15, the operator reads a desired data file from the FDD 14, stores it in the control circuit 13, and supplies it to the input terminal 11. While checking the display based on the video signal to be displayed on the monitor 23, it waits for the timing at which the controlled object 50 should operate. Then, when this timing is reached, the operator performs a key input operation indicating that. By this operation, the recording device 10 performs the following operations.

That is, in the image corresponding to the timing at which the controlled object 50 should operate, the portion corresponding to the first field and first horizontal line has an identification indicating the write head of the control data. A mark is written. ' Subsequently, data indicating the content of the control data to be written next is written in the third and fifth horizontal lines of the first field of this image. This data includes, for example, parity for error correction code, data for interpreting the control data to be written, and data indicating the format of the control data to be written. Also, it may be the control data itself.

The control data are sequentially written in the portions corresponding to the subsequent odd horizontal lines in the first field.

More preferably, the even horizontal lines of the second field of this image should be written with exactly the same data as in the first field. This means that noise resistance is enhanced by writing data using multiple fields.

Then, an identification mark indicating that fact is written in the last part where the control data is written. '

In this embodiment, the control data is written in the horizontal line, but in the present invention, the writing position of the control data is not limited to a specific position. For example, control data may be written on vertical lines, or on specific lines at predetermined intervals, such as the first, eleventh, second, third, and third lines. ……A horizontal line is also acceptable. Although the write density of the control data is sparse in a configuration in which lines are written at predetermined intervals, there is the advantage that when this recording tape is played back on a normal VTR, the degradation of the playback image is small. .

Further, if the identification mark can be reliably detected on the playback device side, which will be described later, the identification mark indicating the beginning of writing is not limited to the first horizontal line. It is also possible to detect the least conspicuous portion of the image corresponding to the ring and write in this portion.

In this way, the video signal whose horizontal line has been partially rewritten is reconverted to an analog signal and recorded by the VTR22.

According to this recording device 10, the control data for causing the controlled object to perform an action suitable for the image (music) of the video signal is recorded by replacing a part of the video signal. A video signal of an image and control data are recorded in the video signal recorded in this manner. The control data is extracted from the video signal and output by the playback device shown in Fig. 1(b). .

Therefore, next, the operation of this playback device 30 will be described.

In the playback device 30, the video signal supplied to the input terminal 31 is converted into a digital signal and then sequentially written to the memory 32.

Here, the control circuit 33 detects whether or not there is an identification mark indicating the write head of the control data in the video signals sequentially stored in the memory 32 . If the control circuit 33 does not detect the existence of the identification mark, it sequentially reads out the video signals written in the memory 32, reconverts them into analog video signals, and outputs them. As a result, the read video signal is displayed on the monitor 42 based on this video signal.

On the other hand, when the control circuit 33 detects the presence of the identification mark, it temporarily stops reading from the memory 32 at the image immediately preceding the image in which the identification mark is written. Next, the control circuit 33 extracts data indicating the content of the control data following the identification mark and control data from the video signal.

Next, the control circuit 33 supplies the control data to the controlled object 50 (correcting the control data from the data indicating the content of control, if necessary). Then, when the identification mark indicating the end of writing of the control data is detected, reading from the memory 32 is restarted from the image next to the image in which the identification mark is written.

As a result, the display on the monitor 42 remains the image immediately before the image of the identification mark indicating the write start of the control data until the identification mark indicating the write end of the control data is detected. pause for a moment. In other words, an image in which control data is written is not output. This is because if the image is output as it is, the line corresponding to the rewritten portion will be disturbed, which may make the viewer feel uncomfortable.

In this case, if the effect is small, the video signal may not be output only during the reproduction period of the signal in which the control data is written, instead of the screen being paused. Now, the controlled object 50 operates based on the control data extracted by the control circuit 33.

For example, if the controlled object 50 is an exhibition display, the operation is performed in accordance with the tone and tempo of the reproduced image or music. This can increase the attention of the audience.

In addition, the brightness and the color of the illumination light change according to the stage where the controlled object 50 is the lighting equipment of the indoor environment, the reproduced image and the tone and tempo of the music. As a result, it is extremely suitable for making music such as karaoke.

Thus, the control circuit 33 detects the identification mark in the memory 32 while the video signal is being supplied to the input terminal 31, and detects the identification mark indicating the write start of the control data. This operation is repeated every time. The output video signal is displayed as an image on the monitor 42, while the operation of the controlled object 50 is controlled based on the control data extracted from the video signal.

Therefore, according to this playback device 30, the operation of the controlled object 50 is performed appropriately for the video on the monitor 42, that is, the playback image.

In addition, as the VTR used in the recording device 10 and the reproducing device 30, a home-use one that has been widely used in the past can be used. Since a general-purpose computer such as a personal computer can be used, this video control system can be configured simply and inexpensively.

In addition, in order to prevent the video signal stored in the VTR 22 from being reproduced and output without going through the control data extraction mechanism, some measures, for example, control data writing during recording of the control data should be taken. It is desirable to take measures in advance such as inserting a signal to indicate this and notifying the operator to that effect to prevent trouble. Furthermore, it is better to write control data in a format that takes this into consideration. In the above-described embodiment, the recording device and the reproducing device are configured separately for the sake of explanation, but they may be shared. In this case, the control to be performed by the control circuit during recording and reproduction can be done by reading programs corresponding to each. · In addition, as a playback device, as shown in FIG. 2, the configuration shown in FIG. Also good.

Next, with reference to FIG. 3, an example of a configuration in which the playback device of this embodiment is incorporated in the simulator 70 will be described.

1 and the playback device shown in FIG. The control circuit 33 controls the readout of the device 61, and the data is supplied from the controlled object 50 to the control circuit 33. The same parts in this figure and FIG. 1(b) are given the same reference numerals, and the description thereof is omitted.

In addition, the FDD 34 stores the teacher signal that indicates the correct response after converting it to o

The disk reproducer 61 is a magneto-optical disk reproducer capable of random access and having high access speed. This magneto-optical disk records a video signal of a training image, and a part of it is replaced with the aforementioned control data by the recording device shown in FIG. 1(a).

In this case, the control data is data that instructs the controlled object 50 to perform an action that enhances the atmosphere of the training video.

In addition, the controlled object 50 detects the action of the learner and supplies this detection signal to the control circuit 33. Based on this detection signal, the control circuit 33 controls the reading (for example, access, playback speed, etc.) of the disc reproducer 61, and displays the training video according to the behavior of the learner. At the same time, this detection signal is compared with the teacher signal stored in the FDD 34 to determine whether the learner's action is right, wrong, or appropriate, and based on the result of that determination, the disc is played. It performs the cue interrupt reproduction control in the device 61. Furthermore, the control circuit 33 creates a display screen of the judgment result and superimposes it on the training video to notify the trainee of the correctness or appropriateness of the action.

It is assumed that the control circuit 33 reads data corresponding to cueing to the disc player 61 from the FDD 34.

According to this configuration, a training video is displayed on the monitor 42, and the trainee can watch this video. Take some action while watching. A detection signal corresponding to this action is supplied to the control circuit 33 by the controlled object 50 .

Then, the control circuit 33 compares the detection signal with a teacher signal indicating an original correct response to determine whether or not the behavior of the learner is correct with respect to the reproduced image. It is possible to determine whether or not Furthermore, by controlling the readout of the disc player 61, it is possible to cue to the next training video according to the behavior of the learner and to adjust the playback speed according to the behavior of the learner. It is possible to display training videos with

As a result, for example, when the simulator is used for driving training, if the trainee makes an excessive steering operation, the screen showing the accident is cueed and the image is displayed. It is also possible to display a training video at a playback speed corresponding to the degree of opening of the accelerator of the trainee.

Claims

The scope of the claims

1. replacement means for replacing a part of a video signal containing image information of multiple frames with control data corresponding to an event command at the timing to be generated; and recording means for recording video signals.

2. The video control system ₀ according to claim 1, wherein the control data is a control command for a controlled object that operates in synchronization with the reproduction progress state of the video signal.

3. detection means for detecting predetermined control data from a video signal containing image information of multiple frames;

an extracting means for extracting and outputting the control data from the video signal when the control data is detected by the detecting means;

A video control system characterized by comprising:

4. Means for sequentially sampling and holding image signals of a plurality of frames is provided, and when the control data is detected by the detection means, the video signal before the detection is held and output. 4. The video control system of claim 3, wherein:

5. The video control system according to claim 3, wherein the control data is a control command for a controlled object that operates in synchronization with the progress of reproduction of the video signal.

6. display means for displaying based on the video signal from which the control data is extracted by the extraction means;

an action detection means for detecting actions of a person viewing the display by the display means and outputting data corresponding to the actions;

a storage means for pre-storing data corresponding to an action that should be performed;

a comparison means for reading data stored by the storage means and comparing the data with the data output by the behavior detection means;

6. The video control system according to claim 5, further comprising notifying means for notifying that if the comparison by the comparing means indicates a mismatch.

7. The video control according to claim 6, wherein readout control of the video signal containing the image information of the plurality of frames is performed based on the data output by the action detection means. system.