CA1295046C - Method for providing an interactive full motion synched compatible audio-visual television display - Google Patents

Abstract

ABSTRACT OF DISCLOSURE
A method for providing a full motion synched compatible audio/visual interactive television display from a plurality of syllable synched compatible audio choices for a common full motion video frame presentation. Two or more audio channels are synched to a common video channel by first recording the most likely branch and then rerecording the audio portions for the alternate branches by syllable synching the alternate branch choices to the original video presentation so as to make the video compatible with all audio channels. Animated characters, such as puppets, cartoon animations or humans, are used in the video with the audio being synched to the mouth movements of such an animated character so that all branches appear to be visually the same. The same techniques can be used to convert appropriate preexisting non-interactive programming into interactive programming.

Description

~;295;046 Titl~: METHOD ~OR PROVIDING ~N INTERACTIVE FULL
MOTION SYMC~D CO~PATI~LE AUDIO/VISUAL
TELEVISION DISPLAY __ Inventor: Michael J. Freeman CROSS-REFERENCE TO RELATED APPLICATIONS
This application is related to the commonly owned copending Canadian patent application Ser. Nos. 564,491 and 553,765 o~ applicant herein entitled "Interactive Television System For Providing Full Motion Synched Compatible Audio/Visual Displays," and "Interactive Television System for Providing Full Motion Synched Compatible Audio/Visual Displays From Transmitted Television Signals," respectively, filed April 19, 1988 and December 8, 1987, r~spectively.

Technical Fi~l~
Th~ present lnvention xelate to interactive television syste~s and particularly to a method Sor providing an int~ractive ~ull mo~lon synched compatlble audio/visual tel~vision display presentation based on dynamic user selection o~ a plurallty of syllable synched co~patible audio choices for a common full motion, video frame press~tation in a ~ultiple video fra~e com~on full motion video display provided over a common televi5ion channel.

5~i~6 ackground Art Real time conversational studPnt response teaching apparatus are ~nown, such as described in U.S. Patent Nos.
3,947,972 and 4,078,316. In addition, multiple choice student response systems are well known such as exemplified by the systems disclosed in U.S. Patent Nos. 2,921,385; 3,020,360;

2,826,828, 3,623,238; 3,546,791; 3,273,260; 3,665,615;

3,245,147; 3,28~,923; 3,538,621; 3,477,144; 3,708,~91;
3,235,536; 2,777,901; 2,90~,767; 3,774,316; 3,194,895;
3,484,950, 3,343,280; and 3,763,577, by way of example. NonP
of these systems, however, has been employed in connection with an int~ractive television system in which there is dynamic user selection of a plurality o~ synched compatible audio presentations for a common ~ull motion video presentation for providing a common ~ull motion multipla video frame television display over a common television channel, nor in such an interactive system in which a plurality of recipients of the common television channel ~ay independently select different syllable synched compatlble audio presentations for the co~mon full motion video presentation to provide different interactive full motion audio/visual television displays. Moreover, although prior art subscription cable television systems are well known in which a plurality o~ unrelated television programs, under control of a computer, are transmitted over a common television channel for selection by individual sub~crlber~, such a~ dlsclosed in U.S. Patent Nos. 3,814,891 and 3,759~2Z5, ~uch syst~ms are also not interactive television systems capable of providing dynamic user selection of a plurality of syllable synched compatible audio pre~entations for a common ull ~otion video presentation so as to provide a common ~ull motlon multiple video frame t~levision display over a common television channel. Similarly, although interactive teleYision systems per se are known, such as described in applicant's prior U.S. Patent Nos. 4,264,925; 4,264,924;

4,507,680 and 4,573,072, and in U.S. Patent Nos. 4,305,131 and 4,331,974 by way of example, none o~ these interactive televi~ion systems employs the a~orementioned dynamic user s~l~ction o~ syllable synched compatible audio ~ignal~ ~or a common video channel to provide a ~ull motlon audio/vl~ual tel~vision display. This ~g 80 despite the prior art usa of multipl~ audio signals in connection with a television picture, such as disclo~ed in U.S. Patent No~. 2,612,553; 3,245,157;
4,555,730; 3,221,098; 4,665,~31; 3,~40,342; 3,860,745;
3,387,084; such a~ for providing Gtereo~ such a~ disclosed in U.S. Patent Nos. 4,646,150; 4,603,349 an~ 4,621,282: or the prior art u8e of program substltution, such as disclosed in U.S. Patent No. 3,366,731.
9y utili~ing applicant's unique system and method, however, interactive television may not only bs provided using conventional videotape equipmant or conventional broadcast or cable televlsion~ but previously recorded non-interactive movie~ or t~levision programs can readily be rerecorded to provide an interactive television program. These advantages are not believed to be present in the prior art known to applicant.
DISCLOSURE OF T~IE XNVENTION
The present invention relates to a method for providing an interactive full motion synched compatibl~ audio/visual television display presentation based on dynamic user selection of a plurality of choices for a multiple video frame common full motion television display. The television system includes means, such a~ a conventional VCR or video disc, for providing a common full motion multiple video frame audio/visual televi~ion di~play comprising a common interrogatory message and a plurality of user selectable choices related to the common interrogatory message, and a plurality of syllable synched user selectable audio pre~entatlons corresponding to the user seleatable common interrogatory message related cho~ C~8 and which are compatible with a subsequent common full motion video frame subsequent to the co~mo~ interrogatory me6sag~ containing video rrame. The audio presentations comprise re6ponfiive messages to the common interrogatory m~3sage and have a different word content but, substantially ldentical syllabIe content portions for providlng a plurality of dynamic user selectable 6ynched dif~erent rssponsive audio ~2$3~6 messages to the prevlous video frame common interrogatory message in the common full motion television display. Thus, two or more audio channels are synched to a common video channel in providing the full motion interactive television display over the common television channel. The audio may be provided a~ a multiplexed signal multiplexed into the video signal or ~ultiplexed into an existing aud~o channel or may be a stereo type signal. In addition to providing such an interactive program for a slngle user from a ~torage media, such a~ a video cass2tte or video disc, the progra~ may be broadcast or sent over cable television to a plurality of users who may then independently dynamically make their own choic~e of the audio/visual televi~ion di~play to be provided~ The dynamic selection may employ a plurality o~ ~21eators, ~uch as button~, which are actually greater in number than the number of provided audio choices,whereby greater flexibility is provided. For example, one or two or more of the buttons can refer to a generically wrong answer while only one o~ the buttons can refar to a specific right answer. These buttons and combinat~ons o~ buttons can vary with each question.
In recording the interactive televislon programming to be provided, the method employed involves recording a first choice audio/viaual television presentation, such as the most likely or correct one o~ a plurality of audlo channel choices, and then subsequently recording the second and other subsequent ~9~ 6 usor sQlectable audio choice~ over tha ~irst choic~ on all but one of th~ other audio channels by sylla~le synching these subsequent audio choices to the first recsrded choice, such as by changing only certain Xey words in the subse~uen responsive messages being recorded. The recordad audio in each instance is syllable synched and compatible with the mouth movements of an animated character, such as a puppet or ~uman or cartoon animation, in the common video scene in which the audio responsive message will be provided in a full motion audio/visual television display. Side ~hot~, cut aways, reaction shots atc., may also be used to provide the compatible syllable synched televislon di~play. Previously recordecl tslevision programs or movies can also be used as a sourcQ for interactivs programming by selecting scenes ~rom these shows lending themselves to syllable synching of dlfferent choices and rerecording these program~ to insert the lnteractive audio portions of the programming.

In a preferred embodiment there is provided a methocl for providing an interactive full motion synched compatible audio/visual television display presentation based on dynamic user selection of a plurality oP choices for a multiple video frame common full motion television display comprising the steps of recording a first choice audio/visual television display presentation comprising said multiple video frame common full motion television display, said recorded common full motion television display comprising a plurality of synched successive video frames, at least one of said ~295~6 successive video ~rames comprising a common interrogatory message and a plurality of simultaneously providable user selectable choices related to said common interrogatory message, said recorded first choice audio/visual television display presentation comprising a user selectable audio presentation corresponding to a single one of said user selectable common interrogatory related choices and being synched to and compatible with a subsequent common full motion video frame video presentation in said common full motion television display subsequent to said common interrogatory message containing video frame, said recorded single audio presentat.ion first choice comprising a first user selectable responsive output messa~e to said common interrogatory message and having a particular word content and syllable content portion for providing a recorded simultaneously providable dynamic user selectable synched responsive audio output message to said recorded previous video frame common interrogatory message in said recorded common full motion television display; and subsequently recording a second choice simultaneously providable user selectable audio output presentation corresponding to a different single one of said user selectable common interrogatory related choices and synched to and compatible with the same subsequent common full motion video frame presentation as said simultaneously providable previously recorded first choice user selectable audio output presentation in said previously recorded common full motion television display, said simultaneously providable subsequently recorded second choice user selectable audio -6a- :

output presentatlon comprising a second user selectable responsive output messAge to said common interrogatory message and having a different particular word content but substantially identical syllable content to said previously recorded simultaneously providable first choice user selectable audio output presentation portion for providing a different recorded dynamic us~r selectable responsive audio output message syllable synched to said first choice recorded dynamic user selectable responsive audio output message a.nd compatible with said previously recorded subsequent common full motion video frame video presentation in said recorded common full motion television display subsequent to said recorded common interrogatory message containing frame;
whereby a recording capable of providing said user selectable interactive audio/visual ~ull motion television display over a common television channel is provided.

BRIEF DESCRIPTION OF DRAWINGS
FIG.l is a block diagram of a VCR based television system in accordance with the present invention in which two or more audio channel~ are multiplexed into the video line;
FIG.2 i8 a block diagram, ~imilar to FIG.}, in which two or mora audio channels are multiplexed into the existing audio channel;
FIG.3 is a block diagram 6imilar to FIG.l in which the -6b-,, ~

~ 2~46 televislon signal i~ taken off the air, with a VC~ front-end and the r~celved audio multiplexed into the received video signal;
FIG.4 is a block diagram similar to FI~.2 in which the television signal ls taken off the air, with a VCR front-end and the received audio multiplexed into the existing audi.o channel;
FIG.5 i~ a block diagram sim$1ar to FI&.l in which the television signal is taken off the air with a simplified TV
front-end and the received audio ~ultiplexed ~nto the received video line; and FIG.6 i~ a block diagram similar to FIG.2 ln which the televislon signal is taken of~ the air with a simplified TV
~ront-end and the rqceived audlo multiplexed into the existing audio channel.
BEST MODE FOR CARRYING OUT THE INVENTION
Referring now to the drawings in detail, the present invention is a system and method for providing interactive televl~lon by using conventional video recording equipment or conventional broadcast or cable television. FIGS. l and 2 show int~ractive tolevision systems in accordance with the present invention in which a conventional VCR by way of example, is used as the source of the interactive programming in accordance with th~ present invention, and FIGS. 3-6 show interactive systems in which a conventional broadcast or cable television ls used a~ the source of the interactlve progra~ming in accordance wlth the present invention. Basically, as will be described in greater detail hereinafter, the interacti~e programming of the present invention is provicled by synching two or more audio channels to a common video c:hannel, with the video and audio belng carefully programmed so that the video is compatible with all audio channels. The audio channels each contain syllable synched portions or interactive branches so as to provide dif~erent syllable ~ynched responsive messages to a common interrogatory message video presentation using a co~mon video presentation containing animated character mouth movements with whlch the different syllable synchad audio portions are compatible. In this manner, from the viewerls point o~ view, kha televi~ion programming appears totally interactive in providing a full motion audio/visual television presentation.
Di~ferent approaches ~or providing the interactive programming o~ the present invention will be described with reference to FIGS. 1-6. In each of these approaches, preferably dynamic user #election is provided such as by using a plurality o~ selector buttons, or a ~oystick by way of example, in which each button or ~elector can be dynamically assigned to any audio track for each question or interrogatory me~sage during the interactive programming presentation. For exa~ple, i~ there were three button selectors and two audio ~2~
tracks or channels, for a given question, by way of example, channel 1 could be assigned to button 1 and channel 2 could be assigned to both buttons 2 and 3. Thus, i~ the user selected button 2 or 3 in this example he would hear what is on audio channel 2. Similarly, in such a three button, two channel arrangement, buttons 1 and 2 could be dynamically assigned to audio channel 1 and button 3 to audio channel 2 for a given guestion, or buttons 1 and 3 could be assigned to audio channel 2 and button 2 to audio channel 1 for a given question. Such an arrangement in which dynamic user or button selection i~
provided pr~vides greater variability of the questions and answer~ and enables a more efficient use of the audio channels.
Re~Qrring now to FIG. 1, an int2ractive television system 10 in accordance with the pr~sent invention i8 shown in which the preferr~d interactive programmlng is stored on a conventional video cassette 12 or video disc or other storage media, and two or more audio channels containing the presently preferred syllable synched audio signals are conventionally multiplexQd into the video line. Any conventional technique ~or multiplexing the audio into the video line may be employed such as pulse amplitude modulation pulse duration or pulse code modulation or digitizing. In the pulse amplitude modulation approach, a ~ample of the audio channel is inserted into either the front porch area, the back porch area, both areas, or into the act~ve portion of the video line. In the pulse duration modulation approach, a pulse, whose duration is proportional to the signal ak sampling time, is inserted into the Pront porch, back porch or active vldeo portions of the video line. In the digitizing or pulse code modulation approach, the audio i5 digitized and the coded sample is then placed into th~ front porch and back porch area and/or the active portion Qf the video line. In the example of FIG. 1, the interactive program with the encoded audio is played back through a conventional VCR 12, into the control module 14. The control module 14 contains a conventional demultiplexer 16 which conventionally extracts the presently preferred audio signal ~rom the video signal and provides it to a conventional analoq switch 18v The video passe~ through to a conventional ~F modulator 20 with the signal al80 being passed to a video line command separator 22, to be d2scribed in greater detail hereina~ter, which, together with computer 24 and the dynamic choice selector 26, determine the selected user audio choice to be combined with th~ video in RF modulator 20 to provide the presently preferred interactive full motion audio/visual television display. The selected audio channel as well as the video provided from the VCR 12 are preferably conventionally up modulated to, for example, channel 3 or 4, by RF modulator 20, with the interac~ive programming then being di~played or viewed on a conventional televislon receiver (not shown). By putting the presently pre~erred audio track~ into the video portion of the signal in the embodiment of FIG. 1, a Yiewer who docs not have a control module 14 to decode the presently preferred audio signal would be able to hear a di~ferent non-in eractive audio channel, such as one provided via the regular audio signal.
Referring now to FIG. 2, the system lOa is basically the same as the interactive television system 10 previously described with reference to FIG. 1, with li~e reference numerals being used for like ~unctioning components, with the exception that in this instance the two or more presently preferred audio channels containing the preferred syllable synched compatible audio signals are multiplexed into the existing audio channel, or placed in available channels i~ the VCR 12a i~ a conventlonal ~tereo VCR. Thu~, the conventional demultiplexer 16a in control module 14a conventionally demultiplexes the audio channel and provides the demultiplixed signal to the convent~onal analog switch 18 with the v~deo ~till being passe~ to the conventional RF modulator 20 along with the selacted audio from switch 18. The balance of the operation is the ~ame as previously described with respect to FI~. 1.
Re~erring now to FIG. 3, the operatlon of the interactive television system lOb i8 preferably identical to that prsviously described with reference to FIG. 1 with the exception that the source of the presently preferred interactive television program~ing is a conventional television ~2~ 6 type broadcast or cable televislon transmission over the air in which the presently preferred audio signals have been multiplexed into the video signal at the head end and transmitted in this format, with the conventional VCR 12 being used as a tuner for the television signal received via the conventional TV antenna or cable 28. Prefera,bly~ in the embodiment of FIG. 3, audio on the normal tel~evision audio channel is chosen to be compatibie with the video so as to permit viewers who do not own a VCR 12 or have a control module 14 to watch and listen to the program in a non-interactive manner.
Re~erring now to FIG. 4, the operation o~ the lnteractive televi~ion system lOc i~ pre~erably identical to that previou31y dc~cribed with re~erence to FIG. 2 with the excQption that the source o~ thQ presently preferred interactiYe television programming i8 a conventional television type broadcast or cable television transmission over the air in which the pre6ently pre~erred audio signals have been multiplexed into the existing audio channel, or placed in available channela lf ~ t i5 a stereo broadcast, at the head end and transmltted in thi~ format, with the conventional VCR 12a being u~ed as a tuner for the television signal received via the conventional rv antenna or cable 28. In this instance, however, as contrasted with the embodiment of FIG. 3, since the exis~ing audio channel ~or channels for stereo) has already been utilized, non-interactive programming cannot be available at the same time.

Refsrring now to FIG. 5, the operation of the interactive televiYiOn syBtem lOd is preferably identical to that prPviously described with reference to FIGo 3 with the exception that the conventional VCR 12 is replaced with a conventional simplified TV front end tuner 30 which functions in the same manner as the VCR 12 tuner to receive the transmitted television signal and provide it to the control module 14. As with respect to the e~bodiment ~f FIG. 3, non-interactive television programming can also be provided in the same manner as accomplished in FIG. 3.
Raferring now to FIG. 6, the operation o~ the interactive television sy6tem lOe is pre~erably identical to that previously deAcribed with reference to FIG. 4 with the ~xception that the con~entional VCR 12a is replaced by th2 previou~ly mentioned conventional ~implified TV ~ront-ond tuner 30 which functions Ln the same manner a~ the VCR 12a tuner to receive the transmitted television signal and provide it to the control module 14a. Because the existing audio channel or channels ar~ used, however, a~ was the case with the embodiment of FIG. 4, non-interactive television programming cannot be provided at the 6ame time.
With respact to the video line command ~eparator 22 present in ~ach o~ the embodi~ents of FIGS. 1-6, this circuit i8 conventional and conventionally extracts one line, such as a line in the range of between line 15 and 22, from the video stream, and extracts the serial data contained therein ~or processing by thQ computer 24, which is preferably a convention~l 4 bit microprocessor having about 64 bytes of RAM
and 2K bytes ef ROM, and which conventionally interprets the com~andq extracted by the video line command separator 22 and the dynamic user selected choices indicated by conventional choice selector 26, which may be a hard wired or wireless link to computer 24, and then conventionally operate~ analog switch 18 to provide the selected audio signal to the RF modulator 20. By way of example, the serial data encoded commands enable the microprocessor 24 to conventionally accomplish the followlng task~ or functions: read entry, go to channel de~ined by last entry, i~ entry i8 ~IXl~ then make entry "y", i~ entry i~
"x" then make entry "y" and go to that channel, store entry at memory "z" go to channel defined by memory "z", other TBD. 0~
course, although the commands are described, by way of example, as being encoded into the video, they may instead be conventionally encoded into the audio if desired.
~ lthough various conventional techniques for multiplexing tho audio channels containing the presently preferred syllable synched audio ~ignals have been described, others may o~ course be utillzed, such as the use of two channels associated with conventlonal stereo video cassette recorders or the use o~ two channel~ associated with a conventional stereo broadcast.

Now that various systems 10-lOe have been described for providing the presently preferred interactlve television programming, the presently preferred method of recording such programming so as to enable such interactive progra~ming to occur sha}l be described. Assuming the interactive progra~ is to be recorded live for the first time rather than rerecording a previous non-interactive movie or television show ~o make it interactlve, the video is recorded preferably along with the most likely (or correct choice) portion of th~e audio first.
Assuming the VCR is a conventional "video tape or 3/4" video tape machine with two audio channels, this audio portion is preferably recorded on both channels. During the recording, an in~tant o~ ~ilence ~hould be provlded before and after each branch. ~fter the ~irst recording of the program, the alternate branch or choice should be recorded on the appropriate audio track which will erase or record over the ~lrst alternate on that track and replace lk with the second such as in the following example:
1. "Hello my friend, I see you answered true. It'~ a ~act that...
2. ~'Hello my friend, I see you answered false."
In th~ ~bove example, only the word "true" i8 actually recorded over the first branch choice on the second branch audio channel. Of course, as previously mentioned, a substantially identical syllable count i~ needed for the second `r choice if any type o~ mouth movement i8 seen in the corresponding video so that both choices appear to be visually the same. Xn order to do this, the actor who recorded the first choice in the original program should view the replayed video on a studio monitor, for example, and wear headphones in order to hear what was originally recordedO The actor then resay~ the same line but changes the branch word or phrase while watching the video, such as the phrase "a boy'l in the above example. Watching the video will make it easier to sync-up the voice. The actor preferably says the whole line again even though only the branch di~ference actually gets recorded over the previously recorded firat choice on the second branch audio channel. By doing thls, it pre~erably a~ures that proper pacing and naturalne3s o~ voice i~
achieved. The actor ~hould preferably be ln the ~ame position as when the original or ~irst branch was recorded and the microphone should be similarly positioned. Thi~ will prevent the tone and timbre of the voice from sounding different.
Proferably, the wearing of headphones by the actor insures that no leaking of sound from the branch that was shot ~irst is recorded onto tbe alternate branch. By simply playing back either o~ the two audio tracks while watching the video, one can hear and see i~ the desired result has been achieved. If not, the alternate branch may be rerecorded again. Thi~ same approach can be used in recording compatible aud~o to go with .

.

previously recorded movies or television proyrams that lend themselve to audlo synchlng with the video poxtions of those program~. In this regard, whethsr original programming or preexisting programming, certain types of animated characters lend themselve6 to being programming characters to which the audio synching technique can be readily appli~ed. These characters, by way of example, are puppets, talking animals, animation, voice over segments, people, robots, etc. With respect to people, side shots, moving shots, or wide shots generally work best, as does group singing.
By utilizing a microprocessor 24 in the control module 14, 14a, it can, ir desired, not allow changes o~ channQls except when de3ired, such as from thQ moment the previou~
branch ended until a ~oment be~ore the current branch takes place, it can maintain memory on a branch selectlon, suoh as remember~ng a prev~ous answer and causing it to be sub~equently repeated as many time~ as desired, it can maintain memory on a button ~election, it can do logic operations, and it can allow many branches, one right after the other, to create large combinations o~ output. It can blank out all video and audio i~ certain requirements are not met (such as receiving less than 80 point~ on a test or getting less than 6 out of 7 clues correct). U6ers who axceed these limits could get to see additional programming, such as payoff6, rewards, or more material, or the sy~tem could give remedial instruction to ~51~6 those who need it while the other group sees the end o~ the program ~ooner (unbeknown to them). The additional material can be int~ractive in effect providing a real video branch.
But no matter how flexible the microprocessor 24 is, it is still the creation of the script for the interactive program that is important. Parts that are generic must work for both po:rtions of the branch whereas the branches themselves must preferably be as specific as possiblP. An example of such a script is given below ~or two audio channels.

EXAMP~E OF A SCRIPT

POLLY: Hello, I'm Polly the Parrot ~a puppet~, and this is my sidekick, Pro~essor Bumpers (a person~. We would like to ask you 3 questions today. First --are you a boy, or a girl? Press the top button if you're a boy, or the bo~tom button if you're a girl! Oh, I an see that you're a boy. a airl.

3UMPERS: Well, how nice to meet youl May I ask a question now, Polly?

POL~Y: Sure -- go right ahead!

BUMPERS: Here are 2 nu~bers: 18 and 9. If you want Polly to subtract ~hem press the middle button; or if you want Polly to multiply them, press the bottom button. Go ahead -- press one.

:: :

~19--:

I ~ubtract ~hem and I multiply and get coms up with the answer one-hundred-sixty-two.
nine. (Note: this ~ (Note: this answer answer consists-of 12 also consists of 12 syllables.) syllables in order to enable the puppet's mouth movements to match both channels of audio.) BU~PERS: You do great math, Pollyl POLLY: Thanks. Why don~t you ask him or her ~referring to the camera~ another question,. Pro~essor Bu~per~? (NOTE: Polly's reference to the child's 6ex i5 a memory branch, meaning that the child's sex was recalled from memory.) : BUMPERS: I~d love to. Which is the only animal that can make no sound? Here are three choices:
a) giraffe b) rhlnoceros : c) elephant.
~ Answer a, b, or c, nowl ~ ' ~ :' POLLY: WQ11~ Bumpers, what'~ the scoop? I'm anxious to see the answer! ~NOTE: The above line o~ Polly's is dellvered while the video is on a two-shot o~ Polly - and the Professor, and remains on the two-shot ~or the first 3 words o~ the Pro~essor's next line.
After the Professor says "Well, I have" the video cuts to a close-up shot of Polly listening intently.) BUMPERS: Well, I have ~Video cuts to close-up shot of Polly listening.) qood new9~ our ~rlend ' k~ na~8- Our ~riend picksd ira~e, and is ' picked the wron~ answerl absolutely correctl Only a giraff~ can make no sound. (*No syllable count is necessary during Bumpers' dialogue, since we are not seeing him speaking.) .

1 2 3 4 5 6 ' 1 2 3 4 5 6 POLLY: Hay,/you/are/ve/ry/smartl ' Nice/try,/but/no/ci/gar!
: - (**A syllable count is ~ necessary for Pollyls :: : : ~ :
:
~ . -2 1-:: :

~2~ 6 ' line, since we are seeing her speaking. Both lines contain 6 syllables as shown.) BUMPERS: Can we sum up everything our ~riend ~id, Polly?
(**~ All branches following thi~ point are memory branches, meaning the content refers back to an earlier selection made by the child at home.

POI,LY: Surel First, our friend told us that ke i~ a boy. Next, he ' she is a gi~1. Next, told you she told you that I should subtract the ~ that I should multiply number 9 from 18. ~ numbers 9 and 18.*(* Each ~ ~ ~ bran~h ha~ 9 syllables) :; :
BUMPERS: I reme~ber!

PO4LY: And lastly, our friend ~ And lastly, our friend wa~ riqht by answerin~ ~ wa~ wrona. and that was t~e qiraffe. ~ unfortunate.**(**Each ~ , ~
~ : branch has ~ syllables~
:
~ 22-B17MPERS ~hanks, Polly. I enjoyed working with our friend at home today, didn I t you?

POLLY: I always enjoy teaching o I always enjoy teaching little boys new things ' little irls new things.
o S BUMPERS
AND
POLLY: Goodbye, and have a nice day !

~'hus, by utillzing the pres~nt invention, lnteractlvQ
tQlevislon programming may be provlded ln whlch two or mor~ I
IO audio channel~ may be ~ynched to a common video channel, with th~ video bsing ~ull motion and ~ull re~olution video which is compatible with all audio channels which may b~ individually selected by the user to provide the full motion audio vi~ual television presentation using dynamic button selection for the choic~s~

: -23-,:.i

Claims (27)

1. a method for providing an interactive full motion synched compatible audio/visual television display presentation based on dynamic user selection of a plurality of choices for a multiple video frame common full motion television display comprising the steps of recording a first choice audio/visual television display presentation comprising said multiple video frame common full motion television display, said recorded common full motion television display comprising a plurality of synched successive video frames, at least one of said successive video frames comprising a common interrogatory message and a plurality of simultaneously providable user selectable choices related to said common interrogatory message, said recorded first choice audio/visual television display presentation comprising a user selectable audio presentation corresponding to a single one of said user selectable common interrogatory related choices and being synched to and compatible with a subsequent common full motion video frame video presentation in said common full motion television display subsequent to said common interrogatory message containing video frame, said recorded single audio presentation first choice comprising a first user selectable responsive output message to said common interrogatory message and having a particular word content and syllable content portion for providing a recorded simultaneously providable dynamic user selectable synched responsive audio output message to said recorded previous video frame common interrogatory message in said recorded common full motion television display; and subsequently recording a second choice simultaneously providable user selectable audio output presentation corresponding to a different single one of said user selectable common interrogatory related choices and synched to and compatible with the same subsequent common full motion video frame presentation as said simultaneously providable previously recorded first choice user selectable audio output presentation in said previously recorded common full motion television display, said simultaneously providable subsequently recorded second choice user selectable audio output presentation comprising a second user selectable responsive output message to said common interrogatory message and having a different particular word content but substantially identical syllable content to said previously recorded simultaneously providable first choice user selectable audio output presentation portion for providing a different recorded dynamic user selectable responsive audio output message syllable synched to said first choice recorded dynamic user selectable responsive audio output message and compatible with said previously recorded subsequent common full motion video frame video presentation in said recorded common full motion television display subsequent to said recorded common interrogatory message containing frame;
whereby a recording capable of providing said user selectable interactive audio/visual full motion television display over a common television channel is provided.

2. A method in accordance with claim 1 wherein said plurality of user selectable choices comprises a correct choice to said common interrogatory message and other choices, said first choice recording step comprising the step of recording said correct choice as said user selectable audio output presentation.

3. A method in accordance with claim 1 wherein said first choice recording step comprises the step of recording an animated character as said subsequent common full motion video frame video presentation, said recorded animated character having mouth movements common to said substantially identical syllable content portions of said simultaneously providable recorded first and second choice audio output presentations.

4. A method in accordance with claim 3 wherein said animated character recording step comprises the step of providing a puppet as said animated character and recording mouth movements of said puppet.

5. A method in accordance with claim 3 wherein said animated character recording step comprises the step of providing a cartoon animation as said animated character and recording mouth movements of said cartoon animation.

6. A method in accordance with claim 3 wherein said animated character recording step comprises the step of providing a human character as said animated character and recording mouth movements of said human character.

7. A method in accordance with claim 3 wherein said plurality of user selectable choices comprises a correct choice to said common interrogatory message and other choices, said first choice recording step comprising the step of recording said correct choice as said user selectable audio presentation.

8. A method in accordance with claim 4 wherein said plurality of user selectable choices comprises a correct choice to said common interrogatory message and other choices, said first choice recording step comprising the step of recording said correct choice as said user selectable audio output presentation.

9. A method in accordance with claim 5 wherein said first choice recording step comprising the step of recording said correct choice as said user selectable audio output presentation.

10. A method in accordance with claim 1 wherein said first choice recording step comprises the step of rerecording a previously recorded audio/visual presentation to provide said first choice audio/visual television display presentation.

11. A method in accordance with claim 10 wherein said first choice recording step comprising the step of recording said correct choice as said user selectable audio output presentation.

12. A method in accordance with claim 1 wherein said subsequent recording step comprises the step of providing said simultaneously providable first and second user selectable audio output presentations as audio signals and multiplexing said audio signals.

13. A method in accordance with claim 12 wherein recording step comprises the step of providing said full motion video frame video presentation as a video signal and said multiplexing step subsequent recording step comprises the step of multiplexing said audio signals into said video signal.

14. A method in accordance with claim 13 wherein said multiplexing step further comprises the step of pulse amplitude modulating said audio signals with said video signal.

15. A method in accordance with claim 13 wherein said multiplexing step further comprises the step of digitizing said audio signals and inserting said digitized audio signals into an active portion of said video signal.

16. A method in accordance with claim 12 wherein said recording steps comprise the step of recording said first choice audio/visual presentation and said second choice user selectable audio output presentation on a common storage media.

17. A method in accordance with claim 16 wherein said common storage media comprises a video cassette.

18. A method in accordance with claim 16 wherein said common storage media comprises a video disc.

19. A method in accordance with claim 16 wherein recording step comprises the step of providing said full motion video frame video presentation as a video signal and said multiplexing step subsequent recording step comprises the step of multiplexing said audio signals into said video signal.

20. A method in accordance with claim 19 wherein said multiplexing step further comprises the step of pulse amplitude modulating said audio signals with said video signal.

21. A method in accordance with claim 19 wherein said multiplexing step further comprises the step of digitizing said audio signals and inserting said digitized audio signals into an active portion of said video signal.

22. A method in accordance with claim 1 wherein said recording steps comprise the step of recording said first choice audio/visual presentation and said second choice user selectable audio output presentation on a common storage media.

23. A method in accordance with claim 22 wherein said common storage media comprises a video cassette.

24. A method in accordance with claim 22 wherein said common storage media comprises a video disc.

25. A method in accordance with claim 1 wherein said recording common full motion television display comprises a full resolution television display.

26. A method in accordance with claim 13 wherein said multiplexing step further comprises the step of pulse duration modulating said audio signals with said video signal.

27. A method in accordance with claim 19 wherein said multiplexing step further comprises the step of pulse duration modulating said audio signals with said video signal.