CA2124000C - Transaction based interactive television system - Google Patents

Abstract

A transaction based interactive televi-ion system (20) includes an insertion system (22) for inserting in a preferred embodiment coded interactive information in the vertical blanking interval of a standard television sig-nal. The signal is received and decoded by a decoded system (24) which includes a settop decoder (30) which sends an infrared signal to a handheld device (28). The viewer using the handheld device (28) can interact with a game, sports, or educational or event or other presentation on television. The system includes proprietary high level command language and a proprietary set of PIU tables which are handheld in non-volatile memo-ry (74) of the handheld device (28). The PIU
tables store the transaction of the various events presented on the television. The PIU tables allow the various events to be broken down into a number of transactions. Thus, for a sports event with interleaved commercials, a number of PIU tables would be used to store a collection of transactions used for the main event and additional PIU tables are used for storing transactions for each of the various interleaved commercials.

Description

WO 93/1060 PCT/US92/0945~
~.r - z~2~~fl0 TRANSACTION BASED
INTERACTIVE TELEVISION SYSTEM
10 ~TMT'T'ED COPYRIGHT WAIVER
A portion of the disclosure of this patent document contains material (code listings and message listings) to which the claim of copyright protection is made. The copyright owner has no objection to the facsimile reproduction by any person of the patent document or the patent disclosure, as it appears in the U.S. Patent and Trademark Office file or records, but reserves all other rights whatsoever.
Copyright 1991 Watch & Win FIELD OF THE INVENTION
The present invention is directed to an interactive communication system and in particular, one adapted for use with existing broadcast, cable, and satellite television or radio or other communication systems for allowing participants and viewers to interact with the system in order, by way of example only, to shop, enter into games of skill, and engage in educational presentations and other events where information is provided and the participant or viewer can make an appropriate response thereto.
BACKGROUND OF THE INVENTION
Many products have been introduced that provide the capability for the viewer to participate in television programs. These products accept cue signals transmitted to handheld devices that measure and control the response of the viewers as the viewers participate in the program. Some of these devices SUBSTITUTE SHEET

%c ~~~.r9.2~ ~ 9s~~ f--IPtR/US ~3 UEG 1993 _~1~4~OQ

implement hardware that monitors the response or the results of responses accumulated over time and reports the results to a central site. One of the early embodiments of this technology was the QUHE
interactive two-way television system introduced by Warner Communications at least as early as 1982.
Other systems include the INDAX system field tested at least as early as 1984 by Cox Communications, and the Interactive Networks System field tested during 1990 and 1991.
The Interactive Network System is at least in part described in U.S. Patent No. 4,592,546 which is entitled "GAME OF SKILL PLAYABLE HY A REMOTE

PARTICIPANTS IN CONJUNCTION WITH A LIVE EVENT" and issued on June 3, 1986. This system, in one embodiment, contemplates the use of the vertical blanking interval of the standard NTSC television signal for downloading to a remote viewer's handheld device game play or other interactive instructions.

In addition over the vertical blanking interval (VBI) a lock-out signal can be sent to prevent scores from being credited after the answer to the event has been presented on the screen. This system demonstrates the capability of having the scores accumulate throughout the television presentation, then allows the final scores to be burst back as, for example, digital data over a modem after the program is completed and during a time interval which is significantly less than the total time interval of the program.

All of the above products fall generally within one of two categories of product. The first category consists of software that is coded in firmware in a remote participant's handheld device where the participant can start playing along with the interactive program as soon as the program begins.

SUBSTITUTE SHEET
~~EAfUs _212400 The second category maintains the software in random access memory in the viewer's handheld device where the program must be downloaded into the device prior to the event starting. This process may require up to five minutes requiring the participant to wait prior to participating in the interactive program.
Both categories of devices are designed to work with one interactive program at a time, where the participant must complete that program before being able to participate in a new program.
When these products are compared to the television viewing habits of consumers, significant deficiencies are apparent. Most viewers do not continuously watch one program. Viewers generally switch between several channels. This is so pervasive in the industry that the term "grazing" has been given to the habit of switching between channels during the programs.
SUMMARY OF THE INVENTION
An interactive system concept that is compatible with the participants viewing habits is required for interactive television to be successful.
This system must include the ability to maintain several interactive programs active at the same time and not require advance downloading of programs or initialization information. When the viewer tunes the channel, the viewer is immediately able to participate in the interactive program either if the viewer is for the first time watching that program or the viewer is returning after watching some other program for a brief or extended period.
In the situation where a viewer returns to a program that was previously watched, the interactive game continues, leaving out only the part that was SUBSTITUTE SHEET

-q_ missed. Any cumulative score for the part of the event actually particpated in can be entered. The result would be the same as if the missed questions were not answered.
The present invention is designed to overcome the problems and disadvantages associated with the prior art and to address the way participants actually view television events. In particular, the present invention provides for a transaction based system whereby the various interactions, which can occur over a period time, between the system and the viewer, can be broken down into and defined by a plurality of transactions. The transactions are stored in programmer (PIU) tables which are identified by programmer identification (PID) numbers and which are provided in non-volatile memory in, for an example, a handheld device used by the viewer to interact with the television presentation. Data to update and reprogram each of the tables is supplied, in a preferred embodiment, over the vertical blanking interval in conjunction with the television presentation. Once the structure of the PIU table is established, the game can then be initiated through a high level command language which is sent over and incorporated in succeeding VBI lines in order to initiate the various transactions.
With a transaction based system, multiple games and interactions dealing with different subject matter can be accomplished in an interleaved manner.
For example, during an hour long television presentation, a number of transactions can be strung together in order to interact with a continuous theme being presented in the main programming for that hour.
Additionally, should the main programming be broken down into sections, the transactions can be grouped in SUBSTITUTE SHEET

2~24Q00 _5_ ..
as many groupings as necessary in order to represent the desired interactivity with each portion of the main program. Still in addition, the present system has the capability of allowing, for example, a transaction or grouping of transactions to take place for each of the multiple commercials which are spread throughout the main presentation. Thus, the present system affords the ability for the viewer to play and interact with multiple transactions which can be associated with totally different interactive presentations on the screen and have all of the interactions properly recorded and scored. As each of PIU tables can be established through the use of only a few VBI lines, the system allows a viewer to begin playing a game or interacting with the television presentation during any portion of the presentation and also allows the viewer to switch channels or "graze" and still be immediately able to play or interact with any game or presentation presently presented on the newest selected channel.
This ability presents a significant advantage over the prior art which requires, as indicated above, that the viewer pretune to a specific channel ahead of the game so that the necessary game software can be downloaded, over a significant interval of time, into the remote terminal before the game can be commenced.
Further, such prior devices only afford the viewer the ability to play or interact with a single game or main event at a time without the ability to switch between events interleaved on the same channel, as for example, between the main event and commercials, or to switch to other channels and be able to interact with the event of that channel and have the results scored.
Such grazing would not be available with prior devices due to the fact that a remote terminal would not have SUBSTITUTE S~-iEET

~~~~.19~/~9~/s3 lPEA/US ~3~EC tss3 2124~OQ
been properly programmed. In fact, should the viewer change channels, with prior devices the viewer would then not be able to interact with the event on that channel until the next event began or would have to wait for the software for that particular event to be downloaded before commencing with the interactivity.

Accordingly, the present invention provides for an interactive presentation system which comprises a device for receiving at a remote location interactive data in assocation with the presentation of an event. The interactive presentation system further includes a device for defining transaction structures for allowing the interactive active data to be communicated only as needed for each particular aspect of an event, and throughout the event such that there is no interruption of the event. Further, the transaction structures allow for events and aspects within each event to be interleaved while maintaining interactivity with each event. The system further includes a device for reporting the results of the interactivity.

The receiver mechanism of the present invention also includes a settop decoder for decoding interactive data received in conjunction with a signal of the event. The receiver device additionally includes a handheld terminal for allowing the user to interact with the event and a mechanism for providing communciation between the settop decoder and the handheld terminal.

In another aspect of the invention, the transaction structure includes a device for-storing _ identification for each of the plurality of transaction tables and a device for storing at least a portion of the interactive data and a user response to the interactive data.

u~~5 s iTGTE SH~E~r tPE~"!S

WO 93/10606 PCT1US92/094~s ~~24(~~Q
In another aspect of the invention, the interactive data includes interactive commands, and also event specific data associated with each specific event or aspect of each event.
In yet another aspect of the invention, the receiving device includes a message display and the interactive commands cause messages to be displayed on the message display.
Yet in a further aspect of the invention, the receiving device can receive messages to be displayed and the transaction structure can store received messages. The interactive commands are for additionally causing either a received message or a stored message to be displayed in order to initiate or to continue with an interactive presentation.
Thus, with the present invention, the viewer is afforded the ability of interacting with a multiplicity of interleaved events, the ability to stop and start the interactivity at the viewers time of chosing, the ability to select events offered on a multiplicity of channels and to interact within a time period and in the order desired by the viewer and to have all of the responses for the various events scored and stored for the portion participated in by the viewer.
$RIEF DESCRIPTION OF THE FIGURES
Fig. 1 depicts a schematical representation of an embodiment of the inserting system and the decoding system of an embodiment of the transaction based interactive television system of the invention.
Fig. 2 depicts the format of a line of data in the vertical blanking interval.
Fig. 3 depicts the data spacing for the data of Fig. 2.
SUBSTITUTE SHEET

_8_ Fig. 4 depicts the IR data stream embodied as an FSK biphase encoded data stream.
Fig. 5 depicts a more detailed schematical representation of the settop decoder of Fig. 1.
Fig.6 depicts a more detailed schematic representation of the handheld device or terminal of Fig. 1.
Fig. 7 depicts a schematical representation of the IR detector of the handheld device of the receiver of the system.
Fig. 8 depicts a top plan view of a "T"
shaped handheld device of an embodiment of the invention of Fig. 1.
Fig. 9 depicts an embodiment of a keypad layout for the device of Fig. 8.
Fig. 10. depicts a representation of the IR
coverage area for the invention of Fig. 1.
Fig. 11 depicts an embodiment of the memory map of the static RAM of an embodiment of the handheld terminal of the invention of Fig. 1.
Fig. 12 depicts a schematical representation of the static RAM interface of an embodiment of the handheld terminal of the invention of Fig. 1.
n~'TAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
TRANSACTION BASED INTERACTIVE SYSTEM:
An interactive system 20 (Fig. 1) of the invention that includes the capability of allowing the viewer to participate with interactive television programs on many channels is best implemented by transmitting the interactive control information along with the television program.
One of the recognized approaches to transmit data in conjunction with a television video signals is to insert the data in lines 10 through 20 of the SUBSTITUTE SHEET

~G~~r ~/192~0 9f/~I-_ ~PtA/~$ 13 DEC 1995 2.12400 _9_ vertical blanking interval (VBI). An example of this method of transmitting data is closed captioning information which inserts data on line 21 of the VHI.

The system 20 has the data inserted with an insertion system 22 on the VHI of the program material prior to broadcasts and decoded with a decoding system 24 for the participant watching the program. At each receiving location 26, the data must be recovered from the VBI by the decoding system 24 which includes a decoder 30 and a handheld device 28, with the decoder 30 transmitting data to the handheld device 28 which is required to be used in order to participate in the interactive event.

Marketing considerations dictate that the settop data converter or decoder 30 decodes the VBI

information and transmits the interactive data via an infrared transmission device 32 to the handheld device 28. Using IR transmission, the participant may move freely about the room keeping the handheld device 28 pointed in the general direction of the settop data converter 30.

The video tape recorder 34 of the insertion system 22 is used to play the source program of interest. This program may be a live event, and in that situation, a camera is substituted for the tape recorder. The output of the tape recorder 34 is a NTSC video-and sound signal which can be transmitted through a video delivery system such as a cable or conventional television broadcast system 36 to a multiple of remote locations, for example, homes.

The NTSC video output signal is supplied to _ a standard data bridge luminance inserter 38 which includes the capability to insert luminance modulated data on horizontal blanking interval lines within the vertical blanking interval. The interactive data to SUBSTITUTE SHEET
IPEA~US

O~~~U,l9~~G9s/.s~
_ IPEA/U$ 13DEC 1993 z~z4ooo be inserted is provided by a computer 40 which synchronizes this data using a conventional frame grabber card 42 providing hardware interrupts for the vertical and horizontal blanking intervals of the program material from the VTR 34. The format of a horizontal line 44 of data is shown in Fig. 2.

One format for data transmitted within the VBI that is both well documented and is considered to be reliable is the format chosen for closed captioning information. This format transmits a burst of data 46, preceded by a start bit 45, driving one line of the VBI and located between synchronization pulse 48.

A color burst signal 47 and a clock run-in signal 49 are also depicted. Each burst is repeated at the television field rate of 16.67 milliseconds Fig. 3.

This data format provides for 14-bits of data with a parity bit every seven bite.

Any conventional data format is acceptable with the-understanding that the data may be inserted on blank lines within the vertical blanking interval.

The output signal from the luminance or VITS inserter 38 is transmitted over any conventional television distribution system including a broadcast, satellite or cable delivery system. The individual television channel carrying the program is selected using a conventional TV tuner as found in a television or consumer VCR 50. If a VCR is used as the tuner, the VCR contains a demodulator to provide a baseband video output containing the video of the program from VTR 34 and the interactive data inserted by the luminance or VITS inserter 38.

The video signal is processed using, for example, a conventional VHI data removal circuit 52 to create a data stream 54 identical to the inserted interaction data stream.

CONSTITUTE SHE:
~ °~A~US

-11- _ ~1~4000 For reliable transmission using infrared as a transmission system, the data rate in a preferred embodiment does not exceed 3,000-bits per second. The VBI data is recovered at a data rate of 500,000-bits per second. However, this rate occurs for a short burst during the vertical blanking interval. Thus, while active video is being transmitted, interactive data is recovered from the program source.
Setron Decoder or Converter 30:
The purpose of the settop converter 30 is to recover the data transmitted during the VBI at a high data rate and, using infrared, transmit that same information to the handheld device 28 at a much slower data rate of 3,000-bits per second. This can be solved using a first-in-first-out buffer 56 with different clocks for the input and output functions.
The serial data stream is stored in the first-in-first-out buffer 56. Each group of 14-bits of data from a horizontal line 44 in the VBI is stored at the transmitted data rate of 500,000-bits per second. Since a specific horizontal line only occurs every 16.7 milliseconds, the data stream consists of 14-bits clocked at a high rate followed by 16.7 milliseconds of no data as shown in Fig. 3.
The output of the first-in-first-out buffer 56 is clocked at a data bit rate of 3,000-bits per second. Using this rate, the 14-bits are transmitted within 4.7 milliseconds as shown in Fig. 3.
The slower output rate from the first-in-first-out buffer 56 is necessary to insure that the output bit time is compatible with transmitting the data using an infrared modulator.
The infrared modulator or transmitter 32 consists of two oscillators running at a multiple of SUBSTITUTE SHEET

0°~~~9~/09~.~'s IPEA/U$ 13DEC 1993 3,000 Hz, with each phase locked to the output clock rate. If the bit from the buffer is a "1", the first oscillator is selected to drive the IR transmitter.
If the bit is a "0", the second oscillator is selected to drive the IR transmitter. Using this FSK encoded data stream approach (Fig. 4), the IR transmitter radiates IR energy at a frequency determined by the aerial data clocked out of the first-in-first-out buffer.
Thus from the above, it is evident that the interactive system includes a device for delivering one way low speed digital data to a handheld device that can be used to participate in interactive television programs.

Figure 5 depicts a more detailed schematical representation of the settop decoder 30 of the system as shown in Fig. 1. This settop decoder 30 is substantially similar to a conventional decoder for decoding VBI information used, for example, for closed caption applications. Additionally settop decoder 30 includes the IR modulator or transmitter 32 as described above. Viewing Fig. 5, it can be seen that the settop decoder 30 includes a synchronization detector and line counter 60 which receives the broadcast signal. Further, the settop decoder 30 includes a data recovery and fitter correction unit 62. Theseunits 60, 62 communicate with the microprocessor 64 for causing the microprocessor 64 to latch VBI data to the register or first-in-first-out buffer 56. From buffer 56, the data is communicated to the FSK modulator and IR drive 66 and therefrom to the IR diode array 68. The FSK modulator and IR

driver 66 and the IR diode array 68 comprise the IR

transmitter 32.

SUBSTITUTE SHEET
IPEA~IJS

~C%~r/19.2~d9~~
~/~$ ~3DEC 199b -13- ~~240aU
Handheld Device or Terminal 28:

The handheld interactive terminal 28, depicted in Figure 6, provides the means to participate in the interactive program. It decodes the data stream from the settop converter 30 and implements the interactive program.

The hardware modules within the handheld device 28 consist of an infrared photo detector 70 to sense the IR signal from the settop converter 30, a microprocessor 72 with a control program; which can implement the c~miand code discussed below stored in an on-board ROM, a RAM ?4 including both non-volatile and temporary storage for information sent via the IR

link, a keyboard 76 for data entry, a clock circuit 78 to t-rack actual time, and a LCD display 80. A block diagram of the handheld device is shown Figs. 1 and 6.

The IR receiver or detector 70 has a circuit 82 which consists of a photo diode 84 providing an electrical voltage proportional to the IR light level and a frequency discriminator 86 detecting the FSK

modulation of the IR signal (Fig. 7).

The output of the photo detector 84 is amplified and shaped to provide a square wave with the frequency identical to the frequency of the IR signal.

This frequency modulated signal is supplied to the frequency discriminator 86 tuned to the two frequencies used to transmit the IR data. This discriminator 86 recovers the serial data and supplies it to the microprocessor 72 of the handheld device 28.

The microprocessor 72 monitors the serial data transmitted via the IR link and builds a command stream from this data as defined in the below section describing the software structure of the invention.

The commands create an operating program that SUBSTfTUTE SHEET
IPEA~US

~~~~f9~/~9y~
IPEA/U$ 130EC 1993 2~240Q0 -~3y-implements an interactive program for the participant.
The ROM of the microprocessor 72 contains the control SUBSTITUTE SHEET
IPEA~US

o°

-14- _ program and command interpreter for the commands sent on the VHI. The RAM memory 74 stores the data and commands transmitted over the IR link representing the interactive program.

Figure 8 shows an example for the "T" shaped case for the handheld device 28. Aspects of the outer housing 94 of the handheld device 28 include the following.

The case 94 is made from molded plastic of a strength and texture suitable for use by consumers in a household environment.

The keypad 76 should be a 1-piece molded rubber type with carbon contacts that make switch connections against a switch pattern on a printed circuit board (PCB). The words under nine of the keys (YES, N0, TRUE, FALSE, POOR, FAIR, AVERAGE, GOOD, EXCELLENT) are part of the plastic case 94 and not part of the keypad 76. The keypad 76 is arranged as four rows times five columns. Figure 9 shows the arrangement and names all twenty keys.

The handheld device 28 derives power, in a preferred embodiment, from four 'AA' size cells that must be replaceable by the consumer via a removable door on the back of the unit.

The IR receiver 70 will have two windows of red tinted plastic that filter visible light in the front left and right corners of the case. IR receive circuitry will be mounted on the PCB behind both of these windows.

The "T" shape device 28 accommodates a relatively wide LCD display 80 (approximately four inches) and a relatively narrow keypad 76 into a package that can be either set on a table or held in a consumer's hand.

~~~~ ~ ~ k ~~cE s~~.~~
iPEAfUS

-15- _ 2~24~Q0 The microprocessor 72 includes, in a preferred embodiment, a Mitsubishi M38002M2-FP with 8K-bytes of internal ROM in a plastic quad flat pack package. The microprocessor 72 operates in a memory expansion mode at a crystal frequency of 5MHz crystal.
The assignments of I/O pins to specific functions are shown in Table 1 below.
TABLE 1: MICROPROCESSOR I/O PIN ASSIGNMENTS
PC~FP

PIN NUMBER PIN NAME DESCRIPTION

56 P30 Column 5 Keypad Scan Output 3 P60 Column 4 Keypad Scan Output 2 P61 Column 3 Keypad Scan Output 1 P62 Column 2 Keypad Scan Output 64 P63 Column 1 Keypad Scan Output 63 P64 Row 4 Keypad Scan Input 62 P65 Row 3 Keypad Scan Input 61 P66 Row 2 Keypad Scan Input 60 P67 Row 1 Keypad Scan Input 11 INT2 Active Low Keypad Key Hit Interrupt 21 P40 Real-Time Data 20 P41 Real-Time Output Enable 10 P51 Real-Time Clock 9 P52 Real-Time S1-8 P53 Real-Time S2-55 P31 LCD Contrast MSB

58 P71 LCD Contrast 3 5 59 P70 LCD Contrast LSB

12 SRDY- Not Used 14 TXD Not Used 15 RXD Serial NRZ Data From IR
Receiver - 40 17 INTO Carrier Detect (Any Levels 16 INT1 IR Data Clock (Rising Edge, Tie to SCLK) 13 SCLK IR Data Clock (Rising Edge, Tie to 45 INT1) 4 P57 LCD Power Enable/Disable (ENABLE=0) SUBSTITUTE SHEET

WO 93/1060 PCT/US92/0945s P56 Low Battery Input 6 P55 32K-Byte Static RAM Write Protect 7 P54 Piezoelectric Speaker Output (Pulses) 48 ADO Address Bus 0 47 AD1 Address Bus 1 46 AD2 Address Bus 2 45 AD3 Address Bus 3 44 AD4 Address Bus 4 43 AD5 Address Bus 5 42 AD6 Address Bus 6 41 AD7 Address Bus 7 40 AD8 Address Bus 8 3g AD9 Address Bus 9 38 AD10 Address Bus 10 37 AD11 Address Bus 11 36 AD12 Address Bus 12 35 AD13 Address Bus 13 34 AD14 Address Bus 14 33 AD15 Address Bus 15 32 DBO Data Bus 0 31 DB1 Data Bus 1 30 DB2 Data Bus 2 2g DB3 Data Bus 3 3 0 28 DB4 Data Bus 4 27 DB5 Data Bus 5 26 DB6 Data Bus 6 25 DB7 Data Bus 7 3 5 49 RD- Read Strobe to Static RAM

50 WR- Write Strobe fo Static RAM
and LCD

51 SYNC Not Used 52 PHI Not Used 53 RESETOUT- Not Used 40 54 ONW- 1 Wait State for LCD

XIN Connect 5MHZ Crystal 23 XOUT Circuit Across XIN/XOUT

4 5 19 RESET- Active Low Rest From Power Detect 1g CNVSS Connect to VSS for Internal ROM

24 VSS VSS from Battery -50 57 VCC VDD from Battery +

SUBSTITUTE SHEET

The keypad 76 is scanned by the microprocessor using five outputs and four inputs.
The four inputs are diode-or'ed together such that any keypress will produce an interrupt to the microprocessor. These active low interrupts occur when a key is pressed.
The handheld device 28 receives all remote data from the settop unit 30 via an infrared (IR) data link. The performance of this link must have a bit error rate less than one error for every 100,000-bits transmitted (random bit errors) when in the configuration shown in Fig 10. In this configuration, the handheld receiver 28 is 7.6m (25 feet) from the transmitter of the settop converter 30 and anywhere within plus or minus 60 degrees of the centerline of the transmitter.
As indicated above, the physical format of the IR data is an encoded FSK signal. The lower frequency is a 49KHz and the upper frequency will be 59RHz. The data rate is a 3000 bits/seconds (BPS).
Figure 4 shows the format of this data. The first line is the digital clock. The second line is the stream of digital IR data. The third line is the equivalent line mid-bit transition encoded data and the fourth lines shows the data FSK encoded. The FSK
data is applied to the IR transmitting LEDs on the settop unit 30 and received by the diodes in the handheld device 28. The FSK data is decoded into mid-bit transition data, from which a clock is extracted and the data returned to the digital format. The microprocessor 72 uses the clock to shift the data into an internal serial port running in the synchronous mode. As indicated previously, the clock that is extracted as shown on the first line (Fig. 4) and is called the digital data clock.
SUBSTITUTE SHEET

WO 93/10605 PCT/US92/0945~

~zn~~ooo To minimize power consumption, the IR
receiver 70 should be preceded by a carrier detect (CD) filter 96 (Fig. 6). When energy in the 46-62KHz range is detected then the carrier defect filter 96 is said to be active. This signal will actually switch power to the IR receiver with a VDD switch (a MOS
transistor gate circuit in a preferred embodiment) which will remain powered while the IR data is received. After the IR data transmission from the settop unit 30 is complete the CD signal will go inactive and will remove power from the IR receiver 70. The CD filters 96 consumes as little current as possible since it is active all of the time. The logic level of the CD signal is a "don't care" for the microprocessor 72 and is chosen based on the lowest power consumption or cost of the CD circuit.
Static RAM:
Figure 11 shows the memory map of the 32K-byte static RAM 74. The static RAM 74 will be decoded into microprocessor addressees OOOOh to 7FFFh. The first 400h locations of the external RAM 74 will be unused since these locations are internal to the microprocessor. The static RAM must run with zero wait states.
Figure 12 shows the 32K-byte static RAM
interface 98. It is important that the chip select (CE-) pin of the RAM be higher than VDD-0.2 when not being accessed in order to be in the lowest power mode. This is the reason for the transistor circuit 100 at the CE- pin in Figure 12. This extremely low power mode is found on the latest currently available versions of static RAM chips and results in a current draw~of about 2uA at room temperature.
SUBSTITUTE SHEET

WO 93/10605 PCTlUS92/09455 -19- _ ~~.24DOD
The static RAM 74 chip (like the real-time clock) will be powered by the power fail detect circuitry 78 that changes over to the lithium coin cell 102 when loss of power from the main four 'AA' cells 104 is detected. This power is referred to as VDDsafe in Fig. 6.
The 32K-byte static RAM 74 has write protect circuitry 106 that requires the microprocessor 72 to place a logic low on an L/O pin before any write' operation can be performed and will prevent false writes to the static RAM 74 during reset (which is active whenever VDD is invalid). The write protect circuit 106 is also powered by VDDsafe. It is noted that address bus lines AD14 and AD15 are pulled up to VDD for the memory address decoding to work properly.
The LCD display 80 is a two line by 24-character display with built in display RAM and character generator RAM. No backlight is used. The LCD display 80, in a preferred embodiment, shall conform to the features of the Sharp LM24255 (preprogrammed character generator ROM and eight character generator RAM locations).
The LCD display is mapped into memory at microprocessor addresses 8000h (control.register) and 8001h (data register). The timing of the typical LCD
display 80 module indicates that one wait state may be required during accesses and the microprocessor ONW-line is appropriately controlled to accomplish this task (see Table 1).
To allow the microprocessor to control the LCD contrast in software a R/2R ladder network is to be implemented using three I/O bits of the microprocessor (see, Table 1).
The LCD design does not have a low power mode. To extend battery life, the LCD power must be SUBSTITUTE SHEET

_ ~°~~ ~~f~,~a9f~J r A/(J$ 13 DEC 1993 -20- _ controlled by an I/0 bit from the microprocessor.

Figure 6 shows this as a VDD switch 108. This can be, in a preferred embodiment, a MOS transistor gate circuit that will allow power to the LCD when the microprocessor control signal is low.

The Epson RTC-4503 chip is the preferred real-time clock 78. It is connected to the microprocessor 72 with I/0 pins. The real-time clock 78 (like the static RAM 74) is powered by the power fail detect circuitry that will change over to the lithium coin cell 102 when loss of power from the main four 'AA' cells 104 is detected. This power is referred to as VDDsafe above.

The piezoelectric speaker 88 will produce musical tunes and tones. The frequency response of this unit is within the range of lKHz or below on the low end and 5Khz or above in the high end. Within this range, the sound pressure output of the piezo is level. The sound pressure level output should be in the range of 20dB to 30dH.

The speaker 88 is driven by one of the timer outputs of the microprocessor 72 running in the pulse output mode.

The preferred main source of power is four 'AA' cells 104. There is an additional three volt lithium coin cell 102 that powers the 32K-byte static RAM 74, write protect circuitry 110, and the real-time clock 78 when loss of main power is detected since these must remain powered at all times. Main power is lost when the four 'AA' cells are either drained below minimum working voltage or are removed entirely. The power derived only from the main batteries is referred to as VDD. The power that is output from the power fail detect circuitry that is SUBSTITUTE SHEET
f PEA~US

~UI9~~J9s~'S
IPEK/nS 13DEC 1993 21240a(~

powered by the three volt lithium coin cell is referred to as VDDsafe as indicated above.
SOFTWARE STRUCTURE:

The features of a particular interactive program are implemented in part in software resident in the handheld terminal 28. This software performs two functions. The first function is to build a short interactive program from high level conmnands transmitted via the IR link. After the program_has been transmitted and verified by a CRC error check, the software enables the program to be executed. The second function is the execution of the program. Each independent program that is transmitted and executed is called a transaction. A typical transaction would consist of a sequence of a question asking for a response from the participant followed by a test of the response resulting in a score.

During the time that the participant is responding to the transaction, the next transaction is being received and made ready for the participant to process. Using this approach, the amount of information transmitted via the network prior to a participant being able to use the handheld device 28 is essentially transparent to the user compared to other-prior interactive devices.

Timed responses where the participant must react within a specific time interval is controlled either by a countdown timer implemented with the microprocessor 72 within the handheld terminal 28 or via a new transaction being sent and activated before the participant enters the response to the prior question.

For a question where the viewer has a predeternined amount of time to provide an answer, the SUBSTITUTE SHEET
IPEAfUS -~C'~ ~/l ~.z~~~~

-22- - 2-~ 24 0 ~ 0 input command requesting the answer includes a time in seconds that the handheld device 28 waits for user input.
After completing an interactive game, a resulting score is encoded with the program code and a box serial ID number to establish an authorization number unique for the viewer. Using a touch tone telephone, the viewer may enter their results for prizes or recognition.
Da a Transmitted via the IR Link:
- The interactive programs and messages are transmitted over the IR link in a data format structured as a packet containing all of the interactive commands required for a participant to use the handheld device 28. The structure of this packet is as follows:
Sync 3-bytes of all ones Packet ID 3-bytes Packet Count 2-byte Command 1 Interactive Program Command i CRC 2-bytes End of Frame 3-bytes of all ones The sync block and end of frame block are three-bytes with a bit pattern that is unique within the packet. This approach clearly defines the start and end of each packet.
The packet ID consists of 24-bits (3-bytes) with the bits segmented into a programmer ID of 9-bits, a program ID of 12-bits, and a PIU slot address of 3-bits.
The PIU table (200 of which are located in RAM 74) where data is stored corresponds to an unique PIU code. Each programmer as defined by the ~L~~~~It~~UTE SNrET
Ip~A~US

WO 93/1060, PCT/US92/09455 programmer ID has a specified number of tables available for their use. The PIU slot address defines which table within the programmer's set of table may be used by the interactive program.
S The software process within the handheld device 28 consists of the packet being received correctly over the IR link. The programmer ID and the slot address is used to select a PIU table. If a table does not exist with the same programmer ID and slot address, a new table is created. If the table exists and the programmer ID is the same for the new transaction compared to the stored ID in the table, the old values in the table are kept and the interactive commands transmitted within the packet are processed. If the new program ID of the table are different, the table values are erased before processing the packet.
The command structure is encrypted using a conventional FEC algorithm with one half rate coding to improve data transmission reliability. It is also encrypted using a key ranging up to 56-bits. Within the handheld device 28, a total of three keys are stored. A command to modify the third key is defined and is available for changing the key in the event the three keys become known.
~~rprac eve Software Commands:
In order to reduce the time required to send an interactive program via the IR link, a high level interactive language was invented. This concept reduces the amount of data that must be transmitted to a few powerful commands. The specific order and collection of these commands within the packet determine the interactive program. The user's SUBSTITUTE SHEET

response to these commands implement the interactive program.
An interactive program consists of one or more packets of commands that are sent via the IR link and processed by the control program of the handheld device 28. Each handheld device 28 contains the interactive px~pgram transmitted via the IR link and can generate-a.score or response unique to the individual participant.
Copyright ~ 1991 Watch & Win:
COMMANDS The handheld device implements transactions, events, and PIUs through interpreting a set of commands inserted by programmers at the insertion system 22 and transmitted over the data path by, for example, broadcast signals, to decoding system 24. These commands are created by the programmer using a software package provided with the insertion system 22. The following commands represent the main types of functions that are implemented. Table 2 attached, includes a further list of commands.
Display (msg) The message is displayed on the LCD and remains on the LCD display until one of the following conditions or events occurs:
Another message is processed.
The Recall button is pressed.
Other special massages are displayed if the appropriate button is pressed.
SUBSTITUTE SHEET
. ..__.~. ., Y.......

~~ ~4 0o a No data is transmitted to the handheld within 15 seconds and the viewer has not pressed any buttons (at which time the handheld device powers down).

If the viewer attempts an invalid input, the display does not change.

Input (msg) The message is displayed and the unit waits for input as described below:

A time delay INPUT (msg, counter) request is one where the amount of time in seconds is transmitted along with the input command. For timed input, while waiting for the counter to reach zero, the two (or three) digit time value is displayed .in the bottom right two (or three) screen display 2U characters.

If the counter times out before any input by the viewer, the handheld device displays MSG1.

An open ended INPUT (msg) request is one where the unit waits for input until the next transaction is received.

If the viewer provides a response after the next transaction is received, the response is ignored and the transaction containing the INPUT command is flushed from the unit. Alternatively, the last response could be interpreted as a SUBSTITUTE SHEET

2.24000 response to the next subsequent transaction.
The handheld device waits until the enter key is pressed before processing the response. The number of keys entered from the keyboard can be limited ,b~ the field width variable. If the field width is one, then an enter key is not needed to terminate an input response. If the Timeout variable is not zero, then the input command will be timed. If the timer expires, the command will automatically terminate and the input response ignored.
Example:
INPUT "How much are you willing to bet?", 3, 33 [OPCODE] [Field Width] [X Offset]
[String) [Null) INPUT "How much are you willing to bet?", 3, 33, 10 [OPCODE] [Field Width] [X Offset) [Timeout) [String) [Null]
Range (x, y) Associated with the INPUT command prescribing the range of acceptable key inputs that is the range of value that are acceptable as answers. When the viewer response is detected, the unit confirms that the response is within the range and processes the next command within the transaction.
If the response is not between "x" and "y" values, the unit displays MSG2 and waits for a new input. If the second SUBSTITUTE SHEET
.......... ._........... .. .... .... r 2~~4~0~
response is still not within the range, the unit displays MSG3, clears the input buffer and processes the next command.
Example:
RANGE T0, Tl [OPCODE] [LOW REGISTER] [HIGH REGISTER]
(3-bytes) RANGE 1, 2 [OPCODE] [LOW VALUE] [HIGH VALUE]
(9-bytes) Add (x,y) The programmer can add the value in location x to the value in location y, where the sum is stored in location y.
Sub (x,y) The programmer can subtract the value in location x from the value in location y, where the result is stored in location y.
Save (x,y) The programmer can save the value in location x (or a value itself) in location y. The previous value in location y is lost.
CONDITIONAL:
If, Then, The programmer can establish logic and And, Or arithmetic function using ~, (, ~ _, ( -And, Or or = as a test of either keyed input, stored responses, or stored scores to do other logic steps. A typical example is as follows:
Example:
SUBSTITUTE SHEET

_28_ IF TSCORE ~ THEN DISPLAY "Good Work!"
IF (RESP 1 -- TO) THEN
[OPCODE] [Operator] [Operand A] [Operand B] [True Offset] [False Offset) IF (RESP 1 -- TO and (RESP 2 -- T1) THEN
[OPCODE) [# of Op's] [Op] [0p1] [0P2]
[OP) '[Op3] [OP4] [Op] [True Offset]
[False Offset]
Else Used a part of IF statement to signify alternative processing for, as an example, wrong INPUT
responses.
Beep (x,y,z) This will generate an audio sound from the handheld device 28, where x is the number of beeps, y is the duration in seconds of each beep, and z is the number of seconds between each beep.
Shift (x,y) This command is used to indicate a multiplication desired by the programmer. The value in location y can be multiplied by 2(x=1), 4(x=2), 8(x-3), or 16(x=4).
Repeat A command which results in (msg x,y,z) multiple DISPLAY and other logic commands being sent to the handheld device 28. Using REPEAT, the programmer can request that a message be displayed on the handheld device 28 every x minutes, that the message be sent to the handheld device 28 every y minutes, and that the message stop. being displayed after z minutes.
SUBSTITUTE SHEET
r . .

WO 93/10605 PCT/US92/0945s Hold (x) A command sent to and used by the data inserter 38 which tells the inserter 38 not to insert any background information on line x until the line is released using a RELEASE command.
Release (x) A command sent to and used by the data inserter 38 which tells the inserter 38 that it is OK to insert background commands on line x.
Delete (PID) This is a command used to delete the PIU
table from non-voltage memory to make room for new PIUs. A background task of sending a group of DELETE commands for known completed PIUs will be initiated when it is detected that PIUs have not been deleted normally.
Example:
DELETE PID NUMBER
[OPCODE] [PID NUMBER] (4-bytes) Prestore Stores a standard message in (msg, MSGx) message buffer of non-voltage memory in the handheld device 28, in location MSGx (MSGS - MSG10 are still available). A
DISPLAY command can either designate that a free form message or a prestored message be displayed on the screen.
Example:
PRESTORE 5, "Please try again."
[OPCODE] [MSG#] [STRING] [NULL]
Disable Reset the handheld device 28 to its (boxid) uninitialized state.
Example:
SUBSTITUTE SHEET

[OPCODE] [BOX ID]
(5-bytes) Appendcode The, command to add a new block of assembly level (exentable) code to the iriemory in the handheld device 28.
DEFINE NEW This Opcode will load a new address key ADDRESS KEY: to be used to descramble the next program segment to be executed.
Example:

[OPCODE) [KEY] (3-Hytes) UN- This Opcode is used to transfer program CONDITIONAL execution to a different Opcode within BRANCH the program.
Example:
GO TO LABEL
[OPCODE] [16-Bit 2's Comp. Offset]
(3-bytes) EXIT: Used to signal the software for the handheld device 28 that the current program is finished.
Example:
EXIT
[OPCODE] (1-byte) Table 3 presents a list of prestored messages.
SOFTWARE REGIS'T'ERS RESIDENT IN HANDHELD DEVICE 28:
PIU 200 PIU tables are used by the software SUBSTITUTE SHEET

WO 93/10605 PCTlUS92/09455 ~I24ppQ

TRANSACTOR to store user responses and game scores.
REGISTERS The transaction register contents are maintained until a program deletes the PIU table or the registers are used by another program. The registers defined in each table are:
PID Programmer ID Number Flag Programmable Flag Register Score 1 Event Score Register Score 2 Event Score Register Score 3 Event Score Register RESP1 User Response Register RESP2 User Response register RESP3 User Response Register REGISTER 1 Program Storage Register REGISTER 2 Program Storage Register REGISTER 3 . Program Storage Register REGISTER 4 Program Storage Register Counter Elapsed Timer for Viewer Response SCRATCH PAD Scratch pad registers are used by the REGISTERS program for temporary storage. The value of each register is cleared at the start of each program.
There are 16, 32-bit registers available.
DATE/TIME Used to verify program execution Date REGISTERS and Time. Registers available for program use are:
Minute SUBSTfTUTE SHEET

Hour Day Month Year BOX ID A four-byte register that contains a REGISTER unique set of numbers for each handheld device 28.
CODE A four-byte register stored in non-REGISTER volatile memory for global program usage.
Table 4 presents an example of interactive games that can be played with this system.
Industrial A~plicabilitv The operation of the transaction based interactive television system 20 of the invention is as follows:
In a preferred embodiment, at the programming or source end of the system, an event such as, for example, a sports event, a quiz show or an educational presentation is mated with interactive data in order to associate a series of inquiries and response with the event. The series of queries and responses are, in a preferred embodiment, inserted into the designated lines of the vertical blanking interval much as closed captioning signals are inserted in the VBI. Thus, the standard NTSC signal carries the traditional programming in addition to encoded data of the present invention. This signal is then communicated by broadcasts, satellite, cable, microwave or telephone lines, and any combination thereof to remote user's which have a VCR or SUBSTITUTE SHEET
_.. . _ _ r /~$ 53DEC 1993 2~~~000 television receiver, television monitor and the proprietary handheld device 28 of the present invention. As the signals are encoded in the vertical blanking interval, such signals are not apparent to standard viewer at a remote location without a proprietary decoding system 24, which includes the handheld device 28 and the settop decoder 30. Thus, the NTSC signal is received without the viewer knowing or being disturbed by any other signals of the present invention. With the decoding system 24, the viewer is able to receive, decode, and thus interact with the presentation on the television screen.

In much the same way as closed caption VBI

decoders work, the settop decoder 30 detects the proprietary programming data recorded on the lines in the vertical blanking interval and decodes this data.

The data is then transmitted through an infrared transmitter to a handheld-~device 28 which has infrared detectors. This signal once detected by the handheld device 28 is then used to initiate functions of the handheld device 28. Principal among these functions are the display of messages of the LCD display 80 and the creating and updating of the PIU tables which are associated with each transaction of the event.

the proprietary high level command Thus , language transmitted in conjunction with the a standard television broadcast signal is used to activate the handheld device 28. This command language is used to cause the executable code also sent over the VBI to fill in the PIU tables stored in the handheld device in order to update and create~new _ transactions, to perfornn the various message functions of the handheld device, and to initiate the various transactions. Such an arrangement eliminates the need for the viewer (1) to wait for the downloading of main ~t~~STITUTE SHEET
IPE.A~S

~~~ ~l~~a~s ~x~4aQ0 programs and (2) to be tuned to the appropriate stations before the game begins in order to obtain the entire game program.
The high level proprietary language affords commands and also allows for a rapid delivery of executable code which resides in the PIU tables. Each programmer or program creator at the PIU insertion system 24 would have its own program or ID number and the ID number of a number of PIU tables. Thus, the programmer can insert, at any time, in the VBI new information needs to go into the PIU table. As explained above, each PIU table includes a transaction for at least one response to an interactive inquiry from the programmer. Each of these transactions can be associated with a different game or event occuring throughout the programming and a number of these transactions or PIU tables can be linked together in order to create a series of continuous interactive transactions throughout an interactive session. For example, in the situation of a commercial broadcast of a live sports event with interleaved commercials, a number of PIU tables can be associated together to present interactivity throughout the length of the sports event. Further interleaved with the activity 5 of the main sports event, the various commercials can each be assigned their own PIU table and interleaved throughout the main interactive event. Thus, the viewer can interact with the transactions of the main event and also interact with the transactions of each of the separate commercial events and have all the scores and responses recorded.
It is noted from the above that the _ implementation of the PIU tables breaks down the games and events into individual transactions. These tables can be quickly created from information encoded on the w ~~ ; s t ATE SHEEN
J ~ J '~ ~ ~ EARS

_ IPE~'/US f~~c9~~
2I~~000 vBI. Tables as indicated above, are identified with a programmer ID. The tables are maintained in, for example, the static RAM as long as needed. Should the games change, the programmer simply sends a new signal in order to reprogram that location in the static RAM.

In the present embodiment there are several hundred tables, and each is capable of allowing the user to play a game. Thus for a game on a commercial, each game may have its own PIU table and main game played with the main feature would have a multiplicity.of PIU

tables.

It follows from the above that the present embodiment allows the viewer to come in at any time during the program and immediately begin to play games or otherwise interact with the television and also to "graze" or switch between several stations and immediately be able to play or interact with each channel. This is an improvement over the prior art devices which require that only one game at a time be played, that the user wait for the information to be downloaded to the system, and that does not allow for the interleaving of various games. Further, prior art devices cannot allow the viewer to begin or leave the game at any point in time and have the score for the portion of the game played recorded.

Even with interleaved games and with viewer's coming and leaving the screen at various times, the viewer's reactions and answers to all games in which the viewer participates are stored by the system and later reported to a central processing station.

Finally, after the events are concluded, the viewer will receive a score or scores from the handheld device 28. The score is encoded along with, for example, the user identification number and the SUSjTITUTE SHEET
~PEA~IIS

~~7U.~9s/o9~,3s _ te~us vao~~ ~

identification number of the handheld device 28. The a ~~ ~l ~ ~ ~ ~Nt~'~
_~.";;
~~-viewer can then telephone a central processing station and with the use of a touch tone telephone key in the score and the identification information received from the handheld device 28.
It is further to be understood that the present system can be encrypted using encryption algorithms and keys as is known in the trade. The handheld device 28 would thus store, for example, three keys at least one of which could be reprogrammed by a signal sent on the VBI.
It should also be appreciated that with the present system that a series of events can be linked together. For example, the system can afford the viewer the ability to participate in an interactive event which strings together the four or more games of a world series baseball event. That is to say that the viewer is asked to the pick the winner of each of the games of a world series and the winner of the world series. This information could be stored in the handheld device 28 over a period of days or longer if necessary for other games and then checked against the actual outcome of the individual games and series.
The user's score over a period of time could then be encoded and then reported back to the central station by the users.
Other aspects and embodiments of the present invention can be viewed from a view of the figures and a review of the claims.
It is to be understood that other embodiments of the present invention could be configured and come within scope and spirit of the appended claims.
SUBSTITUTE SHEET

WO 93/10605 PCT/US9210945s 21~400~
Table 2 Instruction Set Summary Mnemonic Description Bytes Opcode ADD Add direct 3 80h ADDI Add immediate 6 90h AND And direct 3 81h ANDI And immediate 6 91h BEEP Beep direct 2 71h BEEPI Beep immediate 4 70h CLR Clear gister 2 20h re DISABLE Disable handheld 5 A4h DISPLAY Display formatted text DIV Divide 3 82h direct DIVI Divide 6 92h immediate DPT Delete 4 AOh PIU table EXTT Terminate 1 ~ A2h program GOTO Unconditional 3 A7h branch iF Conditional 8113 A9h branch INPUT Input *** SOh user response KEY Define 3 A3h new decryption key LOCK Lock out 1 A8h user input VIOD Calculate 3 83h remainder MODI Calculate 6 93h remainder immediate MOV Load register 3 84h MOVI Load register 6 94h immediate MPY Multiply 3 85h direct MPYI Multiply 6 95h immediate OR Or direct 3 86h ORI Or immediate 6 96h PRESTORE , "" A6h Store display string R\'G Define ~ 8$h input range R\TGI Define 9 Alh input range immediate RSTF Reset 1 1Xh bit, PIU flag register SETF Set bit, 1 1Xh PIU flag register SHL Shift 3 87h left direct SHLI Shift 6 97h left immediate SHR Shift 3 88h right SHRI Shift 6 98h right immediate SUB Subtract 3 89h direct SUBI Subtract 6 99h immediate TI~~IE Verify 5 60h real time XOR Exclusive-OR 3 8Ah direct XORI Exclusive-OR 6 9Ah immediate * The number of bytes for the display command is the string length plus one.
* * The number of bytes for the prestore command is the string length plus two.
*** The number of bytes for the input command is the string length plus four or seven.
SUBSTITUTE SHEET

_ 2 ~ 2 ~ 0 U 0 P~/US92/0945s 1 ADD add 38 rreisters Description The contents of the destination register are added to the contents of the source register and the result is stored in the destination register.
Execution Rd <- Rd + Rs Encoding [80h][Rd][Rs] ( 3 Bytes ) Script example TO = TO + Tl Before Instruction After Instruction .2 ,~DDI add immediate value to re ister Description The contents of the destination register are added with a 32 bit immediate value and the result is stored in the destination register.
E~ezution Rd <- Rd + Value Encoding [90h]jRd](Value] ( 6 Bytes ) Script example TO = TO + 100 Before Instruction After instruction .3 .-~''D and registers Description The contents of the destination register are anded with the contents of the source register and the result is stored in the destination register.
Execution Rd <- Rd AND Rs Encoding j8lh]jRd]jRs] ( 3 Bytes ) Script example TO = TO AND T1 Before Instruction After Instruction TO - 0F000h TO - 8000h T1- 7000h T1 - 7000h SUBSTITUTE SHEET
~.

- ~~2~0~0 4 ANDI and register with immediate value Description The contents of the destination register are anded with a 32 bit immediate value and the result is stored in the destination register.
Execution Rd <- Rd AND Value Encoding [9lhJ[Rd](Value] ( 6 Bytes ) Script example TO = TO AND 8000h Before Instruction After Instruction TO - OCOOOh TO - 4000h ~ BEEP produce an audible tine Description BEEP is exactly the same function as BEEPI except that the information used to produce the tone is stored in ROM and is referenced by the operand specified in this command. There are three predefined tones of one, rivo or three beeps with a duration of SOOmS and a period of SOOmS. If the reference operand is out of the range of 1 -3, this command will be ignored.
Execution SFLAG <- 1 NBEEPS <- BEEP[REF].NBEEPS
NDUR <- BEEP(REF].NDUR
NPER <- BEEP[REF].NPER
Encoding (71h][Reference Beep] ( 2 Bytes ) Script Example BEEP 2 Produces two tones, 500mS apart, for a duration of SOOmS for each tone.
b BEEPI producean audible tine Description BEEPI is used to produce an audible tone from the handheld terminal. Once this command is executed, the beep function will operate in the background allowing other instructions to be executed. There are two ways the beep function is terminated. First, the number of beeps specified in the command has expired; or second, a new program transaction has been received and execution of that program has started. The duration and period operands are defined to be 100mS units of time, with a maximum time value of 25.5 seconds.
Execution SFLAG <- 1 NBEEPS <- Operand # 1 NDUR <- Operand #2 SUBSTITUTE SHEET

212 4 U 0 ~ 93/10605 NPER <- Operand #3 Encoding (70h)(NBEEPSj[NDURjjNPERj ( 4 Bytes ) Script Example BEEPI 2, 5, S
Produces two tones, SOOmS apart, for a duration of SOOmS for each tone.
7 CLR clear resister Description The contents of the destination register is reset to zero.
Execution Rd <- 0 Encoding (20hj(Rdj .( 2 Bytes ) Script Example TO = 0 Before Instruction After Instruction 8 DISABLE disables handheld terminal Description When this command is executed, the handheld terminal will be set to the uninitialized state. The unit will no longer respond to the IR receiver or keyboard input from the user except in the access control mode to reinitialize the handheld terminal.
1<<ecution IFLAG c- 0 Encoding [OA4hj[Box IdJ ( 5 Bvtes ) Script Example DISABLE 12345678 Before Instruction After Instruction .9 DISPLAY write formatted text to the disolav Description Display . accepts a series of plain characters and delimiters in the string and outputs the formatted string to the display screen. The plain characters are copied verbatim to the display screen and the delimiters are used to specify the insertion of prestored strings, variables, end of display lines and end of display strings.
Delimiters NULL: Used to signify the end of a display string. When this character is encountered in the string, the formatted display string is transferred to the sixteen screen message buffer and becomes the active display message SUBSTITUTE SHEET

S92/0945~

in the buffer. 'Che encoded byte value for the NULL
character is 0.
VARIABLE: Used to signify that an internal register value will be inserted into the formatted text string. The VARIABLE delimiter is composed of the delimiter, register number to be displayed and the format specifies.
The encoded byte value for the VARIABLE character is Olh, followed by the register number and the format specifies. A total of three bytes are needed to define this delimiter.
The format specifies is composed of a four bit field defining the field width and a four bit field defining the field format. The field width is located in the upper nibble of the byte and specifies a field width of 1 - 15 characters. Refer to the table below for the definition of the field format located in the lower nibble.
0 - Left justified integer 1 - Right justified integer, blank padded 2 - Right justified integer, zero padded 3 - Reserved 4 - Left justified fixed point integer - Right justified fixed point integer, blank padded 6 - Right justified fixed point integer, zero padded 7 - 15 Reserved MESSAGE: Used to insert any of the prestored messages available in ROM or non-volatile memory.
When this delimiter is encountered. the current display line will be terminated and padded to 24 characters, if needed, and the prestored message specified will be inserted on the following display lines. The encoded b_vce value for the MESSAGE character is 02h, followed b5~
the prestored message number. A total of two bytes are needed to define this delimiter.
CR: Used to signify the end of a display line. If 24 characters where not specified for the current display line, the remainder of the display line will automatically be padded with blanks. The encoded byte value for the CR character is ODh.
Encoding (OAShJ[String]
Script Example DISPLAY 'Thanks for playing! Tune in & play again soon!"
Display Screen Line 1 - Thanks for playing! Tune Line 2 - in & play again soon!
DISPLAY'To get poll results,~rpress 'Yes' now:' SUBSTITUTE SHEET

Display Screen Line 1- To get poll results, Line 2 - press 'Yes' now.
DISPLAY "You have %i points.~t-Great work!", TSCORE
Display Screen Line 1- You have 20 points.
Line 2 - Great work!
DIV divide resisters Description The contents of the destination register are divided by the contents of the source register and the quotient is stored iri the destination register.
Execution Rd <- Rd / Rs Encoding (82h)(Rd)[Rs) ( 3 Bytes ) Script Example TO'= TO/T1 Before Instruction After Instruction 11 DIVI divide register by an immediate value Description The contents of the destination register are divided by a 32 bit immediate value and the quotient is stored in the destination register.
Execution Rd <- Rd / Value Encoding (92h)(RdJ(ValueJ ( 6 Bytes ) Script Example TO = TO / 20 Before Instruction After Instruction SUBSTITUTE SHEET
_ ~ .. . .

PCT/tJS92/09455 _ 2124~~0 12 DP'T delete PIU table Description Deletcs a PIU
table from non-volatile memory allowing a different to use that PIU table. All pro of the values in the e are cleared.
PI tabl Execution PIU(PID] <-Encoding (OAOh](PID Number)( 4 Bytes Script Example DELETE 112233 Before InstructionAfter Instruction PIU Table PIU Table RlrSP2 - 0 RESP2 - 0 FLAG - l 1h FLAG - 0 13 E~'IT terminate program execution Description Used to signal to the control software that the active transaction is finished.
execution TFLAG <- 0 Encoding [OA2hJ ( 1 Byte Script Example EXIT
Before Instruction After Instruction SUBSTITUTE SHEET

~ 44 '14 GO TO unconditinnai relative branch Description Used to update the transaction pointer and transfer program control to the new program location stored in the transaction pointer. If the value being stored in the transaction pointer is out of the current address range of the program, the program will be halted. The offset used for the relative branch is a 16 bit two's complement value.
Execution TP = TP + Offset Encoding [OA7h)[Offset] ( 3 Bytes ) Script Example GO TO LOOP
Before Instruction After Instruction TP - 1000h TP - 9FOh LOOP - 9FOh LOOP - 9FOh OFFSET - OFFFOh OFFSET - OFFFOh 1~ IF conditional branch Description This instruction is used to form higher level constructs:
IF, IF - THEN, IF - THEN - ELSE and WHILE. The two operands are logically or arithmetically compared.
All comparisons are referenced to operand A. Operand B can be a register or an immediate value.
If the logical or arithmetic comparison is true, the true offset wrll be added to the transaction pointer and program execution will be transfered to that new location. Otherwise, the false offset will be added to the transaction pointer. Below is a Iist of the available operators and their encoded values.
OOh - ">", Greater Than Olh - "<", Less Than 02h - "> _", Greater Than or Equal to 03h - "< _", Less Than or Equal to 04h - "_ _", Equal to OSh - "! _", Not Equal to 06h _ "AND", Logical AND
07h - "OR", Logical OR
Encoding [A9hJ[Operator][Operand AJ[Operand BJ(True Offset)[False Offset) ( 8/13 Bytes Script Example IF ( RESP1 == TO ) THEN
SUBSTITUTE SHEET

~~24Q00 16 INPUT input response Description Used to accept uscr input from the ke~rboard. The command can accept input from any location specified on the visible screen, specified by the X offset variable.
The number of keys entered from the keyboard can be limited bar the field width variable. If the field width variable is one, then an enter key is not needed to terminate an input response. If the timeout variable is non-zero, then the input response from the user will be timed and the remaining time will be displayeri on the screen. If the timer expires, the input command will terminate automatically and the input buffer will contain a null string.
There is one option available with the timed input response mode. The control program has the capability to display a decreasing score rather than time. This is achieved by specifying a register to decrement, a time to update the score and a value to decrement the register at every register update. The score will be displayed in the same location as the time. There is only a three character field to display the score within, so register values should not be greater than 999. If the initial register value to be displayed is greater than 999, then the input command will be terminated.
The string that is specified with the input command has the exact same format as the string format for the display command. Refer to the display command for a definition of the string format.
Encoding Timer Format (SOh](Field Width](X offset](TimeoutJ(String]
Score Format (Slhj(Field Width](X offset](Timeout][RsJ[Dec.](Time Inc.)(StringJ
Script Faample INPUT "How much are you willing to bet?", 3,33 INPUT "Enter your responselrnow?", 1, 30, 10, 0. 5, 2 SUBSTITUTE SHEET

WO 93/10606 PCT/US92/0945s .17 KEY define new decryption kev Description When executed, the 16 bit value specified will replace decryption KEY #3. This will allow all subsequent transactions that were encrypted with KEY # 3 to be decrypted by KEY #3. 'Ibis command does not delete the other decryption keys, allowing other transactions to be decrypted by KEY #l or KEY #2.
Execution KEY3 <- Value Encoding (OA3h](Value) ( 3 Bytes ) Script Example KEY 1234 Before Instruction After Instruction 18 LOCK lock out user input Description Used during a live interactive broadcast to terminate an input command. This should be the only command in the transaction except for a display or exit command. The lock command does not operate on any register or memory location. It is basically a NOP command.
The only function of this command is to terminate the currently executing program.

Execution Told <- Tnew Encoding (A8h) ( t Byte ) Script Example DISPLAY "No more inputs at thislrtime"

LO CK

EXIT

19 ~iOD calculate remainder Description The contents of the destination register are divided by the contents of the source register and the remainder is stored in the destination register.

Execution Rd <- Rd % Rs Encoding (83hJ(RdJ(RsJ ( 3 Bytes ) Script Example TO = TO % T1 Before Instruction After Instruction Tl-10 T1-10 SUBSTITUTE SHEET
r.

PCT/US92/0945s 20 MODI calculate remainder by an immediate value Description The contents of the destination register are divided by a 32 bit immediate value and the remainder is stored in the destination register.
Execution Rd <- Rd % Value Encoding j93h][Rd][Value] ( 6 Bytes ) Script Example TO = TO % 20 Before Instruction After instruction 21 'tOV move resister Description The contents of the destination register are loaded with the contents of the source register.
Execution Rd <- Rs Encoding j84hJjRdJ(RsJ ( 3 Bytes ) Script Example TO = T1 Before Instruction After Instruction " ~IO~~I load register with immediate value Description The contents of the destination register are loaded with a 32 bit immediate value.
Execution Rd <- Value Encoding (94h]jRd][Value] ( 6 Bytes ) Script Example TO = 1000 Before Instruction After Instruction SUBSTITUTE SHEET

2124~~0 _ 48 23 MPY multiply registers Description The contents of the destination register are multiplied with the contents of the source register and the result is stored in the destination register Execution Rd <- Rd * Rs Encoding (85h][Rd][RsJ ( 3 Bytes ) Script Example TO = TO * T1 Before Instruction After Instruction 2~ it4PYI multiply register with an immediate value Description The contents of the destination register are multiplied by a 32 bit immediate value and the result is stored in the destination register.
Execution Rd <- Rd * Value Encoding (95h](RdJ(Valuej ( 6 Bytes ) Script Example TO = TO * 100 Before Instruction After Instruction '= OR or registers Description The contents of the destination register are ored with the contents of the source register and the result is stored in the destination register.
Execution Rd <- Rd OR Rs Encoding (86hJ(Rd](RsJ ( 3 Bytes ) Script Example TO = TO OR T1 Before Instruction After Instruction TO - 8000h TO - OFOOOh T1- 7000h T1 - 7000h SUBSTITUTE SHEET

~~24~~0 26 ORI or reeister with immediate value Description The contents of the destination register are ored with a 32 bit immediate value and the result is stored in the destination register.
Execution Rd <- Rd OR Value Encoding [96hJ[Rd][Value] ( 6 Bytes ) Script Example TO = TO OR 33h Before Instruction After Instruction Tp - gOpph TO - 8033h 27 PRESTORE store disulay strip Description Used to store a display string to one of the six prestored message buffers in non-volatile memory. The display string can have a maximum length of eight display lines and can have any of the string delimiters embedded in the string except for the variable delimiter. If the string length is longer than eight display lines and the message number specified is not within the range of 6 - 10, then the command will be ignored.
Execution MSG(#j <- String Encoding [OA6hJ[Message #J[String]
Script Example PRESTORE "Please tn~ again", 6 MSG(6J <- "Please try again"
SUBSTITUTE SHEET

WO 93/10606 PCT/US92/0945s ~~~~oaQ
28 RNG specify input range Description The contents of the low & high registers are saved and used to execute input value range checking anytime an input command is executed. If the range command was not specified, then all input commands in the current transaction will not be range checked. If the input response is within the range, the processing of opcodes will continue. If the input response was entered for the first time the prestored message #2 will be displayed for two seconds and the user will be allowed to respond one more time after the display is restored. If the response was the second attempt the prestored message #3 will be displayed for two seconds and the input command terminated with a zero placed in the input buffer. The controller will begin executing opcodes after the input opcode.
Execution Low Range <- RI
High Range <- Rh Encoding [8Bh)[R1)[Rh) ( 3 Bytes ) Script Example RANGE T0, T1 Before Instruction After Instruction RL-10 _ RL-1 29 R\GI specify input range with immediate values Description The low & high 32 bit immediate values are saved and used to execute input value range checking anytime an input command is executed. If the range command was not specified, then all input commands in the current transaction will ,not be range checked. If the input response is within the range, the processing of opcodes will continue. If the input response was entered for the first time the prestored message #2 will be displayed for two seconds and the user will be allowed to respond one more time after the display is restored. If the response was the second attempt the prestored message #3 will be displayed for two seconds and the input command terminated with a zero placed in the input buffer. The controller will begin executing opcodes after the input opcode.
Execution Low Range <- Low Value High Range <- High Value SUBSTITUTE SHEET
r 21~40~Q
Encoding [OAlhJ[Low Value)[High Value) ( 9 Bytes ) Script Example RANGE 1, 2 Before Instruction After Instruction RFLAG - 0 RFL.AG - 1 30 RSTF reset PIU flan bit Description This instruction resets a bit of the PIU flag register. The bit that is reset is specified in the instruction.
Execution PIU(PID].FLAG(BITJ <- 0 Encoding (OOOlObJ[xxxJ ( 1 Byte ) Script Example RSTF 3 Before instruction After Instrucnon FLAG - FFh FLAG - F7 31 SETF sets PItJ flay bit Description This instruction sets a bit of the PIU flag register. The bit that is set is specified in the instruction.
Execution PIU[PID].FLAG[BIT) <- 1 Encodint (OOOllbJ(xxxJ ( l Byte ) Script Example SETF 3 Before Instruction After Instruction FLAG - lOh FLAG - 18h 3~ SHL shift register left Description The contents of the destination register are shifted left by the number of bits specified by the value in the source register.
Execution Rd <- Rd SHL Rs Encoding [87h][RdJ[RsJ ( 3 Bytes ) Script Example TO = TO SHLT1 Before Instruction After Instruction SUBSTITUTE SHEET

~.~2~000 TO - 1000h TO - 8000h Tl-3 TI-3 33 SFiLI shift register lets by an immediate value Description The contents of the destination register are shifted left by the number of bits specified by the 32 bit immediate value.
Execution Rd <- Rd SHL Value Encoding (97hj(Rdj(Valuej ( 6 Bytes ) Script Example TO = TO SHL 8 Before Instruction After Instruction TO - 100h TO - 10000h 34 SHR shift register right Description The contents of the destination register are shifted right by the number of bits specified by the value in the source register.
Execution Rd <- Rd SHR Rs Encoding (88hJ(Rdj(Rsj ( 3 Bytes ) Script Example TO = TO SHR T1 Before Instruction After Instruction TO - 1000h TO - 200h 3~ SHRI shift resister risht by an immediate value Description The contents of the destination register are shifted right by the number of bits specified by the 32 bit immediate value.
E.vecution Rd <- Rd SHR Value Encoding (98hJ(Rdj(Valuej ( 6 Bytes ) Script Example TO = TO SHR 8 Before Instruction After Instruction TO - 1000h TO - 10h SUBSTITUTE SHEET

212~~aQ
- ~ 53 ,.
36 SUB subtract resisters Description The contents of the destination register are subtracted from the contents of the source register and the result is stared in the destination register.
Execution Rd <- Rd - Rs Encoding (89hJ[RdJ[RsJ ( 3 Bytes ) Script example TO = TO - T1 Before Instruction After Instruction 37 SUBI subtract immediate value from register Description The contents of the destination register are subtracted by a 32 bit immediate value and the result is stored in the destination register.
Execution Rd <- Rd - Value Encoding (99hJ(Rd](Value] ( 6 Bytes ) Script example TO = TO - 50 Before Instruction After Instruction TO - i00 TO - ~0 38 TIME verif~~ real time Description When this instruction is executed. the dace and time of the real time clock is compared to the date and time specified with this instruction. Due to the potential for the real time clock to drift over time. the comparison will be made over a range of +- one minute. If the time of the handheld is out of this range. the unit will be set to it's uninitiaiized state and will no longer have the ability to process new transactions until it is reinitialized. If this instruction is used, it should be the first executable instruction in a transaction.
Execution If ( Real Time == Time Stamp ) Then Process Transaction Else Disable Handheld Encoding [60h](TIMFaDATE] ( S Bytes ) The encoded value of the year is the difference between SUBSTITUTE SHEET

the present. year and the year 1990. Below is a table of the encoded date and time:
Byte #1- M1 MO SS S4 S3 S2 S1 SO
Byte #2 - H3 H2 H1 HO MS M4 M3 M3 Byte #3 - M 1 MO D4 D3 D2 D 1 DO H4 Byte #4 - YS Y4 Y3 Y2 Yl YO M3 M2 Script Example TIME ~a TIME, Qa DATE
The current date and time variables are inserted by the RDI when it detects the time opcode. This is to insure that the real time of the handheld should match the real time of the program being aired.
39 XOR exclusive or registers Description The contents of the destination register are exclusive ored with the contents of the source register and the result is stored in the destination register.
Execution Rd <- Rd XOR Rs Encoding (8Ah)(Rd](Rs) ( 3 Bytes ) Script Example TO = TO XOR T1 Before instruction After Instruction TO - 8000h TO - 4000h T1 - OC000h T1 - OC000h -i0 XORI exclusiyeor register with immediate value Description The contents of the destination register are exclusive ored with a 32 bit immediate value and the result is stored in the destination register.
Execution Rd <- Rd XOR Value Encoding (9Ah][Rd)[Value] ( 6 Bytes ) Script Example TO = TO XOR 8033h Before Instruction After Instruction TO - 8000h TO - 33h SUBSTITUTE SHEET

WO 93/10605 PCT/US92/0945~
2124~~Q
able 3 Pre~torea t,iessages Message #1 Line 1 - Too Late! Try next time!

Message #2 Line 1 - Not a valid choice.\r Line 2 - Try again now!

Message #3 Line 1 - Still not valid.lr-Line 2 - Better luck next time!

Message #4 Line 1 - Press enter after your\r Line 2 - answer.

Message #11 Line 1 - Enter your choice now.

Message #12 Line 1 - Enter your answer now.

Viessage #I3 Line 1 - Select your answer &\r Line 2 - then press "Enter"

l~iessage #14 Line 1 - Sorry invalid answer.You Line 2 - have one more chance now 'tessage #15 Line 1 - Invalid answer.No answer Line 2 - will be accepted now.

'iessage # 16 Line 1 - Good answer! You are\r Line 2 - right!

Message #17 Line 1 - Wrong answer. Too Bad!

Message #18 Line 1 - Good try! You can do\r Line 2 - better next time!

Message #19 Line 1 - Nice try! Better luck\r Line 2 - next time!

Message #20 Line 1 - Goad score! You may be\r Line 2 - a winner!

Message #2I Line 1 - Enter answer before the\r Line 2 - time displayed runs out!

Message #22 Line 1 - The faster you answer,\r Line 2 - the higher you score!

Message #23 Line 1 - Not fast enough. Sorry.

SUBSTITUTE SHEET

WO 93/10605 PCTlUS92/0945~

Message #24 Line 1 -Sorry, too late.
Message #25 Line 1-Thank you.
Message #26 Line 1 - Thanks for playing! Tune Line 2 - in & play again soon!
Message #27 Line 1-Thanks for tuning in!1r Line 2 - Please join us again!
Message #28 Line 1- Tune in and try again\r Line 2 - next time!

Message #29 Line 1- To qualify to win, your Line 2 - must register your score Message #30 Line 1- To enter by mail, press\r Line 2 -'yes" now.

.'Message #31 Line 1 - To register your scorer Line 2 - by mail,press "yes"
now.

Message #3? Line 1 - To save your score press Line 2 - "save" then 1,2 or 3;or\r Line 3 - write your score downlr Line 4 - now!

Message #33 Line 1-To save this info,presslr Line 2 - "save" then 1,2 or 3;orlr Line 3 - write it down now.

Message #34 Line 1 -To save phone# presser Line 2 - "save" then 1.2 or 3;orlr Line 3 - write it down now.

'iessage #35 Line 1- To get survey results,\r Line 2 - press "yes" now.

lZessage #36 Line 1-To get poll results,\r Line 2 - press "yes" now.

lZessage #37 Line 1- To get a copy of the\r Line 2 - rules,press "yes"
now.

Message #38 Line 1- Winners will be notified Line 2 - by certified mail.
Message #39 Line 1- To get the list of\r Line 2 - winners,press "yes" now.
114essage #40 Line 1-To get your test results Line 2 - press "yes" now.
Message #4I Line 1- To get your game score,\r SUBSTITUTE SHEET
_ r.

WO 93/10605 PCT/US92/0945~
~~2~000 Line 2 - press 'yes" now.

Message #42 Line 1 - To get your score result "

now.
Line 2 - press'~cs Message #43 Line 1- You must be 12 or olderlr Line 2 - to use 900#'s.

Message #44 Line 1- Parental consent needed~r Line 2 - if under 18 years old.

Message #45 Line 1- Must be 18 years or~r Line 2 - older to win.

Message #46 Line 1- Void where protu-bited by Line 2 - law Message #47 Line 1- For more information,lr Line 2 - press 'yes" now.

~~fessage #48 Line 1 - For a summary of ruleslr Line 2 - press "yes" now.

'Tessage #49 Line 1 - Welcome to a new TVIr Line 2 - experience!

'iessage #50 Line 1- Hello! We hope you are~r Line 2 - enjoying our program!

Message #S1 Line 1- We're glad you're back!

SUBSTITUTE SHEET

WO 93/1060 PCf/US92/0945~

w V G
> w ~ ~ m a~

;_ a~

a L c~cc ~ cn a>

~--.

U , U
U

~ a ~, z m ~

p ~

f.r L O C p N (n _ E" C

. CJO ff.U

i.r n.

~ U

c o y., U U rn~. o m 'O

' C7 r-r _ ~ o c O~

~., _ "'~ O ... L O
C
H

J-~vs O W

N pip ~
~ N

Q.
C

C ,~ _O
~ ~

~ v3 p > a~
o =' ~

o o ' ~

~ ~~ a a o z ~

SUBSTITUTE SHEET

PCT/US92/~945~

21240p0 T' c~ t0 cd ~

_ w ..r SUBSTITUTE SHEET

WO 93/10605 PCT/US92/0945~

M M

DD GO

'D

M

N H

O O

LL Q.

c~ cG

Q. _ ~ ~

_ _ SUBSTITUTE SHEET

WO 93/1060, PCT/LrS92/0945~

c ~ ~ -. a ~ o -, ~ -.

N 4 mn N 'p G o Oa t U ~ d ~ . = 0 0 a, L - L O 'O E G

c ., L ~ Oa O O

C O . d L L C

c ~,c x ~ ~ ~ o ~ w ~ .R

w . c L L ~ 3 u,,~ ccc n~ a~

GJ v: d c0 L . O N 'O N '~

I
n, 3 m -R N .J C:> . _ c~~..

m . O b L C .DO C
~I

(l7C C~tn L aJ N V~ N 4..-=. G ''~

m 3 a. a U -oa L
L C 'p . (/] r U .--. Tiv ~J T Vi. G~ L ..~. C,C V7v.C t r1. C CL

c o c L a~ ~...U --I a cvc c c: o a. . c~ tno _ x - 3 ~ . o a v m > L V >
c o v ..v o v~ d o - a v ~ ec._ e~
i V L v;L . L - V. O C - V:

L N O hD O u~ L L C L
Y

d O ~ U O a~ U w CJ 4J(!: ~ . d V7 3 U o ~ ~..,L ~,ug 2S~n voa as3 v~

on N

cV~
CL

~

_ cd N 0.

w SUBSTITUTE SHEET

2~~~~0 i O C!J

cnL o v o .~SE

'O L ~-.

C w ~L OJ

C N

'L~' J .
_ W L

z ~.

C d 'O

'D C

J ~ _ N

r L L

v: a o a~

' ' E

CIJL CC (D
i enw. C7 M

w G

c cd A. 0.

SUBSTITUTE SHEET

a v v o _ o ~ ~ a, a a 3 ~ c q7 Y N

....

dl Tl , bD

tn ~ o E o I
c c m o ,, ._ o c b~ to ~ , v~

U m , I
I

N ca > _ ~ , , i w" ~ a~

o ~ .~v I

c ~ ~' ~ v ~

._ o ~ ~ T ~ , , I

m . .a c. c. t173 c . N _.

w 3 a a.

Y~ ~ , ~D

oL

.D 'D W
,.~y ~ O OND

N N
V
d T
ca ~. 0.

SUBSTITUTE SHEET

~124pp0 _ ~' L l~L

o v eo o v 3 D =

N

L = ..d u7 O G7V7 p.~ . W =

N

c > y c~> 3 asm ~o., ~ E o L

3 L L m 3 ~ ~ ~ s o m L 3- > 3 d >

o ~. . .JE u, cc o . m o0 C L C c3LL cc5c~ tn C U N
C

v: 3 w r o c E N

W
O

~ 3 L . W v; L C c6 .

O

~n~. m .~ w ~ cv v 3 cd a~ a y n 3 3 c c~

a.E ' . L U o ,n ";

m d a. n.~ o ~, ~ ~ c ~ _ a~

O ~ ~ ~ 4 ..L c0 17 t 4.
(d L L 1fJC ~ L

0 o m 3 c~~! L E 3 L .. c..,w L ... CJ!n 'OV ~ L CC L

> C = U O O 4i O ..

w ,.. .,~, w d c~d ~ cc >, w ~

y ...., l l L ~ l J

,~, ~~, ~ ~~~

O
"~ ~ w ,~ (~
v~ a 00 ~

v~ ~ 'n C O
v~
~-N H , Q. ~ c~ ~ ~ ~ 'dn0 O

N ' ~ ~
~ N

~. ~ N
cd . _ >, 'n ~ O ~'.' O

4~.. 1.. ~ 4~ v~ ~ (~

w ~ ~ .' p ~
i-1 W

SUBSTITUTE SHEET

65 _ I
4w N J: Ov y _ L, p C
J

~

_ N .fir 4 N ~

r T fn ~

~.,~ G O . ~
~ ~ 1 ~ w v~ w .
a. NO 0. -~
p ~

ai ., ~w ~. ~

SUBSTITUTE SHEET

1t~ N
N
L
L N
'U 'D

b W
p w. ~, 47 4~
W
t1. p c~ ~ y~ a) "" a> o~
~ M 'O ~ ~ p O
~NU.~ ~OGLy SUBSTITUTE SHEET

~124~00 O
0.G
O G
E~ ...
a~ '~
G
~N

w fti .~
ww V7 ~.
N ~~-.
w ~ .G
w N G
C ~"
O ~, N ~
y~ >
a ~
Q' w G O
V
0.
a A.

U
N .~ ~ ...'~.~ _Vyd N ~ O G. b G.
G.

,, II ~ O
", p O ~_n ~ W 11.
G W ~ ~
' . O .. i. v.., O ~.-~ ~~ , v.
E..., ~ ~ O .
~-. ~ ~ O
v O
N

cd w N

4.
p. a~ an G G

a w SUBSTITUTE SHEET

~l~4pp0 0.~ v a a~
.~

w C

p N

v~
c in ~
c ~ o c 'c ~

o ...

v aW

w ~
c~
o w r r 3 m c c ,~
o N

w N .~ ~
o N H

~,, o o 'r n. a. .
o N .
~

; N p II v'~ _ o c~

E ~ ~ ~
' a '' v o ~

3 3 Wv ' "' ~
a ~. ,v SUBSTITUTE SHEET
_ t Q7 c cC Y .~

d d t O

c. U c. II

V a~

c- D cb .

G, ~ O ~ L L

4w ~

~

_ G C C L II U Y
~_ ~
v' Y
N

O
a U N V) ~j .~

y V

. C L II
G..~

, ~

~ C C . L d M
v~

N

N
Y
"4 ~".. . O~ .C1 ~' V

E.
W

V ~ v~ c.
~
~
U

~ . ~n G~ 0~U a~ O
'D
'O
'~
C~
w O

~
Q

N .
, 'p L . T L
, O
~
pp L . 'S

.
.Y ~
,.a Y

L L
O

~
d w c ~. ~n 3 7 C . II .. II

c. W ~ r-,~ N

a~
~o ~~-~ aN o''n air av~
o a° ao ,° ~ :d ~ ~, ao 0 0 ~ o ~ O
V G

G V O D" ~ ~ p ~..' Q. O ~ n s'. ~
4~.. .~>. O>~ O c0 Ov .bf~ GL '~
Gr :~ Gh G' W ~n 4.. O c~
-.
d O
d ~
d O
~ ~ ~ z > .
U ~ L '~ U
d 17 O
O L U CJ
L V II T :!
V N d CO C:
I I
L o. C' 7 ~. -O U d U
T L L1 U t O
L
d_ ... ,.. w <n C . II II C
w 3 .~ M ? d SUBSTITUTE SHEET

..
a c a o ~ on a~ o ~o, ao ~,-, .x o ~ o ~
a a,~ a~ a~

' "

_ v.

cd cps i~

SUBSTITUTE SHEET

2~~40~~

a .
.

.
V

Cy O ~n O O

N

r o 3 en a I '' G

p n o n. e~o a V C .. ~' m C
y V s..
(3.~
O

0 .,.. O O
(y O

H

NM

N

~
'S7 V

QSO O inO V
N

C

;~
.

,.rV U 4JV

V

C W o ~ ~n w y O
.r ,_,~ ~ c.

0 o I . o z ~. ~. ~ d ~ ~ a ~

.

~ C ~ ~ V
~
U

C C O C

'~ C
a 1. G 0.~' ~ ~' ~ ..
cd~_n 1. N ya>c~..
cv~_:

'D 'G p a W .., O
~ V

II 4. ~ O
~ 'D O
~ .--~
~ oZj .. ~ 0 p .~
v.~. O ~'~
O ~ N

~ N w . O
~ O
O N
O

O O ,3,~ H ~ O W..
'n O w c~ ~ O
. .Vn ~

V V D N
O N ~ ~ t3 N O
C1 t.. O
rVn p O O . , w ~
~ ~ p ,.., w y y aia~ ~ ~ ' A 3 ~
~, ~ Wv ~ ~
~ ~ .~ ~s O
>, a o : 3 3 ' c ~~;
~~ N~ ~ ~
~ ~
'~

Q Q . Q' ~ ~ f3 ~

o . . a. .
" ~ ~
w ' ~
'n o ~Wo f3~ ~ f , a < , SUBSTITUTE SHEET

O N O

E N d ~ 0 0 o w c0 u~ O o 0 o O N

~ w . o m v, V . aJ o L o ..
~., c7 i''. d bD d .m n N ~ LL

3 0 o c L ~ ul ~r ~ . _ , v v v E ,_ a .~v v~ .r >,c v v v v 0a cc~
~

V ccc E N N N v Z, 4.

_ V v;c' C i~D v . . . ~ i "~

:r y C
y~

c v o n.3 L L L L v o ~

~ a. n. a. ,_ o c>
>
>
;~

V L ~ ~ v O v .~ ~ 'o E , _-' c~

CJ
b w V C w C L O

U G. a1 'D ~ c~ r. N M V ..
C

C
V

_ c a m ~ v~

Y 'D cD cD cD QS
c.~.. i N

_ 'D In C .-rw N d v N

C

0 0 . cac E E E L._ cO O O ~ L O S aS c0 c~ O L

C7 E" ... E"V .-.C7 C7 C7 w G.

~

U V ~ ~-'~U

a ~

o ~ y ~a '~~' N ~ ..~
~

4., . 4., . ~ w O ~ ~ ~ p..
N O ~. O
~

_ N '-' ~ w 4"
O >

~ ~ >, a~ o a 3 3 . C a~-~ 0. ~, ~ a i. ~ ~ V~ _ ~ ~ 0 0.
. O D

cd O w ~
S D ..., b p ~ v~
'~ w.

(Z" ~ ~ c~
V1 ~

SUBSTITUTE SHEET
_ ... ~

WO 93/10605 ' PCT/US92/09455 'c ' ~ o, C7 " '-' ' p C cd p ,.~., p., ~ ~ TN
"~ O 'n ~ ....

Wp ~, cG N
O ~ .

~ Q. ~D
~ ~ b0 w C
~ V
p pL\
> ~ G

7 . ~
O ~ ~.Y ~ y,, .
LL G~ ~Y C ~ f_A
0 ~ ~ N
~

(~ ~, p O ...w. :d L, ~ ~ p 40 w H ~
~

~ O
~
CC H

.-W N M

SUBSTITUTE SHEET

Claims (65)

We Claim:

1. An interactive presentation system comprising:
means for receiving interactive data in association with a presentation of a first interactive event and one or more interactive aspects of said first interactive event;
said receiving means including means for defining and updating transaction structures (1) for allowing said interactive data to be communicated only as needed for the first interactive event and for each particular interactive aspect of the first interactive event and throughout the first interactive event and (2) for allowing the first event and each particular aspect of the first event to be interleaved with at least a second interactive event or an aspect of the second event while maintaining interactivity with each said interactive first and second events and each said interactive aspect thereof, such that a participant can selectively choose to interact with lees than all the events and aspects and still maintain interactivity with those events and aspects chosen;
and said receiving means including means responsive to said interactive data for presenting the participant with selectively chosen events and aspects.

2. The system of claim 1 wherein said receiving means includes:
a settop decoder for decoding said interactive data received in conjunction with the first event;
a handheld terminal for allowing the participant to interact with the first event; and means for providing communications between the settop decoder and the handheld terminal.

3. The system of claim 1 wherein said means for defining and updating transaction structures include:
means for storing an identification for each of a plurality of said transaction structures; and means for storing that portion of said interactive data in said transaction structure which is required for a particular aspect of the first event immediately before or during when said particular aspect is to be interacted with and means for storing a user response to said interactive data in said transaction structure].

4. The system of claim 1 wherein:
said interactive data, which is associated with each event or aspect of each event includes (1) interactive commands and (2) event specific data associated with each event or aspect of each event;
wherein said interactive data associated with each event or aspect of each event is stored in the means for defining and updating the transaction structures; and said system including processor means for processing the interactive commands in order to control the presentation of each interactive event.

5. The system of claim 4 wherein:
said receiving means including a message display; and said interactive commands in conjunction with the processor means causes messages to be displayed on said message display.

6. The system of claim 5 wherein:
said receiving means can receive said messages to be displayed and said means for defining and updating transaction structures can store said received messages; and said interactive commands cause selectively either one of said received messages or one of said stored messages to be displayed in order to initiate or continue with the interactive presentation.

7. The system of claim 1 wherein;
said means for defining and updating transaction structures for allowing said interactive data for one aspect of the first event to be used interactively by a participant while subsequent interactive data for a subsequent aspect of the first or secopnd event is being received by the receiving means for subsequent use by the participant.

8. The system of claim 1 wherein:
said receiving means including means for decoding said interactive data encoded in a vertical blanking interval of a television signal.

9. The system of claim 2 wherein:
said means for providing communication including an infrared encoder and transmitter associated with the settop decoder and an infrared receiver and decoder associated with the handheld terminal.

10. The system of claim 1 wherein:
said receiving means including means for receiving the interactive data at a high data rate and for substantially reducing the data rate so that the interactive data can be accurately received by the transaction structures of the defining and updating means.

11. The system of claim 1 wherein:
said receiving means and said transaction structures defining and updating means for additionally allowing said interactive data to be received in a manner that is transparent to the participant of the interactive aspect of the first or second event .

12. An interactive presentation system comprising:
means for receiving interactive data which includes commands and event specific data as needed throughout a presentation of a first event having one or more aspects which make up the first event, in accordance with specific requirements of any particular said aspect of the first event and as needed immediately before or during the presentation of any particular aspect, such that a participant need only be tuned to the particular aspect and not from the beginning of the first event in order to participate in that particular aspect;
means for storing the event specific data;
and means for acting responsive to the commands in order to use the event specific data stored by the storing means to allow a participant to interact with that particular aspect of the first event of the presentation.

13. The system of claim 12 including:
means for presenting messages;

said means for acting responsive to the commands for causing the message presenting means to display at least one of a message sent in association with the commands and a message prestored as part of the event specific data.

14. The system of claim 12 wherein:
said means for acting responsive to the commands for initiating and controlling the ability of the participant to interact with the presentation and for controlling the event specific data.

15. The system of claim 12 wherein:
said means for storing event specific data including means for defining and updating transaction structures (1) for allowing the event specific data to be communicated only as needed for each particular said aspect of said first event and throughout said first event such that a participant need only be tuned to that particular said aspect and not preview aspects of the first event in order to participate in that particular aspect of said first event and (2) for allowing said first event and aspects within said first event to be interleaved with at least a second event and any aspects within said second event while maintaining interactivity with any aspect of said first and second events to which the participant is tuned.

16. The system of claim 12 wherein:
said receiving means includes a settop decoder for decoding said interactive data received in conjunction with said first event;

said storing means includes a handheld terminal for allowing the participant to interact with said first event; and said system further includes means for providing communications between the settop decoder and the handheld terminal.

17. The system of claim 15 wherein said means for defining and updating transaction structures includes:
means for storing an identification for each of a plurality of transaction structures;
means for storing at least a portion of the event specific data; and means for storing a user response to the event specific data.

18. The system of claim 12 including:
a message display; and said commands in conjunction with the acting means for causing messages to be displayed on said message display.

19. The system of claim 15 wherein:
said receiving means can receive messages to be displayed and said means for defining and updating transaction structures can store said received messages; and said commands for causing, in conjunction with the acting means, selectively either one of said received messages or one of said stored messages to be displayed in order to initiate or continue with the interactive presentation.

20. The system of claim 15 wherein;

said means for defining and updating transaction structures for allowing said interactive data for one aspect of the first event to be used interactively by the participant while subsequent interactive data for a subsequent aspect of the first or second event is being received by the receiving means for subsequent use by the participant.

21. The system of claim 12 wherein:
said receiving means including means for decoding said interactive data encoded in a vertical blanking interval of a television signal.

22. The system of claim 12 wherein:
said receiving means including an infrared encoder and transmitter and the storing means includes an infrared receiver and decoder for communicating said interactive data between the receiving means and the storing means.

23. The system of claim 12 wherein:
said receiving means including means for receiving the interactive data at a high data rate and for substantially reducing the data rate so that the interactive data can be accurately stored by the storing means.

24. The system of claim 12 wherein:
said receiving means and said storing means for additionally allowing the interactive data to be received in a manner that is transparent to the participant of the event.

25. The system of claim 1 wherein:

said receiving means can receive said first event on a first channel and can receive said second event on a second channel.

26. The system of claim 1 wherein:
said receiving means need not be tuned to either the first or second event from the beginning of either the first or second event in order to maintain interactivity with any aspect of the first or second event chosen by the participant.

27. The system of claim 1 wherein:
said means for defining and updating transaction structures include score means for storing the results of only those aspects of said events that are interacted with by the participant.

28. The system of claim 27 wherein:
said score storing means can accumulate the scores for each event.

29. An interactive presentation system comprising:
means for receiving at a remote location interactive data in association with a presentation of an event, said interactive data including commands and event specific data;
means, at the remote location, for storing transactions including:
means for establishing a programmer table prior to receiving the interactive data, and means for updating said programmer table in response to the interactive data; and means, responsive to said commands and said programmer table, for presenting a participant with a transaction.

30. The system of claim 29 wherein, said means for presenting a participant with a transaction, presents a transaction based on a plurality of programmer tables stored in the means for storing transactions.

31. The system of claim 29 further including, a hand held terminal, wherein said means for storing and said means for presenting are contained within the handheld terminal.

32. The system of claim 29 wherein, said means for storing transactions includes a plurality of programmer tables, each of the plurality of programmer tables having a unique identification number.

33. An interactive presentation system comprising:
means for receiving interactive data such that when a participant chooses to participate in a first event said interactive data includes a first set of commands and first event specific data, and when the participant chooses to participate in a second event said interactive data includes a second set of commands and second event specific data;
means, in communication with the means for receiving, for storing data in programmer tables and for updating the programmer tables in response to the interactive data; said programmer tables defined such that interactive data is only received as needed and said first event can be interleaved with said second event while maintaining interactivity with each event;
and means, in response to said interactive data and the programming tables, for presenting transactions such that when the participant chooses to participate in the first event the transactions presented are in association with the first event, and when the participant chooses to participate in the second event the transactions presented are in association with the second event;
wherein, said participant can change between the first event and the second event throughout the first event and the second event, thereby interleaving the first event with the second event and interleaving the transactions presented in association with the first event with the transactions presented in association with the second event while maintaining interactivity with each event.

34. The system of claim 33 wherein:
said means for storing interactive data data only stores data needed for any of the first or second events or portion of any of the first or second events immediately before the event or portion thereof is presented and in a manner that is transparent to the participant, such that the participant can change back and forth between the first and second events and any portions thereof and maintain interactivity.

35. A method for making an interactive video presentation comprising the steps of:
constructing interactive data which is relevant to each aspect, which when taken together comprise a first event of an interactive video presentation such that such interactive data relevant to each aspect is self-contained and does not rely on interactive data for a previous-in-time aspect of the first event; and sending said interactive data synchronized with the aspect to which it relates to a participant such that the interactive data for each particular aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to said first event from the beginning of said first event in order to interact with the particular aspect to which the participant is presently tuned.

36. The method of claim 35 further including the steps of:
constructing interactive data which is relevant to each aspect, which when taken together comprise a second event of an interactive video presentation such that such interactive data relevant to each aspect of said second event is self-contained and does not rely on interactive data for a previous-in-time aspect of the second event; and interleaving at least one aspect of the second event with at least one aspects of the first event in order to make the interactive video presentation to the participant, such that the participant need not be tuned to either the first or the second event from the beginning of either the first or the second event in order to interact with the particular aspect to which the participant is presently tuned.

37. The method of claim 35, wherein said construction step includes constructing interactive data which includes commands and event specific data;
wherein said commands can be used for a variety of aspects of each event and for a variety of events; and further including the step of sending only those commands and the event specific data relevant to the particular aspect of the event immediately before or during the aspect is to be presented.

38. The method of claim 35 including the steps of:
sending events in addition to the first event to the participant, each said event having at least one aspect; and allowing a participant to select any particular aspect of any particular event with which to interact and to subsequently select any particular subsequent aspect of the same particular event or another event with which to interact.

39. A method for making an interactive presentation comprising the steps of:
sending interactive data synchronized with an aspect of an event to which it relates to a participant such that the interactive data for each particular aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to said event from the beginning in order to interact with the particular aspect to which the participant is presently tuned;
and receiving by the participant the interactive data relevant to the particular aspect of said event immediately before or during the aspect of the event that is being presented, so that the participant does not need to receive any interactive data relevant to prior aspects of the event.

40. An interactive presentation system comprising:
means for constructing interactive data which is relevant to each aspect which taken together comprise an event of an interactive presentation such that said interactive data relevant to each said aspect is self-contained and does not rely on interactive data for a previous-in-time aspect of the event;
means for sending said interactive data synchronized with the aspect to which it relates to a participant such that the interactive data for each aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to the event from the beginning of the event in order to interact with the aspect to which the participant is presently tuned; and means for the participant to receive the interactive data relevant to said aspect of said event immediately before or during when said aspect is being presented and interact with the interactive data and the aspect of the event, so that the participant does not need to receive any interactive data relevant to prior aspects of the event.

41. An interactive presentation system comprising:
means for constructing interactive data which is relevant to each aspect which when taken together comprise an event of an interactive presentation such that such interactive data relevant to each aspect is self-contained and does not rely on interactive data for a previous-in-time aspect of the event; and means for sending said interactive data synchronized with the aspect to which it relates to a participant such that the interactive data for each said aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to said event from the beginning of said event in order to interact with the aspect to which the participant is presently tuned.

42. An interactive presentation system comprising:
means for sending interactive data synchronized with an aspect of an event to which it relates to a participant such that the interactive data for each particular aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to each event from the beginning of each event in order to interact with the particular aspect to which the participant is presently tuned; and means for receiving by the participant the interactive data relevant to said particular aspect of an event immediately before or during when said particular aspect of the event that is being presented, so that the participant does not need to receive any interactive data relevant to prior aspects of the event.

43. A method of programming an interactive presentation comprising the steps of:

selecting a first event which has one or more aspects which when taken together comprise the first event as a whole; and constructing interactive data which is relevant to each aspect of the first event of the interactive presentation such that such interactive data relevant to each aspect is self-contained and does not rely on interactive data for a previous- in-time aspect of the first event so that a participant can interact with the particular aspect of the first event and the interactive data associated therewith without being required to receive or interact with interactive data associated with prior aspects of the first event.

44. The method of claim 43 including the steps of:
selecting a second event which has one or more aspects which when taken together comprise the second event as a whole;
constructing interactive data which is relevant to each aspect of the second event of the interactive presentation such that said interactive data relevant to each aspect is self-contained and does not rely on interactive data for a previous-in-time aspect of the first or second event so that a participant can interact with the particular aspect of the second event and the interactive data associated therewith without being required to receive or interact with interactive data associated with prior aspects of the first or the second event, and interleaving selected aspects of the first and the second event.

45. A method of broadcasting an interactive presentation comprising the steps of:
broadcasting a first event and one or more aspects of the first event;
broadcasting interactive data which is relevant to each aspect of the first event which when taken together comprise the first event of an interactive presentation such that such interactive data relevant to each aspect is self-contained and does not rely on interactive data for previous-in-time aspects of the first event; and said broadcasting step including the step of sending said interactive data synchronized with the aspect to which it relates to a participant such that the interactive data for each particular aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to the beginning of said first event in order to interact with the particular aspect to which the participant is presently tuned.

46. The method of claim 45 including the steps of:
broadcasting a second event and one or more aspects of the second event, interleaved with the first event and the aspects of the first event;
broadcasting interactive data which is relevant to each aspect of the second event which when taken together comprise the second event such that interactive data relevant to each aspect of the second event is self-contained and does not rely on interactive data for previous-in-time aspects of the first or second event;
said broadcasting step including the step of sending said interactive data synchronized with the aspect to which it relates to the participant such that the interactive data for each particular aspect is received immediately before or during the presentation of said aspect so that the participant need not be tuned to the first or second event from the beginning of the first or second event respectively in order to interact with the particular aspect to which the participant is presented tuned;
and interleaving the interactive data of the first and second aspects of the first and second event in the same manner that the aspect of the first and second event are interleaved.

47. A method for receiving an interactive presentation comprising the steps of:
receiving interactive data in association with a presentation of a first interactive event and one or more interactive aspects of the first interactive event; and defining and updating transaction structures (1) for allowing the interactive data to be communicated only as needed for the first interactive event and for each particular interactive aspect of the first interactive event and throughout the first interactive event and (2) for allowing the first event and each particular aspect of the first event to be interleaved with at least a second event or any aspect of the second event, such that a participant can selectively choose to participate in less than all the events and aspects and still maintain interactivity with those events and aspects chosen.

48. The method of claim 47 further including the step of:

storing the scores from any of those aspects of the events that are interacted with by the participant.

49. The method of claim 48 wherein:
said score storing step includes accumulating the scores from each event.

50. A method for receiving an interactive presentation comprising the steps of:
receiving interactive data which includes commands and event specific data as needed throughout a presentation of a first event having one or more aspects which make up the first event, in accordance with specific requirements of any particular aspect of the first event and as needed immediately before or during the presentation of any particular aspect, such that a participant need not be tuned to the first event from the beginning of the first event in order to participate in said any particular aspect;
storing the event specific data; and acting responsive to the commands in order to use the event specific data stored by the storing means to allow a participant to interact with that particular aspect of the first event of the presentation.

51. The system of claim 1 including:
means for reporting the results of the interactivity.

52. The system of claim 1 including:
means for storing a participant response to said interactive data in said transaction structures.

53. The system of claim 29 wherein:
said means for presenting a participant with a transaction, presents a transaction based on a programmer table stored in the means for storing a transaction.

54. The method of claim 39 wherein said aspect of an event includes a question and an answer, wherein said sending step includes sending the question and the answer.

55. The system of claim 15 wherein:
said first event is presented on a first television channel and said second event is presented on a second television channel.

56. The method of claim 36 including:
presenting the first event on a first television channel and presenting the second event on a second television channel.

57. The method of claim 44 including:
presenting the first event on a first television channel and presenting the second event on a second television channel.

58. The method of claim 46 including:
broadcasting the first event on a first television channel and the second event on a second television channel.

59. The method of claim 47 including:
receiving the first interactive event on a first television channel and the second interactive event on a second television channel.

60. The system of claim 1 wherein:
said receiving means receives interactive data such that the interactive data does not interfere with the presentation of the first or second event on a television monitor.

61. The system of claim 12 wherein:
said receiving means receives interactive data such that the interactive data does not interfere with the presentation of the first event on a television monitor.

62. The method of claim 35 including:
sending the interactive data such that the interactive data does not interfere with the presentation of the first event on a television monitor.

63. The method of claim 39 including:
receiving the interactive data such that the interactive data does not interfere with the presentation of the event on a television monitor.

64. The system of claim 42 including:
said receiving means receives interactive data such that the interactive data does not interfere with the presentation of the event on a television monitor.

65. The method of claim 47 including:
receiving the interactive data such that the interactive data does not interfere with the presentation of the first or second event on a television monitor.