WO2003067876A2

WO2003067876A2 - Dynamic hot spot

Info

Publication number: WO2003067876A2
Application number: PCT/US2003/003485
Authority: WO
Inventors: Steven O. Markel
Original assignee: Intellocity Usa, Inc.
Priority date: 2002-02-06
Filing date: 2003-02-04
Publication date: 2003-08-14
Also published as: ES2335398T3; ATE445967T1; AU2003219714A1; EP1483911A2; EP1483911B1; WO2003067876A3; US20030149983A1; DE60329662D1

Abstract

Disclosed is a method for defining, transmitting, creating, and displaying a dynamic hot spot on a video stream. Two or more trajectory points can define a dynamichot spot. The trajectory points may be used to interpolate the position of the hot spotduring the course of its movement.

Description

DYNAMIC HOT SPOT

Ci oss Reference to Related Applications

The present application is based upon and claims the benefit of United States Provisional Patent Application Senal Number 60/354,745 by Steven 0 Markel entitled "Tracking Moving Objects on Video with Interactive Access Points" filed February 6, 2002, the entire contents of which is hereby specifically incorporated by reference for all it discloses and teaches

Background

a Field

The present wπting pertains generally to interactive video and specifically to tracking of moving objects on video with interactive access points (hot spots) b Descπption of the Background Interactive video has not gained wide acceptance for several different reasons, among them are that the user interface can be unwieldy and that the programs tend to be labor intensive to produce The user interface currently in vogue for interactive video requires that the video be shrunk to about 2/3 of its oπgmal size, freeing up the remainder of the screen for interactive buttons and other content The interactive content needs to be manually designed, constructed, and updated in a very labor-intensive process

The shrunken video image takes away from the enjoyment of watching the show, and the additional interactive content is further distracting the viewer The interactive content generally contains buttons, text, possibly advertisements, and other elements that must be updated and changed dunng the course of the show In accordance with these pnor methods, the viewer is subjected to viewing the large border containing the interactive content while watching the program Further, when new interactive content became available, the viewer can be distracted from the program Content providers do not want to provide these distractions, nor do the viewers enjoy the distractions As such, neither the program nor the interactive content can be enjoyed to their fullest potential Interactive access points (hot spots) that reside on the content of the video program alleviate the problems of the shrunken video with the L- haped interactive

Page t content. See "System and Method for Web Based Enhanced Interactive Television Content Page Layout", application number 09/935,492 filed August 23, 2001 by Steven O. Markel, "Creating On Content Enhancements", application serial number 10/041,881 by Gary Rasmussen, et al, filed October 24, 2001, and "Post Production Visual Alterations", application serial number 10/212,289 filed August 2, 2002 by Thomas Lemmons all of which are commonly assigned and specifically incorporated herein by reference for all they teach and disclose. The major limitation of interactive access points on a video program is that the definitions of interactive access points are static, and it is difficult to create a dynamic interactive access point that is coordinated to track a moving object in a video. Using current technology, an interactive access point definition would have to be created for each frame.

Defining a hot spot for each frame of video consumes a large amount of bandwidth, as individual definitions must accompany each frame. Further, having several hot spots active on the screen simultaneously increases the bandwidth requirements even more. Also, extensive effort is required to separately place these hot spots on the correct location on each frame

It would therefore be advantageous to provide a system and method for integrating interactive enhancement video whereby hot spots may be created to track moving objects in a manner that is not cumbersome or complex. Additionally, it would be advantageous to minimize computational power and bandwidth for the creation, distribution, and use of interactive video.

Summary

The present disclosure overcomes the disadvantages and limitations of the prior art by providing a system and method for generating dynamic interactive access point definitions that do not require substantial bandwidth. The access points (i.e., hot spots) are located on the video content, allowing the viewer a much more engaging interactive video experience. A semi-automated method may be employed to help the producer create interactive content with a minimum of effort. The on-content hot spots allow a producer of an interactive video program to use the full screen of the video display for the program content and not be forced to shrink the very expensive program just to add the interactive content. The benefit to the producer is that the hard work and great expense that went into the production of the video is not deprecated or diminished by the interactive content.

Within this specification, reference is made to video signals, including broadcast signals. These terms shall be construed to comprise all forms of electronically stored motion pictures, such as television signals broadcast over the air, on cable or satellite distribution systems, as well as distribution channels over the internet, such as streaming media. The video signals may be distributed on stored media, such as DVD, tape, optical disks, or other such media. The signals shall further comprise formats such as MPEG, MPEG-2, NTSC, PAL, and any other form of video signal.

The present invention may therefore comprise a method for generating a dynamic hot spot for an interactive video program comprising: defining a trajectory, said trajectory having at least a start point and an end point, said start point being associated with a first frame identifier of said video program, said end point being associated with a second frame identifier of said video program; defining an action associated with said hot spot; defining attributes for said hot spot; and embedding a trigger into said interactive video program comprising said trajectory, said action, and said attributes.

The present invention may further comprise a method for displaying a dynamic hot spot on a video image comprising: providing a set top box capable of receiving triggers embedded in said video image; receiving a hot spot definition by said set top box, said definition comprising at least a start point and an end point which indicate a starting position and an ending position on said screen, and at least one frame identifier; creating a hot spot on said start point based on said hot spot definition; displaying said hot spot on said start point; determining a trajectory based on said hot spot definition; calculating intermediate positions for said hot spot for intermediate frames of said video between said start point and said end point; and displaying said hot spot on said video image for frames of said video between said start point and said end point.

The present invention may further comprise a method of creating and displaying a moving hot spot on a video signal comprising: defining a first trajectory point on a first frame of a video signal; defining at least one more trajectory point for a subsequent motion of said hot spot on said video signal on at least one subsequent frame of said video signal, said subsequent frame having at least one intermediate frame between said first frame and said subsequent frame; creating parameters to define an equation for a trajectory of said hot spot; creating a trigger comprising said parameters; transmitting said trigger to a set top box; creating said hot spot with said set top box; calculating an intermediate position of said hot spot for said at least one intermediate frame using said parameters; and displaying said hot spot on a video display.

The present invention may further comprise a system for interactive video comprising: an editing system that: defines a first trajectory point on a first frame of a video signal for motion of a hot spot, defines at least one more trajectory point for a subsequent motion of said hot spot on said video signal on at least one subsequent frame in said video signal, said subsequent frame having at least one intermediate frame between said first frame and said subsequent frame; creates parameters to define an equation for said trajectory of said hot spot; creates a trigger comprising said parameters; and inserts said trigger into said video signal; and, a set top box that receives said trigger, creates said hot spot, calculates at least one intermediate position of said hot spot for said intermediate frames using said parameters, and displays said hot spot on a video display. The advantages of the present invention are that the present invention can provide an improved interactive video experience, since the viewer may enjoy interactive content plus the underlying video show with minimal distraction. Further, since the methods of hot spot creation can be done inexpensively, a much larger body of interactive video content maybe created quickly, advancing the widespread acceptance of interactive video.

Brief Description of the Drawings In the drawings,

FIGURE 1 is an illustration of a video screen showing a news clip. FIGURE 2 is an illustration of the news clip of FIGURE 1 with hot spots overlaid thereupon.

FIGURES 3 A, 3B, and 3C are illustrations of a moving, i.e., dynamic hot spot FIGURE 4 is an illustration of a block diagram of an embodiment of the present invention for creating and displaying enhanced video content that is specifically enhanced with hot spots.

FIGURE 5 is a block diagram showing an embodiment of the present invention wherein hot spots may be created manually.

FIGURE 6 is a work flow diagram of a method of creating dynamic hot spots. FIGURE 7 represents a snippet of an exported XML file with hot spot information.

FIGURE 8 is a block diagram of a process foτ embedding triggers into a video signal.

FIGURE 9 is a flow diagram for a process executed by a set top box client to receive a trigger code.

FIGURE 10 is a flow diagram illustrating the process of incrementing a hot spot position.

Detailed Description of the Invention Figure 1 illustrates an unenhanced video image 100 depicting a video news clip. The news clip depicts a press conference announcing a tire recall, with one gentleman 102 speaking, a second gentleman 104 seated, and a picture of a tire 1 6 on an easel. The image is a news feed from a camera at a press conference and is typical of the images used in national nightly news programs.

Figure 2 illustrates a video image 200, which is the image of Figure 1 with hot spots overlaid thereupon. The gentleman speaking is defined with hot spot 202, the seated gentleman is defined by hot spot 204, and the tire is defined by hot spot 206. The hot spots 202, 204, and 206 are geometric shapes that are placed on top of the video signal. Hot spots 202 and 204 are rectangular hot spots that identify the two persons. Hot spot 206 is a hot spot defined by an eight-sided polygon. In general, a hot spot will have some action associated with it. For example, hot spot 202 may be linked to a short biography of the gentleman, so that when the viewer activates the hot spot, the gentleman's biography will be displayed. The viewer may select a hot spot by moving a cursor over the hot spot and selecting the hot spot. The cursor may be moved with a keypad, mouse, joystick, gyroscopic pointing device, or other device adapted to move a cursor on a video screen. In one embodiment, the viewer may step from one hot spot to the next and illuminate each hot spot in succession using a single key of a remote control or keyboard. A second key may be used to select the particular hot spot to launch some interactive content. The selection of the hot spot may require the viewer press a button, issue an audible command such as clapping, speaking, or otherwise provide input to activate the hot spot.

In some embodiments, hot spots may be shaped to closely follow the contour of a particular person or object in a video presentation. Such an embodiment may be particularly useful if many hot spots were to be presented, so that the viewer may be better able to distinguish which hot spot was associated with which object on the screen.

As the object on a video program moves and changes, so may the hot spot associated with the object. For example, if a hot spot is over a beverage can, and the beverage can is picked up by and actor and raised to the actor's lips, the hot spot associated with the beverage can may also move with the can. Further, if the video zooms into the can, a hot spot associated with the can may also zoom in. The hot spot may rotate, translate, zoom, or otherwise change shape, position, or size as it tracks an object. The movement of the hot spot on the screen draws the viewer into the program as the viewer becomes involved in the interactive aspects of the program. The viewer may watch the screen and track the object with a cursor as the viewer engages the interactive content. The viewer is focused on the object, not a button that may relate to the object that is located on the side of the screen. This is a powerful advantage for advertisers, who may be offering a product for sale as an impulse purchase. Such an advertisement may be much more effective if the purchaser does not lose focus on the product.

A moving hot spot, when visible,- ay be used to draw special attention to the object to which it refers. For some objects that appear small on the video screen, a highlighted hot spot that tracks the object will cause the viewer to pay attention to the object. For advertisers, any mechanism that forces attention to be drawn to the object for sale may be used to increase awareness and sales. In embodiments where multiple hot spots are located on the same video image, the hot spots may overlap. The producer or creator of the programming may develop rules to resolve how to handle the overlapping hot spots. For example, when a hot spot that refers to an object that is in front of a second object that also has a hot spot, the hot spot of the object in front may be given priority. In other cases, the area of overlap may be divided, with one half being assigned to one hot spot and the other half of the overlapping area being assigned to the second. In other cases, the hot spot that is defined first may be assigned to the rear, and any hot spots defined later that overlap might be given priority. Those skilled in the art may create other rules and methods of handling overlapping hot spots without violating the spirit of the present invention.

During mouseOver events with overlapping hot spots, the border of the nearest hot spot may be illuminated first, then as the cursor moves off of the first hot spot and over the second, the entire border of the second hot spot may be illuminated. In this manner, the object of the second hot spot may be more apparent to the viewer. Figures 3A, 3B, and 3C are illustrations of a moving, or dynamic hot spot.

Figure 3 A illustrates frame I of video signal 302 with a hot spot 304 located thereupon. The coordinates and size of the hot spot are given.

Figure 3B illustrates frame 200 of video signal 306 with a hot spot 308 located thereupon, with coordinates and size information. Figure 3C illustrates frame 400 of video signal 310 with hot spot 312 located thereupon, with coordinates and size information.

During the video sequence, the hot spot is desired to follow an object through the three points and form a trajectory 314. With the definition of the three points, at the locations defined by hot spots 304, 308, and 312, the intermediate locations of the hot spots may be interpolated.

The interpolation of the trajectory of the hot spot may be done with a minimum of one point, wherein the hot spot does not move. A two-point interpolation may take the form of a linear interpolation. Using three or more points may be used to form a curve that the hot spot will follow, both in physical location and in time. In other words, both the speed and location of the hot spot may be varied as it moves across the screen. The variation of the speed and location may be defined by three or more points of a trajectory curve.

Figure 4 is a block diagram of a method 400 for creating and displaying enhanced video content, specifically enhanced video with hot spots. A raw video signal 402 has hot spots added in block 404 to create a broadcast signal 406. The broadcast signal 406 is sent to a set top box 408 that processes the enhanced video signal to be displayed on a video display 410.

The method 400 is a genera] method for the creation and use of enhanced video. The raw video signal 402 may be the output from a single camera, or may be a mixed and edited video program from several cameras and/or video sources, including computer generated video. The video signal may be of any standard or format for the purposes of the present invention. In some embodiments, the video signal may come from a plurality of cameras shooting a live event, such as a sporting event. In other embodiments, the video signal may be a thirty second commercial that is pre-recorded, mixed, and edited. In still other embodiments, the video signal may be a half hour situation comedy show that is also pre-recorded.

The hot spot creation process 404 is the method that the hot spots are created and added to the raw video signal. A broadcast signal 406 is the output of the hot spot creation process 404. The broadcast signal 406 is the signal or signals that are transmitted to the set top box 408. In some forms, the broadcast signal 406 may be a signal sent over the air to antennas located in a viewer, sent via a cable video network or satellite distribution system to a subscriber, recorded on a video cassette or optical disk for playback at the viewer's convenience, or any other method of distributing a video signal. In addition, the broadcast signal may be packetized and sent over the internet to a viewer's set top box, personal computer, or other appliance capable of receiving and displaying the broadcast video signal.

The broadcast signal 406 may have commands or triggers, such as hot spot triggers, embedded inside the video signal. In some embodiments, the triggers may be embedded into the vertical blanking interval (VBI) of the video signal. In other embodiments, the commands or triggers may be sent in a separate broadcast signal or may be downloaded separately through an Internet connection. In still other embodiments, the broadcast signal may include a video signal on a DVD and a separate file for commands and triggers located on the same DVD or a separate DVD. For the purposes of this specification, the term broadcast signal shall be construed to include any form or combination of signals, files, or other definitions of a video signal and the commands and triggers necessary to reproduce an enhanced video program.

The set top box 408 receives the broadcast signal 406 and may perform some manipulation of the video signal prior to displaying the resultant signal on the viewer's video display 410. The set top box 408 may be capable of understanding and executing embedded commands. The set top box may take the form of a separate box that accepts the broadcast video and prepares a signal for display on a common television. In other embodiments, the electronics for the set top box may be incorporated directly into the television. In still further embodiments, the set top box may be a personal computer or other internet appliance, capable of receiving the broadcast signal from conventional television distribution networks or directly over the internet. Figure 5 is a block diagram showing an embodiment 500 of the present invention wherein hot spots may be created manually. The method 500 is an embodiment of the hot spot creation process 404 shown in Figure 4. The raw video signal 502 is fed into the manual hot spot creation process 504, from which is generated an XML export file 506. The XML export file 506 is matched with the raw video signal 502 in the trigger insertion application 508 and encoded into the vertical blanking interval (VBI) of the raw video signal 502 with the encoder 510. The result of the process is a broadcast signal 512.

The raw video signal 502 is preferred to be pre-recorded, mixed, and edited. The video may include live action video, computer generated video, stock footage, or any other type of video. Due to the manual nature of the process 500, live video feeds may not be preferred.

The manual hot spot creation 504, an embodiment of which is described hereinafter, may be any method whereby a user may position a video signal and manually define a hot spot and its associated parameters. In general, the manual methods rely on the user to position the video to a certain point in the presentation, create the hot spot by drawing or positioning a shape onto the video screen and enter some parameters. The manual methods may be done using a computer application or a specialized video processing equipment adapted to perform such functions

The result of the manual hot spot creation 504 may be an export file 506. The export file 506 may include all of the parameters associated with each hot spot. The export file 506 may be in XML or any other file structure as those skilled in the art may devise.

The trigger insertion application 508 merges the raw video signal 502 and the export file 506. The trigger insertion application 508 may create the triggers and commands necessary for a particular set top box to successfully decode and execute the hot spots. The trigger insertion application 508 may then package the triggers and commands with the raw video signal 502 to create the broadcast signal 510. The packaging may be to encode the triggers and commands into the VBI of the raw video signal. In another embodiment, the packaging may be to incorporate the triggers and commands into a data or command portion of the video signal. In other embodiments, the triggers and commands may be placed in a separate file that can be downloaded by a set top box. The trigger insertion application 508 will prepare and package the hot spot information in the formats necessary for a set top box to execute the hot spots and otherwise present the interactive video program.

Figure 6 is a work flow diagram of a method 600 of creating hot spots that are dynamic. In block 602, a user selects a video source to create the dynamic hot spot. As the user positions and plays the video in block 604, the user may hit pause to stop the video at the frame where the hot spot will be created in block 606. The user will then create the hot spot and assign attributes in block 608. The user then moves the video forward to the next point foτ defining or destroying the hot spot in block 610. The user may elect to continue creating points for the hot spot or may select the current point to destroy the hot spot from the video signal. The results are saved in a table in block 614 and the user advances the video to either the next location for a new hot spot in block 606 or the user is finished creating hot spots in block 614, where an export XML file may be created. The method 600 is directed at post processing a video signal and manually adding dynamic hot spots to the video. The basic process is to position the video to the frame where the first hot spot will be created, create the hot spot, move the video to another frame where the hot spot will be shown, add additional information to the hot spot, continue until the trajectory of the hot spot is defined, and save the positions and parameters of the hot spot. The information may define a trajectory that can be used to create movement of the hot spot on the display of the video signal, as will be discussed hereinafter.

The user selects a video source in block 602. The video source may be any type of program to which the user wishes to add hot spots. For example, the video may be a commercial advertisement for a product, a news program, a situation comedy, an educational documentary, or any other video signal.

The user positions and plays the video until the user finds a frame to start the hot spot in block 604. The user mayjog the video forward and backward to select the exact frame where the hot spot will begin in the sequence.

The user then pauses the video at the start point of the hot spot to begin the process of assigning attributes to the hot spot in block 606. These attributes include the action associated with the hot spot, plus any additional attributes that the user may desire, including the color, width of border, whether it is flashing, the hot spot's latency, and other attributes as may be required. The action may be to display a web page on the screen, highlight an area on the screen, create a text box with a description of the object in the hot spot, send a message to a server, or any other action typically associated with a hot spot.

The user defines the hot spot location in block 608. The hot spot may be located by using a cursor-pointing device, such as a mouse, joystick, stylus, trackball, keyboard, or other input device to create a hot spot of a specific geometry. In general, the ATVEF specification allows for circular, rectangular, or n-sided polygons as standard hot spots The hot spot may be created directly on the video image, allowing the user to position the hot spot exactly where the user wishes the hot spot to be. References made herein to the ATVEF specification are made for illustrative purposes only, and such references should not be construed as an endorsement, in any manner, of the ATVEF specification. The user then forwards the video to a frame of the video where a second position of the hot spot will be located in block 61 . The user mayjog the video forward and backward to find the exact frame for the second position. The second position maybe a point on a continuing trajectory or may be the point where the hot spot will be destroyed. The user uses the same methodology as in block 606 to create a second or subsequent position of the hot spot. The second or subsequent position may have translated, rotated, enlarged, or otherwise changed from the first position.

The user may continue to add positions to define the hot spot trajectory and when finished, the results are saved in a table in block 614. The table is updated with each new hot spot as it is created until the user is done creating hot spots.

The positions of the hot spots will be used to interpolate hot spots for each of the frames of the video between the first position and the last position. If two points are defined, the interpolation is linear from the first position to the second. If three or more points are defined, a trajectory curve may be created for the interpolation. In addition to translating from one position to a second, the hot spot may also be scaled, rotated, or otherwise changed. In general, it may be easier to restrict the first and second hot spots to being of the same geometric shape. For example, if the first hot spot was rectangular, the second hot spot may be restricted to also being rectangular. However, it is well within the abilities of those skilled in the art to create routines to create methods for the transformation or morphing of a first geometry of hot spot to a second geometry.

An XML export file is created in block 61 and saved. The XML export file may contain all of the attributes for the hot spots and maybe ready for integration into the video signal.

Figure 7 represents a snippet of an exported XML file with hot spot information. Figure 8 illustrates a method for embedding the hot spot information into a broadcast video signal, and represents an embodiment 800 of the trigger insertion application 508 of Figure 5. An XML export file 802 is merged with the video signal 804 in a trigger insertion application 806. The output of the trigger insertion application 806 is fed into an encoder 808 that produces the encoded broadcast signal 810.

The trigger insertion application 806 reads the XML export file 802, create the necessary trigger strings, and, at the appropriate frame time, merge the trigger with the incoming video stream by feeding both into the encoder 808. The trigger strings comprise the necessary information to instruct a receiver to create and execute a hot spot. A trigger string for a dynamic hot spot may take the form of:

t ctp : //www. 6ortteServer . com_> [v : l] [s .- hor.eρoc ( Fa , Ta , a , Ha , Wa , Fb Tb, I_Jb, Hb, Wb) ] ICC]

Where www.someServer.com is the link to which the hot spot will jump, Fa is the frame number of the first hot spot, Ta is the top coordinate for the first frame's hot spot, La is the left coordinate for the first frame's hot spot, Ha is the height of the first frame's hot spot, Wa is the width of the first frame's hot spot; Fb, Tb, Lb, Hb, Wb, are the corresponding frame number, top, left, height, and width of the second hot spot. The variable CC is a checksum that is used to validate the string.

The trigger string may be sent several frames prior to when the hot spot may be activated on the viewer's screen. The set top box may receive the trigger and prepare to execute the hot spot action when the appropriate time occurs.

The encoder 808 maybe a vertical blanking encoder such as a Norpak TES-3 encoder. Such an encoder is capable of encoding the output of the trigger insertion application 806 into an NTSC compliant VBI. In other embodiments, the trigger and command information may be embedded into a different portion of the video signal, such as a data section of an MPEG-2 video. In still other embodiments, the trigger and command information may be prepared and saved as a separate file intended to be used by a set top box during the presentation of the video program.

Figure 9 illustrates a flow chart of the sequence 900 for the set top box client to receive a trigger code. The trigger is received in step 902, parsed in step 904, and the delta time variable is initialized in step 906. A timer is initialized to fire off every frame, or every 33ms for a standard video frame length in step 910, then the process ends in step 912.

When the set top box receives a trigger command, the set top box parses the command in step 904. The parsing includes recalculating the checksum and comparing that to the transmitted checksum. If both checksums match, the trigger is assumed to be received correctly and is acted upon. If the checksums do not match, the trigger is ignored. Variables necessary to execute the trigger may be set up and initialized to certain values as required in this step. The delta time variable may be set up in step 906. The delta time variable may be the total number of frames from the first frame where the hot spot is created to the last frame where the hot spot is destroyed.

The frame counter may be set up in step 908. The frame counter may be the number of frames from the first frame where the hot spot is created. The frame counter may be used to calculate the interpolated intermediate positions of the hot spot.

A timer is initialized and set to fire off every frame of the video in step 910. A typical video frame may be 33ms in length, however other frame lengths may also be used. The increment of the timer may be greater than one frame, depending on the application. In some applications where the set top box does not have the processing bandwidth to calculate the hot spot locations for each frame, the timer may be set to increment at more than one frame. The set top box may have an internal routine that monitors the amount of processing bandwidth and adjusts the timer increment upwards or downwards based on other activities that the set top box may perform. The timer is active the entire time that the hot spot is active. After the timer is initiahzed, the process comes to an end in step 912.

Figure 10 illustrates a flow chart of process 1000 for the events that happen when the timer of step 910 of Figure 9 is fired. The timer fires in step 1002 and the frame counter is incremented in step 1004, and the frame counter is compared to the delta time variable in step 1006. If the frame counter is equal to or greater than the delta time variable, the timer is killed in step 1008, the hot spot is killed in step 1010 and the process ends in step 1012. If the frame counter is less than the delta time variable, the hot spot coordinates are recalculated in step 1014 and the process ends in step 1016.

The process 1000 is a process whereby the hot spot coordinates are updated to make the hot spot appear to move across a video screen in synchronous movement with an object on the video. On each increment, such as a single frame, the position of the hot spot is recalculated and a new location for the hot spot displayed on the screen. The process 1000 also includes the mechanism whereby the timer created in step 910 of Figure 9 may be ended. The timer fires in step 1002 The increment of the frame counter in step 1004 is the same increment as the timer is fired; otherwise the motion of the hot spot will not be in synchronous motion with the object that it is supposed to follow.

The frame counter is compared to the delta time in step 1006. The delta time is the total number of frames that the hot spot is supposed to be active. The frame counter is the current number of frames that the hot spot has been active. If the delta time is greater than the number of frames, the hot spot is still valid.

If the hot spot is no longer valid, the timer is killed in step 1008, the hot spot is killed in step 1010 and the process ends in step 1012. The hot spot may be killed in step 1010 by eliminating the hot spot from the HTML page that is displayed with the video image.

If the hot spot continues to be valid, the hot spot coordinates are recalculated in step 1014. The methods of determining the hot spot coordinates are varied. For dynamic hot spots that appear to move across the screen, the motion of the hot spot may be estimated as a straight line or a curve. In the case of a straight line, two points may determine the hot spot trajectory: generally a start point and end point. In the case of a curved line, several points, generally three or more, that define a start point, an end point and one or more points in between.

For the case of a straight line motion of a rectangular, ATVEF compliant hot spot, the coordinates for the intermediate positions may be calculated by the following equations:

Tc= ( (Tb-Ta) / ( Fb-Fa) ) ^» (cfn- Fa) Ta

Lc= ( (Lb-La ) / (Fb- Fa) ) ^« (cfn-Fa ) +La Hc= ( (Hb-Ha ) / (Fb- Fa) ) ^« ( cfn-Fa) +Ha wc= ( (Wb- a ) / (Fb-Fa) ) * (cfn-Fa) + a

Where Tc is the current Top coordinate, Lc is the current Left coordinate, He is the current Height value, Wc is the current Width value, cfh is the current frame number, Fb is the last frame number, and Fa is the first frame number. For the case of a curved trajectory, similar equations based on the calculated curve constants may be created and used to determine the intermediate coordinates. Those skilled in the art may create other methods for calculating the intermediate values of a hot spot coordinate and remain within the spirit and intent of the present invention.

The calculated values of the hot spot locations maybe inserted into the location variable for the hot spot each time the values are recalculated and thus the position of. the hot spot will appear to move across the screen as the viewer "watches the video image. The set top box may have several different modes for displaying dynamic hot spots, all of which may be manipulated and changed by the viewer to enhance the viewing experience. Among the modes for displaying dynamic hot spots include: having no hot spot borders shown, having borders shown in a certain manner, having only a selected group of borders shown, showing the borders on mouseOver, displaying text or graphics on mouseOver, or other modes as may be desired.

A mode that the viewer may select is to have the set top box remove all hot spot borders from the screen. In one embodiment of the present mode, the hot spots may be made totally inactive, and the viewer would thereby ignore the interactive video elements. In another embodiment of the present mode, the hot spots may be active, but no border or other interfering graphics would be present on the screen. In such an embodiment, the viewer would then need to find the interactive content on the screen. For example, a small icon in the corner of the screen may indicate the presence of interactive content. It would then be incumbent on the viewer to move the cursor on the screen to find the interactive hot spot and execute the associated action. Such a mode may be desirable in the case of a sporting event with many interactive elements. In such a case, the viewer who has watched previous events may be familiar with the style, type and location of the interactive content, so the viewer does not need to have any hot spot borders or other graphics cluttering the screen and preventing the viewer from fully enjoying the video experience.

The viewer may select the modes for the display of hot spots and other interactive elements. The modes selected by the viewer may be set for a specific broadcast, for each instance of a program such as a football contest, for a certain broadcast channel, for a certain period of time, or for all programs. All of the modes may be processed in the set top box, therefore each set top box may be configured independently. The set top box may store a particular viewer's settings separate from a second viewer's settings. In this manner, each viewer may configure their own preferences into the set top box and have the set top box configuration readily changed over to a new configuration when different viewers use the television.

Hot spots may be classified into certain groups when the hot spots are created. Individual groups of hot spots maybe selectively displayed. For example if a viewer is watching a football game, and the viewer was a fan of a particular player, the viewer may elect to have the hot spots associated with that particular player displayed.

In short review, this writing has disclosed a method for defining, transmitting, creating, and displaying a dynamic hot spot on a video stream. Two or more trajectory points can define a dynamic hot spot. The trajectory points may be used to interpolate the position of the hot spot during the course of its movement.

The foregoing description has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and other modifications and variations may be possible in light of the above teachings. The embodiment was chosen and described in order to best explain the principles of the invention and its practical application to thereby enable others skilled in the art to best utilize the invention in various embodiments and various modifications as are suited to the particular use contemplated. It is intended that the appended claims be construed to include other alternative embodiments of the invention except insofar as limited by the prior art.

Claims

ClaimsWhat is claimed is.

1. A method for generating a dynamic hot spot for an interactive video program comprising: defining a trajectory, said trajectory having at least a start point and an end point, said start point being associated with a first frame identifier of said video program, said end point being associated with a second frame identifier of said video program; defining an action associated with said hot spot; defining attributes for said hot spot; and embedding a trigger into said interactive video program comprising said trajectory, said action, and said attributes.

2. The method of claim 1 wherein said trigger is embedded into the vertical blanking interval of a video signal.

3. The method of claim 1 wherein said interactive video program comprises MPEG video.

4. A method for displaying a dynamic hot spot on a video image comprising: providing a set top box capable of receiving triggers embedded in said video image; receiving a hot spot definition by said set top box, said definition comprising at least a start point and an end point which indicate a starting position and an ending position on said screen, and at least one frame identifier; creating a hot spot on said start point based on said hot spot definition; displaying said hot spot on said start point; determining a trajectory based on said hot spot definition; calculating intermediate positions for said hot spot for intermediate frames of said video between said start point and said end point; and displaying said hot spot on said video image for frames of said video between said start point and said end point.

5. The method of claim 4 wherein said trigger is embedded into the vertical blanking interval of a video signal.

6. The method of claim 4 wherein said video image comprises MPEG video.

7. A method of creating and displaying a moving hot spot on a video signal comprising: defining a first trajectory point on a first frame of a video signal; defining at least one more trajectory point for a subsequent motion of said hot spot on said video signal on at least one subsequent frame of said video signal, said subsequent frame having at least one intermediate frame between said first frame and said subsequent frame; creating parameters to define an equation for a trajectory of said hot spot; creating a trigger comprising said parameters; transmitting said trigger to a set top box; creating said hot spot with said set top box; calculating an intermediate position of said hot spot for said at least one intermediate frame using said parameters; and displaying said hot spot on a video display.

8. The method of claim 7 wherein said trigger is embedded into the vertical blanking interval of said video signal.

9. The method of claim 7 wherein said video signal comprises MPEG video.

10. A system for interactive video comprising: an editing system that: defines a first trajectory point on a first frame of a video signal for motion of a hot spot; defines at least one more trajectory point for a subsequent motion of said hot spot on said video signal on at least one subsequent frame in said video signal, said subsequent frame having at least one intermediate frame between said first frame and said subsequent frame; creates parameters to define an equation for said trajectory of said hot spot; creates a trigger comprising said parameters; and inserts said trigger into said video signal; and, a set top box that receives said trigger, creates said hot spot, calculates at least one intermediate position of said hot spot for said intermediate frames using said parameters, and displays said hot spot on a video display.

11. The system of claim 10 wherein said trigger is embedded into the vertical blanking interval of said video signal.

12. The system of claim 10 wherein said video signal comprises MPEG video.