US20130191751A1 - Systems and methods for mapping media content to web sites - Google Patents

Systems and methods for mapping media content to web sites Download PDF

Info

Publication number
US20130191751A1
US20130191751A1 US13/750,159 US201313750159A US2013191751A1 US 20130191751 A1 US20130191751 A1 US 20130191751A1 US 201313750159 A US201313750159 A US 201313750159A US 2013191751 A1 US2013191751 A1 US 2013191751A1
Authority
US
United States
Prior art keywords
time
display region
media
media content
video content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/750,159
Inventor
Steven Robinson
Alexander Krassel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
XAXIS Inc
Original Assignee
Steven Robinson
Alexander Krassel
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=38475341&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20130191751(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Steven Robinson, Alexander Krassel filed Critical Steven Robinson
Priority to US13/750,159 priority Critical patent/US20130191751A1/en
Priority to US13/864,671 priority patent/US20130232418A1/en
Priority to US13/908,697 priority patent/US20130268842A1/en
Publication of US20130191751A1 publication Critical patent/US20130191751A1/en
Assigned to XAXIS HOLDINGS, INC. reassignment XAXIS HOLDINGS, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: 24/7 MEDIA, INC.
Assigned to XAXIS, INC. reassignment XAXIS, INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: XAXIS HOLDINGS, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74Browsing; Visualisation therefor
    • G06F16/748Hypervideo
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • G06F16/84Mapping; Conversion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/93Document management systems
    • G06F16/94Hypermedia
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9558Details of hyperlinks; Management of linked annotations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • This invention is directed to systems and methods for mapping media content to web sites. Specifically, this invention is directed to mapping screen locations of viewable and non-viewable media content and objects in viewable media content by means of media time segments and screen locations to web sites.
  • Some new methods of advertising in media have been conceived. These include product placements, when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content, and graphical overlays, such as pop-ups, crawls, and scrolls, which lay over the viewable media content.
  • product placements when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content
  • graphical overlays such as pop-ups, crawls, and scrolls, which lay over the viewable media content.
  • pop-ups crawls, and scrolls
  • FIG. 1 shows a display, media playing device, and remote control according to an embodiment of the present invention.
  • FIG. 2A shows a screen shot of a display with a crawl graphical overlay according to an embodiment of the present invention.
  • FIG. 2B shows a screen shot of a display with an image graphical overlay according to an embodiment of the present invention.
  • FIG. 3 illustrates a media playing device according to an embodiment of the present invention.
  • FIG. 4 illustrates data flow according to an embodiment of the present invention.
  • FIG. 5 illustrates a flowchart for operation of a media playing device according to an embodiment of the present invention.
  • Embodiments of the present invention are directed to mapping of media content and objects within the media content to web sites.
  • the media content is viewable media content and objects within the viewable media content are mapped based upon their screen locations during specific time durations to web sites.
  • the media content is non-viewable media content or viewable media content and mapping is performed based on the frame or time segment of the media content, and there may be default mapping for part or all of the media content.
  • the mapping may be executed through data externally associated with the media content or data physically embedded in the media content.
  • the embedded/associated data contain information that is used to instruct a browser what web site should be launched during a particular frame or time segment of playing media content.
  • consumers watching viewable media content may interact with the media content to launch a web browser to a specific destination web site or to multiple web sites.
  • the consumer/user may interact by clicking a button on a remote control, activating a pointing device, which may be an advanced pointing device, or through any other method used to interact with a television, computer, set top box, and/or media player.
  • the consumer/user may interact by voice commands.
  • the launching of the web browser to the specific web site(s) may be based on the time of the media content, for example the time measured in frames, with a certain number of frames per second, for viewable media content, or a time segment of non-viewable media content.
  • the launching may also be based on (x,y) coordinates of the media content and objects within the media content in addition to the time of the media content.
  • there may be a default web site that is launched to when there is no web site identified for a particular frame or time segment.
  • media producers, advertisers, and other content providers may specify the data structure for mapping media time segments and screen locations of viewable media content to websites. They may also specify the data structure for mapping time segments of non-viewable media content to web sites.
  • the data structures taught herein are merely illustrative structures for mapping media content to web sites and are not intended to be limiting.
  • Media playing devices process the data structures into data mapping objects, which are managed into queues and arrays in order to be dynamically evaluated. The media playing devices further can process and manage the data queues, arrays, and mapping objects to properly navigate a browser to a specific web site. As data may be associated with media content and/or embedded in media content (such as with an MPEG stream) manufacturers of media playing devices may load data structures for mapping media time segments as they believe appropriate in accordance with optimal processing for their hardware or software.
  • media content have media durations, which are time measurements. Generally, all playing of media content is measured in time and time offsets. Time is the total time of the media content and time offset is the time from the commencement of playing.
  • Viewable media content which includes, for example, television, movies, video, and video files, uses a Timecode measured in hours, minutes, seconds and frames, with approximately 30 frames per second (fps) for NTSC (National Television Systems Committee) or 25 fps for PAL (Phase Alternation Line, the format used in Europe).
  • the commencement of viewable media content is zero and time portions (or durations or points) in the viewable media content are measured in HH:MM:SS:FF, or Hours:Minutes:Seconds:Frames.
  • a video whose length is two hours, fifteen minutes, thirty seconds and ten frames would have a duration of 02:15:30:10.
  • a stop of play at any time in the media content would be measured from an origin of 00:00:00:00. For example, if a video were stopped one hour, twelve minutes, fifteen seconds after starting during the twelfth frame of the second, the Timecode would be 01:12:15:12.
  • Sound media content uses a Timecode measured in hours, minutes, seconds and hundredths of seconds, or HH:MM:SS:hh.
  • the viewable media content may be measured solely with respect to frames.
  • a time portion of the media content may be one or more frames, such as Frame.sub.1-Frame.sub.N or [Frame.sub.2, Frame.sub.4-Frame.sub.6, Frame.sub.8].
  • the structure of a time portion may be any structure that will allow a user to choose a time portion of the media content during which it is desired to launch a browser to a web site.
  • the position of each object on the display has a number of (x,y) coordinates corresponding to the width and height from the origin.
  • the origin of a display is the top left corner, but it is envisioned that the origin could be at any other location, for example, the bottom left corner, top right corner, top left corner, or center of the display.
  • a particular video segment could contain any number of objects of which it is desired to know the position.
  • objects may be product placements, objects placed in a viewable media content to advertise themselves to the viewer. Examples could be coffee tables, sofas, shoes, cars, people, drinks, computers, and really anything that an advertiser wanted to show during the program.
  • a sofa could be a product that appears during a time duration of a viewable media content. At least once in the program, the sofa would appear beginning at HH.sub.1:MM.sub.1:SS.sub.1:FF.sub.1 and ending at HH.sub.2:MM.sub.2:SS.sub.2:FF.sub.2.
  • the sofa could appear any number of times, each time with a particular start time and end time.
  • the viewable media content might use multiple cameras.
  • One,camera angle might show the sofa and another camera angle might show a view that does not include the sofa. Switching between angles would start or end viewing of the sofa.
  • the position of the sofa would have a number of (x,y) coordinates defining its area.
  • the position of the object, sofa in this particular case could be represented by a rectangle, oval, or other general shape that allows a fairly simple algorithm to determine which coordinates are within the sofa area. It is also possible to map out more complex shapes that more closely track the location of the object or exact (x,y) coordinates where the object appears.
  • FIG. 1 shows a display 100 and media playing device 110 according to an embodiment of the invention.
  • the display 100 may be a television, computer monitor, or any other type of display.
  • the display 100 may be coupled to the media playing device 110 and may be part of the media playing device 110 or separate from the media playing device 110 .
  • FIG. 1 one frame is shown, in which a man is sitting on a sofa 104 .
  • the selection area 106 for the media-to-browser-destination-data (MBDD) is a rectangle.
  • the (x,y) origin 108 of the viewable area is at the upper left of the screen.
  • the origin of the rectangle selection area 106 is at the (x origin, y origin) 101 , which is the upper left of the selection area 106 .
  • the media playing device 110 is a set top box, such as would be used to receive cable or satellite television.
  • the media playing device 110 is activated by the remote control 120 .
  • Use of a remote control is illustrative only, and it is contemplated that any sort of interface with the media playing device could be used.
  • the (x,y) coordinates of an object may vary with each frame.
  • each frame would have its own set of (x,y) coordinates corresponding to each desired object.
  • Having the data to know when the object appears and the rectangle or other shape in which it appears will allow a remote control or other pointing device to not only act on the media content playing in a specific time segment (e.g., pause, etc.), but also a remote control or pointing device will allow selection of a specific object area within the time duration.
  • the activation of objects may be by voice commands. This will allow recognizing of embedded product placements or objects, which will allow consumers to do media commerce and advertisers to get more opportunities from product placements.
  • Graphical overlays are displays placed over playing video media content.
  • Video e.g., television, video, and video data files
  • graphical overlays are viewable objects in a subset of the (x,y) rectangular area of the video in a z-axis that appears above the video.
  • a remote control or pointing device or other interface such as one allowing voice commands, to interact with graphical overlays based on the time duration during which they appear as well as their rectangular coordinates. This will allow consumers to do media commerce and advertisers to get more opportunities from graphical overlays.
  • FIG. 2A and 2B show graphical overlays placed over the playing video media content.
  • a crawl 250 is on the z-axis that appears over the video on the display 200 , which may be part of the media playing device.
  • a pop-up 255 is on the z-axis that appears over the video.
  • a cursor 202 may be used to map a browser to a website.
  • the graphical overlay may be the only item that is associated with MBDD. Thus, there may be no need to have a cursor, and the user may merely activate a button on a remote control or another interface to launch the browser.
  • a consumer may launch a browser to a destination website, including, but not limited to, a website correlated to information provided on television or radio (e.g., embedded product placements), relating to a traditional advertisement or commercial, and/or responding to a pop-up, scroll or crawl displayed as a graphical overlay during a show.
  • a commercial may be considered media content.
  • a user may launch a browser to a destination web site correlated to information in the commercial.
  • a commercial would contain data to launch the browser to one web site, the web site for the advertised product/services, but it is possible that data could be included to launch to multiple web sites, either at the same time or during different frames or time segments of the commercial.
  • Viewable media content and non-viewable media content according to the present invention may come in multiple forms.
  • media content includes broadcast television, satellite television, cable television, MPEG files, Microsoft WindowsTM media files, WindowsTM video files, other types of video files, MP3 files, AVI files, sound files, broadcast radio, satellite radio, and so forth.
  • Graphical overlays are also included as media content, for example, images, videos, scrolls, crawls, etc. overlaid for display on a viewable screen's area of a display.
  • media content in embodiments of the present invention is associated with data regarding the content that is being viewed or listened to by the user.
  • the data associated with the media content is processed in a procedure that supports dynamic mapping of time sequences and, where desired, (x,y) coordinates of viewable media content and objects within the viewable media content to web sites.
  • media players to implement the methods include television set top boxes (e.g., cable or satellite boxes) personal computers, digital video recorders (DVR, e.g., a TWOTM recorder), a cable card that resides inside a television or monitor, MP 3 and other audio and video file players (e.g., an iPODTM player), video phones, video and/or audio cassette players, optical disk players (e.g., DVD and CD players), and any other type of video player.
  • DVR digital video recorders
  • MP 3 and other audio and video file players e.g., an iPODTM player
  • video phones e.g., video and/or audio cassette players
  • optical disk players e.g., DVD and CD players
  • any other type of video player e.g., DVD and CD players
  • the media player of the present invention contains software to launch an Internet browser, for example, Microsoft WindowsTM Internet ExplorerTM or Mozilla FirefoxTM Browser.
  • the browser software may be integrated into the media player apparatus itself.
  • the browser software may be included in the software or firmware loaded onto the device.
  • the software or firmware could be loaded at the manufacturing facility or other location prior to use by the purchaser. Alternatively, it could be downloaded over the Internet as an update or loaded onto the device in any other feasible way.
  • the browser software might be included in an operating system providing media viewing services or might be software loaded onto the computer separately, by disk, Internet, flash drive, etc. Any other type of media player described above, or capable of playing media content, may include browser software that would be able to launch Internet web sites as long as the media player can connect to the Internet, through wired or wireless means.
  • the media playing device 310 includes a receiver 350 to receive media content/files and media-to-browser-destination-data (MBDD) from data locations 370 .
  • the receiver 350 may receive the media content and MBDD from the same or different data locations 370 .
  • the receiver 350 is in communication with a processor 340 , which processes the MBDD and media content, as well as receiving requests from user input device(s) 320 .
  • the input device(s) 320 may include pointing devices, such as a mouse, keyboard, remote control, or laser pointer.
  • user input may be via a touch screen display, which would also be considered an input device even though it may be part of a display that is an output device.
  • the user input may be by voice commands through a microphone or other device.
  • the processor 340 is in communication with one or more output devices 360 , such as a display, television, speakers, headphones, etc.
  • the processor 340 is also in communication with a memory 380 , which can store the MBDD and/or the media content.
  • memory may refer to any type of storage device that may store the MBDD and/or the media content, including, without limitation, a semiconductor memory or hard drive.
  • FIG. 3 shows some of the components within the media playing device 310 and some outside the media playing device 310 , this embodiment is merely illustrative.
  • the input device(s) 320 and/or the output device(s) could be located within the media playing device 310 or partially within the housing of the media playing device 310 or separate from the media playing device 310 .
  • media-to-browser-destination-data is used to map the media content to particular web sites.
  • MBDD may arrive to a media playing device in a variety of ways.
  • MBDD may be embedded in media content or may be supplied separately.
  • MBDD may be embedded in media content (e.g., a media file), such as a video, music file or MPEG file.
  • the media content with embedded MBDD 415 may be sent to the media player 410 over the Internet 403 , by cable or satellite or other (e.g., radio) transmission 413 , may be located on a disk 423 , such as an optical storage disk or DVD, or other storage device 433 , such as a flash drive, and downloaded to the media player 410 from that disk 423 or storage device 433 , or may be passed to the media player 410 in any other feasible way.
  • the media playing device 410 such as a set top box, personal computer, or other type of media playing device contains software to decode and read the embedded MBDD from the video, music or MPEG file.
  • the MBDD or equivalent data may be embedded in a transport stream identified by a Packet Identifier (PID) and processed by the software.
  • PID Packet Identifier
  • the software reads and extracts the data from the transport stream and passes the MBDD into a data queue for use.
  • the MBDD is processed into an in-memory collection of data objects in the physical memory 407 of the media playing device 410 .
  • the MBDD contains one or more Advertisement Data blocks 405 , which will be discussed further below.
  • the MBDD provides the required information to the media player for proper browser navigation during play of any frame or time segment of the media content.
  • the web browser 408 which is on the media player device, is launched and is mapped to the requested URL Routing Server 401 over the Internet 403 or private network based on the MBDD.
  • MBDD may be embedded in a signal being transmitted 413 to the media playing device 410 , such as a signal from a television or radio broadcaster.
  • the MBDD could be identified and filtered by a Packet Identifier (PID) by the media playing device 410 .
  • PID Packet Identifier
  • the extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described.
  • the signal could also be transmitted from a media content provider that provides media content over the Internet.
  • a personal computer may have a software component that decodes and filters MBDD from IP packets.
  • the extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described.
  • the media player 410 then processes the transmission embedded MBDD 425 for use, similar to how the file embedded MBDD 415 is processed, and as discussed further below.
  • the MBDD provides the required information to the media player for proper browser navigation during play of any frame/time segment.
  • MBDD may be downloaded by the media playing device or pushed to the media playing device in advance, for example over the Internet 403 .
  • the media playing device may periodically download MBDD from a remote server/location 440 , such as a web site or private network, and maintain that MBDD for future use.
  • a remote server/location 440 such as a web site or private network
  • the MBDD will provide the required information to the media player for proper browser navigation during play of any frame or time segment of the media content.
  • MBDD may be provided by a graphical overlay, such as images, videos, scrolls, crawls, etc.
  • the MBDD code is included with the play out instructions for the graphical overlay.
  • the graphic overlay may be provided via any one of the methods discussed above, e.g., Internet, cable or satellite broadcast, disk or other storage device, or by any other suitable method.
  • the MBDD provides the required information for mapping from the graphical overlay to a particular web site.
  • MBDD may be in any format, including binary, that can be processed by a media playing device according to the present invention.
  • MBDD may be coded in any desired language, including, but not limited to, C, C++, C#, .Net, XML, and Java.
  • TABLE 1 is an example set of MBDD shown in XML format. The descriptions and tags provided in the XML sample in Table 1 are lengthened for ease of readability. Actual MBDD may be compiled or abbreviated to be lighter in weight to reduce transport and/or processing overhead.
  • TABLE 1 shows an example of MBDD according to the present invention.
  • the MBDD includes information about the media. For example, in TABLE 1, the media publisher, title of the media content, version information, and length of the media content are included. Additional information or less information may be included. In the MBDD shown in TABLE 1, there is a default URL and a default GUID (globally unique identifier). Also included in the MBDD are two “Advertisement Data” blocks. Each block includes information for instructing the media playing device what web site to launch at a particular time and location.
  • the scene name e.g., time offset and duration of the object (e.g., product placement), (x,y) coordinates, which include the distance from the origin to start a rectangle and the width and height of the rectangle that can be selected to launch to the URL Routing Server passing the optional GUID if supplied.
  • the rectangle starts at (0,0) and has a width and height of 100.
  • the MBDD also may include an area for custom data, for example, for the media player device manufacturers to extend the data format.
  • the media playing device reads and loads the MBDD data structure into memory when media content is loaded for viewing, when a media broadcast takes place, during a channel change, or in advance by downloading all information from the Internet for broadcasts.
  • a graphical overlay placed on the media playing device that plays independently of the media content may also include the same data in its file structure to be passed to the media playing device.
  • the ultimate browser destination web site can be changed at the URL Routing Server thereby eliminating the need to change any data in a physical media file.
  • This technique also allows for last minute web site destination changes without having to resend MBDD to a media player prior to a broadcast.
  • a laser or other pointing device or user interface, allows for supporting multiple product placements in the same time segment in viewable media content.
  • Using a Unique Lookup Key Value in the MBDD allows for future flexibility of modification of the ultimate web site to be mapped to, but without modification of an entire media file. For example, during the initial publication of media content, such as a national broadcast run of a viewable show distributed in a media file format, the ultimate browser navigation destination may be sold for a nationally advertised product. Years later, during syndication and local showing of the same media file, the ultimate browser navigation destination could be resold for a different web site destination.
  • FIG. 5 shows an example flow chart for the processing of MBDD data in an embodiment of the present invention.
  • the MBDD data unit providing time duration and optional rectangular area arrives to the consumer end point media player.
  • the rectangular area, or (x,y) coordinates, may be shaped in any desired way that allows selection of the shape.
  • the MBDD data unit is parsed and translated into a collection of objects in memory. These data objects represent information on objects appearing in the media content during time durations measured in Timecodes (HH:MM:SS:FF) and optionally areas within the viewable screen area.
  • the software or firmware running on the media playing device converts the data into an internal in-memory lookup table that for each “Advertisement Data” block, for example as shown in TABLE 1, maps the time offset from the beginning of the current program and the duration for this block to the rest of the information provided in the “Advertisement Data” block.
  • the “Advertisement Data” block can of course be named something completely different, such as “Product Placement Data.”
  • the optional (x,y) screen location information, if present in any or all of the “Advertisement Data” blocks may also be stored in internal data objects in the media playing device's memory.
  • all the lookup information describing all of the “Advertisement Data” blocks contained in the MBDD data unit for the current media program is contained in an in-memory collection of data objects in the physical memory of the media playing device.
  • the user clicks the designated button on the remote control (or any other controlling/pointing device) optionally pointing to a location on the screen. It is possible that the entire screen at a particular point may be designated to map to a single web site, so it would not be necessary to point at any object. In addition, it may be possible for the background area, or areas where data allowing mapping to a web site is not included, to have a default web site that launches upon activation of a controller.
  • the matching “Advertisement Data” block gets resolved by looking up the current offset of the media content in the internal in-memory lookup table.
  • the time offset and the (x,y) screen location of the remote control/pointer are processed and matched to the time offsets, durations and areas of the collection of in-memory data objects.
  • the process of finding the match is done as follows: (1) the correct subset of Advertisement Data Blocks is obtained by finding the resulting subset of all the in-memory objects for which the time of the user event occurs within the time interval between the time offset and the time offset plus duration. (2) If the resulting subset is a non-empty subset the resulting subset may be further narrowed by comparing the (x,y) screen location of the user event to the areas provided by the data objects in the resulting subset.
  • the system proceeds with the match as the selected matching entry. If no match based on location is found the first match based on time, the closest match to the (x,y) coordinates or any match based on time may be utilized. As a result of these steps if a matching entry is found (an entry that covers the time interval during which the browser navigation request has occurred), then the system proceeds to 509 , where the appropriate “Unique Lookup Key Value” is relayed to the appropriate “URL Routing Server” (both of these results come from the matching in-memory data object). The final destination URL is obtained. The URL Routing Server resolves the “Unique Lookup Key” to a particular URL string, which is returned back to the media playing device.
  • a valid URL it is determined whether a valid URL has been obtained. If yes, at 513 , the media content is optionally paused, and a Web Browser is launched and navigated to the final destination URL.
  • the media content could be paused when pausing is supported by the media device player, such as a DVD player or a digital video recorder. The pausing could be automatic or an option of the user. If at 511 , a valid URL is not obtained, in 515 no action is taken, which is the end 521 of the sequence. Alternatively, an error message could be provided, for example “no URL available.”
  • a matching entry is not found for the current offset/screen location, it is determined in 517 if there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair for the entire MBDD data unit.
  • a default “URL Routing Server” and “Unique Lookup Key Value” would be to show a web page of all advertisers or upcoming episodes, etc.
  • no action could be performed, depending on the user preferences and/or the media playing device functionality.
  • the media playing device may have a default “Unique Lookup Key Value” and default .degree.
  • all of the corresponding MBDD in-memory data objects for the media program may be discarded from the device's memory.
  • all of the time offsets for this program inside the matching in-memory structures may be adjusted accordingly, so that when the user resumes the viewing, the following scenes also remain navigable.
  • MBDD embedded in a transport stream such as an MPEG transport stream may be discarded and loaded when the user changes a television channel.

Abstract

Systems and methods for mapping viewable and non-viewable media to websites are disclosed. Mapping is executed through associated or embedded data, based upon frame and/or time segment of the media. The media-to-browser-destination-data (MBDD) may be embedded in media content, embedded in a transmitted signal, downloaded or pushed to a media playing device, or provided by a graphic overlay. Media players are disclosed that can process the MBDD to launch a browser to a selected web site.

Description

    CROSS-REFERENCES TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 11/371,611, filed Mar. 9, 2006, pending, the entire contents of which are hereby incorporated by reference in this application.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • This invention is directed to systems and methods for mapping media content to web sites. Specifically, this invention is directed to mapping screen locations of viewable and non-viewable media content and objects in viewable media content by means of media time segments and screen locations to web sites.
  • 2. Description of Related Art
  • In recent years, the delivery of media programs to homes has become increasingly complex and sophisticated. Media programs were once simple viewable programs, such as television shows and movies, and non-viewable programs, such as radio shows, transmitted to antennas over airwaves at certain radio frequencies. As time went on, cable television was introduced, which allowed media content to be transmitted over cables, such as fiber-optic cables, broadening the amount of media content that could be delivered to homes all over the world. The development of satellite transmission of media content also allowed widespread distribution of media content both unencoded and encoded from satellites to various types of satellite dishes. Set top boxes receiving media content now allow for real time play and storage for future play, and transmission of media content has now evolved to transmission over the Internet. In addition to traditional television and set top boxes, home computer users can watch television or listen to radio programs on their computers. The combination of all these distribution capabilities, improved technology and availability of media content such as television and radio presents opportunities for incorporating new advertising methods into media distribution.
  • Some new methods of advertising in media have been conceived. These include product placements, when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content, and graphical overlays, such as pop-ups, crawls, and scrolls, which lay over the viewable media content. Currently, there is some availability of methods to determine the location of an object or graphical overlay. However, there is a need to integrate these methods into superior advertising techniques.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a display, media playing device, and remote control according to an embodiment of the present invention.
  • FIG. 2A shows a screen shot of a display with a crawl graphical overlay according to an embodiment of the present invention.
  • FIG. 2B shows a screen shot of a display with an image graphical overlay according to an embodiment of the present invention.
  • FIG. 3 illustrates a media playing device according to an embodiment of the present invention.
  • FIG. 4 illustrates data flow according to an embodiment of the present invention.
  • FIG. 5 illustrates a flowchart for operation of a media playing device according to an embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Embodiments of the present invention are directed to mapping of media content and objects within the media content to web sites. In certain embodiments of the present invention, the media content is viewable media content and objects within the viewable media content are mapped based upon their screen locations during specific time durations to web sites. In further embodiments, the media content is non-viewable media content or viewable media content and mapping is performed based on the frame or time segment of the media content, and there may be default mapping for part or all of the media content. The mapping may be executed through data externally associated with the media content or data physically embedded in the media content. The embedded/associated data contain information that is used to instruct a browser what web site should be launched during a particular frame or time segment of playing media content.
  • In embodiments of the present invention, consumers watching viewable media content, for example, television, movies, video, and video files, or listening to media content, for example, radio, mp3 files, and sound files, may interact with the media content to launch a web browser to a specific destination web site or to multiple web sites. The consumer/user may interact by clicking a button on a remote control, activating a pointing device, which may be an advanced pointing device, or through any other method used to interact with a television, computer, set top box, and/or media player. In further embodiments, the consumer/user may interact by voice commands. The launching of the web browser to the specific web site(s) may be based on the time of the media content, for example the time measured in frames, with a certain number of frames per second, for viewable media content, or a time segment of non-viewable media content. For viewable media content, the launching may also be based on (x,y) coordinates of the media content and objects within the media content in addition to the time of the media content. In further embodiments, there may be a default web site that is launched to when there is no web site identified for a particular frame or time segment.
  • In further embodiments of the present invention, media producers, advertisers, and other content providers may specify the data structure for mapping media time segments and screen locations of viewable media content to websites. They may also specify the data structure for mapping time segments of non-viewable media content to web sites. The data structures taught herein are merely illustrative structures for mapping media content to web sites and are not intended to be limiting. Media playing devices process the data structures into data mapping objects, which are managed into queues and arrays in order to be dynamically evaluated. The media playing devices further can process and manage the data queues, arrays, and mapping objects to properly navigate a browser to a specific web site. As data may be associated with media content and/or embedded in media content (such as with an MPEG stream) manufacturers of media playing devices may load data structures for mapping media time segments as they believe appropriate in accordance with optimal processing for their hardware or software.
  • Currently, media content have media durations, which are time measurements. Generally, all playing of media content is measured in time and time offsets. Time is the total time of the media content and time offset is the time from the commencement of playing. Viewable media content, which includes, for example, television, movies, video, and video files, uses a Timecode measured in hours, minutes, seconds and frames, with approximately 30 frames per second (fps) for NTSC (National Television Systems Committee) or 25 fps for PAL (Phase Alternation Line, the format used in Europe).
  • The commencement of viewable media content is zero and time portions (or durations or points) in the viewable media content are measured in HH:MM:SS:FF, or Hours:Minutes:Seconds:Frames. For example, a video whose length is two hours, fifteen minutes, thirty seconds and ten frames would have a duration of 02:15:30:10. A stop of play at any time in the media content would be measured from an origin of 00:00:00:00. For example, if a video were stopped one hour, twelve minutes, fifteen seconds after starting during the twelfth frame of the second, the Timecode would be 01:12:15:12. Sound media content uses a Timecode measured in hours, minutes, seconds and hundredths of seconds, or HH:MM:SS:hh. In further embodiments, the viewable media content may be measured solely with respect to frames. For example, a time portion of the media content may be one or more frames, such as Frame.sub.1-Frame.sub.N or [Frame.sub.2, Frame.sub.4-Frame.sub.6, Frame.sub.8]. In other words, the structure of a time portion may be any structure that will allow a user to choose a time portion of the media content during which it is desired to launch a browser to a web site.
  • When viewable media content is playing on a display, the position of each object on the display has a number of (x,y) coordinates corresponding to the width and height from the origin. Generally, the origin of a display is the top left corner, but it is envisioned that the origin could be at any other location, for example, the bottom left corner, top right corner, top left corner, or center of the display.
  • In embodiments of the invention, a particular video segment could contain any number of objects of which it is desired to know the position. For example, in a television program or movie program, objects may be product placements, objects placed in a viewable media content to advertise themselves to the viewer. Examples could be coffee tables, sofas, shoes, cars, people, drinks, computers, and really anything that an advertiser wanted to show during the program. By way of example only, a sofa could be a product that appears during a time duration of a viewable media content. At least once in the program, the sofa would appear beginning at HH.sub.1:MM.sub.1:SS.sub.1:FF.sub.1 and ending at HH.sub.2:MM.sub.2:SS.sub.2:FF.sub.2. The sofa could appear any number of times, each time with a particular start time and end time. For example, the viewable media content might use multiple cameras. One,camera angle might show the sofa and another camera angle might show a view that does not include the sofa. Switching between angles would start or end viewing of the sofa. The position of the sofa would have a number of (x,y) coordinates defining its area. Simply, the position of the object, sofa in this particular case, could be represented by a rectangle, oval, or other general shape that allows a fairly simple algorithm to determine which coordinates are within the sofa area. It is also possible to map out more complex shapes that more closely track the location of the object or exact (x,y) coordinates where the object appears. In the case of the sofa, if someone were sitting on the sofa, it may be desirable to have only the (x,y) coordinates where the person is not sitting to correspond to the sofa. In this way, the person's clothing could be a different product placement with a different set of (x,y) coordinates.
  • FIG. 1 shows a display 100 and media playing device 110 according to an embodiment of the invention. The display 100 may be a television, computer monitor, or any other type of display. The display 100 may be coupled to the media playing device 110 and may be part of the media playing device 110 or separate from the media playing device 110. In FIG. 1, one frame is shown, in which a man is sitting on a sofa 104. In this embodiment, the selection area 106 for the media-to-browser-destination-data (MBDD) is a rectangle. The (x,y) origin 108 of the viewable area is at the upper left of the screen. The origin of the rectangle selection area 106 is at the (x origin, y origin) 101, which is the upper left of the selection area 106. It is measured as a being x origin number of pixels right (or an equivalent coordinate measuring system) of the origin 108 and y origin number of pixels down from the origin 108. The width 105 of the selection area 106 and the height 103 of the selection area complete the rectangle. Also shown in FIG. 1 is a cursor 102 that has been moved to lie over the selection area 106. In certain embodiments, the selection area 106 might change color, darken or lighten, or reverse colors to indicate that the cursor is over that area. In further embodiments a change in color or shading of the selection area 106 might only occur when a button or other interface is activated by a user. In FIG. 1, the media playing device 110 is a set top box, such as would be used to receive cable or satellite television. Use of a set top box is illustrative only, and it is contemplated that any media playing device could be used, as long as it is capable of using the MBDD. In FIG. 1, the media playing device 110 is activated by the remote control 120. Use of a remote control is illustrative only, and it is contemplated that any sort of interface with the media playing device could be used.
  • The (x,y) coordinates of an object may vary with each frame. Thus, each frame would have its own set of (x,y) coordinates corresponding to each desired object. Having the data to know when the object appears and the rectangle or other shape in which it appears will allow a remote control or other pointing device to not only act on the media content playing in a specific time segment (e.g., pause, etc.), but also a remote control or pointing device will allow selection of a specific object area within the time duration. In further embodiments, the activation of objects may be by voice commands. This will allow recognizing of embedded product placements or objects, which will allow consumers to do media commerce and advertisers to get more opportunities from product placements.
  • Graphical overlays are displays placed over playing video media content. Video (e.g., television, video, and video data files) takes up an (x,y) rectangular area on a single z-axis, and graphical overlays are viewable objects in a subset of the (x,y) rectangular area of the video in a z-axis that appears above the video. In addition to using a remote control to recognize product placements or objects, as discussed above, it is therefore possible to use a remote control or pointing device or other interface, such as one allowing voice commands, to interact with graphical overlays based on the time duration during which they appear as well as their rectangular coordinates. This will allow consumers to do media commerce and advertisers to get more opportunities from graphical overlays. FIGS. 2A and 2B show graphical overlays placed over the playing video media content. As shown in FIG. 2A, a crawl 250 is on the z-axis that appears over the video on the display 200, which may be part of the media playing device. In FIG. 2B, a pop-up 255 is on the z-axis that appears over the video. In either scenario, a cursor 202 may be used to map a browser to a website. In alternative embodiments, the graphical overlay may be the only item that is associated with MBDD. Thus, there may be no need to have a cursor, and the user may merely activate a button on a remote control or another interface to launch the browser.
  • In embodiments of the invention, a consumer may launch a browser to a destination website, including, but not limited to, a website correlated to information provided on television or radio (e.g., embedded product placements), relating to a traditional advertisement or commercial, and/or responding to a pop-up, scroll or crawl displayed as a graphical overlay during a show. In further embodiments, a commercial may be considered media content. For example, during commercial breaks, a user may launch a browser to a destination web site correlated to information in the commercial. Generally, a commercial would contain data to launch the browser to one web site, the web site for the advertised product/services, but it is possible that data could be included to launch to multiple web sites, either at the same time or during different frames or time segments of the commercial.
  • Viewable media content and non-viewable media content according to the present invention may come in multiple forms. For example, media content includes broadcast television, satellite television, cable television, MPEG files, Microsoft Windows™ media files, Windows™ video files, other types of video files, MP3 files, AVI files, sound files, broadcast radio, satellite radio, and so forth. Graphical overlays are also included as media content, for example, images, videos, scrolls, crawls, etc. overlaid for display on a viewable screen's area of a display.
  • To support mapping specific segments of media content and objects to different web sites, media content in embodiments of the present invention is associated with data regarding the content that is being viewed or listened to by the user. The data associated with the media content is processed in a procedure that supports dynamic mapping of time sequences and, where desired, (x,y) coordinates of viewable media content and objects within the viewable media content to web sites.
  • The methods of the present invention for mapping media content to web sites may be implemented on any media player. For example, and in no way by limitation, media players to implement the methods include television set top boxes (e.g., cable or satellite boxes) personal computers, digital video recorders (DVR, e.g., a TWO™ recorder), a cable card that resides inside a television or monitor, MP3 and other audio and video file players (e.g., an iPOD™ player), video phones, video and/or audio cassette players, optical disk players (e.g., DVD and CD players), and any other type of video player. The media player may also be integrated into a television or monitor itself.
  • The media player of the present invention contains software to launch an Internet browser, for example, Microsoft Windows™ Internet Explorer™ or Mozilla Firefox™ Browser. The browser software may be integrated into the media player apparatus itself. For example, if the media player apparatus is a set top box, DVR or similar device, or cable card or similar device, the browser software may be included in the software or firmware loaded onto the device. The software or firmware could be loaded at the manufacturing facility or other location prior to use by the purchaser. Alternatively, it could be downloaded over the Internet as an update or loaded onto the device in any other feasible way. When a personal computer is used, the browser software might be included in an operating system providing media viewing services or might be software loaded onto the computer separately, by disk, Internet, flash drive, etc. Any other type of media player described above, or capable of playing media content, may include browser software that would be able to launch Internet web sites as long as the media player can connect to the Internet, through wired or wireless means.
  • As shown in FIG. 3, in embodiments of the present invention, the media playing device 310 includes a receiver 350 to receive media content/files and media-to-browser-destination-data (MBDD) from data locations 370. The receiver 350 may receive the media content and MBDD from the same or different data locations 370. The receiver 350 is in communication with a processor 340, which processes the MBDD and media content, as well as receiving requests from user input device(s) 320. The input device(s) 320 may include pointing devices, such as a mouse, keyboard, remote control, or laser pointer. In addition or alternatively, user input may be via a touch screen display, which would also be considered an input device even though it may be part of a display that is an output device. The user input may be by voice commands through a microphone or other device. The processor 340 is in communication with one or more output devices 360, such as a display, television, speakers, headphones, etc. The processor 340 is also in communication with a memory 380, which can store the MBDD and/or the media content. As used herein, memory may refer to any type of storage device that may store the MBDD and/or the media content, including, without limitation, a semiconductor memory or hard drive. Although FIG. 3 shows some of the components within the media playing device 310 and some outside the media playing device 310, this embodiment is merely illustrative. For example, the input device(s) 320 and/or the output device(s) could be located within the media playing device 310 or partially within the housing of the media playing device 310 or separate from the media playing device 310.
  • In embodiments of the present invention, media-to-browser-destination-data (MBDD) is used to map the media content to particular web sites. As shown in FIG. 4, MBDD may arrive to a media playing device in a variety of ways. MBDD may be embedded in media content or may be supplied separately. For example, as shown in FIG. 4, MBDD may be embedded in media content (e.g., a media file), such as a video, music file or MPEG file. The media content with embedded MBDD 415 may be sent to the media player 410 over the Internet 403, by cable or satellite or other (e.g., radio) transmission 413, may be located on a disk 423, such as an optical storage disk or DVD, or other storage device 433, such as a flash drive, and downloaded to the media player 410 from that disk 423 or storage device 433, or may be passed to the media player 410 in any other feasible way. In this embodiment, the media playing device 410, such as a set top box, personal computer, or other type of media playing device contains software to decode and read the embedded MBDD from the video, music or MPEG file. For example, in an MPEG file the MBDD or equivalent data may be embedded in a transport stream identified by a Packet Identifier (PID) and processed by the software. The software reads and extracts the data from the transport stream and passes the MBDD into a data queue for use. As shown in FIG. 4, and as described below the MBDD is processed into an in-memory collection of data objects in the physical memory 407 of the media playing device 410. The MBDD contains one or more Advertisement Data blocks 405, which will be discussed further below. The MBDD provides the required information to the media player for proper browser navigation during play of any frame or time segment of the media content. The web browser 408, which is on the media player device, is launched and is mapped to the requested URL Routing Server 401 over the Internet 403 or private network based on the MBDD.
  • Also as shown in FIG. 4, in further embodiments, MBDD may be embedded in a signal being transmitted 413 to the media playing device 410, such as a signal from a television or radio broadcaster. For example, in an MPEG file (or MPEG transport stream) the MBDD could be identified and filtered by a Packet Identifier (PID) by the media playing device 410. The extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described. The signal could also be transmitted from a media content provider that provides media content over the Internet. For example a personal computer may have a software component that decodes and filters MBDD from IP packets. The extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described.
  • The media player 410 then processes the transmission embedded MBDD 425 for use, similar to how the file embedded MBDD 415 is processed, and as discussed further below. During viewing of or listening to media content transmitted over the signal, the MBDD provides the required information to the media player for proper browser navigation during play of any frame/time segment.
  • In further embodiments, MBDD may be downloaded by the media playing device or pushed to the media playing device in advance, for example over the Internet 403. For example, the media playing device may periodically download MBDD from a remote server/location 440, such as a web site or private network, and maintain that MBDD for future use. During viewing or playing of media content associated with the MBDD, the MBDD will provide the required information to the media player for proper browser navigation during play of any frame or time segment of the media content.
  • In further embodiments, MBDD may be provided by a graphical overlay, such as images, videos, scrolls, crawls, etc. When the graphical overlay information is provided to the media player, the MBDD code is included with the play out instructions for the graphical overlay. The graphic overlay may be provided via any one of the methods discussed above, e.g., Internet, cable or satellite broadcast, disk or other storage device, or by any other suitable method. During viewing of the graphical overlay, the MBDD provides the required information for mapping from the graphical overlay to a particular web site.
  • MBDD may be in any format, including binary, that can be processed by a media playing device according to the present invention. For example, MBDD may be coded in any desired language, including, but not limited to, C, C++, C#, .Net, XML, and Java. TABLE 1 is an example set of MBDD shown in XML format. The descriptions and tags provided in the XML sample in Table 1 are lengthened for ease of readability. Actual MBDD may be compiled or abbreviated to be lighter in weight to reduce transport and/or processing overhead. TABLE-US-00001 TABLE 1 <MBDD> <Media_Publisher Publisher=“CBS Television” Name=“Two and a Half Men” Version=“Episode 4 - 2005” Length=“00:24:00:00” URL_Default=“http://www.panthersoft.com/mbdd-[optional parameters]” Default_Lookup=“[Default GUID key goes here]” > <Advertisement_Data Scene_Name=“Charlie laying on sofa with magazine” Time_Offset=“00:05:10:10” Duration=“00:01:03:10” XOrigin=“0” Width=“100” YOrigin=“0” Height=“100” URL_Routing_Server=“http://www.panthersoft.com/mbdd-[optional parameters]” Unique_Lookup_Key_Value=“[GUID goes here]”/> <Advertisement_Data Scene_Name=“Charlie laying on sofa with magazine” Time_Offset=“00:05:15:10” Duration=“00:00:35:00” XOrigin=“250” Width=“100” YOrigin=“250” Height=“100” URL_Routing_Server=“http://www.panthersoft.com/mbdd-[optional parameters]” Unique_Lookup_Key_Value =“[Different GUID goes here]”/> </Media_Publisher> <Custom_Data> <!—Area for media player device (e.g., set top box) manufacturers to extend the MBDD data format—> </Custom Data> </MBDD>
  • TABLE 1 shows an example of MBDD according to the present invention. The MBDD includes information about the media. For example, in TABLE 1, the media publisher, title of the media content, version information, and length of the media content are included. Additional information or less information may be included. In the MBDD shown in TABLE 1, there is a default URL and a default GUID (globally unique identifier). Also included in the MBDD are two “Advertisement Data” blocks. Each block includes information for instructing the media playing device what web site to launch at a particular time and location. For example, in both of the “AdvertisingData” blocks in the MBDD shown in TABLE 1, included are the scene name, time offset and duration of the object (e.g., product placement), (x,y) coordinates, which include the distance from the origin to start a rectangle and the width and height of the rectangle that can be selected to launch to the URL Routing Server passing the optional GUID if supplied. In the first “Advertisement Data,” the rectangle starts at (0,0) and has a width and height of 100. The MBDD also may include an area for custom data, for example, for the media player device manufacturers to extend the data format.
  • In embodiments of the present invention, the media playing device reads and loads the MBDD data structure into memory when media content is loaded for viewing, when a media broadcast takes place, during a channel change, or in advance by downloading all information from the Internet for broadcasts. A graphical overlay placed on the media playing device that plays independently of the media content may also include the same data in its file structure to be passed to the media playing device.
  • During the scene commencing at the “Time Offset” shown in TABLE 1 and ending at the conclusion of the “Duration” period, activating the proper interface, such as a browser button on a remote control or a button on a media player, will cause the media player to send a look up request to the “URL Routing Server” passing the “Unique Lookup Key Value” to a URL Routing Server. The URL Routing Server performs a lookup using the Unique Lookup Key Value received from the media player. The URL Routing Server returns the web site destination to the media playing device, which launches the browser with the URL to the web site destination. Similarly, the browser on the media playing device can also pass the Unique Lookup Key Value on the URL Routing Server and be forwarded to the web site.
  • Bu using the Unique Lookup Key Value as a mapping mechanism, the ultimate browser destination web site can be changed at the URL Routing Server thereby eliminating the need to change any data in a physical media file. This technique also allows for last minute web site destination changes without having to resend MBDD to a media player prior to a broadcast.
  • In further embodiments, a laser, or other pointing device or user interface, allows for supporting multiple product placements in the same time segment in viewable media content.
  • Using a Unique Lookup Key Value in the MBDD allows for future flexibility of modification of the ultimate web site to be mapped to, but without modification of an entire media file. For example, during the initial publication of media content, such as a national broadcast run of a viewable show distributed in a media file format, the ultimate browser navigation destination may be sold for a nationally advertised product. Years later, during syndication and local showing of the same media file, the ultimate browser navigation destination could be resold for a different web site destination.
  • FIG. 5 shows an example flow chart for the processing of MBDD data in an embodiment of the present invention. At 501, the MBDD data unit providing time duration and optional rectangular area arrives to the consumer end point media player. The rectangular area, or (x,y) coordinates, may be shaped in any desired way that allows selection of the shape. At 503, the MBDD data unit is parsed and translated into a collection of objects in memory. These data objects represent information on objects appearing in the media content during time durations measured in Timecodes (HH:MM:SS:FF) and optionally areas within the viewable screen area. The software or firmware running on the media playing device converts the data into an internal in-memory lookup table that for each “Advertisement Data” block, for example as shown in TABLE 1, maps the time offset from the beginning of the current program and the duration for this block to the rest of the information provided in the “Advertisement Data” block. The “Advertisement Data” block can of course be named something completely different, such as “Product Placement Data.” The optional (x,y) screen location information, if present in any or all of the “Advertisement Data” blocks, may also be stored in internal data objects in the media playing device's memory. As a result, all the lookup information describing all of the “Advertisement Data” blocks contained in the MBDD data unit for the current media program is contained in an in-memory collection of data objects in the physical memory of the media playing device.
  • At 505, while watching media content on the screen, the user clicks the designated button on the remote control (or any other controlling/pointing device) optionally pointing to a location on the screen. It is possible that the entire screen at a particular point may be designated to map to a single web site, so it would not be necessary to point at any object. In addition, it may be possible for the background area, or areas where data allowing mapping to a web site is not included, to have a default web site that launches upon activation of a controller. When the user initiates the browser navigation on his/her media player, the matching “Advertisement Data” block gets resolved by looking up the current offset of the media content in the internal in-memory lookup table. At 507, the time offset and the (x,y) screen location of the remote control/pointer (if applicable) are processed and matched to the time offsets, durations and areas of the collection of in-memory data objects. The process of finding the match is done as follows: (1) the correct subset of Advertisement Data Blocks is obtained by finding the resulting subset of all the in-memory objects for which the time of the user event occurs within the time interval between the time offset and the time offset plus duration. (2) If the resulting subset is a non-empty subset the resulting subset may be further narrowed by comparing the (x,y) screen location of the user event to the areas provided by the data objects in the resulting subset. If a match based on an (x,y) screen location is found, the system proceeds with the match as the selected matching entry. If no match based on location is found the first match based on time, the closest match to the (x,y) coordinates or any match based on time may be utilized. As a result of these steps if a matching entry is found (an entry that covers the time interval during which the browser navigation request has occurred), then the system proceeds to 509, where the appropriate “Unique Lookup Key Value” is relayed to the appropriate “URL Routing Server” (both of these results come from the matching in-memory data object). The final destination URL is obtained. The URL Routing Server resolves the “Unique Lookup Key” to a particular URL string, which is returned back to the media playing device. At 511, it is determined whether a valid URL has been obtained. If yes, at 513, the media content is optionally paused, and a Web Browser is launched and navigated to the final destination URL. The media content could be paused when pausing is supported by the media device player, such as a DVD player or a digital video recorder. The pausing could be automatic or an option of the user. If at 511, a valid URL is not obtained, in 515 no action is taken, which is the end 521 of the sequence. Alternatively, an error message could be provided, for example “no URL available.”
  • If in 507 a matching entry is not found for the current offset/screen location, it is determined in 517 if there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair for the entire MBDD data unit. One potential use of a default “URL Routing Server” and “Unique Lookup Key Value” would be to show a web page of all advertisers or upcoming episodes, etc. Alternatively, no action could be performed, depending on the user preferences and/or the media playing device functionality. Still in further embodiments, the media playing device may have a default “Unique Lookup Key Value” and default .degree. CURL Routing Server.” If there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair, at 519, the default “Unique Lookup Key Value” is relayed to the default “URL Routing Server,” and the final URL is obtained.
  • Then the system would proceed as from 509 to 511 to determine if a valid URL has been obtained, and so forth, until the end 521.
  • Once media content is concluded, all of the corresponding MBDD in-memory data objects for the media program may be discarded from the device's memory. In further embodiments, if the media player pauses the media content in progress as it navigates the browser to the ultimate destination, then all of the time offsets for this program inside the matching in-memory structures may be adjusted accordingly, so that when the user resumes the viewing, the following scenes also remain navigable. Also, in further embodiments MBDD embedded in a transport stream such as an MPEG transport stream may be discarded and loaded when the user changes a television channel.
  • While the description above refers to particular embodiments of the present invention, it will be understood that many modifications may be made without departing from the spirit thereof. The accompanying claims are intended to cover such modifications as would fall within the true scope and spirit of the present invention.
  • The presently disclosed embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims, rather than the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

Claims (35)

1-19. (canceled)
20. A method of providing media content associated with a web site to a video player associated with a display screen, comprising:
receiving video content at the video player;
receiving control data at the video player, wherein the control data includes (a) time data indicating a time period related to the video content; (b) location data indicating a selectable display region of the video content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) a lookup value that has been defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) a URL routing server address of a URL routing server containing a web site destination to be launched when the lookup value has been sent by the video player to the URL routing server;
processing the control data into a memory;
playing the video content on the display screen;
during the display of the video content, receiving a user input, wherein the user input selects a selected screen location of the video content being displayed on the display screen at a selected time during the video content;
determining whether the selected screen location falls within the selectable display region and whether the selected time falls within the time period; and
if the selected screen location falls within the selectable display region and the selected time falls within the time period, passing the lookup value to the URL routing server at the URL routing server address;
receiving the web site destination from the URL routing server at the video player; and
launching a browser program that displays the web site located at the web site destination on the display screen.
21. The method defined in claim 20, where in the selectable display region is the entire display area of the video content.
22. The method of claim 20, wherein the location data indicating the display region includes one or more sets of (x,y) coordinates.
23. The method of claim 20, wherein the location data indicating the display region includes an (x,y) origin value, a width value, and a height value.
24. The method of claim 20, wherein the display region is shaped in a shape selected from the group consisting of a rectangle, an ellipse, a polygon, and a triangle.
25. The method of claim 20, wherein the user input is provided with an input device in communication with the video player.
26. The method of claim 25, wherein the pointing device is selected from the group consisting of a mouse, a keyboard, a remote control, a laser pointer, and a voice input device.
27. The method of claim 20, wherein the time data includes a time offset value and a duration value.
28. The method of claim 27, wherein the time offset value and the duration value are in a format selected from the group consisting of HH:MM:SS:FF, HH:MM:SS:hh, and a format using only frame numbers.
29. The method of claim 20, wherein the video content is television.
30. The method of claim 20, further comprising displaying a graphical overlay on the display screen during display of the video content, wherein the selectable display region includes a portion of the display screen where the graphical overlay is being displayed.
31. The method of claim 30, wherein the graphical overlay is selected from the group consisting of a pop-up, a scroll, and a crawl.
32. The method of claim 30, wherein the graphical overlay is on a z-axis displaying above the video content being displayed.
33. The method of claim 20, wherein the time interval indicated by the time data includes one or more frames of the video content.
34. The method of claim 31, wherein the graphical overlay is on a z-axis displaying above the z-axis of the video content being displayed.
35. The method of claim 20, wherein the time portion indicated by the time data includes one or more frames of the video content.
36. The method of claim 20, wherein the video player is a set top box.
37. The method of claim 20, wherein the video player is a computer.
38. The method of claim 20, wherein the video player is a television.
39. The method of claim 20, wherein the receiving of control data includes receiving data transmitted by a transmission method selected from the group consisting of Internet transmission, cable transmission, radio transmission and satellite transmission.
40. The method of claim 20, wherein the control data is received with the video content.
41. The method of claim 20, wherein the control data is received prior to the receiving of the media content.
42. The method of claim 20, wherein the control data is embedded in a transmission signal.
43. The method of claim 20, wherein the video content is played on the video player prior to receiving the entire video content.
44. A program code storage device, comprising:
a non-transitory machine-readable storage medium;
machine-readable program code, stored on the machine-readable storage medium, the machine-readable program code having instructions to:
receive video content at the video player;
receive control data at the video player, wherein the control data includes (a) time data indicating a time period related to the video content; (b) location data indicating a selectable display region of the video content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) a lookup value that has been defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) a URL routing server address of a URL routing server containing a web site destination to be launched when the lookup value has been sent by the video player to the URL routing server;
process the control data into a memory;
play the video content on the display screen;
during the display of the video content, receive a user input, wherein the user input selects a selected screen location of the video content being displayed on the display screen at a selected time during the video content;
determine whether the selected screen location falls within the selectable display region and whether the selected time falls within the time period; and
if the selected screen location falls within the selectable display region and the selected time falls within the time period, pass the lookup value to the URL routing server at the URL routing server address;
receive the web site destination from the URL routing server at the video player; and
launch a browser program that displays the web site located at the web site destination on the display screen.
45. A method of providing media content associated with a web site to a media player associated with a display screen, comprising:
receiving media content at the media player;
receiving control data at the media player, wherein the control data includes (a) time data indicating a time period related to the media content; (b) location data indicating a selectable display region of the media content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) a lookup value that has been defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) a URL routing server address of a URL routing server containing a web site destination to be launched when the lookup value has been sent by the media player to the URL routing server;
processing the control data into a memory;
playing the media content on the display screen;
during the display of the media content, receiving a user input, wherein the user input selects a selected screen location of the media content being displayed on the display screen at a selected time during the media content;
determining whether the selected screen location falls within the selectable display region and whether the selected time falls within the time period; and
if the selected screen location falls within the selectable display region and the selected time falls within the time period, passing the lookup value to the URL routing server at the URL routing server address;
receiving the web site destination from the URL routing server at the media player; and
launching a browser program that displays the web site located at the web site destination on the display screen.
46. The method defined in claim 45, where in the selectable display region is the entire display area of the media content.
47. The method of claim 45, wherein the location data indicating the display region includes one or more sets of (x,y) coordinates.
48. The method of claim 45, wherein the location data indicating the display region includes an (x,y) origin value, a width value, and a height value.
49. The method of claim 45, wherein the display region is shaped in a shape selected from the group consisting of a rectangle, an ellipse, a polygon, and a triangle.
50. The method of claim 45, wherein the user input is provided with an input device in communication with the media player.
51. The method of claim 50, wherein the pointing device is selected from the group consisting of a mouse, a keyboard, a remote control, a laser pointer, and a voice input device.
52. The method of claim 45, wherein the time data includes a time offset value and a duration value.
53. The method of claim 52, wherein the time offset value and the duration value are in a format selected from the group consisting of HH:MM:SS:FF, HH:MM:SS:hh, HH:MM:SS, a format using seconds, and a format using only frame numbers.
US13/750,159 2006-03-09 2013-01-25 Systems and methods for mapping media content to web sites Abandoned US20130191751A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US13/750,159 US20130191751A1 (en) 2006-03-09 2013-01-25 Systems and methods for mapping media content to web sites
US13/864,671 US20130232418A1 (en) 2006-03-09 2013-04-17 Systems and methods for mapping media content to web sites
US13/908,697 US20130268842A1 (en) 2006-03-09 2013-06-03 Systems and methods for mapping media content to web sites

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/371,611 US8370455B2 (en) 2006-03-09 2006-03-09 Systems and methods for mapping media content to web sites
US13/750,159 US20130191751A1 (en) 2006-03-09 2013-01-25 Systems and methods for mapping media content to web sites

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/371,611 Continuation US8370455B2 (en) 2006-03-09 2006-03-09 Systems and methods for mapping media content to web sites

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US13/864,671 Continuation US20130232418A1 (en) 2006-03-09 2013-04-17 Systems and methods for mapping media content to web sites
US13/908,697 Continuation US20130268842A1 (en) 2006-03-09 2013-06-03 Systems and methods for mapping media content to web sites

Publications (1)

Publication Number Publication Date
US20130191751A1 true US20130191751A1 (en) 2013-07-25

Family

ID=38475341

Family Applications (4)

Application Number Title Priority Date Filing Date
US11/371,611 Expired - Fee Related US8370455B2 (en) 2006-03-09 2006-03-09 Systems and methods for mapping media content to web sites
US13/750,159 Abandoned US20130191751A1 (en) 2006-03-09 2013-01-25 Systems and methods for mapping media content to web sites
US13/864,671 Abandoned US20130232418A1 (en) 2006-03-09 2013-04-17 Systems and methods for mapping media content to web sites
US13/908,697 Abandoned US20130268842A1 (en) 2006-03-09 2013-06-03 Systems and methods for mapping media content to web sites

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/371,611 Expired - Fee Related US8370455B2 (en) 2006-03-09 2006-03-09 Systems and methods for mapping media content to web sites

Family Applications After (2)

Application Number Title Priority Date Filing Date
US13/864,671 Abandoned US20130232418A1 (en) 2006-03-09 2013-04-17 Systems and methods for mapping media content to web sites
US13/908,697 Abandoned US20130268842A1 (en) 2006-03-09 2013-06-03 Systems and methods for mapping media content to web sites

Country Status (6)

Country Link
US (4) US8370455B2 (en)
EP (1) EP1999633A4 (en)
JP (1) JP2009529828A (en)
AU (1) AU2007222070A1 (en)
CA (1) CA2644860A1 (en)
WO (1) WO2007103000A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110213641A (en) * 2019-05-21 2019-09-06 北京睿格致科技有限公司 The micro- class playback method of 4D and device

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8386310B2 (en) * 2007-03-20 2013-02-26 Yahoo! Inc. System for measuring web traffic related to an offline advertising campaign
TW201207643A (en) * 2010-08-09 2012-02-16 Hon Hai Prec Ind Co Ltd System and method for searching information of images
TW201207642A (en) * 2010-08-09 2012-02-16 Hon Hai Prec Ind Co Ltd System and method for searching information of images
WO2014002259A1 (en) * 2012-06-29 2014-01-03 トヨタ自動車株式会社 Image information provision device, image information provision system, and image information provision method
US10051329B2 (en) * 2012-12-10 2018-08-14 DISH Technologies L.L.C. Apparatus, systems, and methods for selecting and presenting information about program content
KR101398781B1 (en) * 2014-03-05 2014-05-27 지윤 Media file recording medium having a time based hyperlink and the playing device
CN103929677B (en) * 2014-03-27 2017-11-07 小米科技有限责任公司 The method and apparatus that multimedia file is played

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5918012A (en) * 1996-03-29 1999-06-29 British Telecommunications Public Limited Company Hyperlinking time-based data files
US6070167A (en) * 1997-09-29 2000-05-30 Sharp Laboratories Of America, Inc. Hierarchical method and system for object-based audiovisual descriptive tagging of images for information retrieval, editing, and manipulation
US20040139474A1 (en) * 2001-05-10 2004-07-15 Carro Fernando Incertis System and method for enhancing broadcast or recorded programs with information on the world wide web
US20060156228A1 (en) * 2004-11-16 2006-07-13 Vizible Corporation Spatially driven content presentation in a cellular environment
US20070005783A1 (en) * 2005-06-30 2007-01-04 Intel Corporation Systems, methods, and media for controlling a media connection from within a remoting protocol

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995004974A1 (en) 1993-08-06 1995-02-16 The Commonwealth Of Australia A method of specifying links in hypermedia
CA2130395C (en) * 1993-12-09 1999-01-19 David G. Greenwood Multimedia distribution over wide area networks
US5708845A (en) * 1995-09-29 1998-01-13 Wistendahl; Douglass A. System for mapping hot spots in media content for interactive digital media program
US5774666A (en) * 1996-10-18 1998-06-30 Silicon Graphics, Inc. System and method for displaying uniform network resource locators embedded in time-based medium
US8635649B2 (en) * 1996-12-19 2014-01-21 Gemstar Development Corporation System and method for modifying advertisement responsive to EPG information
US6076104A (en) * 1997-09-04 2000-06-13 Netscape Communications Corp. Video data integration system using image data and associated hypertext links
US6006265A (en) * 1998-04-02 1999-12-21 Hotv, Inc. Hyperlinks resolution at and by a special network server in order to enable diverse sophisticated hyperlinking upon a digital network
US6154771A (en) * 1998-06-01 2000-11-28 Mediastra, Inc. Real-time receipt, decompression and play of compressed streaming video/hypervideo; with thumbnail display of past scenes and with replay, hyperlinking and/or recording permissively intiated retrospectively
US6564380B1 (en) * 1999-01-26 2003-05-13 Pixelworld Networks, Inc. System and method for sending live video on the internet
US6522342B1 (en) * 1999-01-27 2003-02-18 Hughes Electronics Corporation Graphical tuning bar for a multi-program data stream
US6847778B1 (en) * 1999-03-30 2005-01-25 Tivo, Inc. Multimedia visual progress indication system
US6538665B2 (en) * 1999-04-15 2003-03-25 Apple Computer, Inc. User interface for presenting media information
US20010049826A1 (en) * 2000-01-19 2001-12-06 Itzhak Wilf Method of searching video channels by content
US20020056120A1 (en) * 2000-01-21 2002-05-09 Mcternan Brennan J. Method and system for distributing video using a virtual set
US7200857B1 (en) * 2000-06-09 2007-04-03 Scientific-Atlanta, Inc. Synchronized video-on-demand supplemental commentary
US7213255B2 (en) * 2000-08-25 2007-05-01 Intellocity Usa, Inc. Set-top preview program
US7107606B2 (en) * 2000-08-30 2006-09-12 The Chinese University Of Hong Kong System and method for highly scalable video on demand
US7207006B1 (en) 2000-09-01 2007-04-17 International Business Machines Corporation Run-time hypervideo hyperlink indicator options in hypervideo players
US6859840B2 (en) * 2001-01-29 2005-02-22 Kasenna, Inc. Prefix caching for media objects
US20020112247A1 (en) * 2001-02-09 2002-08-15 Horner David R. Method and system for creation, delivery, and presentation of time-synchronized multimedia presentations
US20040128343A1 (en) * 2001-06-19 2004-07-01 Mayer Daniel J Method and apparatus for distributing video programs using partial caching
US7216170B2 (en) * 2002-05-22 2007-05-08 Microsoft Corporation Systems and methods to reference resources in a television-based entertainment system
US20040019900A1 (en) * 2002-07-23 2004-01-29 Philip Knightbridge Integration platform for interactive communications and management of video on demand services
US20050034153A1 (en) * 2003-08-08 2005-02-10 Maven Networks, Inc. System and method for delivery of broadband content with integrated interactive elements
US20050034151A1 (en) * 2003-08-08 2005-02-10 Maven Networks, Inc. System and method of integrating video content with interactive elements
WO2005015912A2 (en) * 2003-08-08 2005-02-17 Maven Networks, Inc. System and method of integrating video content with interactive elements
US20050044260A1 (en) * 2003-08-08 2005-02-24 Maven Networks, Inc. System and method for delivery of broadband content
US7451152B2 (en) * 2004-07-29 2008-11-11 Yahoo! Inc. Systems and methods for contextual transaction proposals
GB0521796D0 (en) * 2005-10-26 2005-12-07 Cardu Salvatore Gtgvr software application
US20090024922A1 (en) * 2006-07-31 2009-01-22 David Markowitz Method and system for synchronizing media files
US8015162B2 (en) * 2006-08-04 2011-09-06 Google Inc. Detecting duplicate and near-duplicate files
US7962523B2 (en) * 2008-04-11 2011-06-14 Yahoo! Inc. System and method for detecting templates of a website using hyperlink analysis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5918012A (en) * 1996-03-29 1999-06-29 British Telecommunications Public Limited Company Hyperlinking time-based data files
US6070167A (en) * 1997-09-29 2000-05-30 Sharp Laboratories Of America, Inc. Hierarchical method and system for object-based audiovisual descriptive tagging of images for information retrieval, editing, and manipulation
US20040139474A1 (en) * 2001-05-10 2004-07-15 Carro Fernando Incertis System and method for enhancing broadcast or recorded programs with information on the world wide web
US20060156228A1 (en) * 2004-11-16 2006-07-13 Vizible Corporation Spatially driven content presentation in a cellular environment
US20070005783A1 (en) * 2005-06-30 2007-01-04 Intel Corporation Systems, methods, and media for controlling a media connection from within a remoting protocol

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110213641A (en) * 2019-05-21 2019-09-06 北京睿格致科技有限公司 The micro- class playback method of 4D and device

Also Published As

Publication number Publication date
WO2007103000A2 (en) 2007-09-13
AU2007222070A1 (en) 2007-09-13
US20130232418A1 (en) 2013-09-05
EP1999633A2 (en) 2008-12-10
CA2644860A1 (en) 2007-09-13
US20070214234A1 (en) 2007-09-13
US20130268842A1 (en) 2013-10-10
JP2009529828A (en) 2009-08-20
EP1999633A4 (en) 2010-07-14
US8370455B2 (en) 2013-02-05
WO2007103000A3 (en) 2008-04-17

Similar Documents

Publication Publication Date Title
US20130191751A1 (en) Systems and methods for mapping media content to web sites
US20190082212A1 (en) Method for receiving enhanced service and display apparatus thereof
JP5395813B2 (en) Content and metadata consumption techniques
US9438966B2 (en) System and/or method for distributing media content and providing an option to maintain an advertising experience
US9154668B2 (en) Video display device and control method thereof
US8640161B2 (en) Providing content interruptions
US9516392B2 (en) Method and system for content delivery
US8813118B2 (en) Interactive content for media content access systems and methods
CN103988219B (en) Personalized passive content delivery
JP5410565B2 (en) Various methods and systems for providing advertisements
JP5080584B2 (en) Method and apparatus for downloading auxiliary program data to DVR
US20120233646A1 (en) Synchronous multi-platform content consumption
US11558657B2 (en) Integration of control data into digital broadcast content for access to ancillary information
KR20130133918A (en) Systems and methods for selecting media assets for display in a screen of an interactive media guidance application
JP2012508486A (en) Content linkage method and system using portable device
JP2010098730A (en) Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system
US9173001B1 (en) Media content access systems and methods
JP6203657B2 (en) Video display device
WO2013121475A1 (en) Information display device and information display method
JP7099947B2 (en) Transmission / reception system and transmission / reception method
JP6392956B2 (en) Video display device and video display system

Legal Events

Date Code Title Description
AS Assignment

Owner name: XAXIS HOLDINGS, INC., NEW YORK

Free format text: CHANGE OF NAME;ASSIGNOR:24/7 MEDIA, INC.;REEL/FRAME:032151/0050

Effective date: 20131231

AS Assignment

Owner name: XAXIS, INC., NEW YORK

Free format text: CHANGE OF NAME;ASSIGNOR:XAXIS HOLDINGS, INC.;REEL/FRAME:032239/0182

Effective date: 20131231

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION