US20130268842A1 - Systems and methods for mapping media content to web sites - Google Patents
Systems and methods for mapping media content to web sites Download PDFInfo
- Publication number
- US20130268842A1 US20130268842A1 US13/908,697 US201313908697A US2013268842A1 US 20130268842 A1 US20130268842 A1 US 20130268842A1 US 201313908697 A US201313908697 A US 201313908697A US 2013268842 A1 US2013268842 A1 US 2013268842A1
- Authority
- US
- United States
- Prior art keywords
- media content
- media
- data
- display region
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000013507 mapping Methods 0.000 title abstract description 20
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000003860 storage Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 6
- 230000008859 change Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- ZPUCINDJVBIVPJ-LJISPDSOSA-N cocaine Chemical compound O([C@H]1C[C@@H]2CC[C@@H](N2C)[C@H]1C(=O)OC)C(=O)C1=CC=CC=C1 ZPUCINDJVBIVPJ-LJISPDSOSA-N 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013506 data mapping Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G06F17/2247—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/748—Hypervideo
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/84—Mapping; Conversion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/93—Document management systems
- G06F16/94—Hypermedia
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9558—Details of hyperlinks; Management of linked annotations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Definitions
- This invention is directed to systems and methods for mapping media content to web sites. Specifically, this invention is directed to mapping screen locations of viewable and non-viewable media content and objects in viewable media content by means of media time segments and screen locations to web sites.
- Some new methods of advertising in media have been conceived. These include product placements, when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content, and graphical overlays, such as pop-ups, crawls, and scrolls, which lay over the viewable media content.
- product placements when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content
- graphical overlays such as pop-ups, crawls, and scrolls, which lay over the viewable media content.
- pop-ups crawls, and scrolls
- FIG. 1 shows a display, media playing device, and remote control according to an embodiment of the present invention.
- FIG. 2A shows a screen shot of a display with a crawl graphical overlay according to an embodiment of the present invention.
- FIG. 2B shows a screen shot of a display with an image graphical overlay according to an embodiment of the present invention.
- FIG. 3 illustrates a media playing device according to an embodiment of the present invention.
- FIG. 4 illustrates data flow according to an embodiment of the present invention.
- FIG. 5 illustrates a flowchart for operation of a media playing device according to an embodiment of the present invention.
- Embodiments of the present invention are directed to mapping of media content and objects within the media content to web sites.
- the media content is viewable media content and objects within the viewable media content are mapped based upon their screen locations during specific time durations to web sites.
- the media content is non-viewable media content or viewable media content and mapping is performed based on the frame or time segment of the media content, and there may be default mapping for part or all of the media content.
- the mapping may be executed through data externally associated with the media content or data physically embedded in the media content.
- the embedded/associated data contain information that is used to instruct a browser what web site should be launched during a particular frame or time segment of playing media content.
- consumers watching viewable media content may interact with the media content to launch a web browser to a specific destination web site or to multiple web sites.
- the consumer/user may interact by clicking a button on a remote control, activating a pointing device, which may be an advanced pointing device, or through any other method used to interact with a television, computer, set top box, and/or media player.
- the consumer/user may interact by voice commands.
- the launching of the web browser to the specific web site(s) may be based on the time of the media content, for example the time measured in frames, with a certain number of frames per second, for viewable media content, or a time segment of non-viewable media content.
- the launching may also be based on (x,y) coordinates of the media content and objects within the media content in addition to the time of the media content.
- there may be a default web site that is launched to when there is no web site identified for a particular frame or time segment.
- media producers, advertisers, and other content providers may specify the data structure for mapping media time segments and screen locations of viewable media content to websites. They may also specify the data structure for mapping time segments of non-viewable media content to web sites.
- the data structures taught herein are merely illustrative structures for mapping media content to web sites and are not intended to be limiting.
- Media playing devices process the data structures into data mapping objects, which are managed into queues and arrays in order to be dynamically evaluated. The media playing devices further can process and manage the data queues, arrays, and mapping objects to properly navigate a browser to a specific web site. As data may be associated with media content and/or embedded in media content (such as with an MPEG stream) manufacturers of media playing devices may load data structures for mapping media time segments as they believe appropriate in accordance with optimal processing for their hardware or software.
- media content have media durations, which are time measurements. Generally, all playing of media content is measured in time and time offsets. Time is the total time of the media content and time offset is the time from the commencement of playing.
- Viewable media content which includes, for example, television, movies, video, and video files, uses a Timecode measured in hours, minutes, seconds and frames, with approximately 30 frames per second (fps) for NTSC (National Television Systems Committee) or 25 fps for PAL (Phase Alternation Line, the format used in Europe).
- the commencement of viewable media content is zero and time portions (or durations or points) in the viewable media content are measured in HH:MM:SS:FF, or Hours:Minutes:Seconds:Frames.
- a video whose length is two hours, fifteen minutes, thirty seconds and ten frames would have a duration of 02:15:30:10.
- a stop of play at any time in the media content would be measured from an origin of 00:00:00:00. For example, if a video were stopped one hour, twelve minutes, fifteen seconds after starting during the twelfth frame of the second, the Timecode would be 01:12:15:12.
- Sound media content uses a Timecode measured in hours, minutes, seconds and hundredths of seconds, or HH:MM:SS:hh.
- the viewable media content may be measured solely with respect to frames.
- a time portion of the media content may be one or more frames, such as Frame.sub.1-Frame.sub.N or [Frame.sub.2, Frame.sub.4-Frame.sub.6, Frame.sub.8].
- the structure of a time portion may be any structure that will allow a user to choose a time portion of the media content during which it is desired to launch a browser to a web site.
- the position of each object on the display has a number of (x,y) coordinates corresponding to the width and height from the origin.
- the origin of a display is the top left corner, but it is envisioned that the origin could be at any other location, for example, the bottom left corner, top right corner, top left corner, or center of the display.
- a particular video segment could contain any number of objects of which it is desired to know the position.
- objects may be product placements, objects placed in a viewable media content to advertise themselves to the viewer. Examples could be coffee tables, sofas, shoes, cars, people, drinks, computers, and really anything that an advertiser wanted to show during the program.
- a sofa could be a product that appears during a time duration of a viewable media content. At least once in the program, the sofa would appear beginning at HH.sub.1:MM.sub.1:SS.sub.1:FF.sub.1 and ending at HH.sub.2:MM.sub.2:SS.sub.2:FF.sub.2.
- the sofa could appear any number of times, each time with a particular start time and end time.
- the viewable media content might use multiple cameras.
- One, camera angle might show the sofa and another camera angle might show a view that does not include the sofa. Switching between angles would start or end viewing of the sofa.
- the position of the sofa would have a number of (x,y) coordinates defining its area.
- the position of the object, sofa in this particular case could be represented by a rectangle, oval, or other general shape that allows a fairly simple algorithm to determine which coordinates are within the sofa area. It is also possible to map out more complex shapes that more closely track the location of the object or exact (x,y) coordinates where the object appears.
- FIG. 1 shows a display 100 and media playing device 110 according to an embodiment of the invention.
- the display 100 may be a television, computer monitor, or any other type of display.
- the display 100 may be coupled to the media playing device 110 and may be part of the media playing device 110 or separate from the media playing device 110 .
- FIG. 1 one frame is shown, in which a man is sitting on a sofa 104 .
- the selection area 106 for the media-to-browser-destination-data (MBDD) is a rectangle.
- the (x,y) origin 108 of the viewable area is at the upper left of the screen.
- the origin of the rectangle selection area 106 is at the (x origin, y origin) 101 , which is the upper left of the selection area 106 .
- the media playing device 110 is a set top box, such as would be used to receive cable or satellite television.
- the media playing device 110 is activated by the remote control 120 .
- Use of a remote control is illustrative only, and it is contemplated that any sort of interface with the media playing device could be used.
- the (x,y) coordinates of an object may vary with each frame.
- each frame would have its own set of (x,y) coordinates corresponding to each desired object.
- Having the data to know when the object appears and the rectangle or other shape in which it appears will allow a remote control or other pointing device to not only act on the media content playing in a specific time segment (e.g., pause, etc.), but also a remote control or pointing device will allow selection of a specific object area within the time duration.
- the activation of objects may be by voice commands. This will allow recognizing of embedded product placements or objects, which will allow consumers to do media commerce and advertisers to get more opportunities from product placements.
- Graphical overlays are displays placed over playing video media content.
- Video e.g., television, video, and video data files
- graphical overlays are viewable objects in a subset of the (x,y) rectangular area of the video in a z-axis that appears above the video.
- a remote control or pointing device or other interface such as one allowing voice commands, to interact with graphical overlays based on the time duration during which they appear as well as their rectangular coordinates. This will allow consumers to do media commerce and advertisers to get more opportunities from graphical overlays.
- FIG. 2A and 2B show graphical overlays placed over the playing video media content.
- a crawl 250 is on the z-axis that appears over the video on the display 200 , which may be part of the media playing device.
- a pop-up 255 is on the z-axis that appears over the video.
- a cursor 202 may be used to map a browser to a website.
- the graphical overlay may be the only item that is associated with MBDD. Thus, there may be no need to have a cursor, and the user may merely activate a button on a remote control or another interface to launch the browser.
- a consumer may launch a browser to a destination website, including, but not limited to, a website correlated to information provided on television or radio (e.g., embedded product placements), relating to a traditional advertisement or commercial, and/or responding to a pop-up, scroll or crawl displayed as a graphical overlay during a show.
- a commercial may be considered media content.
- a user may launch a browser to a destination web site correlated to information in the commercial.
- a commercial would contain data to launch the browser to one web site, the web site for the advertised product/services, but it is possible that data could be included to launch to multiple web sites, either at the same time or during different frames or time segments of the commercial.
- Viewable media content and non-viewable media content according to the present invention may come in multiple forms.
- media content includes broadcast television, satellite television, cable television, MPEG files, Microsoft WindowsTM media files, WindowsTM video files, other types of video files, MP3 files, AVI files, sound files, broadcast radio, satellite radio, and so forth.
- Graphical overlays are also included as media content, for example, images, videos, scrolls, crawls, etc. overlaid for display on a viewable screen's area of a display.
- media content in embodiments of the present invention is associated with data regarding the content that is being viewed or listened to by the user.
- the data associated with the media content is processed in a procedure that supports dynamic mapping of time sequences and, where desired, (x,y) coordinates of viewable media content and objects within the viewable media content to web sites.
- media players to implement the methods include television set top boxes (e.g., cable or satellite boxes), personal computers, digital video recorders (DVR, e.g., a TWOTM recorder), a cable card that resides inside a television or monitor, MP3 and other audio and video file players (e.g., an iPODTM player), video phones, video and/or audio cassette players, optical disk players (e.g., DVD arid CD players), and any other type of video player.
- DVR digital video recorders
- MP3 and other audio and video file players e.g., an iPODTM player
- video phones e.g., video and/or audio cassette players
- optical disk players e.g., DVD arid CD players
- any other type of video player e.g., DVD arid CD players
- the media player of the present invention contains software to launch an Internet browser, for example, Microsoft WindowsTM Internet ExplorerTM or Mozilla FirefoxTM Browser.
- the browser software may be integrated into the media player apparatus itself.
- the browser software may be included in the software or firmware loaded onto the device.
- the software or firmware could be loaded at the manufacturing facility or other location prior to use by the purchaser. Alternatively, it could be downloaded over the Internet as an update or loaded onto the device in any other feasible way.
- the browser software might be included in an operating system providing media viewing services or might be software loaded onto the computer separately, by disk, Internet, flash drive, etc. Any other type of media player described above, or capable of playing media content, may include browser software that would be able to launch Internet web sites as long as the media player can connect to the Internet, through wired or wireless means.
- the media playing device 310 includes a receiver 350 to receive media content/files and media-to-browser-destination-data (MBDD) from data locations 370 .
- the receiver 350 may receive the media content and MBDD from the same or different data locations 370 .
- the receiver 350 is in communication with a processor 340 , which processes the MBDD and media content, as well as receiving requests from user input device(s) 320 .
- the input device(s) 320 may include pointing devices, such as a mouse, keyboard, remote control, or laser pointer.
- user input may be via a touch screen display, which would also be considered an input device even though it may be part of a display that is an output device.
- the user input may be by voice commands through a microphone or other device.
- the processor 340 is in communication with one or more output devices 360 , such as a display, television, speakers, headphones, etc.
- the processor 340 is also in communication with a memory 380 , which can store the MBDD and/or the media content.
- memory may refer to any type of storage device that may store the MBDD and/or the media content, including, without limitation, a semiconductor memory or hard drive.
- FIG. 3 shows some of the components within the media playing device 310 and some outside the media playing device 310 , this embodiment is merely illustrative.
- the input device(s) 320 and/or the output device(s) could be located within the media playing device 310 or partially within the housing of the media playing device 310 or separate from the media playing device 310 .
- media-to-browser-destination-data is used to map the media content to particular web sites.
- MBDD may arrive to a media playing device in a variety of ways.
- MBDD may be embedded in media content or may be supplied separately.
- MBDD may be embedded in media content (e.g., a media file), such as a video, music file or MPEG file.
- the media content with embedded MBDD 415 may be sent to the media player 410 over the Internet 403 , by cable or satellite or other (e.g., radio) transmission 413 , may be located on a disk 423 , such as an optical storage disk or DVD, or other storage device 433 , such as a flash drive, and downloaded to the media player 410 from that disk 423 or storage device 433 , or may be passed to the media player 410 in any other feasible way.
- a disk 423 such as an optical storage disk or DVD, or other storage device 433 , such as a flash drive
- the media playing device 410 such as a set top box, personal computer, or other type of media playing device contains software to decode and read the embedded MBDD from the video, music or MPEG file,
- the MBDD or equivalent data may be embedded in a transport stream identified by a Packet Identifier (PID) and processed by the software.
- PID Packet Identifier
- the software reads and extracts the data from the transport stream and passes the MBDD into a data queue for use.
- the MBDD is processed into an in-memory collection of data objects in the physical memory 407 of the media playing device 410 .
- the MBDD contains one or more Advertisement Data blocks 405 , which will be discussed further below.
- the MBDD provides the required information to the media player for proper browser navigation during play of any frame or time segment of the media content.
- the web browser 408 which is on the media player device, is launched and is mapped to the requested URL Routing Server 401 over the Internet 403 or private network based on the MBDD.
- MBDD may be embedded in a signal being transmitted 413 to the media playing device 410 , such as a signal from a television or radio broadcaster.
- the MBDD could be identified and filtered by a Packet Identifier (PID) by the media playing device 410 .
- PID Packet Identifier
- the extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described.
- the signal could also be transmitted from a media content provider that provides media content over the Internet.
- a personal computer may have a software component that decodes and filters MBDD from IP packets.
- the extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described.
- the media player 410 then processes the transmission embedded MBDD 425 for use, similar to how the file embedded MBDD 415 is processed, and as discussed further below.
- the MBDD provides the required information to the media player for proper browser navigation during play of any frame/time segment.
- MBDD may be downloaded by the media playing device or pushed to the media playing device in advance, for example over the Internet 403 .
- the media playing device may periodically download MBDD from a remote server/location 440 , such as a web site or private network, and maintain that MBDD for future use.
- a remote server/location 440 such as a web site or private network
- the MBDD will provide the required information to the media player for proper browser navigation during play of any frame or time segment of the media content.
- MBDD may be provided by a graphical overlay, such as images, videos, scrolls, crawls, etc.
- the MBDD code is included with the play out instructions for the graphical overlay.
- the graphic overlay may be provided via any one of the methods discussed above, e.g., Internet, cable or satellite broadcast, disk or other storage device, or by any other suitable method.
- the MBDD provides the required information for mapping from the graphical overlay to a particular web site.
- MBDD may be in any format, including binary, that can be processed by a media playing device according to the present invention.
- MBDD may be coded in any desired language, including, but not limited to, C, C++, C#, .Net, XML, and Java.
- TABLE 1 is an example set of MBDD shown in XML format. The descriptions and tags provided in the XML sample in Table 1 are lengthened for ease of readability. Actual MBDD may be compiled or abbreviated to be lighter in weight to reduce transport and/or processing overhead.
- TABLE 1 shows an example of MBDD according to the present invention.
- the MBDD includes information about the media. For example, in TABLE 1, the media publisher, title of the media content, version information, and length of the media content are included. Additional information or less information may be included. In the MBDD shown in TABLE 1, there is a default URL and a default GUID (globally unique identifier). Also included in the MBDD are two “Advertisement Data” blocks. Each block includes information for instructing the media playing device what web site to launch at a particular time and location.
- the scene name e.g., time offset and duration of the object (e.g., product placement), (x,y) coordinates, which include the distance from the origin to start a rectangle and the width and height of the rectangle that can be selected to launch to the URL Routing Server passing the optional GUID if supplied.
- the rectangle starts at (0,0) and has a width and height of 100.
- the MBDD also may include an area for custom data, for example, for the media player device manufacturers to extend the data format.
- the media playing device reads and loads the MBDD data structure into memory when media content is loaded for viewing, when a media broadcast takes place, during a channel change, or in advance by downloading all information from the Internet for broadcasts.
- a graphical overlay placed on the media playing device that plays independently of the media content may also include the same data in its file structure to be passed to the media playing device.
- the ultimate browser destination web site can be changed at the URL Routing Server thereby eliminating the need to change any data in a physical media file.
- This technique also allows for last minute web site destination changes without having to resend MBDD to a media player prior to a broadcast.
- a laser or other pointing device or user interface, allows for supporting multiple product placements in the same time segment in viewable media content.
- Using a Unique Lookup Key Value in the MBDD allows for future flexibility of modification of the ultimate web site to be mapped to, but without modification of an entire media file. For example, during the initial publication of media content, such as a national broadcast run of a viewable show distributed in a media file format, the ultimate browser navigation destination may be sold for a nationally advertised product. Years later, during syndication and local showing of the same media file, the ultimate browser navigation destination could be resold for a different web site destination.
- FIG. 5 shows an example flow chart for the processing of MBDD data in an embodiment of the present invention.
- the MBDD data unit providing time duration and optional rectangular area arrives to the consumer end point media player.
- the rectangular area, or (x,y) coordinates, may be shaped in any desired way that allows selection of the shape.
- the MBDD data unit is parsed and translated into a collection of objects in memory. These data objects represent information on objects appearing in the media content during time durations measured in Timecodes (HH:MM:SS:FF) and optionally areas within the viewable screen area.
- the software or firmware running on the media playing device converts the data into an internal in-memory lookup table that for each “Advertisement Data” block, for example as shown in TABLE 1, maps the time offset from the beginning of the current program and the duration for this block to the rest of the information provided in the “Advertisement Data” block.
- the “Advertisement Data” block can of course be named something completely different, such as “Product Placement Data.”
- the optional (x,y) screen location information, if present in any or all of the “Advertisement Data” blocks may also be stored in internal data objects in the media playing device's memory.
- all the lookup information describing all of the “Advertisement Data” blocks contained in the MBDD data unit for the current media program is contained in an in-memory collection of data objects in the physical memory of the media playing device.
- the user clicks the designated button on the remote control (or any other controlling/pointing device) optionally pointing to a location on the screen. It is possible that the entire screen at a particular point may be designated to map to a single web site, so it would not be necessary to point at any object. In addition, it may be possible for the background area, or areas where data allowing mapping to a web site is not included, to have a default web site that launches upon activation of a controller.
- the matching “Advertisement Data” block gets resolved by looking up the current offset of the media content in the internal in-memory lookup table.
- the time offset and the (x,y) screen location of the remote control/pointer are processed and matched to the time offsets, durations and areas of the collection of in-memory data objects.
- the process of finding the match is done as follows: (1) the correct subset of Advertisement Data Blocks is obtained by finding the resulting subset of all the in-memory objects for which the time of the user event occurs within the time interval between the time offset and the time offset plus duration. (2) If the resulting subset is a non-empty subset the resulting subset may be further narrowed by comparing the (x,y) screen location of the user event to the areas provided by the data objects in the resulting subset.
- the system proceeds with the match as the selected matching entry. If no match based on location is found the first match based on time, the closest match to the (x,y) coordinates or any match based on time may be utilized. As a result of these steps if a matching entry is found (an entry that covers the time interval during which the browser navigation request has occurred), then the system proceeds to 509 , where the appropriate “Unique Lookup Key Value” is relayed to the appropriate “URL Routing Server” (both of these results come from the matching in-memory data object). The final destination URL is obtained. The URL Routing Server resolves the “Unique Lookup Key” to a particular URL string, which is returned back to the media playing device.
- a valid URL it is determined whether a valid URL has been obtained. If yes, at 513 , the media content is optionally paused, and a Web Browser is launched and navigated to the final destination URL.
- the media content could be paused when pausing is supported by the media device player, such as a DVD player or a digital video recorder. The pausing could be automatic or an option of the user. If at 511 , a valid URL is not obtained, in 515 no action is taken, which is the end 521 of the sequence. Alternatively, an error message could be provided, for example “no URL available.”
- a matching entry is not found for the current offset/screen location, it is determined in 517 if there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair for the entire MBDD data unit.
- a default “URL Routing Server” and “Unique Lookup Key Value” would be to show a web page of all advertisers or upcoming episodes, etc.
- no action could be performed, depending on the user preferences and/or the media playing device functionality.
- the media playing device may have a default “Unique Lookup Key Value” and default .degree.
- all of the corresponding MBDD in-memory data objects for the media program may be discarded from the device's memory.
- all of the time offsets for this program inside the matching in-memory structures may be adjusted accordingly, so that when the user resumes the viewing, the following scenes also remain navigable.
- MBDD embedded in a transport stream such as an MPEG transport stream may be discarded and loaded when the user changes a television channel.
Abstract
Systems and methods for mapping viewable and non-viewable media to websites are disclosed. Mapping is executed through associated or embedded data, based upon frame and/or time segment of the media. The media-to-browser-destination-data (MBDD) may be embedded in media content, embedded in a transmitted signal, downloaded or pushed to a media playing device, or provided by a graphic overlay. Media players are disclosed that can process the MBDD to launch a browser to a selected web site.
Description
- This application is a continuation of U.S. patent application Ser. No. 13/750,159, filed Jan. 25, 2013, pending, which is a continuation of U.S. patent Ser. No. 11/371,611, filed Mar. 9, 2006, now U.S. Pat. No. 8,370,455, filed Feb. 5, 2013, the entire contents of each of which are hereby incorporated by reference in this application.
- 1. Field of the Invention
- This invention is directed to systems and methods for mapping media content to web sites. Specifically, this invention is directed to mapping screen locations of viewable and non-viewable media content and objects in viewable media content by means of media time segments and screen locations to web sites.
- 2. Description of Related Art
- In recent years, the delivery of media programs to homes has become increasingly complex and sophisticated. Media programs were once simple viewable programs, such as television shows and movies, and non-viewable programs, such as radio shows, transmitted to antennas over airwaves at certain radio frequencies. As time went on, cable television was introduced, which allowed media content to be transmitted over cables, such as fiber-optic cables, broadening the amount of media content that could be delivered to homes all over the world. The development of satellite transmission of media content also allowed widespread distribution of media content both unencoded and encoded from satellites to various types of satellite dishes. Set top boxes receiving media content now allow for real time play and storage for future play, and transmission of media content has now evolved to transmission over the Internet. In addition to traditional television and set top boxes, home computer users can watch television or listen to radio programs on their computers. The combination of all these distribution capabilities, improved technology and availability of media content such as television and radio presents opportunities for incorporating new advertising methods into media distribution.
- Some new methods of advertising in media have been conceived. These include product placements, when an advertiser pays for its product to be displayed in viewable media content or mentioned in audio media content, and graphical overlays, such as pop-ups, crawls, and scrolls, which lay over the viewable media content. Currently, there is some availability of methods to determine the location of an object or graphical overlay. However, there is a need to integrate these methods into superior advertising techniques.
-
FIG. 1 shows a display, media playing device, and remote control according to an embodiment of the present invention. -
FIG. 2A shows a screen shot of a display with a crawl graphical overlay according to an embodiment of the present invention. -
FIG. 2B shows a screen shot of a display with an image graphical overlay according to an embodiment of the present invention. -
FIG. 3 illustrates a media playing device according to an embodiment of the present invention. -
FIG. 4 illustrates data flow according to an embodiment of the present invention. -
FIG. 5 illustrates a flowchart for operation of a media playing device according to an embodiment of the present invention. - Embodiments of the present invention are directed to mapping of media content and objects within the media content to web sites. In certain embodiments of the present invention, the media content is viewable media content and objects within the viewable media content are mapped based upon their screen locations during specific time durations to web sites. In further embodiments, the media content is non-viewable media content or viewable media content and mapping is performed based on the frame or time segment of the media content, and there may be default mapping for part or all of the media content. The mapping may be executed through data externally associated with the media content or data physically embedded in the media content. The embedded/associated data contain information that is used to instruct a browser what web site should be launched during a particular frame or time segment of playing media content.
- In embodiments of the present invention, consumers watching viewable media content, for example, television, movies, video, and video files, or listening to media content, for example, radio, mp3 files, and sound files, may interact with the media content to launch a web browser to a specific destination web site or to multiple web sites. The consumer/user may interact by clicking a button on a remote control, activating a pointing device, which may be an advanced pointing device, or through any other method used to interact with a television, computer, set top box, and/or media player. In further embodiments, the consumer/user may interact by voice commands. The launching of the web browser to the specific web site(s) may be based on the time of the media content, for example the time measured in frames, with a certain number of frames per second, for viewable media content, or a time segment of non-viewable media content. For viewable media content, the launching may also be based on (x,y) coordinates of the media content and objects within the media content in addition to the time of the media content. In further embodiments, there may be a default web site that is launched to when there is no web site identified for a particular frame or time segment.
- In further embodiments of the present invention, media producers, advertisers, and other content providers may specify the data structure for mapping media time segments and screen locations of viewable media content to websites. They may also specify the data structure for mapping time segments of non-viewable media content to web sites. The data structures taught herein are merely illustrative structures for mapping media content to web sites and are not intended to be limiting. Media playing devices process the data structures into data mapping objects, which are managed into queues and arrays in order to be dynamically evaluated. The media playing devices further can process and manage the data queues, arrays, and mapping objects to properly navigate a browser to a specific web site. As data may be associated with media content and/or embedded in media content (such as with an MPEG stream) manufacturers of media playing devices may load data structures for mapping media time segments as they believe appropriate in accordance with optimal processing for their hardware or software.
- Currently, media content have media durations, which are time measurements. Generally, all playing of media content is measured in time and time offsets. Time is the total time of the media content and time offset is the time from the commencement of playing. Viewable media content, which includes, for example, television, movies, video, and video files, uses a Timecode measured in hours, minutes, seconds and frames, with approximately 30 frames per second (fps) for NTSC (National Television Systems Committee) or 25 fps for PAL (Phase Alternation Line, the format used in Europe).
- The commencement of viewable media content is zero and time portions (or durations or points) in the viewable media content are measured in HH:MM:SS:FF, or Hours:Minutes:Seconds:Frames. For example, a video whose length is two hours, fifteen minutes, thirty seconds and ten frames would have a duration of 02:15:30:10. A stop of play at any time in the media content would be measured from an origin of 00:00:00:00. For example, if a video were stopped one hour, twelve minutes, fifteen seconds after starting during the twelfth frame of the second, the Timecode would be 01:12:15:12. Sound media content uses a Timecode measured in hours, minutes, seconds and hundredths of seconds, or HH:MM:SS:hh. In further embodiments, the viewable media content may be measured solely with respect to frames. For example, a time portion of the media content may be one or more frames, such as Frame.sub.1-Frame.sub.N or [Frame.sub.2, Frame.sub.4-Frame.sub.6, Frame.sub.8]. In other words, the structure of a time portion may be any structure that will allow a user to choose a time portion of the media content during which it is desired to launch a browser to a web site.
- When viewable media content is playing on a display, the position of each object on the display has a number of (x,y) coordinates corresponding to the width and height from the origin. Generally, the origin of a display is the top left corner, but it is envisioned that the origin could be at any other location, for example, the bottom left corner, top right corner, top left corner, or center of the display.
- In embodiments of the invention, a particular video segment could contain any number of objects of which it is desired to know the position. For example, in a television program or movie program, objects may be product placements, objects placed in a viewable media content to advertise themselves to the viewer. Examples could be coffee tables, sofas, shoes, cars, people, drinks, computers, and really anything that an advertiser wanted to show during the program. By way of example only, a sofa could be a product that appears during a time duration of a viewable media content. At least once in the program, the sofa would appear beginning at HH.sub.1:MM.sub.1:SS.sub.1:FF.sub.1 and ending at HH.sub.2:MM.sub.2:SS.sub.2:FF.sub.2. The sofa could appear any number of times, each time with a particular start time and end time. For example, the viewable media content might use multiple cameras. One, camera angle might show the sofa and another camera angle might show a view that does not include the sofa. Switching between angles would start or end viewing of the sofa. The position of the sofa would have a number of (x,y) coordinates defining its area. Simply, the position of the object, sofa in this particular case, could be represented by a rectangle, oval, or other general shape that allows a fairly simple algorithm to determine which coordinates are within the sofa area. It is also possible to map out more complex shapes that more closely track the location of the object or exact (x,y) coordinates where the object appears. In the case of the sofa, if someone were sitting on the sofa, it may be desirable to have only the (x,y) coordinates where the person is not sitting to correspond to the sofa. In this way, the person's clothing could be a different product placement with a different set of (x,y) coordinates.
-
FIG. 1 shows adisplay 100 andmedia playing device 110 according to an embodiment of the invention. Thedisplay 100 may be a television, computer monitor, or any other type of display. Thedisplay 100 may be coupled to themedia playing device 110 and may be part of themedia playing device 110 or separate from themedia playing device 110. InFIG. 1 , one frame is shown, in which a man is sitting on asofa 104. In this embodiment, theselection area 106 for the media-to-browser-destination-data (MBDD) is a rectangle. The (x,y)origin 108 of the viewable area is at the upper left of the screen. The origin of therectangle selection area 106 is at the (x origin, y origin) 101, which is the upper left of theselection area 106. It is measured as a being x origin number of pixels right (or an equivalent coordinate measuring system) of theorigin 108 and y origin number of pixels down from theorigin 108. Thewidth 105 of theselection area 106 and theheight 103 of the selection area complete the rectangle. Also shown inFIG. 1 is acursor 102 that has been moved to lie over theselection area 106. In certain embodiments, theselection area 106 might change color, darken or lighten, or reverse colors to indicate that the cursor is over that area. In further embodiments a change in color or shading of theselection area 106 might only occur when a button or other interface is activated by a user. InFIG. 1 , themedia playing device 110 is a set top box, such as would be used to receive cable or satellite television. Use of a set top box is illustrative only, and it is contemplated that any media playing device could be used, as long as it is capable of using the MBDD. InFIG. 1 , themedia playing device 110 is activated by theremote control 120. Use of a remote control is illustrative only, and it is contemplated that any sort of interface with the media playing device could be used. - The (x,y) coordinates of an object may vary with each frame. Thus, each frame would have its own set of (x,y) coordinates corresponding to each desired object. Having the data to know when the object appears and the rectangle or other shape in which it appears will allow a remote control or other pointing device to not only act on the media content playing in a specific time segment (e.g., pause, etc.), but also a remote control or pointing device will allow selection of a specific object area within the time duration. In further embodiments, the activation of objects may be by voice commands. This will allow recognizing of embedded product placements or objects, which will allow consumers to do media commerce and advertisers to get more opportunities from product placements.
- Graphical overlays are displays placed over playing video media content. Video (e.g., television, video, and video data files) takes up an (x,y) rectangular area on a single z-axis, and graphical overlays are viewable objects in a subset of the (x,y) rectangular area of the video in a z-axis that appears above the video. In addition to using a remote control to recognize product placements or objects, as discussed above, it is therefore possible to use a remote control or pointing device or other interface, such as one allowing voice commands, to interact with graphical overlays based on the time duration during which they appear as well as their rectangular coordinates. This will allow consumers to do media commerce and advertisers to get more opportunities from graphical overlays.
FIGS. 2A and 2B show graphical overlays placed over the playing video media content. As shown inFIG. 2A , acrawl 250 is on the z-axis that appears over the video on thedisplay 200, which may be part of the media playing device. InFIG. 2B , a pop-up 255 is on the z-axis that appears over the video. In either scenario, acursor 202 may be used to map a browser to a website. In alternative embodiments, the graphical overlay may be the only item that is associated with MBDD. Thus, there may be no need to have a cursor, and the user may merely activate a button on a remote control or another interface to launch the browser. - In embodiments of the invention, a consumer may launch a browser to a destination website, including, but not limited to, a website correlated to information provided on television or radio (e.g., embedded product placements), relating to a traditional advertisement or commercial, and/or responding to a pop-up, scroll or crawl displayed as a graphical overlay during a show. In further embodiments, a commercial may be considered media content. For example, during commercial breaks, a user may launch a browser to a destination web site correlated to information in the commercial. Generally, a commercial would contain data to launch the browser to one web site, the web site for the advertised product/services, but it is possible that data could be included to launch to multiple web sites, either at the same time or during different frames or time segments of the commercial.
- Viewable media content and non-viewable media content according to the present invention may come in multiple forms. For example, media content includes broadcast television, satellite television, cable television, MPEG files, Microsoft Windows™ media files, Windows™ video files, other types of video files, MP3 files, AVI files, sound files, broadcast radio, satellite radio, and so forth. Graphical overlays are also included as media content, for example, images, videos, scrolls, crawls, etc. overlaid for display on a viewable screen's area of a display.
- To support mapping specific segments of media content and objects to different web sites, media content in embodiments of the present invention is associated with data regarding the content that is being viewed or listened to by the user. The data associated with the media content is processed in a procedure that supports dynamic mapping of time sequences and, where desired, (x,y) coordinates of viewable media content and objects within the viewable media content to web sites.
- The methods of the present invention for mapping media content to web sites may be implemented on any media player. For example, and in no way by limitation, media players to implement the methods include television set top boxes (e.g., cable or satellite boxes), personal computers, digital video recorders (DVR, e.g., a TWO™ recorder), a cable card that resides inside a television or monitor, MP3 and other audio and video file players (e.g., an iPOD™ player), video phones, video and/or audio cassette players, optical disk players (e.g., DVD arid CD players), and any other type of video player. The media player may also be integrated into a television or monitor itself.
- The media player of the present invention contains software to launch an Internet browser, for example, Microsoft Windows™ Internet Explorer™ or Mozilla Firefox™ Browser. The browser software may be integrated into the media player apparatus itself. For example, if the media player apparatus is a set top box, DVR or similar device, or cable card or similar device, the browser software may be included in the software or firmware loaded onto the device. The software or firmware could be loaded at the manufacturing facility or other location prior to use by the purchaser. Alternatively, it could be downloaded over the Internet as an update or loaded onto the device in any other feasible way. When a personal computer is used, the browser software might be included in an operating system providing media viewing services or might be software loaded onto the computer separately, by disk, Internet, flash drive, etc. Any other type of media player described above, or capable of playing media content, may include browser software that would be able to launch Internet web sites as long as the media player can connect to the Internet, through wired or wireless means.
- As shown in
FIG. 3 , in embodiments of the present invention, themedia playing device 310 includes areceiver 350 to receive media content/files and media-to-browser-destination-data (MBDD) fromdata locations 370. Thereceiver 350 may receive the media content and MBDD from the same ordifferent data locations 370. Thereceiver 350 is in communication with aprocessor 340, which processes the MBDD and media content, as well as receiving requests from user input device(s) 320. The input device(s) 320 may include pointing devices, such as a mouse, keyboard, remote control, or laser pointer. In addition or alternatively, user input may be via a touch screen display, which would also be considered an input device even though it may be part of a display that is an output device. The user input may be by voice commands through a microphone or other device. Theprocessor 340 is in communication with one ormore output devices 360, such as a display, television, speakers, headphones, etc. Theprocessor 340 is also in communication with amemory 380, which can store the MBDD and/or the media content. As used herein, memory may refer to any type of storage device that may store the MBDD and/or the media content, including, without limitation, a semiconductor memory or hard drive. AlthoughFIG. 3 shows some of the components within themedia playing device 310 and some outside themedia playing device 310, this embodiment is merely illustrative. For example, the input device(s) 320 and/or the output device(s) could be located within themedia playing device 310 or partially within the housing of themedia playing device 310 or separate from themedia playing device 310. - In embodiments of the present invention, media-to-browser-destination-data (MBDD) is used to map the media content to particular web sites. As shown in
FIG. 4 , MBDD may arrive to a media playing device in a variety of ways. MBDD may be embedded in media content or may be supplied separately. For example, as shown inFIG. 4 , MBDD may be embedded in media content (e.g., a media file), such as a video, music file or MPEG file. The media content with embeddedMBDD 415 may be sent to themedia player 410 over theInternet 403, by cable or satellite or other (e.g., radio)transmission 413, may be located on adisk 423, such as an optical storage disk or DVD, orother storage device 433, such as a flash drive, and downloaded to themedia player 410 from thatdisk 423 orstorage device 433, or may be passed to themedia player 410 in any other feasible way. In this embodiment, themedia playing device 410, such as a set top box, personal computer, or other type of media playing device contains software to decode and read the embedded MBDD from the video, music or MPEG file, For example, in an MPEG file the MBDD or equivalent data may be embedded in a transport stream identified by a Packet Identifier (PID) and processed by the software. The software reads and extracts the data from the transport stream and passes the MBDD into a data queue for use. As shown inFIG. 4 , and as described below the MBDD is processed into an in-memory collection of data objects in thephysical memory 407 of themedia playing device 410. The MBDD contains one or more Advertisement Data blocks 405, which will be discussed further below. The MBDD provides the required information to the media player for proper browser navigation during play of any frame or time segment of the media content. Theweb browser 408, which is on the media player device, is launched and is mapped to the requestedURL Routing Server 401 over theInternet 403 or private network based on the MBDD. - Also as shown in
FIG. 4 , in further embodiments, MBDD may be embedded in a signal being transmitted 413 to themedia playing device 410, such as a signal from a television or radio broadcaster. For example, in an MPEG file (or MPEG transport stream) the MBDD could be identified and filtered by a Packet Identifier (PID) by themedia playing device 410. The extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described. The signal could also be transmitted from a media content provider that provides media content over the Internet. For example a personal computer may have a software component that decodes and filters MBDD from IP packets. The extracted data could be loaded into an in-memory collection of data objects that may be processed as previously described. Themedia player 410 then processes the transmission embeddedMBDD 425 for use, similar to how the file embeddedMBDD 415 is processed, and as discussed further below. During viewing of or listening to media content transmitted over the signal, the MBDD provides the required information to the media player for proper browser navigation during play of any frame/time segment. - In further embodiments, MBDD may be downloaded by the media playing device or pushed to the media playing device in advance, for example over the
Internet 403. For example, the media playing device may periodically download MBDD from a remote server/location 440, such as a web site or private network, and maintain that MBDD for future use. During viewing or playing of media content associated with the MBDD, the MBDD will provide the required information to the media player for proper browser navigation during play of any frame or time segment of the media content. - In further embodiments, MBDD may be provided by a graphical overlay, such as images, videos, scrolls, crawls, etc. When the graphical overlay information is provided to the media player, the MBDD code is included with the play out instructions for the graphical overlay. The graphic overlay may be provided via any one of the methods discussed above, e.g., Internet, cable or satellite broadcast, disk or other storage device, or by any other suitable method. During viewing of the graphical overlay, the MBDD provides the required information for mapping from the graphical overlay to a particular web site.
- MBDD may be in any format, including binary, that can be processed by a media playing device according to the present invention. For example, MBDD may be coded in any desired language, including, but not limited to, C, C++, C#, .Net, XML, and Java. TABLE 1 is an example set of MBDD shown in XML format. The descriptions and tags provided in the XML sample in Table 1 are lengthened for ease of readability. Actual MBDD may be compiled or abbreviated to be lighter in weight to reduce transport and/or processing overhead.
-
TABLE 1 <MBDD> <Media_Publisher Publisher=“CBS Television” Name=“Two and a Half Men” Version=“Episode 4 - 2005” Length=“00:24:00:00” URL_Default=“http://www.panthersoft.com/mbdd-[optional parameters]” Default_Lookup=“[Default GUID key goes here]” > <Advertisement_Data Scene_Name=“Charlie laying on sofa with magazine” Time_Offset=“00:05:10:10” Duration=“00:01:03:10” XOrigin=“0” Width=“100” YOrigin=“0” Height=“100” URL_Routing_Server=“http://www.panthersoft.com/mbdd- [optional parameters]” Unique_Lookup_Key_Value=“[GUID goes here]” /> <Advertisement_Data Scene_Name=“Charlie laying on sofa with magazine” Time_Offset=“00:05:15:10” Duration=“00:00:35:00” XOrigin=“250” Width=“100” YOrigin=“250” Height=“100” URL_Routing_Server=“http://www.panthersoft.com/mbdd- [optional parameters]” Unique_Lookup_Key_Value = “[Different GUID goes here]” /> </Media_Publisher> <Custom_Data> <!--Area for media player device (e.g., set top box) manufacturers to extend the MBDD data format--> </Custom_Data> </MBDD> - TABLE 1 shows an example of MBDD according to the present invention. The MBDD includes information about the media. For example, in TABLE 1, the media publisher, title of the media content, version information, and length of the media content are included. Additional information or less information may be included. In the MBDD shown in TABLE 1, there is a default URL and a default GUID (globally unique identifier). Also included in the MBDD are two “Advertisement Data” blocks. Each block includes information for instructing the media playing device what web site to launch at a particular time and location. For example, in both of the “Advertising_Data” blocks in the MBDD shown in TABLE 1, included are the scene name, time offset and duration of the object (e.g., product placement), (x,y) coordinates, which include the distance from the origin to start a rectangle and the width and height of the rectangle that can be selected to launch to the URL Routing Server passing the optional GUID if supplied. In the first “Advertisement Data,” the rectangle starts at (0,0) and has a width and height of 100. The MBDD also may include an area for custom data, for example, for the media player device manufacturers to extend the data format.
- In embodiments of the present invention, the media playing device reads and loads the MBDD data structure into memory when media content is loaded for viewing, when a media broadcast takes place, during a channel change, or in advance by downloading all information from the Internet for broadcasts. A graphical overlay placed on the media playing device that plays independently of the media content may also include the same data in its file structure to be passed to the media playing device.
- During the scene commencing at the “Time Offset” shown in TABLE 1 and ending at the conclusion of the “Duration” period, activating the proper interface, such as a browser button on a remote control or a button on a media player, will cause the media player to send a look up request to the “URL Routing Server” passing the “Unique Lookup Key Value” to a URL Routing Server. The URL Routing Server performs a lookup using the Unique Lookup Key Value received from the media player. The URL Routing Server returns the web site destination to the media playing device, which launches the browser with the URL to the web site destination. Similarly, the browser on the media playing device can also pass the Unique Lookup Key Value on the URL Routing Server and be forwarded to the web site.
- Bu using the Unique Lookup Key Value as a mapping mechanism, the ultimate browser destination web site can be changed at the URL Routing Server thereby eliminating the need to change any data in a physical media file. This technique also allows for last minute web site destination changes without having to resend MBDD to a media player prior to a broadcast.
- In further embodiments, a laser, or other pointing device or user interface, allows for supporting multiple product placements in the same time segment in viewable media content.
- Using a Unique Lookup Key Value in the MBDD allows for future flexibility of modification of the ultimate web site to be mapped to, but without modification of an entire media file. For example, during the initial publication of media content, such as a national broadcast run of a viewable show distributed in a media file format, the ultimate browser navigation destination may be sold for a nationally advertised product. Years later, during syndication and local showing of the same media file, the ultimate browser navigation destination could be resold for a different web site destination.
-
FIG. 5 shows an example flow chart for the processing of MBDD data in an embodiment of the present invention. At 501, the MBDD data unit providing time duration and optional rectangular area arrives to the consumer end point media player. The rectangular area, or (x,y) coordinates, may be shaped in any desired way that allows selection of the shape. At 503, the MBDD data unit is parsed and translated into a collection of objects in memory. These data objects represent information on objects appearing in the media content during time durations measured in Timecodes (HH:MM:SS:FF) and optionally areas within the viewable screen area. The software or firmware running on the media playing device converts the data into an internal in-memory lookup table that for each “Advertisement Data” block, for example as shown in TABLE 1, maps the time offset from the beginning of the current program and the duration for this block to the rest of the information provided in the “Advertisement Data” block. The “Advertisement Data” block can of course be named something completely different, such as “Product Placement Data.” The optional (x,y) screen location information, if present in any or all of the “Advertisement Data” blocks, may also be stored in internal data objects in the media playing device's memory. As a result, all the lookup information describing all of the “Advertisement Data” blocks contained in the MBDD data unit for the current media program is contained in an in-memory collection of data objects in the physical memory of the media playing device. - At 505, while watching media content on the screen, the user clicks the designated button on the remote control (or any other controlling/pointing device) optionally pointing to a location on the screen. It is possible that the entire screen at a particular point may be designated to map to a single web site, so it would not be necessary to point at any object. In addition, it may be possible for the background area, or areas where data allowing mapping to a web site is not included, to have a default web site that launches upon activation of a controller. When the user initiates the browser navigation on his/her media player, the matching “Advertisement Data” block gets resolved by looking up the current offset of the media content in the internal in-memory lookup table. At 507, the time offset and the (x,y) screen location of the remote control/pointer (if applicable) are processed and matched to the time offsets, durations and areas of the collection of in-memory data objects. The process of finding the match is done as follows: (1) the correct subset of Advertisement Data Blocks is obtained by finding the resulting subset of all the in-memory objects for which the time of the user event occurs within the time interval between the time offset and the time offset plus duration. (2) If the resulting subset is a non-empty subset the resulting subset may be further narrowed by comparing the (x,y) screen location of the user event to the areas provided by the data objects in the resulting subset. If a match based on an (x,y) screen location is found, the system proceeds with the match as the selected matching entry. If no match based on location is found the first match based on time, the closest match to the (x,y) coordinates or any match based on time may be utilized. As a result of these steps if a matching entry is found (an entry that covers the time interval during which the browser navigation request has occurred), then the system proceeds to 509, where the appropriate “Unique Lookup Key Value” is relayed to the appropriate “URL Routing Server” (both of these results come from the matching in-memory data object). The final destination URL is obtained. The URL Routing Server resolves the “Unique Lookup Key” to a particular URL string, which is returned back to the media playing device. At 511, it is determined whether a valid URL has been obtained. If yes, at 513, the media content is optionally paused, and a Web Browser is launched and navigated to the final destination URL. The media content could be paused when pausing is supported by the media device player, such as a DVD player or a digital video recorder. The pausing could be automatic or an option of the user. If at 511, a valid URL is not obtained, in 515 no action is taken, which is the
end 521 of the sequence. Alternatively, an error message could be provided, for example “no URL available.” - If in 507 a matching entry is not found for the current offset/screen location, it is determined in 517 if there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair for the entire MBDD data unit. One potential use of a default “URL Routing Server” and “Unique Lookup Key Value” would be to show a web page of all advertisers or upcoming episodes, etc. Alternatively, no action could be performed, depending on the user preferences and/or the media playing device functionality. Still in further embodiments, the media playing device may have a default “Unique Lookup Key Value” and default .degree. CURL Routing Server.” If there is a default “Unique Lookup Key Value” and default “URL Routing Server” pair, at 519, the default “Unique Lookup Key Value” is relayed to the default “URL Routing Server,” and the final URL is obtained. Then the system would proceed as from 509 to 511 to determine if a valid URL has been obtained, and so forth, until the
end 521. - Once media content is concluded, all of the corresponding MBDD in-memory data objects for the media program may be discarded from the device's memory. In further embodiments, if the media player pauses the media content in progress as it navigates the browser to the ultimate destination, then all of the time offsets for this program inside the matching in-memory structures may be adjusted accordingly, so that when the user resumes the viewing, the following scenes also remain navigable. Also, in further embodiments MBDD embedded in a transport stream such as an MPEG transport stream may be discarded and loaded when the user changes a television channel.
- While the description above refers to particular embodiments of the present invention, it will be understood that many modifications may be made without departing from the spirit thereof. The accompanying claims are intended to cover such modifications as would fall within the true scope and spirit of the present invention.
- The presently disclosed embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims, rather than the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Claims (33)
1. A method of providing media content associated with a web site to a media player associated with a display screen, comprising:
sending instructions to a media player to receive media content; and
sending control data to the media player, wherein the control data includes (a) time data indicating a time period related to the media content; (b) location data indicating a selectable display region of the media content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) data for creating a value that is defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) a URL routing server address of a URL routing server containing a web site destination to be launched when the value has been sent by the media player to the URL routing server.
2. The method defined in claim 1 , wherein the selectable display region is the entire display area of the media content.
3. The method of claim 1 , wherein the location data indicating the display region includes one or more sets of (x,y) coordinates.
4. The method of claim 1 , wherein the location data indicating the display region includes an (x,y) origin value, a width value, and a height value.
5. The method of claim 1 , wherein the display region is shaped in a shape selected from the group consisting of a rectangle, an ellipse, a polygon, and a triangle.
6. The method of claim 1 , wherein the user input is provided with an input device in communication with the media player.
7. The method of claim 6 , wherein the pointing device is selected from the group consisting of a mouse, a keyboard, a remote control, a laser pointer, and a voice input device.
8. The method of claim 1 , wherein the time data includes a time offset value and a duration value.
9. The method of claim 8 , wherein the time offset value and the duration value are in a format selected from the group consisting of HH:MM:SS:FF, HH:MM:SS:hh, and a format using only frame numbers.
10. The method of claim 1 , wherein the media content is television.
11. The method of claim 1 , further comprising displaying a graphical overlay on the display screen during display of the media content, wherein the selectable display region includes a portion of the display screen where the graphical overlay is being displayed.
12. The method of claim 11 , wherein the graphical overlay is selected from the group consisting of a pop-up, a scroll, and a crawl.
13. The method of claim 11 , wherein the graphical overlay is on a z-axis displaying above the media content being displayed.
14. The method of claim 1 , wherein the time interval indicated by the time data includes one or more frames of the media content.
15. The method of claim 12 , wherein the graphical overlay is on a z-axis displaying above the z-axis of the media content being displayed.
16. The method of claim 1 , wherein the time portion indicated by the time data includes one or more frames of the media content.
17. The method of claim 1 , wherein the media player is a set top box.
18. The method of claim 1 , wherein the media player is a computer.
19. The method of claim 1 , wherein the media player is a television.
20. The method of claim 1 , wherein sending control data includes sending data transmitted by a transmission method selected from the group consisting of Internet transmission, cable transmission, radio transmission and satellite transmission.
21. The method of claim 1 , wherein the control data is sent with the media content.
22. The method of claim 1 , wherein the control data is sent prior to the sending of the video content.
23. The method of claim 1 , wherein the control data is embedded in a transmission signal.
24. The method of claim 1 , wherein the media content is played on the media player prior to receiving the entire media content.
25. A program code storage device, comprising:
a non-transitory machine-readable storage medium;
machine-readable program code, stored on the machine-readable storage medium, the machine-readable program code having instructions to:
send instructions to a media player to receive media content; and
send control data to the media player, wherein the control data includes (a) time data indicating a time period related to the media content; (b) location data indicating a selectable display region of the media content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) data for creating a value that is defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) a URL routing server address of a URL routing server containing a web site destination to be launched when the value has been sent by the media player to the URL routing server.
26. The method of claim 25 , wherein the media content is television.
27. The device defined in claim 25 , where in the selectable display region is the entire display area of the media content.
28. (canceled)
29. (canceled)
30. (canceled)
31. A method of providing media content associated with a web site to a media player associated with a display screen, comprising:
sending instructions to a media player to receive media content; and
sending control data to the media player, wherein the control data includes (a) time data indicating a time period related to the media content; (b) location data indicating a selectable display region of the media content that displays on the display screen during the time period, wherein the selectable display region is a display region for which a destination web site is desired to be launched if selected by a user during the time period indicated by the time data; (c) selection data that is defined for the combination of (i) the time period indicated by the time data and (ii) the selectable display region indicated by the location data; and (d) URL data enabling a web site destination to be launched in accordance with the selection data.
32. The method of claim 31 , wherein the media content is television.
33. The device defined in claim 25 , where in the selectable display region is the entire display area of the media content.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/908,697 US20130268842A1 (en) | 2006-03-09 | 2013-06-03 | Systems and methods for mapping media content to web sites |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/371,611 US8370455B2 (en) | 2006-03-09 | 2006-03-09 | Systems and methods for mapping media content to web sites |
US13/750,159 US20130191751A1 (en) | 2006-03-09 | 2013-01-25 | Systems and methods for mapping media content to web sites |
US13/908,697 US20130268842A1 (en) | 2006-03-09 | 2013-06-03 | Systems and methods for mapping media content to web sites |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/750,159 Continuation US20130191751A1 (en) | 2006-03-09 | 2013-01-25 | Systems and methods for mapping media content to web sites |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130268842A1 true US20130268842A1 (en) | 2013-10-10 |
Family
ID=38475341
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/371,611 Expired - Fee Related US8370455B2 (en) | 2006-03-09 | 2006-03-09 | Systems and methods for mapping media content to web sites |
US13/750,159 Abandoned US20130191751A1 (en) | 2006-03-09 | 2013-01-25 | Systems and methods for mapping media content to web sites |
US13/864,671 Abandoned US20130232418A1 (en) | 2006-03-09 | 2013-04-17 | Systems and methods for mapping media content to web sites |
US13/908,697 Abandoned US20130268842A1 (en) | 2006-03-09 | 2013-06-03 | Systems and methods for mapping media content to web sites |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/371,611 Expired - Fee Related US8370455B2 (en) | 2006-03-09 | 2006-03-09 | Systems and methods for mapping media content to web sites |
US13/750,159 Abandoned US20130191751A1 (en) | 2006-03-09 | 2013-01-25 | Systems and methods for mapping media content to web sites |
US13/864,671 Abandoned US20130232418A1 (en) | 2006-03-09 | 2013-04-17 | Systems and methods for mapping media content to web sites |
Country Status (6)
Country | Link |
---|---|
US (4) | US8370455B2 (en) |
EP (1) | EP1999633A4 (en) |
JP (1) | JP2009529828A (en) |
AU (1) | AU2007222070A1 (en) |
CA (1) | CA2644860A1 (en) |
WO (1) | WO2007103000A2 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8386310B2 (en) * | 2007-03-20 | 2013-02-26 | Yahoo! Inc. | System for measuring web traffic related to an offline advertising campaign |
TW201207643A (en) * | 2010-08-09 | 2012-02-16 | Hon Hai Prec Ind Co Ltd | System and method for searching information of images |
TW201207642A (en) * | 2010-08-09 | 2012-02-16 | Hon Hai Prec Ind Co Ltd | System and method for searching information of images |
WO2014002259A1 (en) * | 2012-06-29 | 2014-01-03 | トヨタ自動車株式会社 | Image information provision device, image information provision system, and image information provision method |
US10051329B2 (en) * | 2012-12-10 | 2018-08-14 | DISH Technologies L.L.C. | Apparatus, systems, and methods for selecting and presenting information about program content |
KR101398781B1 (en) * | 2014-03-05 | 2014-05-27 | 지윤 | Media file recording medium having a time based hyperlink and the playing device |
CN103929677B (en) * | 2014-03-27 | 2017-11-07 | 小米科技有限责任公司 | The method and apparatus that multimedia file is played |
CN110213641B (en) * | 2019-05-21 | 2022-03-29 | 北京睿格致科技有限公司 | 4D micro-course playing method and device |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5918012A (en) * | 1996-03-29 | 1999-06-29 | British Telecommunications Public Limited Company | Hyperlinking time-based data files |
Family Cites Families (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1995004974A1 (en) | 1993-08-06 | 1995-02-16 | The Commonwealth Of Australia | A method of specifying links in hypermedia |
CA2130395C (en) * | 1993-12-09 | 1999-01-19 | David G. Greenwood | Multimedia distribution over wide area networks |
US5708845A (en) * | 1995-09-29 | 1998-01-13 | Wistendahl; Douglass A. | System for mapping hot spots in media content for interactive digital media program |
US5774666A (en) * | 1996-10-18 | 1998-06-30 | Silicon Graphics, Inc. | System and method for displaying uniform network resource locators embedded in time-based medium |
US8635649B2 (en) * | 1996-12-19 | 2014-01-21 | Gemstar Development Corporation | System and method for modifying advertisement responsive to EPG information |
US6076104A (en) * | 1997-09-04 | 2000-06-13 | Netscape Communications Corp. | Video data integration system using image data and associated hypertext links |
US6070167A (en) * | 1997-09-29 | 2000-05-30 | Sharp Laboratories Of America, Inc. | Hierarchical method and system for object-based audiovisual descriptive tagging of images for information retrieval, editing, and manipulation |
US6006265A (en) * | 1998-04-02 | 1999-12-21 | Hotv, Inc. | Hyperlinks resolution at and by a special network server in order to enable diverse sophisticated hyperlinking upon a digital network |
US6154771A (en) * | 1998-06-01 | 2000-11-28 | Mediastra, Inc. | Real-time receipt, decompression and play of compressed streaming video/hypervideo; with thumbnail display of past scenes and with replay, hyperlinking and/or recording permissively intiated retrospectively |
US6564380B1 (en) * | 1999-01-26 | 2003-05-13 | Pixelworld Networks, Inc. | System and method for sending live video on the internet |
US6522342B1 (en) * | 1999-01-27 | 2003-02-18 | Hughes Electronics Corporation | Graphical tuning bar for a multi-program data stream |
US6847778B1 (en) * | 1999-03-30 | 2005-01-25 | Tivo, Inc. | Multimedia visual progress indication system |
US6538665B2 (en) * | 1999-04-15 | 2003-03-25 | Apple Computer, Inc. | User interface for presenting media information |
US20010049826A1 (en) * | 2000-01-19 | 2001-12-06 | Itzhak Wilf | Method of searching video channels by content |
US20020056120A1 (en) * | 2000-01-21 | 2002-05-09 | Mcternan Brennan J. | Method and system for distributing video using a virtual set |
US7200857B1 (en) * | 2000-06-09 | 2007-04-03 | Scientific-Atlanta, Inc. | Synchronized video-on-demand supplemental commentary |
US7213255B2 (en) * | 2000-08-25 | 2007-05-01 | Intellocity Usa, Inc. | Set-top preview program |
US7107606B2 (en) * | 2000-08-30 | 2006-09-12 | The Chinese University Of Hong Kong | System and method for highly scalable video on demand |
US7207006B1 (en) | 2000-09-01 | 2007-04-17 | International Business Machines Corporation | Run-time hypervideo hyperlink indicator options in hypervideo players |
US6859840B2 (en) * | 2001-01-29 | 2005-02-22 | Kasenna, Inc. | Prefix caching for media objects |
US20020112247A1 (en) * | 2001-02-09 | 2002-08-15 | Horner David R. | Method and system for creation, delivery, and presentation of time-synchronized multimedia presentations |
TWI220036B (en) * | 2001-05-10 | 2004-08-01 | Ibm | System and method for enhancing broadcast or recorded radio or television programs with information on the world wide web |
US20040128343A1 (en) * | 2001-06-19 | 2004-07-01 | Mayer Daniel J | Method and apparatus for distributing video programs using partial caching |
US7216170B2 (en) * | 2002-05-22 | 2007-05-08 | Microsoft Corporation | Systems and methods to reference resources in a television-based entertainment system |
US20040019900A1 (en) * | 2002-07-23 | 2004-01-29 | Philip Knightbridge | Integration platform for interactive communications and management of video on demand services |
US20050034153A1 (en) * | 2003-08-08 | 2005-02-10 | Maven Networks, Inc. | System and method for delivery of broadband content with integrated interactive elements |
US20050034151A1 (en) * | 2003-08-08 | 2005-02-10 | Maven Networks, Inc. | System and method of integrating video content with interactive elements |
WO2005015912A2 (en) * | 2003-08-08 | 2005-02-17 | Maven Networks, Inc. | System and method of integrating video content with interactive elements |
US20050044260A1 (en) * | 2003-08-08 | 2005-02-24 | Maven Networks, Inc. | System and method for delivery of broadband content |
US7451152B2 (en) * | 2004-07-29 | 2008-11-11 | Yahoo! Inc. | Systems and methods for contextual transaction proposals |
US8418075B2 (en) * | 2004-11-16 | 2013-04-09 | Open Text Inc. | Spatially driven content presentation in a cellular environment |
US20070005783A1 (en) * | 2005-06-30 | 2007-01-04 | Intel Corporation | Systems, methods, and media for controlling a media connection from within a remoting protocol |
GB0521796D0 (en) * | 2005-10-26 | 2005-12-07 | Cardu Salvatore | Gtgvr software application |
US20090024922A1 (en) * | 2006-07-31 | 2009-01-22 | David Markowitz | Method and system for synchronizing media files |
US8015162B2 (en) * | 2006-08-04 | 2011-09-06 | Google Inc. | Detecting duplicate and near-duplicate files |
US7962523B2 (en) * | 2008-04-11 | 2011-06-14 | Yahoo! Inc. | System and method for detecting templates of a website using hyperlink analysis |
-
2006
- 2006-03-09 US US11/371,611 patent/US8370455B2/en not_active Expired - Fee Related
-
2007
- 2007-02-23 CA CA002644860A patent/CA2644860A1/en not_active Abandoned
- 2007-02-23 JP JP2008558292A patent/JP2009529828A/en active Pending
- 2007-02-23 AU AU2007222070A patent/AU2007222070A1/en not_active Abandoned
- 2007-02-23 WO PCT/US2007/004714 patent/WO2007103000A2/en active Application Filing
- 2007-02-23 EP EP07751473A patent/EP1999633A4/en not_active Withdrawn
-
2013
- 2013-01-25 US US13/750,159 patent/US20130191751A1/en not_active Abandoned
- 2013-04-17 US US13/864,671 patent/US20130232418A1/en not_active Abandoned
- 2013-06-03 US US13/908,697 patent/US20130268842A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5918012A (en) * | 1996-03-29 | 1999-06-29 | British Telecommunications Public Limited Company | Hyperlinking time-based data files |
Also Published As
Publication number | Publication date |
---|---|
WO2007103000A2 (en) | 2007-09-13 |
AU2007222070A1 (en) | 2007-09-13 |
US20130191751A1 (en) | 2013-07-25 |
US20130232418A1 (en) | 2013-09-05 |
EP1999633A2 (en) | 2008-12-10 |
CA2644860A1 (en) | 2007-09-13 |
US20070214234A1 (en) | 2007-09-13 |
JP2009529828A (en) | 2009-08-20 |
EP1999633A4 (en) | 2010-07-14 |
US8370455B2 (en) | 2013-02-05 |
WO2007103000A3 (en) | 2008-04-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20130268842A1 (en) | Systems and methods for mapping media content to web sites | |
US9918134B2 (en) | Method and system for content delivery | |
US20190082212A1 (en) | Method for receiving enhanced service and display apparatus thereof | |
US9154668B2 (en) | Video display device and control method thereof | |
JP5395813B2 (en) | Content and metadata consumption techniques | |
US9438966B2 (en) | System and/or method for distributing media content and providing an option to maintain an advertising experience | |
US8640161B2 (en) | Providing content interruptions | |
US9398328B2 (en) | Video display device and method for controlling same | |
US8813118B2 (en) | Interactive content for media content access systems and methods | |
US20120233646A1 (en) | Synchronous multi-platform content consumption | |
US11558657B2 (en) | Integration of control data into digital broadcast content for access to ancillary information | |
KR20130133918A (en) | Systems and methods for selecting media assets for display in a screen of an interactive media guidance application | |
JP2010515291A (en) | Method and apparatus for downloading auxiliary program data to DVR | |
JP2010098730A (en) | Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system | |
US9173001B1 (en) | Media content access systems and methods | |
JP6203657B2 (en) | Video display device | |
WO2013121475A1 (en) | Information display device and information display method | |
JP2023019532A (en) | Moving-image delivery system, playback device, playback method, program, and recording medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: XAXIS HOLDINGS, INC., NEW YORK Free format text: CHANGE OF NAME;ASSIGNOR:24/7 MEDIA, INC.;REEL/FRAME:032151/0132 Effective date: 20131231 |
|
AS | Assignment |
Owner name: XAXIS, INC., NEW YORK Free format text: CHANGE OF NAME;ASSIGNOR:XAXIS HOLDINGS, INC.;REEL/FRAME:032239/0194 Effective date: 20131231 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |