WO2002037850A2 - Adaptive method and apparatus for automatically customizing enhanced program content to user preferences - Google Patents

Adaptive method and apparatus for automatically customizing enhanced program content to user preferences Download PDF

Info

Publication number
WO2002037850A2
WO2002037850A2 PCT/EP2001/012093 EP0112093W WO0237850A2 WO 2002037850 A2 WO2002037850 A2 WO 2002037850A2 EP 0112093 W EP0112093 W EP 0112093W WO 0237850 A2 WO0237850 A2 WO 0237850A2
Authority
WO
WIPO (PCT)
Prior art keywords
viewer
program content
content
enhanced program
viewer profile
Prior art date
Application number
PCT/EP2001/012093
Other languages
French (fr)
Other versions
WO2002037850A3 (en
Inventor
James D. Schaffer
Nevenka Dimitrova
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to EP01993123A priority Critical patent/EP1332619A2/en
Priority to KR1020027008456A priority patent/KR20020067925A/en
Priority to JP2002540457A priority patent/JP2004513576A/en
Publication of WO2002037850A2 publication Critical patent/WO2002037850A2/en
Publication of WO2002037850A3 publication Critical patent/WO2002037850A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only

Definitions

  • the present invention relates to the enhancement of primary programming content with supplementary content, and more particularly, to a method and apparatus for tailoring such enhanced content to user preferences.
  • Supplemental programming content is often provided with primary programming material.
  • the closed-captioning system for example, provides a textual version of the audio information associated with primary programming content to permit people that are hearing impaired to read along with the programming content.
  • a number of systems for enhancing programming content have also been proposed or suggested.
  • WebTVTM for example, provides an enhanced interactive television service using Internet and digital technologies. For example, WebTVTM permits users to play along with game shows and participate in polls during television programming.
  • United States Patent Application Serial Number 09/372,959 filed August 12, 1999, entitled “Customizing Database Information For Presentation With Media Selections,” assigned to the assignee of the present invention and incorporated by reference herein, embeds codes in the primary programming content to selectively trigger enhancement or supplemental content in accordance with a user profile. In this manner, the user profile filters the enhancement material that is presented to the user.
  • United States Patent Application Serial Number 09/532,845, filed March 21, 2000 entitled “System and Method for Automatic Content Enhancement of Multimedia Output Device,” hereinafter referred to as the "Automatic Content Enhancement System,” assigned to the assignee of the present invention and incorporated by reference herein, utilizes video processing and feature extraction techniques to provide automatic content enhancement for primary programming content.
  • the disclosed Automatic Content Enhancement System recognizes patterns or features in the primary programming material and thereafter automatically triggers the enhancement or supplemental content, optionally in accordance with a user profile.
  • a television program may include a logo for a given company that is recognized by the Automatic Content Enhancement System.
  • the recognized logo is then correlated with enhanced content that is typically stored locally.
  • the Automatic Content Enhancement System modifies the primary programming content in an appropriate way.
  • the enhanced content presented by the Automatic Content Enhancement System might be a commercial video clip or the telephone number of a local agent of the company.
  • the modification to the primary programming content overlays the local agent's telephone number on the video signal or buffers the primary broadcast signal and plays a supplemental commercial video clip.
  • the supplemental commercial video clip can be presented using picture-in-picture technology simultaneously with the continued presentation of the primary programming content.
  • the enhanced program content may include, for example, biographical information about an individual appearing in the primary programming content or current or historical events regarding a geographical area indicated in the primary programming content.
  • the present invention automatically and selectively triggers presentation of the enhanced program content in accordance with a viewer profile.
  • the viewer profile indicates the level of interest, in the form of a numerical representation, of the viewer in a number of attributes.
  • a viewer profile might have a numerical representation indicating that the user is a rock fan, with the sub-attribute that the user is a particularly heavy fan of a certain rock band.
  • a viewer preference learning process dynamically adjusts the numerical representations set forth in the viewer profile based on the viewer's acceptance or rejection of enhanced program content. In this manner, the present invention automatically adjusts the viewer's profile by observing the viewer's reactions to presented enhancement content.
  • the inferences contained in the viewer profile that automatically trigger the display of individual enhanced program content are thus strengthened or weakened based on the viewer's acceptance or rejection of enhanced program content, or based on an inferred determination as to whether the viewer enjoyed presented enhanced program content.
  • FIG. 1 illustrates a personalized program enhancement system in accordance with the present invention
  • FIG. 2 illustrates a music broadcast where the content is enhanced with several layers of enhanced program content in accordance with the present invention
  • FIG. 3 is a table illustrating an exemplary enhanced program content database that classifies attributes of the enhanced program content
  • FIG. 4A is a table illustrating an exemplary viewer profile of FIG. 1 ;
  • FIG. 4B illustrates a symbolic representation indicating the relative level of interest of a viewer in a particular program attribute;
  • FIG. 5 is a flow chart describing an exemplary personalized program enhancement process embodying principles of the present invention.
  • FIG. 6 is a flow chart describing an exemplary viewer preference learning process embodying principles of the present invention.
  • FIG. 1 illustrates a personalized program enhancement system 100 in accordance with the present invention.
  • the present invention seeks to enhance the enjoyment of a user accessing primary programming content, by providing associated, customized enhanced program content.
  • the primary programming content and enhanced program content may comprise audio, video, textual or other multimedia information, or a combination thereof.
  • the enhanced program content may include, for example, biographical information about an individual appearing in the primary programming content, such as a composer for a musical recording or current or historical events regarding a geographical area indicated in the primary programming content.
  • primary program content is received from a primary program source 110, for example, using a wireless broadcast network, such as a cellular telephone network, a terrestrial television broadcast network, or a digital satellite service (DSS) television network, or a wired network, such as the Internet, Public Switched Telephone Network (PSTN) or a cable television network, or a combination of the foregoing.
  • a wireless broadcast network such as a cellular telephone network, a terrestrial television broadcast network, or a digital satellite service (DSS) television network
  • DSS digital satellite service
  • wired network such as the Internet, Public Switched Telephone Network (PSTN) or a cable television network, or a combination of the foregoing.
  • PSTN Public Switched Telephone Network
  • cable television network or a combination of the foregoing.
  • enhanced program content is received from an enhanced program source 120, which may be local or remote.
  • the programming content may be received by means of any wireless or wired network (or both), in the manner described above. It is noted that the enhanced program content may be received simultaneously with the primary programming content or in an off-line manner.
  • the primary programming content and the enhanced program content are integrated by an enhancement manager 160 and presented to the viewer 195 on a display 180.
  • the enhancement manager 160 can coordinate the presentation or distribution of the enhanced program content.
  • the enhanced program content can optionally be presented simultaneously with the primary programming content, or the enhanced program content may be provided, for example, by electronic mail, for subsequent access.
  • the primary content may be delayed, so that enhanced program content may be viewed first.
  • the present invention automatically and selectively triggers enhanced program content in accordance with a viewer profile 150, discussed further below in conjunction with FIG. 4A.
  • the viewer profile 150 may be associated with a specific user or a group of individuals, such as a household, as would be apparent to a person of ordinary skill in the art.
  • the personalized program enhancement system 100 employs a learner 170 to automatically learn the viewer's profile 150 to greater precision by observing the viewer's reactions to presented enhancement content, as determined by a reaction capture module 190.
  • the inferences contained in the viewer profile 150 that automatically trigger the display of individual enhanced program content can be strengthened or weakened based on the viewer's acceptance or rejection of enhanced program content, or based on an inferred determination as to whether the viewer enjoyed presented enhanced program content. These inferences can be stored in the viewer profile 150 thus influencing all future enhancement behavior by the system.
  • the degree of adjustment to the inferences can vary based on the time of day or year, or whether the viewer selected to experience the enhanced program content simultaneously with the primary programming content or at a later time. For example, a user may have a level of interest in certain things only at certain times of the day or year, or when in certain moods. Likewise, an election to receive enhanced program content subsequent to the presentation of the primary programming content may suggest a lower level of interest in the topic than if the user elected immediate and simultaneous presentation of the enhanced program content.
  • any adjustments to the inferences can be reduced or eliminated if the user has elected to block all enhanced program content under certain conditions, such as during certain categories of programs.
  • the fact that enhanced program content is not presented to a user under certain predefined "blocking" conditions, should not prevent similar enhanced program content from being presented to the user in the future.
  • the personalized program enhancement system 100 also includes a matcher 140 that compares characteristics of the received enhanced program content to characteristics specified in the viewer profile 150 to identify enhanced program content that is of interest to the particular viewer. Thus, while the learner 170 infers information about the viewer based on viewer behavior, the matcher 140 applies what has already been learned about the viewer. The matcher 140 provides the personalized enhanced program content, together with the corresponding trigger conditions, to a trigger detector 130.
  • the trigger detector 130 monitors the primary programming content for embedded codes or specific features, or both.
  • the features in the primary programming content that trigger the display of ithe enhanced program content can be (i) embedded codes (i.e., annotations) placed in the enhanced program content by or on behalf of the content provider, or (ii) features that are dynamically recognized in the primary programming content by the trigger detector 130.
  • the trigger detector 130 may employ face recognition, feature recognition, speech recognition or other well-known techniques to recognize predefined features in the primary programming content.
  • the embedded codes can actually be the enhanced program content, or a pointer to a local or remote location where the enhanced program content is stored.
  • the trigger detector 130 can identify a particular actor in the primary programming content, and then trigger enhanced program content that is related to the identified actor, assuming the viewer is interested in enhanced program content about this actor.
  • the embedded codes or extracted features are provided to the trigger detector 130, for example, by an indexer (not shown),_ as a stream of tags matched to points or segments in the primary programming content.
  • the trigger detector 130 then monitors the tags and filters out those tags that are not of interest to the user, or that do not correspond to available enhanced program content.
  • the trigger detector 130 monitors the primary programming content for embedded codes or specific features, or both.
  • the primary programming content contains embedded enhanced program content
  • the primary programming content is manually indexed with the enhanced program content (or a pointer to a file where the enhanced program content is stored). The indexing can be performed during content production or before content distribution, for example, by the content provider, the broadcaster or a third party.
  • FIG. 2 illustrates a music broadcast 200 where the content 210 is enhanced with several layers 220, 230, 240 of enhanced program content about the same content 210.
  • the music broadcast 200 has been enhanced with biographical information about the composer in layer 220 and an explanation of the movements and passages in layer 240.
  • the trigger detector 130 performs visual or audio characterization using low-level features extracted from the signal. For example, audio-visual characterization can be performed off-line. During audio-visual characterization of the content, the features are extracted and then classified. In this manner, the class label serves as a trigger generator for the enhanced program content.
  • An audio signal can be characterized by features such as: short time energy, band energy ratio, pause rate, and pitch. Other features using Fourier transform and Mel Spectrum Frequency coefficients can also be used. A weighted combination of these features can be used to characterize the audio part (e.g., music program) of a video segment.
  • the features are extracted using a sliding window of N milliseconds with an overlapping of M milliseconds (where N could be, for example, 45 and M could be 30.)
  • the features are then provided to the nearest neighbor classifier to generate k classification labels for each moving window. Then, the k classification decisions from each window are combined to generate a single decision for each segment. This decision represents the identity of the music segment that hopefully reflects the mood, harmony and the melody itself.
  • the input audio signal (music) can be converted into a series of midi symbols, as described in A. Ghias et al., "Query by Humming," ACM Multimedia 95, 231-236 (1995), incorporated by reference herein. These are basically part of a play list indicating which notes have been played.
  • the melody then can be converted into an indexed string representing the audio segment. If the next note is higher than the previous one, then it is labeled U (short for Up), if the next note is the same then it is labeled as S (for same), and if the note is lower then it is labeled as D (for down).
  • the opening of the Beethoven Vth symphony is then SSDUSSD.
  • the whole database is analyzed and indexed.
  • the content provider can then search for similar strings, i.e., similar music segments. If there are similar segments, then the segment is associated with a label (which serves as a trigger later on) of the name and location of the similar audio in the other video streams.
  • a label which serves as a trigger later on
  • the matcher 140 executes a personalized program enhancement process 500, discussed further below in conjunction with FIG. 5, to compare features or characteristics of the received enhanced program content, discussed further below in conjunction with FIG. 3, to viewer preferences (attributes) set forth in the viewer profile 150, discussed further below in conjunction with FIG. 4A, to identify enhanced program content that is of interest to the . particular viewer.
  • the matcher 140 can thus provide personalized enhanced program content, together with the corresponding trigger conditions, to a trigger detector 130.
  • FIG. 3 is a table illustrating an exemplary enhanced program content database 300 that classifies enhanced program content.
  • the enhanced program content database 300 contains a plurality of records 305-310 each associated with a different segment of enhanced program content. For each enhanced program content segment identified in column 340, the enhanced program content database 300 provides a description of the segment in column 345 as well as identifying attributes that indicate the target audience for the segment in column 350.
  • the matcher 140 attempts to match the segments of enhanced program content to the appropriate viewers, based on the attributes specified in the target audience column 350.
  • the enhanced program content database 300 assumes that the enhanced program content is stored and indexed locally.
  • the enhanced program content can be received over a network in real-time, simultaneous with the primary programming content.
  • the attributes of the target audience for the enhanced program content may actually be received with the enhanced program content itself, for example, in a parallel data stream or in header information.
  • FIG. 4A is a table illustrating an exemplary viewer profile 150.
  • the viewer profile 150 contains a plurality of records 405-412 each associated with a different user attribute or sub-attribute (hereinafter, collectively referred to as "attributes").
  • the viewer profile 150 provides a numerical or symbolic representation in column 450, indicating the relative level of interest of the viewer in the corresponding attribute.
  • a viewer profile 150 might have a numerical representation indicating that the user is a rock fan, with the sub-attribute that the user is a particularly heavy fan of the band U2.
  • FIG. 4B illustrates a symbolic representation that indicates the relative level of interest of a viewer in a particular program attribute, such as rock music shows.
  • a particular program attribute such as rock music shows.
  • the number of rock music shows watched by a user is translated into a discrete level of interest in rock music. Thereafter, if the user's level of interest in rock music is "high," for example, then enhanced program content corresponding to rock music will be presented to this user.
  • the viewer profile 150 may initially be established explicitly, for example, in response to a questionnaire administered to the user, or implicitly, for example, by observing the behavior of the user.
  • the present invention dynamically adjusts the numerical representations set forth in column 450 based on the viewer's reaction to presented enhanced program content.
  • the numerical representation in the viewer profile 150 includes an intensity scale such as:
  • the matcher 140 executes a personalized program enhancement process 500, shown in FIG. 5, to compare features of the enhanced program content (from FIG. 3) to viewer preferences (attributes) set forth in the viewer profile 150 (FIG. 4) to identify enhanced program content that is of interest to the particular viewer.
  • a personalized program enhancement process 500 shown in FIG. 5, to compare features of the enhanced program content (from FIG. 3) to viewer preferences (attributes) set forth in the viewer profile 150 (FIG. 4) to identify enhanced program content that is of interest to the particular viewer.
  • the illustrative embodiment of the personalized program enhancement process 400 assumes that the enhanced program content is stored and indexed locally for later retrieval.
  • United States Patent Application Serial Number 09/372,959 filed August 12, 1999, entitled "Customizing Database Information For Presentation With Media Selections,” assigned to the assignee of the present invention and incorporated by reference herein.
  • the personalized program enhancement process 500 initially accesses the enhanced program content database 300 during step 510 to retrieve attributes describing the target audience for a segment of enhanced program content.
  • the personalized program enhancement process 500 accesses the viewer profile 150 during step 520 to retrieve the numerical representations for the corresponding attributes.
  • a test is performed during step 530 to determine if the retrieved numerical representation(s) for the corresponding attribute (s) satisfy predefined criteria.
  • the predefined criteria may be a minimum score.
  • the numerical or symbolic representation set forth in field 450 of the viewer profile 150 may be dynamically adjusted based on the viewer's reaction to enhanced program content in accordance with the present invention, as discussed hereinafter.
  • step 530 If it is determined during step 530 that the retrieved numerical representation(s) for the corresponding attribute (s) satisfy the predefined criteria, then the enhanced program content is presented to the viewer together with the primary programming content during step 540. The presentation of the enhanced program content and the primary programming content is coordinated by the enhancement manager 160. If, however, it is determined during step 530 that the retrieved numerical representation(s) for the corresponding attribute (s) do not satisfy the predefined criteria, then the enhanced program content is not presented to the viewer and program control terminates during step 550.
  • FIG. 6 is a flow chart describing an exemplary viewer preference learning process 600 embodying principles of the present invention.
  • the viewer preference learning process 600 can strengthen or weaken the numerical representations corresponding to each inference contained in the viewer profile 150, based on the viewer's acceptance or rejection of enhanced program content.
  • the viewer preference learning process 600 initially monitors the viewer behavior for an acceptance or rejection of enhanced program content during step 610. Once it is determined during step 610 that the viewer has accepted or rejected some enhanced program content, program control proceeds to step 620.
  • the viewer behavior suggesting an acceptance or rejection of enhanced program content may be express behavior or inferred behavior.
  • the personalized program enhancement system 100 may require the viewer to affirmatively accept enhanced program content before it is presented, for example, by providing an indication of available enhanced program content in a small window and requiring the viewer to press a button on the remote control to initiate the presentation of the enhanced program content.
  • behavior suggesting a positive reaction to the enhanced program content is considered an acceptance of the enhanced program content.
  • the following behavior suggests a positive reaction: expanding a smaller picture-in-picture window containing enhanced program content or otherwise changing the focus from the primary programming content to the enhanced program content.
  • the following behavior suggests a negative reaction: reducing a larger picture-in-picture window containing enhanced program content or otherwise changing returning the focus from the enhanced programming content to the primary program content.
  • a test is performed during step 620 to determine if the viewer has accepted or rejected enhanced program content. If it is determined during step 620 that the viewer has accepted enhanced program content, then the numerical ratings contained in the viewer profile 150 that are associated with the attributes that contributed to the selection of this enhanced program content are incremented during step 630. If, on the other hand, it is determined during step 620 that the viewer has rejected enhanced program content, then the numerical ratings contained in the viewer profile 150 that are associated with the attributes that contributed to the selection of this enhanced program content are decremented during step 640.

Abstract

A method and apparatus are disclosed for providing personalized supplemental programming content that enhances primary programming content. Enhanced program content is automatically and selectively triggered in accordance with a viewer profile. The viewer profile provides a numerical representation indicating the viewer's level of interest a number of attributes. A disclosed viewer preference learning process dynamically adjusts the numerical representations set forth in the viewer profile based on the viewer's acceptance or rejection of enhanced program content. The viewer's profile is thus automatically adjusted by observing the viewer's reactions to presented enhancement content. The inferences contained in the viewer profile that automatically trigger the display of individual enhanced program content are strengthened or weakened based on the viewer's acceptance or rejection of enhanced program content, or based on an inferred determination as to whether the viewer enjoyed presented enhanced program content.

Description

Adaptive method and apparatus for automatically customizing enhanced program content to user preferences
Field of the Invention
The present invention relates to the enhancement of primary programming content with supplementary content, and more particularly, to a method and apparatus for tailoring such enhanced content to user preferences.
Background of the Invention
Supplemental programming content is often provided with primary programming material. The closed-captioning system, for example, provides a textual version of the audio information associated with primary programming content to permit people that are hearing impaired to read along with the programming content. A number of systems for enhancing programming content have also been proposed or suggested. WebTV™, for example, provides an enhanced interactive television service using Internet and digital technologies. For example, WebTV™ permits users to play along with game shows and participate in polls during television programming.
While currently available enhanced programming services provide an improved viewing experience for viewers, they suffer from a number of limitations, which if overcome, could greatly expand the utility of such enhanced television systems and the relevance of the enhanced content they present to an individual viewer. Specifically, most available systems for enhancing programming content are not sufficiently customized to user preferences. One system for enhancing programming content is disclosed in United States Patent Application Serial Number 09/351,086, filed July 9, 1999, entitled "Method and Apparatus for Linking a Video Segment to Another Video Segment or Information Source," assigned to the assignee of the present invention and incorporated by reference herein.
United States Patent Application Serial Number 09/372,959, filed August 12, 1999, entitled "Customizing Database Information For Presentation With Media Selections," assigned to the assignee of the present invention and incorporated by reference herein, embeds codes in the primary programming content to selectively trigger enhancement or supplemental content in accordance with a user profile. In this manner, the user profile filters the enhancement material that is presented to the user. In addition, United States Patent Application Serial Number 09/532,845, filed March 21, 2000, entitled "System and Method for Automatic Content Enhancement of Multimedia Output Device," hereinafter referred to as the "Automatic Content Enhancement System," assigned to the assignee of the present invention and incorporated by reference herein, utilizes video processing and feature extraction techniques to provide automatic content enhancement for primary programming content. The disclosed Automatic Content Enhancement System recognizes patterns or features in the primary programming material and thereafter automatically triggers the enhancement or supplemental content, optionally in accordance with a user profile.
For example, a television program may include a logo for a given company that is recognized by the Automatic Content Enhancement System. The recognized logo is then correlated with enhanced content that is typically stored locally. Based on user preferences (for example, whether the user is interested in that particular company) and the correlated enhanced content, the Automatic Content Enhancement System modifies the primary programming content in an appropriate way.
For example, the enhanced content presented by the Automatic Content Enhancement System might be a commercial video clip or the telephone number of a local agent of the company. In one embodiment, the modification to the primary programming content overlays the local agent's telephone number on the video signal or buffers the primary broadcast signal and plays a supplemental commercial video clip. Alternatively, the supplemental commercial video clip can be presented using picture-in-picture technology simultaneously with the continued presentation of the primary programming content.
Although these profile-based systems significantly advance the quality and relevance of presented enhancement material, relative to conventional techniques, they do not adapt to whether or not the user actually liked presented enhanced program content. A need therefore exists for a method and apparatus for presenting enhanced program content in accordance with personalized preferences of individual viewers that are derived from viewing behavior. A further need exists for a method and apparatus for learning a viewer's preferences by observing the viewer's reactions to presented enhanced content. Yet another need exists for a method and apparatus that strengthens or weakens the individual inferences that trigger the display of enhanced program content based on viewing behavior. Summary of the Invention
Generally, a method and apparatus are disclosed for providing personalized supplemental programming content that enhances primary programming content. The enhanced program content may include, for example, biographical information about an individual appearing in the primary programming content or current or historical events regarding a geographical area indicated in the primary programming content.
The present invention automatically and selectively triggers presentation of the enhanced program content in accordance with a viewer profile. The viewer profile indicates the level of interest, in the form of a numerical representation, of the viewer in a number of attributes. For example, a viewer profile might have a numerical representation indicating that the user is a rock fan, with the sub-attribute that the user is a particularly heavy fan of a certain rock band.
According to one aspect of the invention, a viewer preference learning process dynamically adjusts the numerical representations set forth in the viewer profile based on the viewer's acceptance or rejection of enhanced program content. In this manner, the present invention automatically adjusts the viewer's profile by observing the viewer's reactions to presented enhancement content.
The inferences contained in the viewer profile that automatically trigger the display of individual enhanced program content are thus strengthened or weakened based on the viewer's acceptance or rejection of enhanced program content, or based on an inferred determination as to whether the viewer enjoyed presented enhanced program content.
A more complete understanding of the present invention, as well as further features and advantages of the present invention, will be obtained by reference to the following detailed description and drawings.
Brief Description of the Drawings
FIG. 1 illustrates a personalized program enhancement system in accordance with the present invention;
FIG. 2 illustrates a music broadcast where the content is enhanced with several layers of enhanced program content in accordance with the present invention;
FIG. 3 is a table illustrating an exemplary enhanced program content database that classifies attributes of the enhanced program content;
FIG. 4A is a table illustrating an exemplary viewer profile of FIG. 1 ; FIG. 4B illustrates a symbolic representation indicating the relative level of interest of a viewer in a particular program attribute;
FIG. 5 is a flow chart describing an exemplary personalized program enhancement process embodying principles of the present invention; and
FIG. 6 is a flow chart describing an exemplary viewer preference learning process embodying principles of the present invention.
Detailed Description
FIG. 1 illustrates a personalized program enhancement system 100 in accordance with the present invention. The present invention seeks to enhance the enjoyment of a user accessing primary programming content, by providing associated, customized enhanced program content. The primary programming content and enhanced program content may comprise audio, video, textual or other multimedia information, or a combination thereof. The enhanced program content may include, for example, biographical information about an individual appearing in the primary programming content, such as a composer for a musical recording or current or historical events regarding a geographical area indicated in the primary programming content.
As shown in FIG. 1 , primary program content is received from a primary program source 110, for example, using a wireless broadcast network, such as a cellular telephone network, a terrestrial television broadcast network, or a digital satellite service (DSS) television network, or a wired network, such as the Internet, Public Switched Telephone Network (PSTN) or a cable television network, or a combination of the foregoing.
Likewise, enhanced program content is received from an enhanced program source 120, which may be local or remote. For a remote enhanced program source 120, the programming content may be received by means of any wireless or wired network (or both), in the manner described above. It is noted that the enhanced program content may be received simultaneously with the primary programming content or in an off-line manner. The primary programming content and the enhanced program content are integrated by an enhancement manager 160 and presented to the viewer 195 on a display 180.
According to another feature of the invention, the enhancement manager 160 can coordinate the presentation or distribution of the enhanced program content. For example, the enhanced program content can optionally be presented simultaneously with the primary programming content, or the enhanced program content may be provided, for example, by electronic mail, for subsequent access. In a further variation, the primary content may be delayed, so that enhanced program content may be viewed first.
The present invention automatically and selectively triggers enhanced program content in accordance with a viewer profile 150, discussed further below in conjunction with FIG. 4A. It is noted that the viewer profile 150 may be associated with a specific user or a group of individuals, such as a household, as would be apparent to a person of ordinary skill in the art. According to one feature of the present invention, the personalized program enhancement system 100 employs a learner 170 to automatically learn the viewer's profile 150 to greater precision by observing the viewer's reactions to presented enhancement content, as determined by a reaction capture module 190. The inferences contained in the viewer profile 150 that automatically trigger the display of individual enhanced program content can be strengthened or weakened based on the viewer's acceptance or rejection of enhanced program content, or based on an inferred determination as to whether the viewer enjoyed presented enhanced program content. These inferences can be stored in the viewer profile 150 thus influencing all future enhancement behavior by the system.
Furthermore, the degree of adjustment to the inferences can vary based on the time of day or year, or whether the viewer selected to experience the enhanced program content simultaneously with the primary programming content or at a later time. For example, a user may have a level of interest in certain things only at certain times of the day or year, or when in certain moods. Likewise, an election to receive enhanced program content subsequent to the presentation of the primary programming content may suggest a lower level of interest in the topic than if the user elected immediate and simultaneous presentation of the enhanced program content.
In another variation, any adjustments to the inferences can be reduced or eliminated if the user has elected to block all enhanced program content under certain conditions, such as during certain categories of programs. In other words, the fact that enhanced program content is not presented to a user under certain predefined "blocking" conditions, should not prevent similar enhanced program content from being presented to the user in the future.
The personalized program enhancement system 100 also includes a matcher 140 that compares characteristics of the received enhanced program content to characteristics specified in the viewer profile 150 to identify enhanced program content that is of interest to the particular viewer. Thus, while the learner 170 infers information about the viewer based on viewer behavior, the matcher 140 applies what has already been learned about the viewer. The matcher 140 provides the personalized enhanced program content, together with the corresponding trigger conditions, to a trigger detector 130.
The trigger detector 130, discussed further below in conjunction with FIG. 2, monitors the primary programming content for embedded codes or specific features, or both. The features in the primary programming content that trigger the display of ithe enhanced program content can be (i) embedded codes (i.e., annotations) placed in the enhanced program content by or on behalf of the content provider, or (ii) features that are dynamically recognized in the primary programming content by the trigger detector 130. For example, the trigger detector 130 may employ face recognition, feature recognition, speech recognition or other well-known techniques to recognize predefined features in the primary programming content. It is noted that the embedded codes can actually be the enhanced program content, or a pointer to a local or remote location where the enhanced program content is stored.
For example, the trigger detector 130 can identify a particular actor in the primary programming content, and then trigger enhanced program content that is related to the identified actor, assuming the viewer is interested in enhanced program content about this actor. In one implementation, the embedded codes or extracted features are provided to the trigger detector 130, for example, by an indexer (not shown),_ as a stream of tags matched to points or segments in the primary programming content. The trigger detector 130 then monitors the tags and filters out those tags that are not of interest to the user, or that do not correspond to available enhanced program content.
For a more detailed discussion of a system that triggers enhanced program content using dynamically recognized features, see, United States Patent Application Serial Number 09/532,845, filed March 21, 2000, entitled "System and Method for Automatic Content Enhancement of Multimedia Output Device," assigned to the assignee of the present invention and incorporated by reference herein. For a more detailed discussion of a system that triggers enhanced program content using embedded codes, see, United States Patent Application Serial Number 09/372,959, filed August 12, 1999, entitled "Customizing Database Information For Presentation With Media Selections," assigned to the assignee of the present invention and incorporated by reference herein.
Trigger Detector
As previously indicated, the trigger detector 130 monitors the primary programming content for embedded codes or specific features, or both. In an embodiment where the primary programming content contains embedded enhanced program content, the primary programming content is manually indexed with the enhanced program content (or a pointer to a file where the enhanced program content is stored). The indexing can be performed during content production or before content distribution, for example, by the content provider, the broadcaster or a third party.
FIG. 2 illustrates a music broadcast 200 where the content 210 is enhanced with several layers 220, 230, 240 of enhanced program content about the same content 210. For example, the music broadcast 200 has been enhanced with biographical information about the composer in layer 220 and an explanation of the movements and passages in layer 240.
In an embodiment where the primary programming content is processed to dynamically detect predefined features that trigger the enhanced program content, the trigger detector 130 performs visual or audio characterization using low-level features extracted from the signal. For example, audio-visual characterization can be performed off-line. During audio-visual characterization of the content, the features are extracted and then classified. In this manner, the class label serves as a trigger generator for the enhanced program content.
An audio signal can be characterized by features such as: short time energy, band energy ratio, pause rate, and pitch. Other features using Fourier transform and Mel Spectrum Frequency coefficients can also be used. A weighted combination of these features can be used to characterize the audio part (e.g., music program) of a video segment. The features are extracted using a sliding window of N milliseconds with an overlapping of M milliseconds (where N could be, for example, 45 and M could be 30.) The features are then provided to the nearest neighbor classifier to generate k classification labels for each moving window. Then, the k classification decisions from each window are combined to generate a single decision for each segment. This decision represents the identity of the music segment that hopefully reflects the mood, harmony and the melody itself.
Using pitch-to-midi conversion, the input audio signal (music) can be converted into a series of midi symbols, as described in A. Ghias et al., "Query by Humming," ACM Multimedia 95, 231-236 (1995), incorporated by reference herein. These are basically part of a play list indicating which notes have been played. The melody then can be converted into an indexed string representing the audio segment. If the next note is higher than the previous one, then it is labeled U (short for Up), if the next note is the same then it is labeled as S (for same), and if the note is lower then it is labeled as D (for down). The opening of the Beethoven Vth symphony is then SSDUSSD. In this manner, the whole database is analyzed and indexed. The content provider can then search for similar strings, i.e., similar music segments. If there are similar segments, then the segment is associated with a label (which serves as a trigger later on) of the name and location of the similar audio in the other video streams. When the program is played to the user, the user can see the related information about the matching music segments.
MATCHER
The matcher 140 executes a personalized program enhancement process 500, discussed further below in conjunction with FIG. 5, to compare features or characteristics of the received enhanced program content, discussed further below in conjunction with FIG. 3, to viewer preferences (attributes) set forth in the viewer profile 150, discussed further below in conjunction with FIG. 4A, to identify enhanced program content that is of interest to the . particular viewer. The matcher 140 can thus provide personalized enhanced program content, together with the corresponding trigger conditions, to a trigger detector 130.
FIG. 3 is a table illustrating an exemplary enhanced program content database 300 that classifies enhanced program content. As shown in FIG. 3, the enhanced program content database 300 contains a plurality of records 305-310 each associated with a different segment of enhanced program content. For each enhanced program content segment identified in column 340, the enhanced program content database 300 provides a description of the segment in column 345 as well as identifying attributes that indicate the target audience for the segment in column 350.
Thus, as discussed further below, the matcher 140 attempts to match the segments of enhanced program content to the appropriate viewers, based on the attributes specified in the target audience column 350. It is noted that in the illustrative embodiment, the enhanced program content database 300 assumes that the enhanced program content is stored and indexed locally. In alternate embodiments, the enhanced program content can be received over a network in real-time, simultaneous with the primary programming content. In such a real-time embodiment, the attributes of the target audience for the enhanced program content may actually be received with the enhanced program content itself, for example, in a parallel data stream or in header information.
FIG. 4A is a table illustrating an exemplary viewer profile 150. As shown in FIG. 4, the viewer profile 150 contains a plurality of records 405-412 each associated with a different user attribute or sub-attribute (hereinafter, collectively referred to as "attributes"). In addition, for each attribute set forth in column 440, the viewer profile 150 provides a numerical or symbolic representation in column 450, indicating the relative level of interest of the viewer in the corresponding attribute. For example, a viewer profile 150 might have a numerical representation indicating that the user is a rock fan, with the sub-attribute that the user is a particularly heavy fan of the band U2.
FIG. 4B illustrates a symbolic representation that indicates the relative level of interest of a viewer in a particular program attribute, such as rock music shows. As shown in FIG. 4B, the number of rock music shows watched by a user is translated into a discrete level of interest in rock music. Thereafter, if the user's level of interest in rock music is "high," for example, then enhanced program content corresponding to rock music will be presented to this user.
The viewer profile 150 may initially be established explicitly, for example, in response to a questionnaire administered to the user, or implicitly, for example, by observing the behavior of the user. The present invention dynamically adjusts the numerical representations set forth in column 450 based on the viewer's reaction to presented enhanced program content.
In an exemplary embodiment, the numerical representation in the viewer profile 150 includes an intensity scale such as:
Figure imgf000010_0001
As previously indicated, the matcher 140 executes a personalized program enhancement process 500, shown in FIG. 5, to compare features of the enhanced program content (from FIG. 3) to viewer preferences (attributes) set forth in the viewer profile 150 (FIG. 4) to identify enhanced program content that is of interest to the particular viewer. It is again noted that the illustrative embodiment of the personalized program enhancement process 400 assumes that the enhanced program content is stored and indexed locally for later retrieval. For a discussion of an alternate implementation that stores and indexes the enhanced program content locally for later retrieval, see United States Patent Application Serial Number 09/372,959, filed August 12, 1999, entitled "Customizing Database Information For Presentation With Media Selections," assigned to the assignee of the present invention and incorporated by reference herein.
As shown in FIG. 5, the personalized program enhancement process 500 initially accesses the enhanced program content database 300 during step 510 to retrieve attributes describing the target audience for a segment of enhanced program content. In addition, the personalized program enhancement process 500 accesses the viewer profile 150 during step 520 to retrieve the numerical representations for the corresponding attributes.
A test is performed during step 530 to determine if the retrieved numerical representation(s) for the corresponding attribute (s) satisfy predefined criteria. For example, the predefined criteria may be a minimum score. It is noted that the numerical or symbolic representation set forth in field 450 of the viewer profile 150 may be dynamically adjusted based on the viewer's reaction to enhanced program content in accordance with the present invention, as discussed hereinafter.
If it is determined during step 530 that the retrieved numerical representation(s) for the corresponding attribute (s) satisfy the predefined criteria, then the enhanced program content is presented to the viewer together with the primary programming content during step 540. The presentation of the enhanced program content and the primary programming content is coordinated by the enhancement manager 160. If, however, it is determined during step 530 that the retrieved numerical representation(s) for the corresponding attribute (s) do not satisfy the predefined criteria, then the enhanced program content is not presented to the viewer and program control terminates during step 550.
LEARNER
As previously indicated, the personalized program enhancement system 100 employs a learner 170 to modify the viewer's profile 150 by observing the viewer's reactions to presented enhancement content, as determined by a reaction capture module 190. FIG. 6 is a flow chart describing an exemplary viewer preference learning process 600 embodying principles of the present invention. The viewer preference learning process 600 can strengthen or weaken the numerical representations corresponding to each inference contained in the viewer profile 150, based on the viewer's acceptance or rejection of enhanced program content. As shown in FIG. 6, the viewer preference learning process 600 initially monitors the viewer behavior for an acceptance or rejection of enhanced program content during step 610. Once it is determined during step 610 that the viewer has accepted or rejected some enhanced program content, program control proceeds to step 620. It is noted that the viewer behavior suggesting an acceptance or rejection of enhanced program content may be express behavior or inferred behavior. For example, the personalized program enhancement system 100 may require the viewer to affirmatively accept enhanced program content before it is presented, for example, by providing an indication of available enhanced program content in a small window and requiring the viewer to press a button on the remote control to initiate the presentation of the enhanced program content. In addition, behavior suggesting a positive reaction to the enhanced program content is considered an acceptance of the enhanced program content. For example, the following behavior suggests a positive reaction: expanding a smaller picture-in-picture window containing enhanced program content or otherwise changing the focus from the primary programming content to the enhanced program content. Likewise, the following behavior suggests a negative reaction: reducing a larger picture-in-picture window containing enhanced program content or otherwise changing returning the focus from the enhanced programming content to the primary program content.
A test is performed during step 620 to determine if the viewer has accepted or rejected enhanced program content. If it is determined during step 620 that the viewer has accepted enhanced program content, then the numerical ratings contained in the viewer profile 150 that are associated with the attributes that contributed to the selection of this enhanced program content are incremented during step 630. If, on the other hand, it is determined during step 620 that the viewer has rejected enhanced program content, then the numerical ratings contained in the viewer profile 150 that are associated with the attributes that contributed to the selection of this enhanced program content are decremented during step 640.
It is noted that if a number of attributes contributed to the selection of a given segment of enhanced program content, the numerical representations can be adjusted in accordance with a sliding scale, based on the weights assigned to each contributing feature. Program control terminates during step 650.
It is to be understood that the embodiments and variations shown and described herein are merely illustrative of the principles of this invention and that various modifications may be implemented by those skilled in the art without departing from the scope and spirit of the invention.

Claims

CLAIMS:
1. A method for updating a viewer profile (150) indicating preferences of a viewer concerning enhanced program content (120), comprising the steps of: presenting said enhanced program content (120) to said viewer based on information in said viewer profile (150); and updating said viewer profile (150) based on a reaction of said viewer to said enhanced program content (120).
2. The method of claim 1 , wherein said viewer profile (150) includes a numerical representation indicating a level of interest in at least one attribute.
3. The method of claim 1 , wherein said viewer profile (150) includes a symbolic representation indicating a level of interest in at least one attribute.
4. The method of claim 2, wherein said updating step further comprises the step of adjusting at least one numerical representation.
5. The method of claim 2, wherein said numerical representation is updated in accordance with a sliding scale.
6. The method of claim 3, wherein said updating step further comprises the step of adjusting at least one symbolic representation.
7. The method of claim 1, wherein said enhanced program content (120) is presented simultaneously with primary programming content (110).
8. The method of claim 1, wherein said enhanced program content (120) is presented to said viewer asynchronously relative to said corresponding primary programming content (110).
9. The method of claim 1 , wherein said step of updating said viewer profile (150) further comprises the step of updating said viewer profile (150) based on whether said enhanced program content (120) is presented simultaneously with primary programming content (110).
10. The method of claim 1 , wherein said step of updating said viewer profile (150) further comprises the step of updating said viewer profile (150) based on a time of day.
11. The method of claim 1 , wherein said step of updating said viewer profile (150) further comprises the step of updating said viewer profile (150) based on a time of year.
12. The method of claim 1 , wherein said step of updating said viewer profile (150) further comprises the step of updating said viewer profile (150) based on a mood of the user.
13. The method of claim 1 , wherein said step of updating said viewer profile (150) further comprises the step of updating said viewer profile (150) based on whether a presentation of said enhanced program content (120) is blocked under certain conditions.
14. The method of claim 1, wherein said viewer profile (150) is associated with a specific individual.
15. The method of claim 1 , wherein said viewer profile (150) is associated with a group of individuals.
16. A system ( 100) for updating a viewer profile (150) indicating preferences of a viewer concerning enhanced program content (120), comprising: a memory for storing computer readable code; and a processor operatively coupled to said memory, said processor configured to: present said enhanced program content (120) to said viewer based on information in said viewer profile (150); and update said viewer profile (150) based on a reaction of said viewer to said enhanced program content (120).
PCT/EP2001/012093 2000-10-30 2001-10-16 Adaptive method and apparatus for automatically customizing enhanced program content to user preferences WO2002037850A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP01993123A EP1332619A2 (en) 2000-10-30 2001-10-16 Adaptive method and apparatus for automatically customizing enhanced program content to user preferences
KR1020027008456A KR20020067925A (en) 2000-10-30 2001-10-16 Adaptive method and apparatus for automatically customizing enhanced program content to user preferences
JP2002540457A JP2004513576A (en) 2000-10-30 2001-10-16 Adaptation method and adaptation apparatus for automatically customizing enhanced program content according to user preference

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US69960400A 2000-10-30 2000-10-30
US09/699,604 2000-10-30

Publications (2)

Publication Number Publication Date
WO2002037850A2 true WO2002037850A2 (en) 2002-05-10
WO2002037850A3 WO2002037850A3 (en) 2002-08-01

Family

ID=24810053

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/012093 WO2002037850A2 (en) 2000-10-30 2001-10-16 Adaptive method and apparatus for automatically customizing enhanced program content to user preferences

Country Status (5)

Country Link
EP (1) EP1332619A2 (en)
JP (1) JP2004513576A (en)
KR (1) KR20020067925A (en)
CN (1) CN1331357C (en)
WO (1) WO2002037850A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003105463A2 (en) * 2002-06-10 2003-12-18 Koninklijke Philips Electronics N.V. Content augmentation based on personal profiles
EP1458194A2 (en) * 2002-09-27 2004-09-15 Microsoft Corporation Dynamic adjustment of EPG level of detail based on user behavior
WO2008016492A1 (en) * 2006-07-31 2008-02-07 Microsoft Corporation Adaptive dissemination of personalized and contextually relevant information
WO2010124171A3 (en) * 2009-04-24 2011-01-06 Telegent Systems, Inc. System and method for information delivery including delivery via video-based keyed or tagged content
US8106131B2 (en) 2002-12-31 2012-01-31 Nektar Therapeutics Hydrolytically stable maleimide-terminated polymers
EP3104622A1 (en) * 2015-06-12 2016-12-14 Samsung Electronics Co., Ltd. Electronic device and method for providing user preference program notification in the electronic device
EP3203756A1 (en) * 2016-02-02 2017-08-09 Thomson Licensing Methods for determining a personalized profile and for filtering excerpts of a multimedia content, corresponding devices, computer program product and computer-readable carrier medium
US11570506B2 (en) * 2017-12-22 2023-01-31 Nativewaves Gmbh Method for synchronizing an additional signal to a primary signal

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060130906A (en) * 2005-06-09 2006-12-20 엘지전자 주식회사 Broadcasting terminal with controlling display hue and method of controlling display hue using same

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410344A (en) * 1993-09-22 1995-04-25 Arrowsmith Technologies, Inc. Apparatus and method of selecting video programs based on viewers' preferences
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5818510A (en) * 1994-10-21 1998-10-06 Intel Corporation Method and apparatus for providing broadcast information with indexing
US5857181A (en) * 1994-11-29 1999-01-05 Hitachi America Ltd. Broadcast interactive multimedia system
WO1999045702A1 (en) * 1998-03-04 1999-09-10 United Video Properties, Inc. Program guide system with targeted advertising

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5155591A (en) * 1989-10-23 1992-10-13 General Instrument Corporation Method and apparatus for providing demographically targeted television commercials
US5446919A (en) * 1990-02-20 1995-08-29 Wilkins; Jeff K. Communication system and method with demographically or psychographically defined audiences
US6172677B1 (en) * 1996-10-07 2001-01-09 Compaq Computer Corporation Integrated content guide for interactive selection of content and services on personal computer systems with multiple sources and multiple media presentation
JP3340342B2 (en) * 1997-02-28 2002-11-05 株式会社東芝 Television channel selection device
JPH1169249A (en) * 1997-06-12 1999-03-09 Toshiba Corp Information display controlling method, information transmitting method, information display device and record medium
US6029045A (en) * 1997-12-09 2000-02-22 Cogent Technology, Inc. System and method for inserting local content into programming content

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5410344A (en) * 1993-09-22 1995-04-25 Arrowsmith Technologies, Inc. Apparatus and method of selecting video programs based on viewers' preferences
US5818510A (en) * 1994-10-21 1998-10-06 Intel Corporation Method and apparatus for providing broadcast information with indexing
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5857181A (en) * 1994-11-29 1999-01-05 Hitachi America Ltd. Broadcast interactive multimedia system
WO1999045702A1 (en) * 1998-03-04 1999-09-10 United Video Properties, Inc. Program guide system with targeted advertising

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1332619A2 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1659882B (en) * 2002-06-10 2010-06-16 皇家飞利浦电子股份有限公司 Method and system for implementing content augmentation of personal profiles
WO2003105463A3 (en) * 2002-06-10 2004-02-26 Koninkl Philips Electronics Nv Content augmentation based on personal profiles
WO2003105463A2 (en) * 2002-06-10 2003-12-18 Koninklijke Philips Electronics N.V. Content augmentation based on personal profiles
KR100965457B1 (en) 2002-06-10 2010-06-24 코닌클리케 필립스 일렉트로닉스 엔.브이. Content augmentation based on personal profiles
US7373336B2 (en) 2002-06-10 2008-05-13 Koninklijke Philips Electronics N.V. Content augmentation based on personal profiles
EP1458194A3 (en) * 2002-09-27 2011-06-22 Microsoft Corporation Dynamic adjustment of EPG level of detail based on user behavior
EP1458194A2 (en) * 2002-09-27 2004-09-15 Microsoft Corporation Dynamic adjustment of EPG level of detail based on user behavior
US8106131B2 (en) 2002-12-31 2012-01-31 Nektar Therapeutics Hydrolytically stable maleimide-terminated polymers
US8227555B2 (en) 2002-12-31 2012-07-24 Nektar Therapeutics Hydrolytically stable maleimide-terminated polymers
WO2008016492A1 (en) * 2006-07-31 2008-02-07 Microsoft Corporation Adaptive dissemination of personalized and contextually relevant information
WO2010124171A3 (en) * 2009-04-24 2011-01-06 Telegent Systems, Inc. System and method for information delivery including delivery via video-based keyed or tagged content
EP3104622A1 (en) * 2015-06-12 2016-12-14 Samsung Electronics Co., Ltd. Electronic device and method for providing user preference program notification in the electronic device
US10069769B2 (en) 2015-06-12 2018-09-04 Samsung Electronics Co., Ltd. Electronic device and method for providing user preference program notification in the electronic device
EP3203756A1 (en) * 2016-02-02 2017-08-09 Thomson Licensing Methods for determining a personalized profile and for filtering excerpts of a multimedia content, corresponding devices, computer program product and computer-readable carrier medium
US11570506B2 (en) * 2017-12-22 2023-01-31 Nativewaves Gmbh Method for synchronizing an additional signal to a primary signal
US20230137315A1 (en) * 2017-12-22 2023-05-04 Nativewaves Gmbh Method for Synchronizing Additional Signal to Primary Signal

Also Published As

Publication number Publication date
KR20020067925A (en) 2002-08-24
WO2002037850A3 (en) 2002-08-01
JP2004513576A (en) 2004-04-30
EP1332619A2 (en) 2003-08-06
CN1406439A (en) 2003-03-26
CN1331357C (en) 2007-08-08

Similar Documents

Publication Publication Date Title
JP3654173B2 (en) PROGRAM SELECTION SUPPORT DEVICE, PROGRAM SELECTION SUPPORT METHOD, AND RECORDING MEDIUM CONTAINING THE PROGRAM
US20040073919A1 (en) Commercial recommender
US7096486B1 (en) TV program selection support system
JP3502114B2 (en) Information service system
US6445306B1 (en) Remote control program selection by genre
KR100965457B1 (en) Content augmentation based on personal profiles
US6651253B2 (en) Interactive system and method for generating metadata for programming events
US7600244B2 (en) Method for extracting program and apparatus for extracting program
US20070011203A1 (en) Information processing device, method of information processing, and program
CN1659881A (en) Anticipatory content augmentation
EP1332619A2 (en) Adaptive method and apparatus for automatically customizing enhanced program content to user preferences
JP3888575B2 (en) Program signal recording method and recorded program control signal transmission method
JP4104569B2 (en) Information service system and broadcast receiving system
JP3901973B2 (en) Remote control, program selection method, and broadcast receiving system
EP1459530A2 (en) Systems and methods relating to determining the desirability of and recording programming events
JP3902145B2 (en) Broadcast receiving method and broadcast receiving system
JP3946017B2 (en) Broadcast receiving method and broadcast receiving system
JP4195671B2 (en) Information service system and broadcast receiving system
JP4025740B2 (en) Information service system and broadcast receiving system
JP2006080680A (en) Digital broadcasting receiver and digital broadcasting reception program
JP2008048001A (en) Information processor and processing method, and program
JP2004227597A (en) Information service system and broadcast receiving system
JP2000092405A (en) Man-machine interface system

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref country code: JP

Ref document number: 2002 540457

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1020027008456

Country of ref document: KR

AK Designated states

Kind code of ref document: A3

Designated state(s): CN JP KR

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

WWE Wipo information: entry into national phase

Ref document number: 2001993123

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020027008456

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 01805840X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWP Wipo information: published in national office

Ref document number: 2001993123

Country of ref document: EP