WO2011035286A1 - Implicit mechanism for determining user response to media - Google Patents

Implicit mechanism for determining user response to media Download PDF

Info

Publication number
WO2011035286A1
WO2011035286A1 PCT/US2010/049610 US2010049610W WO2011035286A1 WO 2011035286 A1 WO2011035286 A1 WO 2011035286A1 US 2010049610 W US2010049610 W US 2010049610W WO 2011035286 A1 WO2011035286 A1 WO 2011035286A1
Authority
WO
WIPO (PCT)
Prior art keywords
media content
user
emotional response
viewing
duration
Prior art date
Application number
PCT/US2010/049610
Other languages
French (fr)
Inventor
Todd Stiers
Carl Ghoreichi
Original Assignee
Mobitv, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mobitv, Inc. filed Critical Mobitv, Inc.
Priority to GB1203176.1A priority Critical patent/GB2485713B/en
Priority to DE112010003731T priority patent/DE112010003731T5/en
Publication of WO2011035286A1 publication Critical patent/WO2011035286A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543Billing, e.g. for subscription services
    • H04N21/2547Third Party Billing, e.g. billing of advertiser
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44245Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6581Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6582Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the present disclosure relates to a mechanism for determining user response to media.
  • User 15 response may involve satisfaction and interest levels.
  • Some existing mechanisms allow a user to enter a rating after viewing the media.
  • content providers make use of ratings information in order to modify the types of media materials presented. Users may enter ratings using the same or outside channels. Users may also submit more detailed reviews of particular media experiences, typically by using outside channels.
  • mechanisms for determining user response to media materials are limited. Consequently, the techniques and mechanisms of the present invention provide improved mechanisms for determining user response to media.
  • User response may include satisfaction, interest, and engagement levels.
  • User response is determined implicitly by measuring channel switching, channel switching frequency, duration of viewing time, content duration, etc. in a linear or non-linear manner. In one example, the viewing duration evaluated with the media content duration to generate an interest factor.
  • a relative interest factor for the media content is generated by referencing interest factors for the user for other pieces of media content for the user.
  • User responses can be analyzed to determine user attention span, make content recommendations, deliver selected versions of content, customize advertising for a user, etc.
  • Figure 1 illustrates a particular example of a network that can use the techniques and mechanisms of the present invention.
  • Figure 2 illustrates a particular example of a content delivery system.
  • Figure 3 illustrates a particular example of evaluating user response.
  • Figure 4 illustrates a particular example of applying user profile database information.
  • Figure 5 illustrates a particular example of calculating user interest levels.
  • Figure 6 illustrates a particular example of system. DESCRIPTION OF PARTICULAR EMBODIMENTS
  • connection does not necessarily mean a direct, unimpeded connection unless otherwise noted.
  • the ability to accurately assess user response to media content such as video streams and clips can be very valuable.
  • An accurate assessment of user interest, engagement, satisfaction, etc., with a particular program allows a content or service provider to customize programming, tailor advertising content, target product promotions, revise content streams, recommend additional content, etc.
  • Providing targeted content on devices such as mobile devices can often be difficult.
  • Some providers monitor the number or percentages of viewers watching a particular channel or program.
  • the numbers and percentages provide some rough estimate regarding the overall popularity of a program. They also show viewing trends and patterns. However, these numbers and percentages provide little information on individual interest or satisfaction levels.
  • viewers may be categorized by demographic and geographic groupings, and further insight can be obtained regarding the types of content suitable for particular audiences.
  • the techniques and mechanisms of the present invention provide implicit mechanisms for determining user response to media materials.
  • User interest, engagement, and satisfaction can be passively determined using implicit mechanisms by monitoring user behavior or other indirect activity.
  • implicit mechanisms measure user interest, satisfaction, and engagement related to a viewing or listening experience with or without supplemental explicit mechanisms.
  • the implicit measures of user view time, channel change frequency, clip duration, subsequent content viewed, average viewing duration, time of day, and clip metadata describing the content, etc. are all available for analysis.
  • a simple linear model compares the user view time to the media clip duration in order to generate a single scalar value that is independent of media length. A user viewing a 90% of a clip can be deemed to be very interested while a user viewing 40% of a clip can be deemed to be moderately interested.
  • the linear approach generates a single number that can be used to compare a user's response to various pieces of content in a consistent manner.
  • the linear approach has limited accuracy. With actual analytic data regarding real viewership patterns, it is possible to improve beyond this simple linear model. Rather than using a single linear model for all content, it is possible to vary the function itself based on content length.
  • a non-linear approach analyzes user view time and content duration and applies different functions based on the duration of the content. For example, a 2 minute long clip that was 50% viewed was scored lower than a 10 minute long clip that was viewed for 50% of its duration. In the mobile environment, a viewer who manages to get through the 50% of the 10 minute clip (5 minutes) may be more engaged than the user getting through 50% (1 minute) of the 2 minute clip.
  • a single non-linear function is applied that varies interest level scores based not just on the percentage of a clip viewed but on the clip duration.
  • a user typically watching 10% of all 30 minute video clips may be determined to be very interested after watching 20% of a particular 30 minute video clip.
  • video clips may be left running even when individual viewers are not paying attention.
  • playback of a video clip is typically a good indicator of interest.
  • user viewing patterns are analyzed to determine user characteristics such as attention span. Users determined to have generally shorter attention spans may receive content tailored to short attention spans. A headline version of the news may be provided along with shortened commercial segments. Users having longer attention spans may be provided with more in depth versions of content. Content having scene changes that occur less frequently and less abruptly may be suggested for further viewing.
  • implicit mechanisms can include not only viewing length, but can also include mobile device location, accelerometer activity, audio-level/background, temperature, altitude, battery level, camera activity, local data storage, etc.
  • the responses can be captured and provided to a system for further evaluation.
  • a device can detect when an individual is moving or running and content appropriate to that activity may be provided to the user.
  • FIG. 1 is a diagrammatic representation showing one example of a network that can use the techniques of the present invention.
  • media content is provided from a number of different sources 185.
  • Media content may be provided from film libraries, cable companies, movie and television studios, commercial and business users, etc. and maintained at a media aggregation server 161.
  • Any mechanism for obtaining media content from a large number of sources in order to provide the media content to mobile devices in live broadcast streams is referred to herein as a media content aggregation server.
  • the media content aggregation server 161 may be clusters of servers located in different data centers.
  • content provided to a media aggregation server 161 is provided in a variety of different encoding formats with numerous video and audio codecs.
  • Media content may also be provided via satellite feed 157.
  • An encoder farm 171 is associated with the satellite feed 187 and can also be associated with media aggregation server 161.
  • the encoder farm 171 can be used to process media content from satellite feed 187 as well as possibly from media aggregation server 161 into potentially numerous encoding formats.
  • file formats include open standards MPEG-1 (ISO/IEC 11172), MPEG-2 (ISO/IEC 13818-2), MPEG-4 (ISO/IEC 14496), as well as proprietary formats QuickTimeTM, ActiveMovieTM, and RealVideo TM.
  • Some example video codecs used to encode the files include MPEG-4, H.263, and H.264.
  • Some example audio codecs include Qualcomm PurevoiceTM (QCELP), The Adaptive Multi-Narrow Band (AMR- NB), Advanced Audio coding (AAC), and AACPlus.
  • the media content may also be encoded to support a variety of data rates.
  • the media content from media aggregation server 161 and encoder farm 171 is provided as live media to a streaming server 175.
  • the streaming server is a Real Time Streaming Protocol (RTSP) server 175.
  • Media streams are broadcast live from an RTSP server 175 to individual client devices 101.
  • a variety of protocols can be used to send data to client devices.
  • Possible client devices 101 include personal digital assistants (PDAs), cellular phones, personal computing devices, personal computers etc.
  • PDAs personal digital assistants
  • the client devices are connected to a cellular network run by a cellular service provider.
  • the client devices are connected to an Internet Protocol (IP) network.
  • IP Internet Protocol
  • the client device can be connected to a wireless local area network (WLAN) or some other wireless network. Live media streams provided over RTSP are carried and/or encapsulated on one of a variety of wireless networks.
  • the client devices are also connected over a wireless network to a media content delivery server 131.
  • the media content delivery server 131 is configured to allow a client device 101 to perform functions associated with accessing live media streams.
  • the media content delivery server allows a user to create an account, perform session identifier assignment, subscribe to various channels, log on, access program guide information, obtain information about media content, etc.
  • the media content delivery server does not deliver the actual media stream, but merely provides mechanisms for performing operations associated with accessing media. In other implementations, it is possible that the media content delivery server also provides media clips, files, and streams.
  • the media content delivery server is associated with a guide generator 151.
  • the guide generator 151 obtains information from disparate sources including content providers 181 and media information sources 183.
  • the guide generator 151 provides program guides to database 155 as well as to media content delivery server 131 to provide to client devices 101.
  • the guide generator 151 obtains viewership information from individual client devices.
  • the guide generation 151 compiles viewership information in real-time in order to generate a most-watched program guide listing most popular programs first and least popular programs last.
  • the client device 101 can request program guide information and the most- watched program guide can be provided to the client device 101 to allow efficient selection of video content.
  • guide generator 151 is connected to a media content delivery server 131 that is also associated with an abstract buy engine 141.
  • the abstract buy engine 141 maintains subscription information associated with various client devices 101. For example, the abstract buy engine 141 tracks purchases of premium packages.
  • the media content delivery server 131 and the client devices 101 communicate using requests and responses.
  • the client device 101 can send a request to media content delivery server 131 for a subscription to premium content.
  • the abstract buy engine 141 tracks the subscription request and the media content delivery server 131 provides a key to the client device 101 to allow it to decode live streamed media content.
  • the client device 101 can send a request to a media content delivery server 131 for a most- watched program guide for its particular program package.
  • the media content delivery server 131 obtains the guide data from the guide generator 151 and associated database 155 and provides appropriate guide information to the client device 101.
  • the various devices such as the guide generator 151, database 155, media aggregation server 161, etc. are shown as separate entities, it should be appreciated that various devices may be incorporated onto a single server. Alternatively, each device may be embodied in multiple servers or clusters of servers. According to various embodiments, the guide generator 151, database 155, media aggregation server 161, encoder farm 171, media content delivery server 131, abstract buy engine 141, and streaming server 175 are included in an entity referred to herein as a media content delivery system.
  • FIG. 2 is a diagrammatic representation showing one example of a media content delivery server 291.
  • the media content delivery server 291 includes a processor 201, memory 203, and a number of interfaces.
  • the interfaces include a guide generator interface 241 allowing the media content delivery server 291 to obtain program guide information.
  • the media content delivery server 291 also can include a program guide cache 231 configured to store program guide information and data associated with various channels.
  • the media content delivery server 291 can also maintain static information such as icons and menu pages.
  • the interfaces also include a carrier interface 211 allowing operation with mobile devices such as cellular phones operating in a particular cellular network.
  • the carrier interface allows a carrier vending system to update subscriptions.
  • Carrier interfaces 213 and 215 allow operation with mobile devices operating in other wireless networks.
  • An abstract buy engine interface 243 provides communication with an abstract buy engine that maintains subscription information.
  • An authentication module 221 verifies the identity of mobile devices.
  • a logging and report generation module 253 tracks mobile device requests and associated responses.
  • a monitor system 251 allows an administrator to view usage patterns and system availability.
  • the media content delivery server 291 handles requests and responses for media content related transactions while a separate streaming server provides the actual media streams.
  • a media content delivery server 291 may also have access to a streaming server or operate as a proxy for a streaming server. But in other instances, a media content delivery server 291 does not need to have any interface to a streaming server. In typical instances, however, the media content delivery server 291 also provides some media streams.
  • the media content delivery server 291 can also be configured to provide media clips and files to a user in a manner that supplements a streaming server.
  • a particular media content delivery server 291 is described, it should be recognized that a variety of alternative configurations are possible. For example, some modules such as a report and logging module 253 and a monitor 251 may not be needed on every server. Alternatively, the modules may be implemented on another device connected to the server. In another example, the server 291 may not include an interface to an abstract buy engine and may in fact include the abstract buy engine itself. A variety of configurations are possible.
  • Figure 3 illustrates one example of a technique for evaluating user response to media materials.
  • a user initiated viewing event is detected.
  • the user initiated viewing event may be a change to a particular channel on a mobile device or the selection and playback of a particular video clip.
  • the media material is identified.
  • the user is identified.
  • a user viewing termination event is detected.
  • a user viewing termination event may be a change to a different channel, selection and playback of a different video clip, playback stoppage, navigation to a different site or window, etc.
  • the duration and/or type of the media material is determined at 309.
  • the duration and/or type of the media material may determine what function is applied to generate a metric for user response to the material.
  • a model uses the following determinations. Media material is scored on a rating from 0 to 5 with 5 being very likeable based on the percentage of a clip viewed. In particular examples, different scoring functions are applied based on the length of the clip at 311. At 313, scaling factors can be applied depending on the type of clip.
  • the relative interest level of the user for a particular program is determined by comparing the current determined interest level with interest levels determined for other programs. In some examples, a user relative interested level may be determined to be very high upon watching 15 minutes of a 30 minute clip if the user typically only watches one or two minutes of most 30 minute clips.
  • the interest level along with the relative interest level for a particular piece of content is maintained in a user profile database at 317.
  • the interest level incorporates a measure of satisfaction and engagement.
  • the relative interest level is measured relative to the user's own interest in other types of content.
  • Figure 4 illustrates one mechanism for applying user profile database information.
  • an attention span profile for the user is generated.
  • the attention span profile is generated when the user is determined to have predominantly brief viewing patterns. In some example, a user viewing less than 25% of 95% of all clips watched for at least 10 seconds is determined to have a short attention span profile.
  • the user is provided with the option to receive short attention span profile content.
  • the user is provided shortened versions of video clips, abbreviated versions of advertising, time accelerated versions of content such as content played at 140% speed, or headline news instead of standard news programs.
  • a user viewing more than 95% of at least 75%) of all clips watched for at least 10 seconds is determined to have a long attention span.
  • the user is provided with the option to receive long attention span profile content at 405 if the user is determined to have a long attention span profile. More documentaries and in depth reporting may be suggested. Fewer but longer commercials may also be provided in place of more frequent but shorter commercials.
  • content types and tags associated with high interest levels and/or high relative interest levels are identified.
  • similarly typed and/or tagged content is suggested for users having high interest levels and high relative interest levels for content of a particular type or content having particular tags.
  • content is tagged to allow efficient identification of content characteristics. Tags may include subject matter, rating, violence level, educational value, etc.
  • users determined to have high implicit interest levels in particular types of content are provided with more similarly tagged content.
  • similarly typed and/or tagged advertising is provided to users having particular interest levels or relative interest levels.
  • relative interest level information can be combined with demographic data, location information, and personal preferences to customize and enhance user viewing experiences.
  • Figure 5 illustrates a particular embodiment for calculating interest levels.
  • the duration of viewing, clip duration, and content tags and/or type are determined. In some examples, implicit factors can be used to filter out content having particular tags and/or types.
  • the viewing duration is less than 10s, the activity is disregarded. An extremely short viewing duration may merely be indicative of an intermediate channel change toward a destination channel.
  • the emotional response or interest factor is set to 1 on a scale of 1 to 5, with 5 representing the highest level of interest.
  • different functions are applied depending on clip duration.
  • an emotional response score of 5 is assigned if 95% of the clip is viewed and an emotional response score of 4 is assigned if 90%> of the clip is viewed at 509.
  • an emotional response score of 5 is assigned if 90%> of the clip is viewed and an emotional response score of 4 is assigned if 80%> of the clip is viewed at 511.
  • an emotional response score of 5 is assigned if 80%) of the clip is viewed and an emotional response score of 4 is assigned if 70%> of the clip is viewed at 513.
  • FIG. 6 illustrates one example of a server that can be used to evaluated user response.
  • a system 600 suitable for implementing particular embodiments of the present invention includes a processor 601, a memory 603, an interface 611, and a bus 615 (e.g., a PCI bus or other interconnection fabric) and operates as a streaming server.
  • the processor 601 is responsible for modifying and transmitting live media data to a client.
  • the interface 611 is typically configured to end and receive data packets or data segments over a network.
  • interfaces supports include Ethernet interfaces, frame relay interfaces, cable interfaces, DSL interfaces, token ring interfaces, and the like.
  • various very high-speed interfaces may be provided such as fast Ethernet interfaces, Gigabit Ethernet interfaces, ATM interfaces, HSSI interfaces, POS interfaces, FDDI interfaces and the like.
  • these interfaces may include ports appropriate for communication with the appropriate media. In some cases, they may also include an independent processor and, in some instances, volatile RAM.
  • the system 600 is a content server that also includes a transceiver, streaming buffers, and a program guide database.
  • the content server may also be associated with subscription management, logging and report generation, and monitoring capabilities.
  • functionality for allowing operation with mobile devices such as cellular phones operating in a particular cellular network and providing subscription management.
  • an authentication module verifies the identity of devices including mobile devices.
  • a logging and report generation module tracks mobile device requests and associated responses.
  • a monitor system allows an administrator to view usage patterns and system availability.
  • the content server 691 handles requests and responses for media content related transactions while a separate streaming server provides the actual media streams.
  • the present invention relates to tangible, machine readable media that include program instructions, state information, etc. for performing various operations described herein.
  • machine-readable media include hard disks, floppy disks, magnetic tape, optical media such as CD-ROM disks and DVDs; magneto-optical media such as optical disks, and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and programmable read-only memory devices (PROMs).
  • program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.

Abstract

Mechanisms are provided for implicitly determining user response to media content. User response may include satisfaction, interest, and engagement levels. User response is determined implicitly by measuring channel switching, channel switching frequency, duration of viewing time, content duration, etc. in a linear or non-linear manner. In one example, the viewing duration evaluated with the media content duration to generate an interest factor. A relative interest factor for the media content is generated by referencing interest factors for the user for other pieces of media content for the user. User responses can be analyzed to determine user attention span, make content recommendations, deliver selected versions of content, customize advertising for a user, etc.

Description

IMPLICIT MECHANISM FOR DETERMINING
USER RESPONSE TO MEDIA
5 CROSS REFERENCE TO RELATED APPLICATIONS
This application claims priority to U.S. Patent Application No. 12/563,935, entitled:
"IMPLICIT MECHANISM FOR DETERMINING USER RESPONSE TO MEDIA" filed on 21 September 2009, which is hereby incorporated by reference in its entirety and for all purposes.
l o DESCRIPTION OF RELATED ART
[0001] The present disclosure relates to a mechanism for determining user response to media.
DESCRIPTION OF RELATED ART
[0002] It is often desirable to determine user response to media materials. User 15 response may involve satisfaction and interest levels. Some existing mechanisms allow a user to enter a rating after viewing the media. In some examples, content providers make use of ratings information in order to modify the types of media materials presented. Users may enter ratings using the same or outside channels. Users may also submit more detailed reviews of particular media experiences, typically by using outside channels. 0 [0003] However, mechanisms for determining user response to media materials are limited. Consequently, the techniques and mechanisms of the present invention provide improved mechanisms for determining user response to media.
OVERVIEW
[0004] Mechanisms are provided for implicitly determining user response to media 5 content. User response may include satisfaction, interest, and engagement levels. User response is determined implicitly by measuring channel switching, channel switching frequency, duration of viewing time, content duration, etc. in a linear or non-linear manner. In one example, the viewing duration evaluated with the media content duration to generate an interest factor. A relative interest factor for the media content is generated by referencing interest factors for the user for other pieces of media content for the user. User responses can be analyzed to determine user attention span, make content recommendations, deliver selected versions of content, customize advertising for a user, etc.
[0005] These and other features of the present invention will be presented in more detail in the following specification of the invention and the accompanying figures, which illustrate by way of example the principles of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The disclosure may best be understood by reference to the following description taken in conjunction with the accompanying drawings, which illustrate particular embodiments of the present invention. [0007] Figure 1 illustrates a particular example of a network that can use the techniques and mechanisms of the present invention.
[0008] Figure 2 illustrates a particular example of a content delivery system.
[0009] Figure 3 illustrates a particular example of evaluating user response.
[0010] Figure 4 illustrates a particular example of applying user profile database information.
[0011] Figure 5 illustrates a particular example of calculating user interest levels. [0012] Figure 6 illustrates a particular example of system. DESCRIPTION OF PARTICULAR EMBODIMENTS
[0013] Reference will now be made in detail to some specific examples of the invention including the best modes contemplated by the inventors for carrying out the invention. Examples of these specific embodiments are illustrated in the accompanying drawings. While the invention is described in conjunction with these specific embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. On the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. [0014] For example, the techniques of the present invention will be described in the context of particular devices such as mobile devices. However, it should be noted that the techniques and mechanisms of the present invention can be used with a variety of devices including general computing devices. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The present invention may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order not to unnecessarily obscure the present invention.
[0015] Various techniques and mechanisms of the present invention will sometimes be described in singular form for clarity. However, it should be noted that some embodiments include multiple iterations of a technique or multiple instantiations of a mechanism unless noted otherwise. For example, a processor is used in a variety of contexts. However, it will be appreciated that multiple processors can also be used while remaining within the scope of the present invention unless otherwise noted. Furthermore, the techniques and mechanisms of the present invention will sometimes describe two entities as being connected. It should be noted that a connection between two entities does not necessarily mean a direct, unimpeded connection, as a variety of other entities may reside between the two entities. For example, a processor may be connected to memory, but it will be appreciated that a variety of bridges and controllers may reside between the processor and memory. Consequently, a connection does not necessarily mean a direct, unimpeded connection unless otherwise noted. [0016] The ability to accurately assess user response to media content such as video streams and clips can be very valuable. An accurate assessment of user interest, engagement, satisfaction, etc., with a particular program allows a content or service provider to customize programming, tailor advertising content, target product promotions, revise content streams, recommend additional content, etc. Providing targeted content on devices such as mobile devices can often be difficult.
[0017] Existing systems rely on explicit determination of interest and satisfaction levels. Some systems allow a user to manually enter feedback upon being exposed to media content. The user can rate the media content on a particular scale, provide written reviews, discuss the media content, etc. Users can also complete surveys and attend focus groups to provide insight on satisfaction and interest levels. Some of these response mechanisms occur immediately after viewing while other mechanisms may not occur until well after viewing of media materials.
[0018] Some providers monitor the number or percentages of viewers watching a particular channel or program. The numbers and percentages provide some rough estimate regarding the overall popularity of a program. They also show viewing trends and patterns. However, these numbers and percentages provide little information on individual interest or satisfaction levels. In some instances, viewers may be categorized by demographic and geographic groupings, and further insight can be obtained regarding the types of content suitable for particular audiences.
[0019] Other explicit mechanisms involve asking, polling, and viewer ranking. However, explicit mechanisms have a variety of limitations. Explicit mechanisms require viewer cooperation and reporting accuracy. Some viewers may not want to admit interest in a particular program or may be more interested than they realize. Some viewers may not want to bother or may not have time to complete surveys and questionnaires. In some cases, the users least likely to complete a survey may be the ones most interested in a particular program. A variety of biases can render explicit mechanisms inaccurate at assessing individual user satisfaction, interest, and engagement levels.
[0020] Consequently, the techniques and mechanisms of the present invention provide implicit mechanisms for determining user response to media materials. User interest, engagement, and satisfaction can be passively determined using implicit mechanisms by monitoring user behavior or other indirect activity. According to various embodiments, implicit mechanisms measure user interest, satisfaction, and engagement related to a viewing or listening experience with or without supplemental explicit mechanisms.
[0021] According to various embodiments, the implicit measures of user view time, channel change frequency, clip duration, subsequent content viewed, average viewing duration, time of day, and clip metadata describing the content, etc., are all available for analysis. In particular embodiments, a simple linear model compares the user view time to the media clip duration in order to generate a single scalar value that is independent of media length. A user viewing a 90% of a clip can be deemed to be very interested while a user viewing 40% of a clip can be deemed to be moderately interested. In particular embodiments, satisfaction = function of (time viewed, clip duration) = time viewed/clip duration = X% [0022] The linear approach generates a single number that can be used to compare a user's response to various pieces of content in a consistent manner. However, the linear approach has limited accuracy. With actual analytic data regarding real viewership patterns, it is possible to improve beyond this simple linear model. Rather than using a single linear model for all content, it is possible to vary the function itself based on content length.
[0023] According to various embodiments, a non-linear approach analyzes user view time and content duration and applies different functions based on the duration of the content. For example, a 2 minute long clip that was 50% viewed was scored lower than a 10 minute long clip that was viewed for 50% of its duration. In the mobile environment, a viewer who manages to get through the 50% of the 10 minute clip (5 minutes) may be more engaged than the user getting through 50% (1 minute) of the 2 minute clip. In some examples, a single non-linear function is applied that varies interest level scores based not just on the percentage of a clip viewed but on the clip duration.
[0024] Extension beyond a non-linear model is also possible. Other data such as content type, content quality, device class, time, location, etc., can be used to refine the function space of interest, engagement, and satisfaction. In other examples, different functions are applied depending on the type of content being viewed. Content specification dimension factors can also be applied to further refine models of interest, engagement, and satisfaction. [0025] According to various embodiments, individually tailored measures of user response are enhanced by determining relative interest levels of a user for various pieces or types of content. Relative interest levels across users can also be determined. In some examples, a user typically watching 50%-75% of all video clips may be determined to be very interested in a 85% viewed video clip. By contrast, a user typically watching 10% of all 30 minute video clips may be determined to be very interested after watching 20% of a particular 30 minute video clip. In a large display environment, video clips may be left running even when individual viewers are not paying attention. However, for mobile devices such as cell phones, playback of a video clip is typically a good indicator of interest. [0026] In particular embodiments, user viewing patterns are analyzed to determine user characteristics such as attention span. Users determined to have generally shorter attention spans may receive content tailored to short attention spans. A headline version of the news may be provided along with shortened commercial segments. Users having longer attention spans may be provided with more in depth versions of content. Content having scene changes that occur less frequently and less abruptly may be suggested for further viewing.
[0027] According to various embodiments, implicit mechanisms can include not only viewing length, but can also include mobile device location, accelerometer activity, audio-level/background, temperature, altitude, battery level, camera activity, local data storage, etc. The responses can be captured and provided to a system for further evaluation. In some examples, a device can detect when an individual is moving or running and content appropriate to that activity may be provided to the user.
[0028] Figure 1 is a diagrammatic representation showing one example of a network that can use the techniques of the present invention. According to various embodiments, media content is provided from a number of different sources 185. Media content may be provided from film libraries, cable companies, movie and television studios, commercial and business users, etc. and maintained at a media aggregation server 161. Any mechanism for obtaining media content from a large number of sources in order to provide the media content to mobile devices in live broadcast streams is referred to herein as a media content aggregation server. The media content aggregation server 161 may be clusters of servers located in different data centers. According to various embodiments, content provided to a media aggregation server 161 is provided in a variety of different encoding formats with numerous video and audio codecs. Media content may also be provided via satellite feed 157. [0029] An encoder farm 171 is associated with the satellite feed 187 and can also be associated with media aggregation server 161. The encoder farm 171 can be used to process media content from satellite feed 187 as well as possibly from media aggregation server 161 into potentially numerous encoding formats. According to various embodiments, file formats include open standards MPEG-1 (ISO/IEC 11172), MPEG-2 (ISO/IEC 13818-2), MPEG-4 (ISO/IEC 14496), as well as proprietary formats QuickTimeTM, ActiveMovieTM, and RealVideo TM. Some example video codecs used to encode the files include MPEG-4, H.263, and H.264. Some example audio codecs include Qualcomm PurevoiceTM (QCELP), The Adaptive Multi-Narrow Band (AMR- NB), Advanced Audio coding (AAC), and AACPlus. The media content may also be encoded to support a variety of data rates. The media content from media aggregation server 161 and encoder farm 171 is provided as live media to a streaming server 175. In one example, the streaming server is a Real Time Streaming Protocol (RTSP) server 175. Media streams are broadcast live from an RTSP server 175 to individual client devices 101. A variety of protocols can be used to send data to client devices. [0030] Possible client devices 101 include personal digital assistants (PDAs), cellular phones, personal computing devices, personal computers etc. According to various embodiments, the client devices are connected to a cellular network run by a cellular service provider. IN other examples, the client devices are connected to an Internet Protocol (IP) network. Alternatively, the client device can be connected to a wireless local area network (WLAN) or some other wireless network. Live media streams provided over RTSP are carried and/or encapsulated on one of a variety of wireless networks. [0031] The client devices are also connected over a wireless network to a media content delivery server 131. The media content delivery server 131 is configured to allow a client device 101 to perform functions associated with accessing live media streams. For example, the media content delivery server allows a user to create an account, perform session identifier assignment, subscribe to various channels, log on, access program guide information, obtain information about media content, etc. According to various embodiments, the media content delivery server does not deliver the actual media stream, but merely provides mechanisms for performing operations associated with accessing media. In other implementations, it is possible that the media content delivery server also provides media clips, files, and streams. The media content delivery server is associated with a guide generator 151. The guide generator 151 obtains information from disparate sources including content providers 181 and media information sources 183. The guide generator 151 provides program guides to database 155 as well as to media content delivery server 131 to provide to client devices 101. [0032] According to various embodiments, the guide generator 151 obtains viewership information from individual client devices. In particular embodiments, the guide generation 151 compiles viewership information in real-time in order to generate a most-watched program guide listing most popular programs first and least popular programs last. The client device 101 can request program guide information and the most- watched program guide can be provided to the client device 101 to allow efficient selection of video content. According to various embodiments, guide generator 151 is connected to a media content delivery server 131 that is also associated with an abstract buy engine 141. The abstract buy engine 141 maintains subscription information associated with various client devices 101. For example, the abstract buy engine 141 tracks purchases of premium packages.
[0033] The media content delivery server 131 and the client devices 101 communicate using requests and responses. For example, the client device 101 can send a request to media content delivery server 131 for a subscription to premium content. According to various embodiments, the abstract buy engine 141 tracks the subscription request and the media content delivery server 131 provides a key to the client device 101 to allow it to decode live streamed media content. Similarly, the client device 101 can send a request to a media content delivery server 131 for a most- watched program guide for its particular program package. The media content delivery server 131 obtains the guide data from the guide generator 151 and associated database 155 and provides appropriate guide information to the client device 101.
[0034] Although the various devices such as the guide generator 151, database 155, media aggregation server 161, etc. are shown as separate entities, it should be appreciated that various devices may be incorporated onto a single server. Alternatively, each device may be embodied in multiple servers or clusters of servers. According to various embodiments, the guide generator 151, database 155, media aggregation server 161, encoder farm 171, media content delivery server 131, abstract buy engine 141, and streaming server 175 are included in an entity referred to herein as a media content delivery system.
[0035] Figure 2 is a diagrammatic representation showing one example of a media content delivery server 291. According to various embodiments, the media content delivery server 291 includes a processor 201, memory 203, and a number of interfaces. In some examples, the interfaces include a guide generator interface 241 allowing the media content delivery server 291 to obtain program guide information. The media content delivery server 291 also can include a program guide cache 231 configured to store program guide information and data associated with various channels. The media content delivery server 291 can also maintain static information such as icons and menu pages. The interfaces also include a carrier interface 211 allowing operation with mobile devices such as cellular phones operating in a particular cellular network. The carrier interface allows a carrier vending system to update subscriptions. Carrier interfaces 213 and 215 allow operation with mobile devices operating in other wireless networks. An abstract buy engine interface 243 provides communication with an abstract buy engine that maintains subscription information.
[0036] An authentication module 221 verifies the identity of mobile devices. A logging and report generation module 253 tracks mobile device requests and associated responses. A monitor system 251 allows an administrator to view usage patterns and system availability. According to various embodiments, the media content delivery server 291 handles requests and responses for media content related transactions while a separate streaming server provides the actual media streams. In some instances, a media content delivery server 291 may also have access to a streaming server or operate as a proxy for a streaming server. But in other instances, a media content delivery server 291 does not need to have any interface to a streaming server. In typical instances, however, the media content delivery server 291 also provides some media streams. The media content delivery server 291 can also be configured to provide media clips and files to a user in a manner that supplements a streaming server.
[0037] Although a particular media content delivery server 291 is described, it should be recognized that a variety of alternative configurations are possible. For example, some modules such as a report and logging module 253 and a monitor 251 may not be needed on every server. Alternatively, the modules may be implemented on another device connected to the server. In another example, the server 291 may not include an interface to an abstract buy engine and may in fact include the abstract buy engine itself. A variety of configurations are possible.
[0038] Figure 3 illustrates one example of a technique for evaluating user response to media materials. At 301, a user initiated viewing event is detected. The user initiated viewing event may be a change to a particular channel on a mobile device or the selection and playback of a particular video clip. At 303, the media material is identified. At 305, the user is identified. At 307, a user viewing termination event is detected. According to various embodiments, a user viewing termination event may be a change to a different channel, selection and playback of a different video clip, playback stoppage, navigation to a different site or window, etc. According to various embodiments, the duration and/or type of the media material is determined at 309. The duration and/or type of the media material may determine what function is applied to generate a metric for user response to the material. [0039] In one example, a model uses the following determinations. Media material is scored on a rating from 0 to 5 with 5 being very likeable based on the percentage of a clip viewed. In particular examples, different scoring functions are applied based on the length of the clip at 311. At 313, scaling factors can be applied depending on the type of clip. At 315, the relative interest level of the user for a particular program is determined by comparing the current determined interest level with interest levels determined for other programs. In some examples, a user relative interested level may be determined to be very high upon watching 15 minutes of a 30 minute clip if the user typically only watches one or two minutes of most 30 minute clips. In particular embodiments, the interest level along with the relative interest level for a particular piece of content is maintained in a user profile database at 317. According to various embodiments, the interest level incorporates a measure of satisfaction and engagement. The relative interest level is measured relative to the user's own interest in other types of content.
[0040] Figure 4 illustrates one mechanism for applying user profile database information. At 401 , an attention span profile for the user is generated. According to various embodiments, the attention span profile is generated when the user is determined to have predominantly brief viewing patterns. In some example, a user viewing less than 25% of 95% of all clips watched for at least 10 seconds is determined to have a short attention span profile. At 403, the user is provided with the option to receive short attention span profile content. According to various embodiments, the user is provided shortened versions of video clips, abbreviated versions of advertising, time accelerated versions of content such as content played at 140% speed, or headline news instead of standard news programs. In particular examples, a user viewing more than 95% of at least 75%) of all clips watched for at least 10 seconds is determined to have a long attention span. According to various embodiments, the user is provided with the option to receive long attention span profile content at 405 if the user is determined to have a long attention span profile. More documentaries and in depth reporting may be suggested. Fewer but longer commercials may also be provided in place of more frequent but shorter commercials.
[0041] At 407, content types and tags associated with high interest levels and/or high relative interest levels are identified. At 409, similarly typed and/or tagged content is suggested for users having high interest levels and high relative interest levels for content of a particular type or content having particular tags. In particular embodiments, content is tagged to allow efficient identification of content characteristics. Tags may include subject matter, rating, violence level, educational value, etc. According to various embodiments, users determined to have high implicit interest levels in particular types of content are provided with more similarly tagged content. At 41 1 , similarly typed and/or tagged advertising is provided to users having particular interest levels or relative interest levels. In some embodiments, relative interest level information can be combined with demographic data, location information, and personal preferences to customize and enhance user viewing experiences.
[0042] Figure 5 illustrates a particular embodiment for calculating interest levels. At 501, the duration of viewing, clip duration, and content tags and/or type are determined. In some examples, implicit factors can be used to filter out content having particular tags and/or types. At 503, if the viewing duration is less than 10s, the activity is disregarded. An extremely short viewing duration may merely be indicative of an intermediate channel change toward a destination channel. At 505, if the viewing duration is between 10s and 20s, the emotional response or interest factor is set to 1 on a scale of 1 to 5, with 5 representing the highest level of interest. At 507, different functions are applied depending on clip duration. According to various embodiments, for clips between 20s and 120s, an emotional response score of 5 is assigned if 95% of the clip is viewed and an emotional response score of 4 is assigned if 90%> of the clip is viewed at 509. For clips between 120s and 300s, an emotional response score of 5 is assigned if 90%> of the clip is viewed and an emotional response score of 4 is assigned if 80%> of the clip is viewed at 511. For clips between 300s and 480s, an emotional response score of 5 is assigned if 80%) of the clip is viewed and an emotional response score of 4 is assigned if 70%> of the clip is viewed at 513. For clips longer than 480s, an emotional response score of 5 is assigned if 70%> of the clip is viewed and an emotional response score of 4 is assigned if merely half of the clip is viewed at 515. if (viewduration < 10s) {end;} if (10s <= viewduration < 20s) {emotional response =1;} if (20s <= clipduration < 120s) {
if (viewduration/clipduration > 95%>) {emotional response = 5};
else if (viewduration/clipduration > 90%>) {emotional response = 4};
else {emotional response = 3};
}
if (120s <= clipduration < 300s) {
if (viewduration/clipduration > 90%>) {emotional response = 5};
else if (viewduration/clipduration > 80%>) {emotional response = 4};
else {emotional response = 3};
} if (300s <= clipduration < 480s) {
if (viewduration/clipduration > 80%) {emotional response = 5};
else if (viewduration/clipduration > 70%) {emotional response = 4};
else {emotional response = 3};
}
if (480s <= clipduration) {
if (viewduration/clipduration > 70%>) {emotional response = 5};
else if (viewduration/clipduration > 50%>) {emotional response = 4};
else {emotional response = 3};
}
[0043] It should be noted that a variety of linear and non- linear functions can be applied that account for duration as well as the percentage of a clip watched. In some examples, instead of applying different functions, a single curve function can be applied. It should be noted that the exact values, percentages, and scaling systems can be varied widely.
[0044] Extension beyond is possible by applying still more variation to the model. For example, other data can be applied that can further refine the function space of emotional response. Other data may include content type, content quality, device class/quality/size, time of day, location, weather, etc.
[0045] In some examples, different factors are applied to scoring depending on the content type at 517. For example, if the content is NEWS, the interest factor is multiplied by 1.1%. If the content is MUSIC, the interest factor is multiplied by .75%. [0046] Figure 6 illustrates one example of a server that can be used to evaluated user response. According to particular embodiments, a system 600 suitable for implementing particular embodiments of the present invention includes a processor 601, a memory 603, an interface 611, and a bus 615 (e.g., a PCI bus or other interconnection fabric) and operates as a streaming server. When acting under the control of appropriate software or firmware, the processor 601 is responsible for modifying and transmitting live media data to a client. Various specially configured devices can also be used in place of a processor 601 or in addition to processor 601. The interface 611 is typically configured to end and receive data packets or data segments over a network. [0047] Particular examples of interfaces supports include Ethernet interfaces, frame relay interfaces, cable interfaces, DSL interfaces, token ring interfaces, and the like. In addition, various very high-speed interfaces may be provided such as fast Ethernet interfaces, Gigabit Ethernet interfaces, ATM interfaces, HSSI interfaces, POS interfaces, FDDI interfaces and the like. Generally, these interfaces may include ports appropriate for communication with the appropriate media. In some cases, they may also include an independent processor and, in some instances, volatile RAM. The independent processors may control such communications intensive tasks as packet switching, media control and management. [0048] According to various embodiments, the system 600 is a content server that also includes a transceiver, streaming buffers, and a program guide database. The content server may also be associated with subscription management, logging and report generation, and monitoring capabilities. In particular embodiments, functionality for allowing operation with mobile devices such as cellular phones operating in a particular cellular network and providing subscription management. According to various embodiments, an authentication module verifies the identity of devices including mobile devices. A logging and report generation module tracks mobile device requests and associated responses. A monitor system allows an administrator to view usage patterns and system availability. According to various embodiments, the content server 691 handles requests and responses for media content related transactions while a separate streaming server provides the actual media streams.
[0049] Because such information and program instructions may be employed to implement the systems/methods described herein, the present invention relates to tangible, machine readable media that include program instructions, state information, etc. for performing various operations described herein. Examples of machine-readable media include hard disks, floppy disks, magnetic tape, optical media such as CD-ROM disks and DVDs; magneto-optical media such as optical disks, and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and programmable read-only memory devices (PROMs). Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. [0050] While the invention has been particularly shown and described with reference to specific embodiments thereof, it will be understood by those skilled in the art that changes in the form and details of the disclosed embodiments may be made without departing from the spirit or scope of the invention. It is therefore intended that the invention be interpreted to include all variations and equivalents that fall within the true spirit and scope of the present invention.

Claims

CLAIMS What is claimed is:
1. A method, comprising:
detecting a user initiated viewing event associated with a user viewing media content;
detecting a user viewing termination event associated with the media content; determining a viewing duration for the media content and a total duration for the media content;
calculating an emotional response factor using the viewing duration and the total duration, wherein the emotional response factor is calculated using different functions depending on total duration;
maintaining the emotional response factor with an identifier associated with the media content.
2. The method of claim 1, wherein the media content is associated with a plurality of tags.
3. The method of claim 2, wherein the plurality of tags include type and rating.
4. The method of claim 1, wherein the emotional response factor for the media content is compared to a plurality of emotional response factors for a plurality of pieces of media content for the user in order to determine a relative emotional response factor.
5. The method of claim 1, wherein the emotional response factor is used to generate media content recommendations.
6. The method of claim 5, wherein content similar to media content having high emotional response ratings is presented in media content recommendations.
7. The method of claim 1, wherein the emotional response factor is used to select user specific advertising.
8. The method of claim 7, wherein advertising associated with media content having high emotional response ratings is presented to the user.
9. The method of claim 1, wherein an attention span indicator is generated for the user.
10. The method of claim 9, wherein a short attention span determination is used to provide shortened clips and commercials to the user.
11. The method of claim 9, wherein a long attention span determination is used to provide more in depth clips and commercials to the user.
12. A system, comprising:
an interface configured to detect a user initiated viewing event associated with a user viewing media content as well as a user viewing termination event associated with the media content;
a processor configured to determine a viewing duration for the media content and a total duration for the media content and calculate an emotional response factor using the viewing duration and the total duration, wherein the emotional response factor is calculated using different functions depending on total duration;
data storage configured to maintain the emotional response factor with an identifier associated with the media content.
13. The system of claim 12, wherein the media content is associated with a plurality of tags.
14. The system of claim 13, wherein the plurality of tags include type and rating.
15. The system of claim 12, wherein the emotional response factor for the media content is compared to a plurality of emotional response factors for a plurality of pieces of media content for the user in order to determine a relative emotional response factor.
16. The system of claim 12, wherein the emotional response factor is used to generate media content recommendations.
17. The system of claim 16, wherein content similar to media content having high emotional response ratings is presented in media content recommendations.
18. The system of claim 12, wherein the emotional response factor is used to select user specific advertising.
19. The system of claim 18, wherein advertising associated with media content having high emotional response ratings is presented to the user.
20. An apparatus, comprising:
means for detecting a user initiated viewing event associated with a user viewing media content;
means for detecting a user viewing termination event associated with the media content; means for determining a viewing duration for the media content and a total duration for the media content;
means for calculating an emotional response factor using the viewing duration and the total duration, wherein the emotional response factor is calculated using different functions depending on total duration;
means for maintaining the emotional response factor with an identifier associated with the media content.
PCT/US2010/049610 2009-09-21 2010-09-21 Implicit mechanism for determining user response to media WO2011035286A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB1203176.1A GB2485713B (en) 2009-09-21 2010-09-21 Implicit mechanism for determining user response to media
DE112010003731T DE112010003731T5 (en) 2009-09-21 2010-09-21 Implicit mechanism for determining user reactions to media

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/563,935 US8875167B2 (en) 2009-09-21 2009-09-21 Implicit mechanism for determining user response to media
US12/563,935 2009-09-21

Publications (1)

Publication Number Publication Date
WO2011035286A1 true WO2011035286A1 (en) 2011-03-24

Family

ID=43757752

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/049610 WO2011035286A1 (en) 2009-09-21 2010-09-21 Implicit mechanism for determining user response to media

Country Status (4)

Country Link
US (1) US8875167B2 (en)
DE (1) DE112010003731T5 (en)
GB (1) GB2485713B (en)
WO (1) WO2011035286A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10542315B2 (en) 2015-11-11 2020-01-21 At&T Intellectual Property I, L.P. Method and apparatus for content adaptation based on audience monitoring
US11128675B2 (en) 2017-03-20 2021-09-21 At&T Intellectual Property I, L.P. Automatic ad-hoc multimedia conference generator

Families Citing this family (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101564392B1 (en) * 2009-01-16 2015-11-02 삼성전자주식회사 Method for providing appreciation automatically according to user's interest and video apparatus using the same
GB0911651D0 (en) * 2009-07-06 2009-08-12 Omnifone Ltd Nearest neigbour & digital content recommendation techniques
AU2010257332A1 (en) * 2009-09-11 2011-03-31 Roil Results Pty Limited A method and system for determining effectiveness of marketing
US20110161813A1 (en) * 2009-12-31 2011-06-30 Mobitv, Inc. Data measurement and feedback mechanism using an application framework
US9262526B2 (en) * 2010-01-28 2016-02-16 Karl Muth System and method for compiling search results using information regarding length of time users spend interacting with individual search results
JP4869456B1 (en) * 2010-06-01 2012-02-08 パナソニック株式会社 Video content playback apparatus and content information display method
US10089592B2 (en) 2010-12-29 2018-10-02 Comcast Cable Communications, Llc Measuring video asset viewing
US10945011B2 (en) 2010-12-29 2021-03-09 Comcast Cable Communications, Llc Measuring video viewing
US8620113B2 (en) 2011-04-25 2013-12-31 Microsoft Corporation Laser diode modes
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8584167B2 (en) 2011-05-31 2013-11-12 Echostar Technologies L.L.C. Electronic programming guides combining stored content information and content provider schedule information
US8627349B2 (en) 2011-08-23 2014-01-07 Echostar Technologies L.L.C. User interface
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
EP2613495A1 (en) 2012-01-09 2013-07-10 OÜ Eliko Tehnoloogia Arenduskeskus Method for determining digital content preferences of the user
US8954372B2 (en) * 2012-01-20 2015-02-10 Fuji Xerox Co., Ltd. System and methods for using presence data to estimate affect and communication preference for use in a presence system
US10645433B1 (en) 2013-08-29 2020-05-05 Comcast Cable Communications, Llc Measuring video-content viewing
US10440428B2 (en) 2013-01-13 2019-10-08 Comcast Cable Communications, Llc Measuring video-program-viewing activity
US11627356B2 (en) 2012-01-28 2023-04-11 Comcast Cable Communications, Llc Data translation for video-viewing activity
US20130205311A1 (en) * 2012-02-07 2013-08-08 Arun Ramaswamy Methods and apparatus to control a state of data collection devices
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program
US20140026156A1 (en) 2012-07-18 2014-01-23 David Deephanphongs Determining User Interest Through Detected Physical Indicia
US10034049B1 (en) 2012-07-18 2018-07-24 Google Llc Audience attendance monitoring through facial recognition
US9172999B2 (en) * 2012-08-08 2015-10-27 Verizon Patent And Licensing Inc. Behavioral keyword identification based on thematic channel viewing
KR20140046902A (en) * 2012-10-11 2014-04-21 엘지전자 주식회사 Image display apparatus and method for operating the same
US8832721B2 (en) * 2012-11-12 2014-09-09 Mobitv, Inc. Video efficacy measurement
US8832752B2 (en) * 2012-12-03 2014-09-09 International Business Machines Corporation Automatic transmission content selection
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
US20140289241A1 (en) * 2013-03-15 2014-09-25 Spotify Ab Systems and methods for generating a media value metric
US9602875B2 (en) 2013-03-15 2017-03-21 Echostar Uk Holdings Limited Broadcast content resume reminder
ES2518015B1 (en) * 2013-04-01 2015-08-12 Crambo, S.A. METHOD, MOBILE DEVICE, SYSTEM AND COMPUTER PRODUCT FOR THE DETECTION AND MEASUREMENT OF A USER'S CARE LEVEL
US8973038B2 (en) 2013-05-03 2015-03-03 Echostar Technologies L.L.C. Missed content access guide
US9930404B2 (en) 2013-06-17 2018-03-27 Echostar Technologies L.L.C. Event-based media playback
US9848249B2 (en) 2013-07-15 2017-12-19 Echostar Technologies L.L.C. Location based targeted advertising
US9258583B2 (en) * 2013-07-18 2016-02-09 Comcast Cable Communications, Llc Content rating
US9066156B2 (en) * 2013-08-20 2015-06-23 Echostar Technologies L.L.C. Television receiver enhancement features
US10297287B2 (en) 2013-10-21 2019-05-21 Thuuz, Inc. Dynamic media recording
US9860477B2 (en) 2013-12-23 2018-01-02 Echostar Technologies L.L.C. Customized video mosaic
US9420333B2 (en) 2013-12-23 2016-08-16 Echostar Technologies L.L.C. Mosaic focus control
KR20150136316A (en) * 2014-05-27 2015-12-07 삼성전자주식회사 Electrical apparatus, method and system for providing information
US10708651B2 (en) 2014-06-04 2020-07-07 Comcast Cable Communications, Llc Dynamic content ratings
WO2016018955A1 (en) 2014-07-28 2016-02-04 Iris.Tv, Inc. Ensemble-based multimedia asset recommendations system
US9936248B2 (en) 2014-08-27 2018-04-03 Echostar Technologies L.L.C. Media content output control
US9681176B2 (en) 2014-08-27 2017-06-13 Echostar Technologies L.L.C. Provisioning preferred media content
US9628861B2 (en) 2014-08-27 2017-04-18 Echostar Uk Holdings Limited Source-linked electronic programming guide
US9681196B2 (en) 2014-08-27 2017-06-13 Echostar Technologies L.L.C. Television receiver-based network traffic control
US9621959B2 (en) 2014-08-27 2017-04-11 Echostar Uk Holdings Limited In-residence track and alert
US9565474B2 (en) 2014-09-23 2017-02-07 Echostar Technologies L.L.C. Media content crowdsource
US10433030B2 (en) 2014-10-09 2019-10-01 Thuuz, Inc. Generating a customized highlight sequence depicting multiple events
US11863848B1 (en) 2014-10-09 2024-01-02 Stats Llc User interface for interaction with customized highlight shows
US10536758B2 (en) 2014-10-09 2020-01-14 Thuuz, Inc. Customized generation of highlight show with narrative component
US10419830B2 (en) 2014-10-09 2019-09-17 Thuuz, Inc. Generating a customized highlight sequence depicting an event
US10432296B2 (en) 2014-12-31 2019-10-01 DISH Technologies L.L.C. Inter-residence computing resource sharing
US9800938B2 (en) 2015-01-07 2017-10-24 Echostar Technologies L.L.C. Distraction bookmarks for live and recorded video
WO2016118119A1 (en) * 2015-01-20 2016-07-28 Hewlett-Packard Development Company, L. P. Custom educational documents
DE102015107786A1 (en) 2015-05-18 2016-11-24 Iunera GmbH & Co. KG System, methods and arrangements for the implicit validation and retrieval of documents
KR102102453B1 (en) * 2016-01-08 2020-04-20 주식회사 아이플래테아 Viewer rating calculation server, viewer rating calculation method, and viewer rating calculation remote device
US10455287B2 (en) 2016-02-02 2019-10-22 International Business Machines Corporation Content delivery system, method, and recording medium
US9918128B2 (en) * 2016-04-08 2018-03-13 Orange Content categorization using facial expression recognition, with improved detection of moments of interest
EP3493551A4 (en) 2016-06-01 2020-03-25 Maxell, Ltd. Information processing device
US9936239B2 (en) * 2016-06-28 2018-04-03 Intel Corporation Multiple stream tuning
US10015539B2 (en) 2016-07-25 2018-07-03 DISH Technologies L.L.C. Provider-defined live multichannel viewing events
US10110950B2 (en) 2016-09-14 2018-10-23 International Business Machines Corporation Attentiveness-based video presentation management
US10257312B2 (en) 2016-10-27 2019-04-09 Entit Software Llc Performance monitor based on user engagement
US10021448B2 (en) 2016-11-22 2018-07-10 DISH Technologies L.L.C. Sports bar mode automatic viewing determination
US10051327B1 (en) * 2017-05-16 2018-08-14 AdsWizz Inc. Determination of user perspicaciousness during a content stream
US20190114037A1 (en) 2017-10-17 2019-04-18 Blend Systems, Inc. Systems and methods for distributing customized avatars responsive to events
US10652614B2 (en) * 2018-03-06 2020-05-12 Shoppar, Ltd. System and method for content delivery optimization based on a combined captured facial landmarks and external datasets
US11594028B2 (en) 2018-05-18 2023-02-28 Stats Llc Video processing for enabling sports highlights generation
US11025985B2 (en) 2018-06-05 2021-06-01 Stats Llc Audio processing for detecting occurrences of crowd noise in sporting event television programming
US11264048B1 (en) 2018-06-05 2022-03-01 Stats Llc Audio processing for detecting occurrences of loud sound characterized by brief audio bursts
US11178451B2 (en) * 2018-08-17 2021-11-16 Roku, Inc. Dynamic playout of transition frames while transitioning between playout of media streams
US11068527B2 (en) 2018-10-04 2021-07-20 Rovi Guides, Inc. Systems and methods for optimizing delivery of content recommendations
US11012744B2 (en) * 2019-03-14 2021-05-18 Longtail Ad Solutions, Inc. Systems and methods for evaluating the engagement factor of videos

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030101451A1 (en) * 2001-01-09 2003-05-29 Isaac Bentolila System, method, and software application for targeted advertising via behavioral model clustering, and preference programming based on behavioral model clusters
US20090150919A1 (en) * 2007-11-30 2009-06-11 Lee Michael J Correlating Media Instance Information With Physiological Responses From Participating Subjects
US20090158308A1 (en) * 2007-12-18 2009-06-18 Daniel Weitzenfeld Identifying key media events and modeling causal relationships between key events and reported feelings
US20090210290A1 (en) * 2008-02-20 2009-08-20 Sebastian Elliott Method for determining, correlating and examining the causal relationships between media program and commercial content with response rates to advertising and product placement
US20090217315A1 (en) * 2008-02-26 2009-08-27 Cognovision Solutions Inc. Method and system for audience measurement and targeting media

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6878206B2 (en) * 2001-07-16 2005-04-12 Applied Materials, Inc. Lid assembly for a processing system to facilitate sequential deposition techniques
US20070157242A1 (en) * 2005-12-29 2007-07-05 United Video Properties, Inc. Systems and methods for managing content
US20100280876A1 (en) * 2009-04-30 2010-11-04 Microsoft Corporation Implicit rating of advertisements

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030101451A1 (en) * 2001-01-09 2003-05-29 Isaac Bentolila System, method, and software application for targeted advertising via behavioral model clustering, and preference programming based on behavioral model clusters
US20090150919A1 (en) * 2007-11-30 2009-06-11 Lee Michael J Correlating Media Instance Information With Physiological Responses From Participating Subjects
US20090158308A1 (en) * 2007-12-18 2009-06-18 Daniel Weitzenfeld Identifying key media events and modeling causal relationships between key events and reported feelings
US20090210290A1 (en) * 2008-02-20 2009-08-20 Sebastian Elliott Method for determining, correlating and examining the causal relationships between media program and commercial content with response rates to advertising and product placement
US20090217315A1 (en) * 2008-02-26 2009-08-27 Cognovision Solutions Inc. Method and system for audience measurement and targeting media

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10542315B2 (en) 2015-11-11 2020-01-21 At&T Intellectual Property I, L.P. Method and apparatus for content adaptation based on audience monitoring
US11128675B2 (en) 2017-03-20 2021-09-21 At&T Intellectual Property I, L.P. Automatic ad-hoc multimedia conference generator

Also Published As

Publication number Publication date
GB2485713A (en) 2012-05-23
GB201203176D0 (en) 2012-04-11
GB2485713B (en) 2014-08-27
DE112010003731T5 (en) 2012-08-30
US8875167B2 (en) 2014-10-28
US20110072448A1 (en) 2011-03-24

Similar Documents

Publication Publication Date Title
US8875167B2 (en) Implicit mechanism for determining user response to media
US11490145B2 (en) Content insertion in streaming media content
US10122782B2 (en) Retrieval and display of related content using text stream data feeds
US11373208B2 (en) Non-intrusive advertisement presentation
US11089371B2 (en) Systems and methods for estimating user attention
US20140013346A1 (en) Video stream measurement
US20120173701A1 (en) Matching techniques for cross-platform monitoring and information
US20150180989A1 (en) Methods and apparatus to measure media using media object characteristics
US11522932B2 (en) Using messaging associated with adaptive bitrate streaming to perform media monitoring for mobile platforms
US20120290393A1 (en) User controlled advertising preferences
US20130340005A1 (en) Eye-tracking program guides
US9769523B2 (en) Video efficacy measurement
KR20140033412A (en) System and method for scalable, high accuracy, sensor and id based audience measurement system
JP2018531468A6 (en) System and method for estimating user attention
KR20120075515A (en) Personalized content recommendation system and method
EP3920539A1 (en) Systems and methods for providing audio-video streams with alternative content
EP3087748B1 (en) Methods and apparatus to measure media using media object characteristics
Pham et al. Personalized dynamic ad insertion with MPEG DASH

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10818009

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 1203176

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20100921

WWE Wipo information: entry into national phase

Ref document number: 1203176.1

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 1120100037310

Country of ref document: DE

Ref document number: 112010003731

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10818009

Country of ref document: EP

Kind code of ref document: A1