US20070243930A1 - System and method for using user's audio environment to select advertising - Google Patents
System and method for using user's audio environment to select advertising Download PDFInfo
- Publication number
- US20070243930A1 US20070243930A1 US11/403,179 US40317906A US2007243930A1 US 20070243930 A1 US20070243930 A1 US 20070243930A1 US 40317906 A US40317906 A US 40317906A US 2007243930 A1 US2007243930 A1 US 2007243930A1
- Authority
- US
- United States
- Prior art keywords
- user
- sound
- characteristic
- advertisement
- sounds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
Definitions
- Many video games contain advertising for products.
- the advertising on the walls of a virtual racing game may comprise advertising for real products.
- the present invention provides a method of selecting content for display during a game.
- the method includes storing sounds received at a game console, analyzing the sounds to determine a characteristic associated with the game user, and selecting content for rendering to the user based on the characteristics.
- the sounds may be speech
- the characteristic may be the user's gender, age or whether the user has reached puberty.
- Another aspect of the invention relates to a game console that includes a microphone, a processor and a memory.
- the memory stores advertisements and instructions, where the instructions include: storing sounds received at the microphone; identifying characteristics of the sounds; selecting an advertisement for display based on the characteristics; and rendering the advertisement.
- the instructions may also include transmitting the stored sounds outside of the console for analysis and then receiving the identified characteristics.
- a method in yet another aspect of the invention, includes: receiving sound at a microphone; storing the sound in a memory; analyzing the sound to determine the characteristics of a user based on the sounds; selecting an advertisement from a plurality of advertisements based on the characteristics; and rendering the selected advertisement.
- the plurality of advertisements may be based on different characteristics.
- a further aspect relates to a method of selecting advertising.
- the method comprises receiving sounds transmitted over a network from a computer; analyzing the sounds to determine characteristics associated with the environment surrounding the computer; selecting an advertisement based on the characteristics; and transmitting the advertisement to the computer.
- a still further aspect of the method relates to receiving sound at a microphone, storing the sound in a memory, and analyzing the sound to determine the characteristics of a user or a user's environment based on the sounds.
- FIG. 1 is a functional diagram of a system in accordance with an aspect of the present invention.
- FIG. 2 is a functional diagram of a system in accordance with an aspect of the present invention.
- FIG. 3 is a diagram of a method in accordance with an aspect of the present invention.
- FIG. 4 is a diagram of a method in accordance with an aspect of the present invention.
- a system 100 in accordance with one aspect of the invention comprises a game console 105 , display 200 , user input 210 and other components typically present in game consoles.
- the system is used by a user, indicated as user 300 .
- Game console 105 preferably includes a processor 130 and memory 140 .
- Memory 140 stores information accessible by processor 130 , including instructions 160 for execution by the processor 130 , and data 145 which is retrieved, manipulated or stored by the processor.
- the memory may be of any type capable of storing information accessible by the processor; by way of example, hard-drives, ROM, RAM, CD-ROM, DVD, write-capable memories, and read-only memories.
- the instructions 160 may comprise any set of instructions to be executed directly (e.g., machine code) or indirectly (e.g., scripts) by the processor.
- the terms “instructions,” “steps” and “programs” may be used interchangeably herein. The functions, methods and routines of the program in accordance with the present invention are explained in more detail below.
- Data 145 may be retrieved, stored or modified by processor 130 in accordance with the instructions 160 .
- the data may be stored in any manner known to those of ordinary skill in the art such as in computer registers, in records contained in tables and relational databases, or in XML files.
- the data may also be formatted in any computer readable format such as, but not limited to, binary values, ASCII or EBCDIC (Extended Binary-Coded Decimal Interchange Code).
- any information sufficient to identify the relevant data may be stored, such as descriptive text, proprietary codes, pointers, or information which is used by a function to calculate the relevant data.
- processor and memory are functionally illustrated in FIG. 1 as within the same block, it will be understood by those of ordinary skill in the art that the processor and memory may actually comprise multiple processors and memories that may or may not be stored within the same physical housing. For example, some of the instructions and data may be stored on a removable CD-ROM and others within a read-only computer chip. Some or all of the instructions and data may be stored in a location physically remote from, yet still accessible by, the processor. Similarly, the processor may actually comprise a collection of processors which may or may not operate in parallel.
- system 100 may comprise additional components typically found in a game console or computer system such as a display 200 (e.g., an LCD screen), user input 210 (e.g., a keyboard, mouse, game pad, touch-sensitive screen), microphone 110 , modem 103 (e.g., telephone or cable modem), camera 112 , and all of the components used for connecting these elements to one another.
- Game console 105 preferably communicates with the Internet 220 via modem 103 or some other communication component such as a network card.
- the system may also comprise any device capable of processing instructions and transmitting data to and from humans and other computers or devices, including general purpose computers, network computers lacking local storage capability, PDA's with modems and Internet-capable wireless phones, digital video recorders, cable television set-top boxes or consumer electronic devices.
- instructions 160 comprise a game program, such as a game stored on a DVD-ROM or downloaded to the console 105 via modem 105 from the Internet 220 .
- Instructions 160 may also comprise routines stored within the console 105 which are accessible to, but not specific to, a particular game. For example, the console routines may be called by any game routine.
- the instructions 160 or data 145 comprises advertisements 175 .
- the advertisements 175 may be any type of content that can be rendered, including data (e.g., images or sounds), instructions (e.g., “play product jingle”) or various combinations thereof.
- the advertising profile data 176 provides information which correlates the advertisement to particular classes of users or user environments. For example, if the advertisement relates to a racing car which is typically marketed to young boys, then the advertising profile data 176 may indicate a desired age range (“Child”) and a desired gender (“Male”). If the advertisement relates to a DVD about Beethoven, then the advertising profile data 176 may indicate desired music styles (“Classical”), interests (“audiophile”) and equipment (“DVD Player Owner.”) If the advertisement relates to dog food, then the advertising profile data 176 may be directed to users who own dogs or dog products. The profile data of some advertisements may indicate that the advertisements are directed to all users.
- console routines preferably include audio analysis routines 180 . These routines analyze audio signals and output information gleaned from the audio signals in response.
- One of the audio analysis routines may comprise voice analysis routine 161 .
- This routine analyzes recorded human speech and returns information about the user's characteristics to the extent those characteristics are reflected in the person's speech. For example, the routine may return values relating to the gender and age characteristics of the user detected in the recorded speech. Thus, the value may indicate whether the user is likely to be male and female. It may also indicate the user's likely age, such as the age range reflected in the user's speech or whether the user has reached puberty.
- Another audio analysis routine 180 may comprise sound analysis routine 182 .
- This routine examines recorded audio for particular sounds, and outputs information regarding the sounds it recognized. For example, the routine may return the string value “dog bark” if the routine detects the presence of a dog bark. Thus, the user may be provided advertisements in connection with pet supplies.
- console routines preferably include visual analysis routines 180 . These routines analyze image information (such as still and moving images) and outputs information gleaned from the image signals in response.
- One of the visual analysis routines 190 may comprise human visual appearance routine 191 .
- This routine analyzes a user's visual appearance and returns information about the user's characteristics to the extent those characteristics are reflected in the image. For example, the returned information may indicate whether the user is likely to be male or female (e.g., based on hair style), the age range of the user (e.g., based on the person's size), and whether the user wears glasses.
- Another visual analysis routine may include object appearance analysis routine 192 . This routine attempts to identify particular objects appearing within an image. For example, the routine may look for, and return information indicating, whether a particular image includes a dog bowl.
- Yet another visual analysis routine may include text analysis routine 193 .
- This routine attempts to identify text within an image. For example, this routine may return information indicating the text written on a person's clothing, the spine of a book or a poster on a wall.
- audio and visual analysis routines are not limited to any particular method of analysis but, rather, may comprise any system and method known to those of ordinary skill in the art.
- the fundamental frequency of a human's voice (often referred to as the person's “pitch”) is measurable, and it tends to vary based on gender, age and whether the person has gone through puberty.
- Voice analysis routine 161 may extract the fundamental frequency from human speech recorded in memory 140 , compare the extracted frequency against a table of frequencies stored in memory 140 such as voice and sound table 183 , determine the user's gender and age reflected in the user's speech, and then return a value indicative of that gender and age.
- sound analysis routine 182 may search a recorded sound for the audio signals matching or resembling sound information stored in voice and sound table 183 .
- Text analysis routine 193 may use optical character recognition (OCR) techniques.
- OCR optical character recognition
- Instructions 160 may include one or more communication routines 195 which transmit visual information, audio information, or both to a remote processor or location for analysis.
- the captured visual or audio information may be transmitted over the Internet 220 to off-site analysis system 400 , which may comprise a server with a processor for processing the information and returning the values to the console 105 .
- off-site analysis system 400 may also transmit advertisements in lieu of values used to select advertisements.
- Data 145 may also store user profiles 155 .
- User profiles 155 contain information about the users that use the console 105 . Some of the information may be provided by the user, such as the user's name. Other information may be derived form the captured audio information, video information or both. The user's profile may be specific to a particular user or applicable to all users.
- the objects within the visual environment of the console 160 are analyzed.
- the visual environment may be analyzed by using camera 112 to capture a still or moving image of the objects within the field of view of camera 112 .
- the visual objects may comprise the user 300 in front of the console or other objects within the camera's. field of view, such as posters 300 , books 301 , furniture 302 , and other objects 303 .
- the images may be continuously captured and analyzed, or may be captured and analyzed upon certain events, such as every few minutes, upon the console 105 being powered on, upon the game program 165 being executed, or upon an instruction from the game.
- the captured image 158 may be stored in data 145 for analysis by the visual analysis routines 190 .
- the routines may analyze the visual information and output values representing the visual objects found, or estimates about the user 300 or the environment in which the console resides based on the visual objects.
- the style of hair and clothing may be used to estimate gender (“male”, “female”); the physical size of user 300 may be used to estimate age (“child”, “adult”); the presence of a tie or buttons on a shirt may be used to estimate clothing preferences (“casual attire”, “business casual attire”, “business attire”); the brands appearing on clothing or furnishings (such as stereo 302 ) may be used to identify brand or entertainment preferences (“Sony”, “John Mayer”, “Spiderman”); the show or movies appearing on a television may be used to identify entertainment preferences (“Jeopardy”, “Spiderman”); the size of the room in which the console may be used may be evaluated (“large room”, “small room”); the titles of books 301 may be extracted to estimate reading preferences (“classics”, “fiction”); furnishings in the room may be used to estimate purchasing habits (“lamp”, “stereo”, “DVD player”, “personal computer”, “posters”, “oil painting”); and furniture style may be analyzed (“ornate furniture”, “modern furniture”).
- the physical size of user 300
- the sound-emitting objects within the audio environment of the console 160 are analyzed.
- the audio environment 360 may be analyzed by using microphone 110 to capture sounds.
- Such sound-emitting objects may comprise the user 300 and other users near the console, as well as stereo 302 , pet 302 and other sound-emitting objects 303 .
- the sounds may be continuously captured and analyzed, or may be captured and analyzed upon certain events, such as every few minutes, upon the console 105 being powered on, upon the game program 165 being executed, or upon an instruction from the game.
- the captured sounds 157 are then stored in data 145 for analysis by the audio analysis routines 180 .
- the routines may analyze the audio information, estimate information about the user or the surrounding environment from the audio information, and then output values representing those estimates as follows: the user's speech may be used to estimate gender and age (“male”, “female,” “child”, “adult”); the language and accent of the user's speech may be used to estimate where the user grew up (“Southern USA”, “Japan”); the music playing on a stereo 302 may be used to identify music preferences (“John Mayer”, “classical”), and the mere fact that music is playing may be used to estimate whether the user likes music (“audiophile”, “prefers silence”); the show or movies playing on a television may be used to identify entertainment preferences (“Jeopardy”, “Spiderman”); and the sound of pets 302 may be used to determine pet ownership (“dog”, “cat”).
- the detected audio and visual characteristics 159 may be stored in the user's profile 155 .
- a running total of detected characteristics may also be kept to increase the accuracy of the derived information (e.g., detecting “male” detected ten times and “female” makes it more likely that the user is female).
- Instructions 160 such as a game program 165 , or software in a DVR, cable TV set-top box or consumer electronic device may use the detected characteristics 159 to select advertising 175 . Some or all of the advertising may be selected based on the profile data 176 associated with the advertisements and the detected characteristics 159 stored in user profile 155 .
- a racing game 165 may include at least two advertisements 175 to be displayed on the walls surrounding a racetrack: one ad shows a dump truck and its profile data is “male” and “child”; another ad is for a calcium supplement and its profile is “female” and “adult;” yet another ad is for a Beethoven DVD and its profile is “classical music preference” and “DVD player owner.”
- game program 165 needs to select an advertisement for display, it compares the advertisement profile data 176 against the detected characteristics 159 and selects an advertisement 175 based thereon. Using the foregoing example, if the detected characteristics include only “male” and “child,” the game program 165 would select the dump truck ad and display the ad on the racing track wall.
- the game program 165 selects the advertisement which has the greatest match between the advertisement's profile data and the detected characteristics.
- the advertising does not interrupt the game experience but, rather, is incorporated into the game experience.
- the advertising may be displayed to the user by interrupting the game and showing the advertising.
- the advertising is incorporated into the game, such as on the racetrack walls of a racing game, the side of building in another game, or as objects (such as Beethoven DVD) that the user can pick up and interact with in a simulation.
- the advertising may be displayed with content that it is unrelated to either the user's characteristics or the selected advertisement.
- the present invention provides at least three separate and unique aspects.
- One aspect relates to the analysis of sound-emitting objects to determine information about the environment which enhances the selection of in-game advertising.
- Another aspect relates to the analysis of visually-perceptible objects to determine information about the environment which enhances the selection of in-game advertising.
- Yet another system uses both audio and visual information to detect characteristics about the user and the console's environment to select in-game advertising.
- This last system is particularly advantageous because it allows the audio and visual information to be used in synergistically unique ways.
- the characteristics detected from the visual environment may indicate the presence of books on Beethoven, and the object analysis routine may output a value indicating that there is thus a 30% likelihood that the current user enjoys Beethoven. This likelihood may not be sufficient to show an advertisement for Beethoven CD's in a racing game.
- the characteristics detected from the audio environment may indicate that classical music is playing, and the object analysis routine may output a value indicating that there is thus a 60% likelihood that the current user enjoys classical music.
- Instructions 160 may include rules indicating that combination of these two detected characteristics—Beethoven books and classical music playing—are sufficient to show a Beethoven advertisement even though each characteristic alone is not sufficient. Moreover, by using both audio and visual characteristics, the inherent limitations that are uniquely associated with each may be overcome by the other.
- Differences between detected characteristics may also be used during advertising selection. For example, if the audio analysis routines 180 indicate that the user is male and the visual analysis routines indicate that the user is female, then instructions 160 may select gender-neutral rather than gender-specific content. Alternatively, in the event conflicting characteristics are detected, the instructions may select the characteristic with the greater likelihood of applying to the user.
- the recorded sounds 157 and captured image 158 may be transmitted to the off-site analysis system 400 via modem 103 and Internet 200 for further review.
- instructions 160 and data 145 may contain enough information to determine whether the user is likely male or female based on voice.
- the console 105 may not contain sufficient processing power or information to determine whether the user is male or female based on visual appearance. It may also lack sufficient processing power or information to determine the type of music playing in the background.
- the off-site analysis system 400 may analyze the provided audio and visual information and return detected characteristics to game console 105 .
- a method and system whereby audio and visual information is processed both internally within a game console and externally at a remote geographic location so as to detect characteristics about the user or the user's environment.
- the off-site analysis system 400 may also transmit advertising content to console 105 for use by game program 165 .
- System 100 may also include devices and methods for ignoring certain sounds. For example, sounds emitted in accordance with game program 165 , DVR, TV etc. may be subtracted from the recorded sounds 157 so that these sounds are not mistakenly attributed to the audio environment 360 .
Abstract
Description
- The present application is a continuation-in-part, and claims the benefit of, U.S. patent application Ser. No. (NUMBER UNKNOWN) entitled “System And Method For Obtaining User Information From Voices” that was filed Apr. 10, 2006, listing Eric Larsen and Ruxin Chen as inventors, which claimed the benefit of U.S. Provisional Patent Application No. 60/718,145 filed Sep. 15, 2005. The disclosure of both applications are hereby incorporated by reference.
- Many video games contain advertising for products. For example, the advertising on the walls of a virtual racing game may comprise advertising for real products.
- It would be advantageous if there were a system and method which selected advertising based on information relating to the user.
- In one aspect, the present invention provides a method of selecting content for display during a game. The method includes storing sounds received at a game console, analyzing the sounds to determine a characteristic associated with the game user, and selecting content for rendering to the user based on the characteristics. For example, the sounds may be speech, the characteristic may be the user's gender, age or whether the user has reached puberty.
- Another aspect of the invention relates to a game console that includes a microphone, a processor and a memory. The memory stores advertisements and instructions, where the instructions include: storing sounds received at the microphone; identifying characteristics of the sounds; selecting an advertisement for display based on the characteristics; and rendering the advertisement. The instructions may also include transmitting the stored sounds outside of the console for analysis and then receiving the identified characteristics.
- In yet another aspect of the invention, a method is provided that includes: receiving sound at a microphone; storing the sound in a memory; analyzing the sound to determine the characteristics of a user based on the sounds; selecting an advertisement from a plurality of advertisements based on the characteristics; and rendering the selected advertisement. The plurality of advertisements may be based on different characteristics.
- A further aspect relates to a method of selecting advertising. The method comprises receiving sounds transmitted over a network from a computer; analyzing the sounds to determine characteristics associated with the environment surrounding the computer; selecting an advertisement based on the characteristics; and transmitting the advertisement to the computer.
- A still further aspect of the method relates to receiving sound at a microphone, storing the sound in a memory, and analyzing the sound to determine the characteristics of a user or a user's environment based on the sounds.
- Other aspects of the present invention are described below.
-
FIG. 1 is a functional diagram of a system in accordance with an aspect of the present invention. -
FIG. 2 is a functional diagram of a system in accordance with an aspect of the present invention. -
FIG. 3 is a diagram of a method in accordance with an aspect of the present invention. -
FIG. 4 is a diagram of a method in accordance with an aspect of the present invention. - As shown in
FIG. 1 , asystem 100 in accordance with one aspect of the invention comprises agame console 105,display 200, user input 210 and other components typically present in game consoles. The system is used by a user, indicated as user 300. -
Game console 105 preferably includes aprocessor 130 andmemory 140.Memory 140 stores information accessible byprocessor 130, includinginstructions 160 for execution by theprocessor 130, anddata 145 which is retrieved, manipulated or stored by the processor. The memory may be of any type capable of storing information accessible by the processor; by way of example, hard-drives, ROM, RAM, CD-ROM, DVD, write-capable memories, and read-only memories. - The
instructions 160 may comprise any set of instructions to be executed directly (e.g., machine code) or indirectly (e.g., scripts) by the processor. The terms “instructions,” “steps” and “programs” may be used interchangeably herein. The functions, methods and routines of the program in accordance with the present invention are explained in more detail below. -
Data 145 may be retrieved, stored or modified byprocessor 130 in accordance with theinstructions 160. The data may be stored in any manner known to those of ordinary skill in the art such as in computer registers, in records contained in tables and relational databases, or in XML files. The data may also be formatted in any computer readable format such as, but not limited to, binary values, ASCII or EBCDIC (Extended Binary-Coded Decimal Interchange Code). Moreover, any information sufficient to identify the relevant data may be stored, such as descriptive text, proprietary codes, pointers, or information which is used by a function to calculate the relevant data. - Although the processor and memory are functionally illustrated in
FIG. 1 as within the same block, it will be understood by those of ordinary skill in the art that the processor and memory may actually comprise multiple processors and memories that may or may not be stored within the same physical housing. For example, some of the instructions and data may be stored on a removable CD-ROM and others within a read-only computer chip. Some or all of the instructions and data may be stored in a location physically remote from, yet still accessible by, the processor. Similarly, the processor may actually comprise a collection of processors which may or may not operate in parallel. - As noted above,
system 100 may comprise additional components typically found in a game console or computer system such as a display 200 (e.g., an LCD screen), user input 210 (e.g., a keyboard, mouse, game pad, touch-sensitive screen),microphone 110, modem 103 (e.g., telephone or cable modem),camera 112, and all of the components used for connecting these elements to one another.Game console 105 preferably communicates with the Internet 220 viamodem 103 or some other communication component such as a network card. - Instead of a game console, the system may also comprise any device capable of processing instructions and transmitting data to and from humans and other computers or devices, including general purpose computers, network computers lacking local storage capability, PDA's with modems and Internet-capable wireless phones, digital video recorders, cable television set-top boxes or consumer electronic devices.
- In one aspect of the present invention,
instructions 160 comprise a game program, such as a game stored on a DVD-ROM or downloaded to theconsole 105 viamodem 105 from the Internet 220.Instructions 160 may also comprise routines stored within theconsole 105 which are accessible to, but not specific to, a particular game. For example, the console routines may be called by any game routine. - Preferably, at least a portion of the
instructions 160 ordata 145 comprisesadvertisements 175. Theadvertisements 175 may be any type of content that can be rendered, including data (e.g., images or sounds), instructions (e.g., “play product jingle”) or various combinations thereof. - At least some of the
advertisements 175 are associated with advertising profile data 176. The advertising profile data 176 provides information which correlates the advertisement to particular classes of users or user environments. For example, if the advertisement relates to a racing car which is typically marketed to young boys, then the advertising profile data 176 may indicate a desired age range (“Child”) and a desired gender (“Male”). If the advertisement relates to a DVD about Beethoven, then the advertising profile data 176 may indicate desired music styles (“Classical”), interests (“audiophile”) and equipment (“DVD Player Owner.”) If the advertisement relates to dog food, then the advertising profile data 176 may be directed to users who own dogs or dog products. The profile data of some advertisements may indicate that the advertisements are directed to all users. - Some of the console routines preferably include
audio analysis routines 180. These routines analyze audio signals and output information gleaned from the audio signals in response. - One of the audio analysis routines may comprise
voice analysis routine 161. This routine analyzes recorded human speech and returns information about the user's characteristics to the extent those characteristics are reflected in the person's speech. For example, the routine may return values relating to the gender and age characteristics of the user detected in the recorded speech. Thus, the value may indicate whether the user is likely to be male and female. It may also indicate the user's likely age, such as the age range reflected in the user's speech or whether the user has reached puberty. - Another
audio analysis routine 180 may comprisesound analysis routine 182. This routine examines recorded audio for particular sounds, and outputs information regarding the sounds it recognized. For example, the routine may return the string value “dog bark” if the routine detects the presence of a dog bark. Thus, the user may be provided advertisements in connection with pet supplies. - Some of the console routines preferably include
visual analysis routines 180. These routines analyze image information (such as still and moving images) and outputs information gleaned from the image signals in response. - One of the visual analysis routines 190 may comprise human visual appearance routine 191. This routine analyzes a user's visual appearance and returns information about the user's characteristics to the extent those characteristics are reflected in the image. For example, the returned information may indicate whether the user is likely to be male or female (e.g., based on hair style), the age range of the user (e.g., based on the person's size), and whether the user wears glasses.
- Another visual analysis routine may include object appearance analysis routine 192. This routine attempts to identify particular objects appearing within an image. For example, the routine may look for, and return information indicating, whether a particular image includes a dog bowl.
- Yet another visual analysis routine may include text analysis routine 193. This routine attempts to identify text within an image. For example, this routine may return information indicating the text written on a person's clothing, the spine of a book or a poster on a wall.
- The foregoing audio and visual analysis routines are not limited to any particular method of analysis but, rather, may comprise any system and method known to those of ordinary skill in the art. For example, the fundamental frequency of a human's voice (often referred to as the person's “pitch”) is measurable, and it tends to vary based on gender, age and whether the person has gone through puberty.
Voice analysis routine 161 may extract the fundamental frequency from human speech recorded inmemory 140, compare the extracted frequency against a table of frequencies stored inmemory 140 such as voice and sound table 183, determine the user's gender and age reflected in the user's speech, and then return a value indicative of that gender and age. Similarly,sound analysis routine 182 may search a recorded sound for the audio signals matching or resembling sound information stored in voice and sound table 183. Text analysis routine 193 may use optical character recognition (OCR) techniques. - Although significant advantages are presented if the
console 105 contains analysis routines as described above, another aspect of the invention provides for the analysis to occur outside of the console.Instructions 160 may include one or more communication routines 195 which transmit visual information, audio information, or both to a remote processor or location for analysis. For example, the captured visual or audio information may be transmitted over theInternet 220 to off-site analysis system 400, which may comprise a server with a processor for processing the information and returning the values to theconsole 105. In an alternative embodiment of the invention, some or all of the captured visual or audio information is reviewed by humans, and values for selecting advertisements are transmitted back to the console. Off-site analysis system 400 may also transmit advertisements in lieu of values used to select advertisements. -
Data 145 may also store user profiles 155. User profiles 155 contain information about the users that use theconsole 105. Some of the information may be provided by the user, such as the user's name. Other information may be derived form the captured audio information, video information or both. The user's profile may be specific to a particular user or applicable to all users. - In addition to the operations illustrated in
FIG. 3 , an operation in accordance with a variety of aspects of the invention will now be described. It should be understood that the following operations do not have to be performed in the precise order described below. Rather, various steps can be handled in reverse order or simultaneously. - In accordance with
instructions 160, the objects within the visual environment of theconsole 160 are analyzed. As functionally illustrated inFIG. 2 , the visual environment may be analyzed by usingcamera 112 to capture a still or moving image of the objects within the field of view ofcamera 112. The visual objects may comprise the user 300 in front of the console or other objects within the camera's. field of view, such as posters 300,books 301,furniture 302, andother objects 303. The images may be continuously captured and analyzed, or may be captured and analyzed upon certain events, such as every few minutes, upon theconsole 105 being powered on, upon thegame program 165 being executed, or upon an instruction from the game. - In one example, the captured
image 158 may be stored indata 145 for analysis by the visual analysis routines 190. The routines may analyze the visual information and output values representing the visual objects found, or estimates about the user 300 or the environment in which the console resides based on the visual objects. For example, the style of hair and clothing may be used to estimate gender (“male”, “female”); the physical size of user 300 may be used to estimate age (“child”, “adult”); the presence of a tie or buttons on a shirt may be used to estimate clothing preferences (“casual attire”, “business casual attire”, “business attire”); the brands appearing on clothing or furnishings (such as stereo 302) may be used to identify brand or entertainment preferences (“Sony”, “John Mayer”, “Spiderman”); the show or movies appearing on a television may be used to identify entertainment preferences (“Jeopardy”, “Spiderman”); the size of the room in which the console may be used may be evaluated (“large room”, “small room”); the titles of books 301 may be extracted to estimate reading preferences (“classics”, “fiction”); furnishings in the room may be used to estimate purchasing habits (“lamp”, “stereo”, “DVD player”, “personal computer”, “posters”, “oil painting”); and furniture style may be analyzed (“ornate furniture”, “modern furniture”). In one aspect of the invention, the analysis routines also ascribe values indicating the likelihood that the derived characteristic is accurate, for example, the likelihood that a user is female or the likelihood that a detected sound is a dog bark. - In accordance with
instructions 160, the sound-emitting objects within the audio environment of theconsole 160 are analyzed. As functionally illustrated inFIG. 2 , theaudio environment 360 may be analyzed by usingmicrophone 110 to capture sounds. Such sound-emitting objects may comprise the user 300 and other users near the console, as well asstereo 302,pet 302 and other sound-emittingobjects 303. The sounds may be continuously captured and analyzed, or may be captured and analyzed upon certain events, such as every few minutes, upon theconsole 105 being powered on, upon thegame program 165 being executed, or upon an instruction from the game. - The captured sounds 157 are then stored in
data 145 for analysis by theaudio analysis routines 180. By way of example, the routines may analyze the audio information, estimate information about the user or the surrounding environment from the audio information, and then output values representing those estimates as follows: the user's speech may be used to estimate gender and age (“male”, “female,” “child”, “adult”); the language and accent of the user's speech may be used to estimate where the user grew up (“Southern USA”, “Japan”); the music playing on astereo 302 may be used to identify music preferences (“John Mayer”, “classical”), and the mere fact that music is playing may be used to estimate whether the user likes music (“audiophile”, “prefers silence”); the show or movies playing on a television may be used to identify entertainment preferences (“Jeopardy”, “Spiderman”); and the sound ofpets 302 may be used to determine pet ownership (“dog”, “cat”). - The detected audio and
visual characteristics 159 may be stored in the user's profile 155. In addition to storing the most-recently derived information, a running total of detected characteristics may also be kept to increase the accuracy of the derived information (e.g., detecting “male” detected ten times and “female” makes it more likely that the user is female). -
Instructions 160, such as agame program 165, or software in a DVR, cable TV set-top box or consumer electronic device may use the detectedcharacteristics 159 to selectadvertising 175. Some or all of the advertising may be selected based on the profile data 176 associated with the advertisements and the detectedcharacteristics 159 stored in user profile 155. For example, aracing game 165 may include at least twoadvertisements 175 to be displayed on the walls surrounding a racetrack: one ad shows a dump truck and its profile data is “male” and “child”; another ad is for a calcium supplement and its profile is “female” and “adult;” yet another ad is for a Beethoven DVD and its profile is “classical music preference” and “DVD player owner.” Whengame program 165 needs to select an advertisement for display, it compares the advertisement profile data 176 against the detectedcharacteristics 159 and selects anadvertisement 175 based thereon. Using the foregoing example, if the detected characteristics include only “male” and “child,” thegame program 165 would select the dump truck ad and display the ad on the racing track wall. Preferably, thegame program 165 selects the advertisement which has the greatest match between the advertisement's profile data and the detected characteristics. - Preferably, the advertising does not interrupt the game experience but, rather, is incorporated into the game experience. The advertising may be displayed to the user by interrupting the game and showing the advertising. Preferably, however, the advertising is incorporated into the game, such as on the racetrack walls of a racing game, the side of building in another game, or as objects (such as Beethoven DVD) that the user can pick up and interact with in a simulation. Thus, the advertising may be displayed with content that it is unrelated to either the user's characteristics or the selected advertisement.
- The present invention provides at least three separate and unique aspects. One aspect relates to the analysis of sound-emitting objects to determine information about the environment which enhances the selection of in-game advertising. Another aspect relates to the analysis of visually-perceptible objects to determine information about the environment which enhances the selection of in-game advertising.
- Yet another system uses both audio and visual information to detect characteristics about the user and the console's environment to select in-game advertising. This last system is particularly advantageous because it allows the audio and visual information to be used in synergistically unique ways. For example, the characteristics detected from the visual environment may indicate the presence of books on Beethoven, and the object analysis routine may output a value indicating that there is thus a 30% likelihood that the current user enjoys Beethoven. This likelihood may not be sufficient to show an advertisement for Beethoven CD's in a racing game. However, the characteristics detected from the audio environment may indicate that classical music is playing, and the object analysis routine may output a value indicating that there is thus a 60% likelihood that the current user enjoys classical music.
Instructions 160 may include rules indicating that combination of these two detected characteristics—Beethoven books and classical music playing—are sufficient to show a Beethoven advertisement even though each characteristic alone is not sufficient. Moreover, by using both audio and visual characteristics, the inherent limitations that are uniquely associated with each may be overcome by the other. - Differences between detected characteristics may also be used during advertising selection. For example, if the
audio analysis routines 180 indicate that the user is male and the visual analysis routines indicate that the user is female, theninstructions 160 may select gender-neutral rather than gender-specific content. Alternatively, in the event conflicting characteristics are detected, the instructions may select the characteristic with the greater likelihood of applying to the user. - To the extent the
console 105 lacks the capability of detecting various characteristics, and as functionally illustrated inFIG. 4 , the recorded sounds 157 and capturedimage 158 may be transmitted to the off-site analysis system 400 viamodem 103 andInternet 200 for further review. For example,instructions 160 anddata 145 may contain enough information to determine whether the user is likely male or female based on voice. However, theconsole 105 may not contain sufficient processing power or information to determine whether the user is male or female based on visual appearance. It may also lack sufficient processing power or information to determine the type of music playing in the background. The off-site analysis system 400 may analyze the provided audio and visual information and return detected characteristics togame console 105. Although particular advantages are attained when the information is automatically evaluated with the use of computer processors, some or all of the detected characteristics may also be determined by the use of humans listening or watching the information. In the regard, in one aspect of the present invention, a method and system is provided whereby audio and visual information is processed both internally within a game console and externally at a remote geographic location so as to detect characteristics about the user or the user's environment. - Rather than transmitting the detected characteristics, the off-
site analysis system 400 may also transmit advertising content to console 105 for use bygame program 165. -
System 100 may also include devices and methods for ignoring certain sounds. For example, sounds emitted in accordance withgame program 165, DVR, TV etc. may be subtracted from the recorded sounds 157 so that these sounds are not mistakenly attributed to theaudio environment 360. - Most of the foregoing alternative embodiments are not mutually exclusive, but may be implemented in various combinations to achieve unique advantages. As these and other variations and combinations of the features discussed above can be utilized without departing from the invention as defined by the claims, the foregoing description of the embodiments should be taken by way of illustration rather than by way of limitation of the invention as defined by the claims.
Claims (21)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/403,179 US20070243930A1 (en) | 2006-04-12 | 2006-04-12 | System and method for using user's audio environment to select advertising |
PCT/US2007/009004 WO2007120750A1 (en) | 2006-04-12 | 2007-04-12 | Audio/visual environment detection |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/403,179 US20070243930A1 (en) | 2006-04-12 | 2006-04-12 | System and method for using user's audio environment to select advertising |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070243930A1 true US20070243930A1 (en) | 2007-10-18 |
Family
ID=38605463
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/403,179 Abandoned US20070243930A1 (en) | 2006-04-12 | 2006-04-12 | System and method for using user's audio environment to select advertising |
Country Status (1)
Country | Link |
---|---|
US (1) | US20070243930A1 (en) |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070060350A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for control by audible device |
US20070061851A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for detecting user attention |
US20070061413A1 (en) * | 2005-09-15 | 2007-03-15 | Larsen Eric J | System and method for obtaining user information from voices |
US20070244751A1 (en) * | 2006-04-17 | 2007-10-18 | Gary Zalewski | Using visual environment to select ads on game platform |
US20070255630A1 (en) * | 2006-04-17 | 2007-11-01 | Gary Zalewski | System and method for using user's visual environment to select advertising |
US20070260517A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Profile detection |
US20070261077A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Using audio/visual environment to select ads on game platform |
US20080307412A1 (en) * | 2007-06-06 | 2008-12-11 | Sony Computer Entertainment Inc. | Cached content consistency management |
US20090209339A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player, Control Method Thereof, Gaming System Capable of Conversation with Player, and Control Method Thereof |
US20090209340A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player and Control Method Thereof |
US20090209341A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player and Control Method Thereof |
US20100048300A1 (en) * | 2008-08-19 | 2010-02-25 | Capio Oliver R | Audience-condition based media selection |
US20110244946A1 (en) * | 2010-04-05 | 2011-10-06 | Nvidia Corporation | Personalized gaming experience |
US8416247B2 (en) | 2007-10-09 | 2013-04-09 | Sony Computer Entertaiment America Inc. | Increasing the number of advertising impressions in an interactive environment |
US8447421B2 (en) | 2008-08-19 | 2013-05-21 | Sony Computer Entertainment Inc. | Traffic-based media selection |
US8484219B2 (en) | 2010-09-21 | 2013-07-09 | Sony Computer Entertainment America Llc | Developing a knowledge base associated with a user that facilitates evolution of an intelligent user interface |
US8491392B2 (en) * | 2006-10-24 | 2013-07-23 | Igt | Gaming system and method having promotions based on player selected gaming environment preferences |
US8667519B2 (en) | 2010-11-12 | 2014-03-04 | Microsoft Corporation | Automatic passive and anonymous feedback system |
US20140128166A1 (en) * | 2011-07-22 | 2014-05-08 | Glitchsoft Corporation | Game enhancement system for gaming environment |
US8725659B2 (en) | 2010-09-21 | 2014-05-13 | Sony Computer Entertainment America Llc | Evolution of a user interface based on learned idiosyncrasies and collected data of a user |
US8986093B2 (en) | 2012-02-27 | 2015-03-24 | Igt | Gaming system and method modifying one or more options provided to a player based on the player's previously-chosen options |
US8996409B2 (en) | 2007-06-06 | 2015-03-31 | Sony Computer Entertainment Inc. | Management of online trading services using mediated communications |
US9105178B2 (en) | 2012-12-03 | 2015-08-11 | Sony Computer Entertainment Inc. | Remote dynamic configuration of telemetry reporting through regular expressions |
US9484065B2 (en) | 2010-10-15 | 2016-11-01 | Microsoft Technology Licensing, Llc | Intelligent determination of replays based on event identification |
US9674563B2 (en) | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
US20170171614A1 (en) * | 2010-06-07 | 2017-06-15 | Affectiva, Inc. | Analytics for livestreaming based on image analysis within a shared digital environment |
US10085072B2 (en) | 2009-09-23 | 2018-09-25 | Rovi Guides, Inc. | Systems and methods for automatically detecting users within detection regions of media devices |
US10950227B2 (en) | 2017-09-14 | 2021-03-16 | Kabushiki Kaisha Toshiba | Sound processing apparatus, speech recognition apparatus, sound processing method, speech recognition method, storage medium |
US11412295B2 (en) * | 2018-10-02 | 2022-08-09 | Comcast Cable Communications, Llc | Systems and methods for determining usage information |
US11887352B2 (en) | 2010-06-07 | 2024-01-30 | Affectiva, Inc. | Live streaming analytics within a shared digital environment |
Citations (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719951A (en) * | 1990-07-17 | 1998-02-17 | British Telecommunications Public Limited Company | Normalized image feature processing |
US5839099A (en) * | 1996-06-11 | 1998-11-17 | Guvolt, Inc. | Signal conditioning apparatus |
US6154559A (en) * | 1998-10-01 | 2000-11-28 | Mitsubishi Electric Information Technology Center America, Inc. (Ita) | System for classifying an individual's gaze direction |
US6219645B1 (en) * | 1999-12-02 | 2001-04-17 | Lucent Technologies, Inc. | Enhanced automatic speech recognition using multiple directional microphones |
US20020046030A1 (en) * | 2000-05-18 | 2002-04-18 | Haritsa Jayant Ramaswamy | Method and apparatus for improved call handling and service based on caller's demographic information |
US20020078204A1 (en) * | 1998-12-18 | 2002-06-20 | Dan Newell | Method and system for controlling presentation of information to a user based on the user's condition |
US20020144259A1 (en) * | 2001-03-29 | 2002-10-03 | Philips Electronics North America Corp. | Method and apparatus for controlling a media player based on user activity |
US20020184098A1 (en) * | 1999-12-17 | 2002-12-05 | Giraud Stephen G. | Interactive promotional information communicating system |
US6560511B1 (en) * | 1999-04-30 | 2003-05-06 | Sony Corporation | Electronic pet system, network system, robot, and storage medium |
US20030097659A1 (en) * | 2001-11-16 | 2003-05-22 | Goldman Phillip Y. | Interrupting the output of media content in response to an event |
US20030126013A1 (en) * | 2001-12-28 | 2003-07-03 | Shand Mark Alexander | Viewer-targeted display system and method |
US20030130035A1 (en) * | 2001-12-27 | 2003-07-10 | Amnart Kanarat | Automatic celebrity face matching and attractiveness rating machine |
US20030147624A1 (en) * | 2002-02-06 | 2003-08-07 | Koninklijke Philips Electronics N.V. | Method and apparatus for controlling a media player based on a non-user event |
US20030199316A1 (en) * | 1997-11-12 | 2003-10-23 | Kabushiki Kaisha Sega Enterprises | Game device |
US6665644B1 (en) * | 1999-08-10 | 2003-12-16 | International Business Machines Corporation | Conversational data mining |
US20040015998A1 (en) * | 2002-05-03 | 2004-01-22 | Jonathan Bokor | System and method for displaying commercials in connection with an interactive television application |
US20040193425A1 (en) * | 2002-11-12 | 2004-09-30 | Tomes Christopher B. | Marketing a business employing voice and speech recognition technology |
US20040199387A1 (en) * | 2000-07-31 | 2004-10-07 | Wang Avery Li-Chun | Method and system for purchasing pre-recorded music |
US6842510B2 (en) * | 2002-03-28 | 2005-01-11 | Fujitsu Limited | Method of and apparatus for controlling devices |
US20050045025A1 (en) * | 2003-08-25 | 2005-03-03 | Wells Robert V. | Video game system and method |
US6872139B2 (en) * | 2000-08-23 | 2005-03-29 | Nintendo Co., Ltd. | Information processing system |
US6884171B2 (en) * | 2000-09-18 | 2005-04-26 | Nintendo Co., Ltd. | Video game distribution network |
US6889383B1 (en) * | 2000-10-23 | 2005-05-03 | Clearplay, Inc. | Delivery of navigation data for playback of audio and video content |
US20060004640A1 (en) * | 1999-10-07 | 2006-01-05 | Remi Swierczek | Music identification system |
US7046139B2 (en) * | 2004-04-26 | 2006-05-16 | Matsushita Electric Industrial Co., Ltd. | Method and parental control and monitoring of usage of devices connected to home network |
US7081579B2 (en) * | 2002-10-03 | 2006-07-25 | Polyphonic Human Media Interface, S.L. | Method and system for music recommendation |
US20060206379A1 (en) * | 2005-03-14 | 2006-09-14 | Outland Research, Llc | Methods and apparatus for improving the matching of relevant advertisements with particular users over the internet |
US20070021205A1 (en) * | 2005-06-24 | 2007-01-25 | Microsoft Corporation | Voice input in a multimedia console environment |
US20070061851A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for detecting user attention |
US20070060350A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for control by audible device |
US20070061413A1 (en) * | 2005-09-15 | 2007-03-15 | Larsen Eric J | System and method for obtaining user information from voices |
US20070135187A1 (en) * | 2002-09-24 | 2007-06-14 | Kreiner Barrett M | Apparatus and method for providing hands-free operation of a device |
US7233933B2 (en) * | 2001-06-28 | 2007-06-19 | Microsoft Corporation | Methods and architecture for cross-device activity monitoring, reasoning, and visualization for providing status and forecasts of a users' presence and availability |
US20070244751A1 (en) * | 2006-04-17 | 2007-10-18 | Gary Zalewski | Using visual environment to select ads on game platform |
US20070255630A1 (en) * | 2006-04-17 | 2007-11-01 | Gary Zalewski | System and method for using user's visual environment to select advertising |
US20070261077A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Using audio/visual environment to select ads on game platform |
US20070260517A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Profile detection |
-
2006
- 2006-04-12 US US11/403,179 patent/US20070243930A1/en not_active Abandoned
Patent Citations (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719951A (en) * | 1990-07-17 | 1998-02-17 | British Telecommunications Public Limited Company | Normalized image feature processing |
US5839099A (en) * | 1996-06-11 | 1998-11-17 | Guvolt, Inc. | Signal conditioning apparatus |
US20030199316A1 (en) * | 1997-11-12 | 2003-10-23 | Kabushiki Kaisha Sega Enterprises | Game device |
US6154559A (en) * | 1998-10-01 | 2000-11-28 | Mitsubishi Electric Information Technology Center America, Inc. (Ita) | System for classifying an individual's gaze direction |
US20020078204A1 (en) * | 1998-12-18 | 2002-06-20 | Dan Newell | Method and system for controlling presentation of information to a user based on the user's condition |
US6560511B1 (en) * | 1999-04-30 | 2003-05-06 | Sony Corporation | Electronic pet system, network system, robot, and storage medium |
US6665644B1 (en) * | 1999-08-10 | 2003-12-16 | International Business Machines Corporation | Conversational data mining |
US20060004640A1 (en) * | 1999-10-07 | 2006-01-05 | Remi Swierczek | Music identification system |
US6219645B1 (en) * | 1999-12-02 | 2001-04-17 | Lucent Technologies, Inc. | Enhanced automatic speech recognition using multiple directional microphones |
US20020184098A1 (en) * | 1999-12-17 | 2002-12-05 | Giraud Stephen G. | Interactive promotional information communicating system |
US20020046030A1 (en) * | 2000-05-18 | 2002-04-18 | Haritsa Jayant Ramaswamy | Method and apparatus for improved call handling and service based on caller's demographic information |
US20040199387A1 (en) * | 2000-07-31 | 2004-10-07 | Wang Avery Li-Chun | Method and system for purchasing pre-recorded music |
US6872139B2 (en) * | 2000-08-23 | 2005-03-29 | Nintendo Co., Ltd. | Information processing system |
US6884171B2 (en) * | 2000-09-18 | 2005-04-26 | Nintendo Co., Ltd. | Video game distribution network |
US6889383B1 (en) * | 2000-10-23 | 2005-05-03 | Clearplay, Inc. | Delivery of navigation data for playback of audio and video content |
US20020144259A1 (en) * | 2001-03-29 | 2002-10-03 | Philips Electronics North America Corp. | Method and apparatus for controlling a media player based on user activity |
US7233933B2 (en) * | 2001-06-28 | 2007-06-19 | Microsoft Corporation | Methods and architecture for cross-device activity monitoring, reasoning, and visualization for providing status and forecasts of a users' presence and availability |
US20030097659A1 (en) * | 2001-11-16 | 2003-05-22 | Goldman Phillip Y. | Interrupting the output of media content in response to an event |
US20030130035A1 (en) * | 2001-12-27 | 2003-07-10 | Amnart Kanarat | Automatic celebrity face matching and attractiveness rating machine |
US20030126013A1 (en) * | 2001-12-28 | 2003-07-03 | Shand Mark Alexander | Viewer-targeted display system and method |
US20030147624A1 (en) * | 2002-02-06 | 2003-08-07 | Koninklijke Philips Electronics N.V. | Method and apparatus for controlling a media player based on a non-user event |
US6842510B2 (en) * | 2002-03-28 | 2005-01-11 | Fujitsu Limited | Method of and apparatus for controlling devices |
US20040015998A1 (en) * | 2002-05-03 | 2004-01-22 | Jonathan Bokor | System and method for displaying commercials in connection with an interactive television application |
US20070135187A1 (en) * | 2002-09-24 | 2007-06-14 | Kreiner Barrett M | Apparatus and method for providing hands-free operation of a device |
US7081579B2 (en) * | 2002-10-03 | 2006-07-25 | Polyphonic Human Media Interface, S.L. | Method and system for music recommendation |
US20040193425A1 (en) * | 2002-11-12 | 2004-09-30 | Tomes Christopher B. | Marketing a business employing voice and speech recognition technology |
US20050045025A1 (en) * | 2003-08-25 | 2005-03-03 | Wells Robert V. | Video game system and method |
US7046139B2 (en) * | 2004-04-26 | 2006-05-16 | Matsushita Electric Industrial Co., Ltd. | Method and parental control and monitoring of usage of devices connected to home network |
US20060206379A1 (en) * | 2005-03-14 | 2006-09-14 | Outland Research, Llc | Methods and apparatus for improving the matching of relevant advertisements with particular users over the internet |
US20070021205A1 (en) * | 2005-06-24 | 2007-01-25 | Microsoft Corporation | Voice input in a multimedia console environment |
US20070061851A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for detecting user attention |
US20070060350A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for control by audible device |
US20070061413A1 (en) * | 2005-09-15 | 2007-03-15 | Larsen Eric J | System and method for obtaining user information from voices |
US20070244751A1 (en) * | 2006-04-17 | 2007-10-18 | Gary Zalewski | Using visual environment to select ads on game platform |
US20070255630A1 (en) * | 2006-04-17 | 2007-11-01 | Gary Zalewski | System and method for using user's visual environment to select advertising |
US20070261077A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Using audio/visual environment to select ads on game platform |
US20070260517A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Profile detection |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10076705B2 (en) | 2005-09-15 | 2018-09-18 | Sony Interactive Entertainment Inc. | System and method for detecting user attention |
US20070061851A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for detecting user attention |
US20070061413A1 (en) * | 2005-09-15 | 2007-03-15 | Larsen Eric J | System and method for obtaining user information from voices |
US8616973B2 (en) | 2005-09-15 | 2013-12-31 | Sony Computer Entertainment Inc. | System and method for control by audible device |
US20070060350A1 (en) * | 2005-09-15 | 2007-03-15 | Sony Computer Entertainment Inc. | System and method for control by audible device |
US8645985B2 (en) | 2005-09-15 | 2014-02-04 | Sony Computer Entertainment Inc. | System and method for detecting user attention |
US20070244751A1 (en) * | 2006-04-17 | 2007-10-18 | Gary Zalewski | Using visual environment to select ads on game platform |
US20070255630A1 (en) * | 2006-04-17 | 2007-11-01 | Gary Zalewski | System and method for using user's visual environment to select advertising |
US20070261077A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Using audio/visual environment to select ads on game platform |
US20070260517A1 (en) * | 2006-05-08 | 2007-11-08 | Gary Zalewski | Profile detection |
US9017173B2 (en) | 2006-10-24 | 2015-04-28 | Igt | Gaming system and method having promotions based on player selected gaming environment preferences |
US8491392B2 (en) * | 2006-10-24 | 2013-07-23 | Igt | Gaming system and method having promotions based on player selected gaming environment preferences |
US8996409B2 (en) | 2007-06-06 | 2015-03-31 | Sony Computer Entertainment Inc. | Management of online trading services using mediated communications |
US20080307412A1 (en) * | 2007-06-06 | 2008-12-11 | Sony Computer Entertainment Inc. | Cached content consistency management |
US8416247B2 (en) | 2007-10-09 | 2013-04-09 | Sony Computer Entertaiment America Inc. | Increasing the number of advertising impressions in an interactive environment |
US11660529B2 (en) | 2007-10-09 | 2023-05-30 | Sony Interactive Entertainment LLC | Increasing the number of advertising impressions in an interactive environment |
US9272203B2 (en) | 2007-10-09 | 2016-03-01 | Sony Computer Entertainment America, LLC | Increasing the number of advertising impressions in an interactive environment |
US9795875B2 (en) | 2007-10-09 | 2017-10-24 | Sony Interactive Entertainment America Llc | Increasing the number of advertising impressions in an interactive environment |
US10974137B2 (en) | 2007-10-09 | 2021-04-13 | Sony Interactive Entertainment LLC | Increasing the number of advertising impressions in an interactive environment |
US10343060B2 (en) | 2007-10-09 | 2019-07-09 | Sony Interactive Entertainment LLC | Increasing the number of advertising impressions in an interactive environment |
US20090209341A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player and Control Method Thereof |
US20090209339A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player, Control Method Thereof, Gaming System Capable of Conversation with Player, and Control Method Thereof |
US20090209340A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player and Control Method Thereof |
US8290604B2 (en) | 2008-08-19 | 2012-10-16 | Sony Computer Entertainment America Llc | Audience-condition based media selection |
US20100048300A1 (en) * | 2008-08-19 | 2010-02-25 | Capio Oliver R | Audience-condition based media selection |
US8447421B2 (en) | 2008-08-19 | 2013-05-21 | Sony Computer Entertainment Inc. | Traffic-based media selection |
US10085072B2 (en) | 2009-09-23 | 2018-09-25 | Rovi Guides, Inc. | Systems and methods for automatically detecting users within detection regions of media devices |
US10631066B2 (en) | 2009-09-23 | 2020-04-21 | Rovi Guides, Inc. | Systems and method for automatically detecting users within detection regions of media devices |
US20110244946A1 (en) * | 2010-04-05 | 2011-10-06 | Nvidia Corporation | Personalized gaming experience |
US11887352B2 (en) | 2010-06-07 | 2024-01-30 | Affectiva, Inc. | Live streaming analytics within a shared digital environment |
US20170171614A1 (en) * | 2010-06-07 | 2017-06-15 | Affectiva, Inc. | Analytics for livestreaming based on image analysis within a shared digital environment |
US11056225B2 (en) * | 2010-06-07 | 2021-07-06 | Affectiva, Inc. | Analytics for livestreaming based on image analysis within a shared digital environment |
US8484219B2 (en) | 2010-09-21 | 2013-07-09 | Sony Computer Entertainment America Llc | Developing a knowledge base associated with a user that facilitates evolution of an intelligent user interface |
US8954356B2 (en) | 2010-09-21 | 2015-02-10 | Sony Computer Entertainment America Llc | Evolution of a user interface based on learned idiosyncrasies and collected data of a user |
US8725659B2 (en) | 2010-09-21 | 2014-05-13 | Sony Computer Entertainment America Llc | Evolution of a user interface based on learned idiosyncrasies and collected data of a user |
US9484065B2 (en) | 2010-10-15 | 2016-11-01 | Microsoft Technology Licensing, Llc | Intelligent determination of replays based on event identification |
US8667519B2 (en) | 2010-11-12 | 2014-03-04 | Microsoft Corporation | Automatic passive and anonymous feedback system |
US20140128166A1 (en) * | 2011-07-22 | 2014-05-08 | Glitchsoft Corporation | Game enhancement system for gaming environment |
US9852579B2 (en) | 2012-02-27 | 2017-12-26 | Igt | Gaming system and method modifying of one or more options provided to a player based on the player's previously-chosen options |
US10475283B2 (en) | 2012-02-27 | 2019-11-12 | Igt | Gaming system and method modifying of one or more options provided to a player based on the player's previously-chosen options |
US8986093B2 (en) | 2012-02-27 | 2015-03-24 | Igt | Gaming system and method modifying one or more options provided to a player based on the player's previously-chosen options |
US9105178B2 (en) | 2012-12-03 | 2015-08-11 | Sony Computer Entertainment Inc. | Remote dynamic configuration of telemetry reporting through regular expressions |
US9613147B2 (en) | 2012-12-03 | 2017-04-04 | Sony Interactive Entertainment Inc. | Collection of telemetry data by a telemetry library within a client device |
US9674563B2 (en) | 2013-11-04 | 2017-06-06 | Rovi Guides, Inc. | Systems and methods for recommending content |
US10950227B2 (en) | 2017-09-14 | 2021-03-16 | Kabushiki Kaisha Toshiba | Sound processing apparatus, speech recognition apparatus, sound processing method, speech recognition method, storage medium |
US11412295B2 (en) * | 2018-10-02 | 2022-08-09 | Comcast Cable Communications, Llc | Systems and methods for determining usage information |
US20220321954A1 (en) * | 2018-10-02 | 2022-10-06 | Comcast Cable Communications, Llc | Systems and methods for determining usage information |
US11736766B2 (en) * | 2018-10-02 | 2023-08-22 | Comcast Cable Communications, Llc | Systems and methods for determining usage information |
US20230362437A1 (en) * | 2018-10-02 | 2023-11-09 | Comcast Cable Communications, Llc | Systems and methods for determining usage information |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070243930A1 (en) | System and method for using user's audio environment to select advertising | |
US20070261077A1 (en) | Using audio/visual environment to select ads on game platform | |
US20070260517A1 (en) | Profile detection | |
US20070244751A1 (en) | Using visual environment to select ads on game platform | |
US20070255630A1 (en) | System and method for using user's visual environment to select advertising | |
US20230105041A1 (en) | Multi-media presentation system | |
US9474978B2 (en) | Internet based pictorial game system and method with advertising | |
US9536246B2 (en) | Content recommendation system, content recommendation device, and content recommendation method | |
CN109788345B (en) | Live broadcast control method and device, live broadcast equipment and readable storage medium | |
CN108064406A (en) | It is synchronous for the rhythm of the cross-fade of music audio frequency segment for multimedia | |
CN101441650A (en) | Apparatus, method and system for outputting video images | |
JP5586436B2 (en) | Lifestyle collection device, user interface device, and lifestyle collection method | |
CN105872588A (en) | Method and device for loading advertisement in video | |
JP2008107895A (en) | Virtual space providing server, virtual space providing system, and computer program | |
CN102216945B (en) | Networking with media fingerprints | |
CN113347498A (en) | Video playing method and device and computer readable storage medium | |
CN114327182B (en) | Special effect display method and device, computer storage medium and electronic equipment | |
US9839851B2 (en) | Allowing media and gaming environments to effectively interact and/or affect each other | |
CN105868238A (en) | Information processing method and device | |
JP2007328705A (en) | Method, server, and program for transmitting item data | |
WO2007120750A1 (en) | Audio/visual environment detection | |
CN114710709A (en) | Live broadcast room virtual gift recommendation method and device, storage medium and electronic equipment | |
CN110574066B (en) | Server device and recording medium | |
JP5460977B2 (en) | Method, program, and system for configuring events during logoff in virtual space without contradiction | |
Werning | Itch. io and the One-Dollar-Game: How Distribution Platforms Affect the Ontology of (Games as) a Medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SONY COMPUTER ENTERTAINMENT AMERICA INC., CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZALEWSKI, GARY;RUSSELL, RILEY;REEL/FRAME:017853/0656 Effective date: 20060605 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637 Effective date: 20160331 Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFO Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637 Effective date: 20160331 |