US20060064645A1 - Communication system and method including rich media tools - Google Patents

Communication system and method including rich media tools Download PDF

Info

Publication number
US20060064645A1
US20060064645A1 US11/192,979 US19297905A US2006064645A1 US 20060064645 A1 US20060064645 A1 US 20060064645A1 US 19297905 A US19297905 A US 19297905A US 2006064645 A1 US2006064645 A1 US 2006064645A1
Authority
US
United States
Prior art keywords
user
rich media
window
users
communication system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/192,979
Inventor
Hartmut Neven
Orang Dialameh
Charles Blanchard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vidiator Enterprises Inc
Original Assignee
Vidiator Enterprises Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vidiator Enterprises Inc filed Critical Vidiator Enterprises Inc
Priority to US11/192,979 priority Critical patent/US20060064645A1/en
Publication of US20060064645A1 publication Critical patent/US20060064645A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/157Conference systems defining a virtual conference space and using avatars or agents

Definitions

  • the present invention relates to multimedia communications, and more particularly, to a rich media communication system based on user combinations of computer graphics, video, still images, audio, and text.
  • the present invention is directed to a system, and related method, having tools for generating and presenting rich media communications.
  • the tools allow improved and lower cost rich media communications.
  • the invention may be embodied in a rich media communication system having a theater and a player.
  • the theater includes a representation associated with a person.
  • the representation provides a choice of visual presence for the person.
  • the player presents the theater at a remote location.
  • An alternative embodiment is a rich media theater controller having a theater window and a presentation control.
  • the theater window has a background presentation scene.
  • the presentation control selects a character for a presentation in the theater.
  • the character presentation may be selected from an avatar, a blue screen cutout of the character, or a plain video presentation.
  • the theater window may have a media target onto which the person may direct media, such as a video stream or audio, for display or play.
  • the visual representation may be an avatar representation that is driven by visual sensing of the person.
  • a rich media messaging directory service or an online directory may be used for locating other users capable of communicating with rich media presentations.
  • the rich media communication system may include a status window indicating rich media communications received, the user's visibility to other users, the user's availability to other users, and the user's automatic response to rich media communication messages from other users.
  • the rich media communication users may enter into user defined communities organized in hierarchical levels. Also, a theater window may be published to a rich media website.
  • the rich media communication system may include a message center having a message reader.
  • the message reader may have a text message window and a rich media presentation window.
  • the rich media window may be toggled off such that a user may first read only a text message in the text message window before requesting transmission of a rich media message for presentation in the presentation window.
  • the rich media communication system includes a server infrastructure, a content client, and a plurality of communication clients.
  • the server infrastructure provides web hosting, message hosting and communication services.
  • the content client has an authoring tool for generating a rich media communication.
  • the plurality of communicator clients display the rich media communication at remote locations using the server infrastructure.
  • FIG. 1 is an image of an application window for a communication system having rich media tools in accordance with the present invention.
  • FIG. 2 is a image of a presentation control window for display in the application window of FIG. 1 , having a variety of rich media targets and communication channels for generating a personalized rich media communication.
  • FIG. 3 is an image of a player window for presenting a personalized rich media communication.
  • FIG. 4 is an image of a file manager window of theaters for use in the rich media communication system of FIG. 1 .
  • FIG. 5 is an image of a file manager window of avatars for use in the rich media communication system of FIG. 1 .
  • FIG. 6 is an image of a file manager window of rich media files for use in the rich media communication system of FIG. 1 .
  • FIG. 7 is an image of a message center window of an inbox for use in the rich media communication system of FIG. 1 .
  • FIG. 8 is an image of a message center window of an outbox for use in the rich media communication system of FIG. 1 .
  • FIG. 9 is an image of a message reader window for presenting a personalized rich media communication provided as a message.
  • FIG. 10 is an image of an editor window for generating avatar images for use in the rich media communication system of the invention.
  • FIG. 11 is an image of a status window for use the in the rich media communication system of FIG. 1 .
  • FIG. 12 is an image of a card editor window for use in the rich media communication system of FIG. 1 .
  • FIG. 13 is an image of an address book window for use in the rich media communication system of FIG. 1 .
  • FIG. 14 is an image of a directory window for use in the rich media communication system of FIG. 1 .
  • FIG. 15 is an image of a directory window for use in the rich media communication system of FIG. 1 .
  • FIG. 16 is a block diagram of the architecture of the rich media communication system of FIG. 1 .
  • FIG. 17 is a block diagram of the architecture of a personal communicator of the system of FIG. 16 .
  • FIGS. 18A and 18B show a block flow diagram of rich media communication across a communication channel in accordance with the invention.
  • the rich media communication system of the present invention provides a user with a three-dimensional (3D) communication space or theater having rich media functions.
  • the user may be represented in the theater as a segmented video image or as an avatar.
  • the user is also able to communicate by presenting images, videos, audio files, or text within the theater.
  • the system may include tools for allowing lowered cost of animation, improved collaboration between users, presentation of episodic content, web casts, newscasts, infotainment, advertising, music clips, video conferencing, customer support, distance learning, advertising, social spaces, and interactive game shows and content.
  • the communication system may use existing Internet protocols, communication channels and bandwidth reducing techniques to allow rich media communications over limited bandwidth channels. For example, a theater may be created which has an individualized space with media targets and an image or representation of the user. The theater space is transmitted to a receiver only once.
  • the user representation may be represented by an avatar animated using low-bandwidth control signals, or alternatively, by a bandwidth reducing video cutout.
  • the rich media communication system of the invention allows each person to create his own world in which he is presented to others.
  • the person's individual creativity may provide enhanced entertainment and attention retaining value to the communications space.
  • the rich media communication system of the present invention may be embodied in an application window for a communicator shown in FIG. 1 .
  • the communicator window 10 is composed of a menu bar 12 and a non-interactive background 14 .
  • a variety of communication tools may be invoked in the application window, which tools arise as child windows on the background.
  • the communicator's application window has three global menu options: file 16 , edit 18 , and window 20 .
  • a global toolbar may be used for the application window options.
  • a previously saved session file or environment may be opened 22 , the current session may be saved 24 , or the program quit 26 .
  • Under the edit menu 18 are context sensitive cut, copy, and paste. Also, an option exists for editing user preferences.
  • Under the window menu 20 are options to open the variety of child window tools. As discussed in more detail below, the tools may include a player 28 , a controller 30 , a chat module 32 , a monitor 34 , a status window 36 , an editor 38 , a message center 40 , directories 42 , a card editor 44 , an address book 46 , preferences 48 , a block list 50 , a message reader 52 , and a message composer 54 .
  • a communication tool may be invoked and an associated window pops up on the background.
  • the player 28 , the controller 30 , the monitor 34 , the message center 40 , the address book 46 , and the chat module 32 have been invoked.
  • the individual tool windows may be positioned as desired by the user and may be placed in an overlapping format as is common to typical window applications.
  • the controller window 30 is shown in FIG. 2 .
  • the controller allows a user to control the content that is presented to other users as sessions or messages.
  • the controller window may also show the user what other users may currently view.
  • the controller window may be formatted with three buttons, 56 , 58 and 60 , that open file manager windows.
  • the three file manager windows are the theater file, the avatar file, and the media file manager windows.
  • a display region 62 that provides a working area for constructing a rich media communication session.
  • the controller may provide a visual representation of a user using four buttons, 64 , 66 , 68 and 70 , that gives the user media control of the user's appearance.
  • the buttons are radio buttons that immediately switch between available visual modes.
  • the modes include an avatar mode, a video mode, a cutout mode, or a show nothing mode. If a mode is not available in particular theater, the associated button is grayed out.
  • the controller window 30 may be organized as a theater that provides a stage on which a representation 72 of the user may be displayed and provides media targets, 74 and 76 , on which selected media from a file manager ( FIGS. 4-6 ) may be placed by the user.
  • the theater may be selected or changed by selecting a theater from the theater file menu and dropping the theater into the controller presentation window.
  • An avatar may be selected from the avatar file manager and dropped it onto the stage of the theater. In the theater, shown in FIG. 2 , the avatar mode has been selected.
  • a user may select a media file from the media file manager and drag and place it onto a media target.
  • the media may be a video, a still image, or audio file. When media is placed on a media target, it is either displayed or played in the media target.
  • Media may be presented in the targets by selecting media from the media file manager and dropping it onto a particular media target or by dropping the media onto the theater.
  • the theater places the media into the first available mediate target as designated by the theater designer. If an audio file is dropped onto the stage, the audio is directed to a speaker icon 78 and the audio file played. If the audio file is dropped onto non-audio target, the audio file is nevertheless played.
  • the media targets may be either 2-D or 3-D panes as specified by a particulars stage of the theater.
  • a special media target is the speaker icon next to the presentation the window. This media target receives and plays audio information only.
  • the user may right click the mouse over a media target to invoke a pop-up menu having the following options: open file for opening a media file for display in that particular target, or properties for display of the media.
  • the display properties may include a stretch, crop, playback rate, or show all frames.
  • the controller 30 also includes control buttons for controlling the media in the targets.
  • the particular media target is selected by clicking on the target and its properties may be controlled using the control buttons. If no immediate target is currently selected, the media controls are grayed out.
  • the controller 30 includes a camera button 86 which, when toggled, brings up a camera control user interface overlaid on top of the window.
  • the controller may also include a loudspeaker button 88 that controls the volume of the audio coming from the user's microphone.
  • the controller also includes a behavior button 90 which, when invoked, pops up a pop-up menu of all the available behaviors for a currently displayed avatar. The user may then select one of the behaviors for the avatar.
  • the pop-up menu also shows any hot keys associated with particular behaviors.
  • the controller also includes mutually exclusive radio buttons, 92 and 94 , for move/select. When the select button is selected, a mouse click on an object causes the media controls to be directed to that target. When the move button is selected, a mouse click on an object brings up a move interface on top of the object. Also, object translation and rotation may be performed using mouse clicks and or drags.
  • the controller 30 includes a recorder for savings of a user's session.
  • the recorder includes buttons, 96 , 98 and 100 , for saving the recorded session as a file, making a message out of the recorded session, or making a web page out of the recorded session.
  • the controller also includes a directory button 102 , an address book button 104 , and a friend's button 106 .
  • the monitor window 34 ( FIG. 1 ) is generally used in conjunction with the controller.
  • the monitor window is used to monitor the quality of data when the video cut out modes are selected, and the performance of the visual sensing software when the avatar mode is selected.
  • the monitor window includes three radio buttons for choosing between display of the live video coming from the user's camera, the live video associated with a blue screen cut out of the user, or the live video with sensing control points overlaid on it showing the performance of a tracker for animating the avatar.
  • the monitor window also includes a volume slider for controlling the user's volume.
  • the player window 28 is shown in FIG. 3 . Rich media presentations are delivered to a user's player for display.
  • the player includes buttons, 108 , 110 , 112 , 114 and 116 , for getting or showing a user's card, for privacy or blocking, for camera control, and a slider 118 for volume control.
  • the file manager includes three buttons, 120 , 122 and 124 , for toggling the file manager between the theater file manager 126 , the avatar file manager 128 , and the media file manager 130 .
  • the theater file manager 126 shown in FIG. 4 , displays a thumbnail associated with each theater. A theater may have more than one configuration, and these configurations are collected into one object.
  • the avatar file manager 128 is shown in FIG. 5 and the media file manager 130 is shown in FIG. 6 .
  • the user is shown an icon for every file in the current file directory which may be dropped onto media target.
  • the icons or symbols indicate whether the file is a video, still image, or audio file.
  • Media files may be dragged and dropped onto media targets in the controller window.
  • the file manager also includes cut, copy, paste and delete option under an edit menu available in the media file manager.
  • the message center window 40 is for handling rich media communication messages.
  • the messages may be either just text, text with attached rich media, or only rich media.
  • the inbox 132 of the message center is shown in FIG. 7 .
  • the inbox and outbox may be selected using two radio buttons, 134 and 136 , near the top of the message center.
  • the message center window will show what is in the user's in box, and when the out box radio button is selected, the message window shows what is in the user's outbox.
  • a new message button 138 opens a message composer window allowing the user to create a new message.
  • a reply button 140 opens the message composer window with the sender of the currently selected message in the “to” field.
  • a connect button 142 allows the user to attempt to open a live connection with the sender of a currently selected message. If the live connection is successful, the sender will appear in a new player window 28 .
  • a delete button 144 permanently deletes the currently selected message.
  • a block button 146 adds the sender of a currently selected message to a block list. The currently selected message is immediately deleted and future messages from the sender are also deleted. After a sender placed on the block list, the sender will not exist again in the inbox of the user.
  • the message list 148 is a columnar table of all the messages that the user has received. Using a mouse to click on any of the column headings sorts the message list by that heading. Double clicking the mouse on the subject of the message opens that message in a new message reader window. If a rich media attachment is included in the message, an icon will be displayed in a media icon column. Rich media sessions which have been included as an attachment and which have been downloaded will appear as an icon in a file column. Rich media sessions which have not been downloaded may be marked for downloading in a download column.
  • a triangle icon 150 associated with the words “download manager” is provided in the message center window 40 . When the download manager triangle icon is selected, associated buttons are provided for allowing the user to control downloading of rich media to a local hard disk.
  • buttons 136 , 168 , 170 and 172 are provided to play, file, delete and view messages. The other buttons of the message center performed as described above with respect to the inbox.
  • the message reader window 50 is a two-part window that allows a user to play messages.
  • the first top portion 174 of the reader indicates whom the message is from, the subject of the message, and associated message text.
  • the size of the rich media component for downloading is also shown in the message window.
  • the user may toggle the second half 176 of the reader window, which allows the user to display the rich media portion of the message.
  • the media player opens in the bottom portion of the window and the rich media starts streaming and playing in the media player window.
  • a download indicator 178 shows the progress of the rich media download.
  • An editor window 38 allows a user to create custom avatars, new theater stages, and to edit other media.
  • the editor window includes five sub or child windows. Each child window is selected using an appropriate radio button 180 at the bottom of the editor window. Each child window has its own user interface that allows the user to add the associated media, avatar, or theater.
  • the theater editor allows the user to create a custom theater. The user may change the texture mapped on parts of the theater, may bring in new objects.
  • the media editor allows the user to launch helper applications that provide editing of video, audio, video with audio, and still pictures.
  • An avatar editor window allows a user to generate an avatar that looks and appears similar to the user.
  • a wizard allows the user to select a head geometry that is similar to the head geometry of the user.
  • a new avatar is generated based on an image of the user.
  • an existing avatar may be edited to the satisfaction or the user.
  • the avatar may be animated or driven by wavelet-based facial motion capture as described in U.S. patent application Ser. No. 09/188,079 (WO 99/53443 A1), which is incorporated herein by reference.
  • the avatar window includes a wizard that leads the user through a sequence of steps for allowing the user to improve the accuracy of tracking of the avatar tracker.
  • the avatar wizard may include a tutor face that prompts the user to make a number of expressions and varying head poses. A position is taken for each image and facial features are automatically located for each face image. The user has the opportunity to manually correct the positions of the automatically located features.
  • the status window 36 displays concise information regarding the user and the user's friends who are currently online.
  • the status window shows whether the user has received new rich media messages and allows the user to select his online visibility. For example, the user may select to be visible on white and yellow pages, to current cardholders, friends, or the user may select invisibility. In addition the user may select to whom he is available. The availability may range from available to everyone, available for cardholders, available for friends, or unavailable. The user may also select how his automated call response will react to incoming calls. For example, the call response may be auto accept, caller ID, busy, or a message that the user will call right back.
  • the field also shows a user's identity or ID. The concise nature of the status window information allows the status window to reside permanently on a users desktop.
  • a user card editor window 38 is shown in FIG. 12 .
  • User cards are a convenient means for allowing the users to exchange their coordinates and parameters.
  • a user may appear under several different user IDs. For each ID, the user may provide the card to friends and other users.
  • the user's ID generally includes the user's nickname, address, phone, email, a web page URL, and any comments that the user may provide.
  • the card editor may also show thumbnail of the user in a rich media environment.
  • a white pages button 182 allows the user to be listed in the white pages.
  • a friends button 184 allows predetermined friends of the user to view whether the user is online.
  • the address book includes tabbed fields, 184 and 186 , indicating to whom the user has distributed cards and from whom the user has received cards. Several columns indicate whether the cards are associated with friends, along with the card's user ID, nickname, and the date the card was received or sent.
  • the address book has buttons for searching for nicknames or users 188 , connecting with a particular user 190 , sending messages to users 192 , sending cards to users 194 , adding users to the address book 196 , deleting users from an address book 198 , blocking users 200 , and editing the user's properties 202 .
  • a directory 42 associated with the rich media communication system is shown in FIGS. 14 and 15 .
  • the directory includes an online directory 204 associated with a hierarchal organization, a white page directory 206 , and a yellow page directory 208 .
  • the online directory 204 allows the user to roam between the hierarchal levels. The user may be in only one location at a time. Users at they location are listed by their user ID or nickname. User may leave a card in order for other users to leave a message for him after the user has left an area.
  • a button in the directory allows the user to toggle between all members a location and live members at a location. A user may directly contact a live member in the directory.
  • the hierarchal levels of the directory may be cities, neighborhoods, houses, and rooms. Cities and neighborhoods may be put in place by server staff. Houses and rooms may be built by users. Each hierarchal level has an information button. When activated, a rich media message plays describing the location. To build a house, a user clicks on a house builder button next to a neighborhood, and to build a room, a user clicks on a builder button next to a house. Rooms in houses may have bulletin boards upon which users may leave or read messages. Entering a room is similar to entering a conventional chat room. Each live member of the room or house appears as a thumbnail with his theater next to his name.
  • FIG. 16 A block diagram of an embodiment of a rich media communication system 210 of the invention is shown in FIG. 16 .
  • the system includes a rich media server 212 and a number of rich media clients 214 .
  • a user creating a rich media communication has a client that includes to a web browser 216 , a personal communicator 218 , and an authoring tool 220 .
  • the authoring tool includes a creator studio 222 that receives live input 224 and stored media 226 .
  • the live input may be from a camera, microphone, keyboard or mouse.
  • the stored media may be in the form of video, audio, still images, or 3-D models.
  • additional media may be obtained from a connection to the Internet 228 or from other consumer electronic devices 230 .
  • the server includes a web server 232 , message hosting 234 , and communication services 236 .
  • the server also includes resource information and parameters for each user allowing other users to engage in direct communication with a user based on the parameters stored on the server.
  • Clients of other users may include a personal communicator 218 having only a player window or may include the authoring tools described above.
  • a client side personal communicator 218 is shown in more detail in FIG. 17 .
  • the communicator has links to the server 212 through message terminus 238 , real time terminus 240 , and a connector 242 .
  • Media is input from the live input 224 or from the stored media 230 into the authoring tool or personal creator 222 .
  • the media is encoded into a stream as a real time format or as a message format. In the real time format, the stream is directed to the communicators of other users. In the message format, the stream is directed to a message center 244 that stores the message 246 and provides a message composer 248 and message reader 250 .
  • FIGS. 18A and 18B A flow diagram of the rich media communications data or bit stream is shown in FIGS. 18A and 18B .
  • Media is input into a multiplexer 252 which adds timestamp data and composes as a bit stream 254 after separating the data according to the data type features.
  • the data includes information on the user's representation (video cutout or avatar animation values) and the user's audio and chat text messages.
  • the multiplexer 256 composes the bit stream and provides the bit stream to either a network transmit layer 258 or an off-line message file 246 .
  • the transmitted bit stream is received by other users and a demultiplexer 260 decomposes the received bit stream into separate data streams.
  • the data streams are separated into individual media elements which are provided to render scheduler 262 .
  • the render scheduler provides the media elements to a player 28 or external renderer 264 .

Abstract

The rich media communication system of the present invention provides a user with a three-dimensional communication space or theater having rich media functions. The user may be represented in the theater as a segmented video image or as an avatar. The user is also able to communicate by presenting images, videos, audio files, or text within the theater. The system may include tools for allowing lowered cost of animation, improved collaboration between users, presentation of episodic content, web casts, newscasts, infotainment, advertising, music clips, video conferencing, customer support, distance learning, advertising, social spaces, and interactive game shows and content.

Description

    BACKGROUND OF THE INVENTION
  • The present invention relates to multimedia communications, and more particularly, to a rich media communication system based on user combinations of computer graphics, video, still images, audio, and text.
  • Communication formats have evolved from text to interactive audio-visual communications. Recent virtual reality models generally involve the creation of a shared-space world in which the persons involved in the experience each represent a character in the shared-space world. The user representations, often referred to as avatars, in general consist of video representations or of graphic representations that are animated by a mouse or keyboard. Such virtual reality models often have been limited to real-time interactive communications. Such scenarios and representations limit the creativity and expression available using rich media communication formats.
  • Accordingly, there exists a need for a system and related tools for providing rich media communications. The present invention satisfies these needs.
  • SUMMARY OF THE INVENTION
  • The present invention is directed to a system, and related method, having tools for generating and presenting rich media communications. The tools allow improved and lower cost rich media communications.
  • The invention may be embodied in a rich media communication system having a theater and a player. The theater includes a representation associated with a person. The representation provides a choice of visual presence for the person. The player presents the theater at a remote location.
  • An alternative embodiment is a rich media theater controller having a theater window and a presentation control. The theater window has a background presentation scene. The presentation control selects a character for a presentation in the theater. The character presentation may be selected from an avatar, a blue screen cutout of the character, or a plain video presentation.
  • The theater window may have a media target onto which the person may direct media, such as a video stream or audio, for display or play. The visual representation may be an avatar representation that is driven by visual sensing of the person. A rich media messaging directory service or an online directory may be used for locating other users capable of communicating with rich media presentations. The rich media communication system may include a status window indicating rich media communications received, the user's visibility to other users, the user's availability to other users, and the user's automatic response to rich media communication messages from other users. The rich media communication users may enter into user defined communities organized in hierarchical levels. Also, a theater window may be published to a rich media website.
  • The rich media communication system may include a message center having a message reader. The message reader may have a text message window and a rich media presentation window. The rich media window may be toggled off such that a user may first read only a text message in the text message window before requesting transmission of a rich media message for presentation in the presentation window.
  • In another embodiment, the rich media communication system includes a server infrastructure, a content client, and a plurality of communication clients. The server infrastructure provides web hosting, message hosting and communication services. The content client has an authoring tool for generating a rich media communication. The plurality of communicator clients display the rich media communication at remote locations using the server infrastructure.
  • Other features and advantages of the present invention should be apparent from the following description of the preferred embodiments taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is an image of an application window for a communication system having rich media tools in accordance with the present invention.
  • FIG. 2 is a image of a presentation control window for display in the application window of FIG. 1, having a variety of rich media targets and communication channels for generating a personalized rich media communication.
  • FIG. 3 is an image of a player window for presenting a personalized rich media communication.
  • FIG. 4 is an image of a file manager window of theaters for use in the rich media communication system of FIG. 1.
  • FIG. 5 is an image of a file manager window of avatars for use in the rich media communication system of FIG. 1.
  • FIG. 6 is an image of a file manager window of rich media files for use in the rich media communication system of FIG. 1.
  • FIG. 7 is an image of a message center window of an inbox for use in the rich media communication system of FIG. 1.
  • FIG. 8 is an image of a message center window of an outbox for use in the rich media communication system of FIG. 1.
  • FIG. 9 is an image of a message reader window for presenting a personalized rich media communication provided as a message.
  • FIG. 10 is an image of an editor window for generating avatar images for use in the rich media communication system of the invention.
  • FIG. 11 is an image of a status window for use the in the rich media communication system of FIG. 1.
  • FIG. 12 is an image of a card editor window for use in the rich media communication system of FIG. 1.
  • FIG. 13 is an image of an address book window for use in the rich media communication system of FIG. 1.
  • FIG. 14 is an image of a directory window for use in the rich media communication system of FIG. 1.
  • FIG. 15 is an image of a directory window for use in the rich media communication system of FIG. 1.
  • FIG. 16 is a block diagram of the architecture of the rich media communication system of FIG. 1.
  • FIG. 17 is a block diagram of the architecture of a personal communicator of the system of FIG. 16.
  • FIGS. 18A and 18B show a block flow diagram of rich media communication across a communication channel in accordance with the invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The rich media communication system of the present invention provides a user with a three-dimensional (3D) communication space or theater having rich media functions. The user may be represented in the theater as a segmented video image or as an avatar. The user is also able to communicate by presenting images, videos, audio files, or text within the theater. The system may include tools for allowing lowered cost of animation, improved collaboration between users, presentation of episodic content, web casts, newscasts, infotainment, advertising, music clips, video conferencing, customer support, distance learning, advertising, social spaces, and interactive game shows and content.
  • The communication system may use existing Internet protocols, communication channels and bandwidth reducing techniques to allow rich media communications over limited bandwidth channels. For example, a theater may be created which has an individualized space with media targets and an image or representation of the user. The theater space is transmitted to a receiver only once. The user representation may be represented by an avatar animated using low-bandwidth control signals, or alternatively, by a bandwidth reducing video cutout.
  • The rich media communication system of the invention allows each person to create his own world in which he is presented to others. The person's individual creativity may provide enhanced entertainment and attention retaining value to the communications space.
  • The rich media communication system of the present invention may be embodied in an application window for a communicator shown in FIG. 1. The communicator window 10 is composed of a menu bar 12 and a non-interactive background 14. A variety of communication tools may be invoked in the application window, which tools arise as child windows on the background. The communicator's application window has three global menu options: file 16, edit 18, and window 20. In addition to the global menu, a global toolbar may be used for the application window options.
  • Under the file menu 16, a previously saved session file or environment may be opened 22, the current session may be saved 24, or the program quit 26. Under the edit menu 18 are context sensitive cut, copy, and paste. Also, an option exists for editing user preferences. Under the window menu 20 are options to open the variety of child window tools. As discussed in more detail below, the tools may include a player 28, a controller 30, a chat module 32, a monitor 34, a status window 36, an editor 38, a message center 40, directories 42, a card editor 44, an address book 46, preferences 48, a block list 50, a message reader 52, and a message composer 54. Through the window menu option, a communication tool may be invoked and an associated window pops up on the background. As shown in FIG. 1, the player 28, the controller 30, the monitor 34, the message center 40, the address book 46, and the chat module 32 have been invoked. The individual tool windows may be positioned as desired by the user and may be placed in an overlapping format as is common to typical window applications.
  • The controller window 30 is shown in FIG. 2. The controller allows a user to control the content that is presented to other users as sessions or messages. The controller window may also show the user what other users may currently view. The controller window may be formatted with three buttons, 56, 58 and 60, that open file manager windows. The three file manager windows are the theater file, the avatar file, and the media file manager windows.
  • In the center of the controller 30 is a display region 62 that provides a working area for constructing a rich media communication session. The controller may provide a visual representation of a user using four buttons, 64, 66, 68 and 70, that gives the user media control of the user's appearance. The buttons are radio buttons that immediately switch between available visual modes. The modes include an avatar mode, a video mode, a cutout mode, or a show nothing mode. If a mode is not available in particular theater, the associated button is grayed out.
  • The controller window 30 may be organized as a theater that provides a stage on which a representation 72 of the user may be displayed and provides media targets, 74 and 76, on which selected media from a file manager (FIGS. 4-6) may be placed by the user. The theater may be selected or changed by selecting a theater from the theater file menu and dropping the theater into the controller presentation window. An avatar may be selected from the avatar file manager and dropped it onto the stage of the theater. In the theater, shown in FIG. 2, the avatar mode has been selected. A user may select a media file from the media file manager and drag and place it onto a media target. The media may be a video, a still image, or audio file. When media is placed on a media target, it is either displayed or played in the media target. Media may be presented in the targets by selecting media from the media file manager and dropping it onto a particular media target or by dropping the media onto the theater. When a media file has dropped on the theater, the theater places the media into the first available mediate target as designated by the theater designer. If an audio file is dropped onto the stage, the audio is directed to a speaker icon 78 and the audio file played. If the audio file is dropped onto non-audio target, the audio file is nevertheless played. The media targets may be either 2-D or 3-D panes as specified by a particulars stage of the theater. A special media target is the speaker icon next to the presentation the window. This media target receives and plays audio information only. The user may right click the mouse over a media target to invoke a pop-up menu having the following options: open file for opening a media file for display in that particular target, or properties for display of the media. For example, the display properties may include a stretch, crop, playback rate, or show all frames.
  • The controller 30 also includes control buttons for controlling the media in the targets. The particular media target is selected by clicking on the target and its properties may be controlled using the control buttons. If no immediate target is currently selected, the media controls are grayed out.
  • The controller 30 includes a camera button 86 which, when toggled, brings up a camera control user interface overlaid on top of the window. The controller may also include a loudspeaker button 88 that controls the volume of the audio coming from the user's microphone. The controller also includes a behavior button 90 which, when invoked, pops up a pop-up menu of all the available behaviors for a currently displayed avatar. The user may then select one of the behaviors for the avatar. The pop-up menu also shows any hot keys associated with particular behaviors. The controller also includes mutually exclusive radio buttons, 92 and 94, for move/select. When the select button is selected, a mouse click on an object causes the media controls to be directed to that target. When the move button is selected, a mouse click on an object brings up a move interface on top of the object. Also, object translation and rotation may be performed using mouse clicks and or drags.
  • The controller 30 includes a recorder for savings of a user's session. The recorder includes buttons, 96, 98 and 100, for saving the recorded session as a file, making a message out of the recorded session, or making a web page out of the recorded session. The controller also includes a directory button 102, an address book button 104, and a friend's button 106.
  • The monitor window 34 (FIG. 1) is generally used in conjunction with the controller. The monitor window is used to monitor the quality of data when the video cut out modes are selected, and the performance of the visual sensing software when the avatar mode is selected. The monitor window includes three radio buttons for choosing between display of the live video coming from the user's camera, the live video associated with a blue screen cut out of the user, or the live video with sensing control points overlaid on it showing the performance of a tracker for animating the avatar. The monitor window also includes a volume slider for controlling the user's volume.
  • The player window 28 is shown in FIG. 3. Rich media presentations are delivered to a user's player for display. The player includes buttons, 108, 110, 112, 114 and 116, for getting or showing a user's card, for privacy or blocking, for camera control, and a slider 118 for volume control.
  • The file manager includes three buttons, 120, 122 and 124, for toggling the file manager between the theater file manager 126, the avatar file manager 128, and the media file manager 130. The theater file manager 126, shown in FIG. 4, displays a thumbnail associated with each theater. A theater may have more than one configuration, and these configurations are collected into one object. The avatar file manager 128 is shown in FIG. 5 and the media file manager 130 is shown in FIG. 6. In the media file manager 130, the user is shown an icon for every file in the current file directory which may be dropped onto media target. The icons or symbols indicate whether the file is a video, still image, or audio file. Media files may be dragged and dropped onto media targets in the controller window. The file manager also includes cut, copy, paste and delete option under an edit menu available in the media file manager.
  • The message center window 40 is for handling rich media communication messages. The messages may be either just text, text with attached rich media, or only rich media. The inbox 132 of the message center is shown in FIG. 7. The inbox and outbox may be selected using two radio buttons, 134 and 136, near the top of the message center. When the inbox button is selected, the message center window will show what is in the user's in box, and when the out box radio button is selected, the message window shows what is in the user's outbox. A new message button 138 opens a message composer window allowing the user to create a new message. A reply button 140 opens the message composer window with the sender of the currently selected message in the “to” field. A connect button 142 allows the user to attempt to open a live connection with the sender of a currently selected message. If the live connection is successful, the sender will appear in a new player window 28. A delete button 144 permanently deletes the currently selected message. A block button 146 adds the sender of a currently selected message to a block list. The currently selected message is immediately deleted and future messages from the sender are also deleted. After a sender placed on the block list, the sender will not exist again in the inbox of the user.
  • The message list 148 is a columnar table of all the messages that the user has received. Using a mouse to click on any of the column headings sorts the message list by that heading. Double clicking the mouse on the subject of the message opens that message in a new message reader window. If a rich media attachment is included in the message, an icon will be displayed in a media icon column. Rich media sessions which have been included as an attachment and which have been downloaded will appear as an icon in a file column. Rich media sessions which have not been downloaded may be marked for downloading in a download column. A triangle icon 150 associated with the words “download manager” is provided in the message center window 40. When the download manager triangle icon is selected, associated buttons are provided for allowing the user to control downloading of rich media to a local hard disk. A “get attachment” button 152 allows the user to download rich media associated with the currently selected message. A “get marked attachment” 154 button allows a user to download rich media in marked messages. A “get all attachments” button 156 allows the user to download any rich media which has not been downloaded. A stop button 158 allows user to halt the download process. A downloading message indicator 160 may show how much more of a rich media component is left for downloading both as a visual indicator and as a percentage. The current download speed also may be indicated.
  • By selecting an outbox button 136 of the message center, as shown in FIG. 8, the user is provided with a list of the messages that the user has sent to other users. A send another button 162 allows the user to send a message to additional users. This button brings up a message composer with everything filled in with the selected message except the “to” field. An address button 164 allows the user to open an address book of received user cards. Buttons 166, 168, 170 and 172, are provided to play, file, delete and view messages. The other buttons of the message center performed as described above with respect to the inbox.
  • The message reader window 50 is a two-part window that allows a user to play messages. When the reader is selected or a message is selected for playing, the first top portion 174 of the reader indicates whom the message is from, the subject of the message, and associated message text. The size of the rich media component for downloading is also shown in the message window. The user may toggle the second half 176 of the reader window, which allows the user to display the rich media portion of the message. When the rich media portion 176 is selected, the media player opens in the bottom portion of the window and the rich media starts streaming and playing in the media player window. A download indicator 178 shows the progress of the rich media download.
  • An editor window 38, shown in FIG. 10, allows a user to create custom avatars, new theater stages, and to edit other media. The editor window includes five sub or child windows. Each child window is selected using an appropriate radio button 180 at the bottom of the editor window. Each child window has its own user interface that allows the user to add the associated media, avatar, or theater. The theater editor allows the user to create a custom theater. The user may change the texture mapped on parts of the theater, may bring in new objects. Alternatively, the media editor allows the user to launch helper applications that provide editing of video, audio, video with audio, and still pictures.
  • An avatar editor window allows a user to generate an avatar that looks and appears similar to the user. A wizard allows the user to select a head geometry that is similar to the head geometry of the user. A new avatar is generated based on an image of the user. Alternatively an existing avatar may be edited to the satisfaction or the user. The avatar may be animated or driven by wavelet-based facial motion capture as described in U.S. patent application Ser. No. 09/188,079 (WO 99/53443 A1), which is incorporated herein by reference.
  • The avatar window includes a wizard that leads the user through a sequence of steps for allowing the user to improve the accuracy of tracking of the avatar tracker. The avatar wizard may include a tutor face that prompts the user to make a number of expressions and varying head poses. A position is taken for each image and facial features are automatically located for each face image. The user has the opportunity to manually correct the positions of the automatically located features.
  • The status window 36, shown in FIG. 11, displays concise information regarding the user and the user's friends who are currently online. The status window shows whether the user has received new rich media messages and allows the user to select his online visibility. For example, the user may select to be visible on white and yellow pages, to current cardholders, friends, or the user may select invisibility. In addition the user may select to whom he is available. The availability may range from available to everyone, available for cardholders, available for friends, or unavailable. The user may also select how his automated call response will react to incoming calls. For example, the call response may be auto accept, caller ID, busy, or a message that the user will call right back. The field also shows a user's identity or ID. The concise nature of the status window information allows the status window to reside permanently on a users desktop.
  • A user card editor window 38 is shown in FIG. 12. User cards are a convenient means for allowing the users to exchange their coordinates and parameters. A user may appear under several different user IDs. For each ID, the user may provide the card to friends and other users. The user's ID generally includes the user's nickname, address, phone, email, a web page URL, and any comments that the user may provide. The card editor may also show thumbnail of the user in a rich media environment. A white pages button 182 allows the user to be listed in the white pages. A friends button 184 allows predetermined friends of the user to view whether the user is online.
  • An address book or card manager 46 is shown in FIG. 13. The address book includes tabbed fields, 184 and 186, indicating to whom the user has distributed cards and from whom the user has received cards. Several columns indicate whether the cards are associated with friends, along with the card's user ID, nickname, and the date the card was received or sent. The address book has buttons for searching for nicknames or users 188, connecting with a particular user 190, sending messages to users 192, sending cards to users 194, adding users to the address book 196, deleting users from an address book 198, blocking users 200, and editing the user's properties 202.
  • A directory 42 associated with the rich media communication system is shown in FIGS. 14 and 15. The directory includes an online directory 204 associated with a hierarchal organization, a white page directory 206, and a yellow page directory 208. The online directory 204 allows the user to roam between the hierarchal levels. The user may be in only one location at a time. Users at they location are listed by their user ID or nickname. User may leave a card in order for other users to leave a message for him after the user has left an area. A button in the directory allows the user to toggle between all members a location and live members at a location. A user may directly contact a live member in the directory.
  • The hierarchal levels of the directory may be cities, neighborhoods, houses, and rooms. Cities and neighborhoods may be put in place by server staff. Houses and rooms may be built by users. Each hierarchal level has an information button. When activated, a rich media message plays describing the location. To build a house, a user clicks on a house builder button next to a neighborhood, and to build a room, a user clicks on a builder button next to a house. Rooms in houses may have bulletin boards upon which users may leave or read messages. Entering a room is similar to entering a conventional chat room. Each live member of the room or house appears as a thumbnail with his theater next to his name.
  • A block diagram of an embodiment of a rich media communication system 210 of the invention is shown in FIG. 16. The system includes a rich media server 212 and a number of rich media clients 214. A user creating a rich media communication has a client that includes to a web browser 216, a personal communicator 218, and an authoring tool 220. The authoring tool includes a creator studio 222 that receives live input 224 and stored media 226. The live input may be from a camera, microphone, keyboard or mouse. The stored media may be in the form of video, audio, still images, or 3-D models. In addition, additional media may be obtained from a connection to the Internet 228 or from other consumer electronic devices 230.
  • The server includes a web server 232, message hosting 234, and communication services 236. The server also includes resource information and parameters for each user allowing other users to engage in direct communication with a user based on the parameters stored on the server.
  • Clients of other users may include a personal communicator 218 having only a player window or may include the authoring tools described above. A client side personal communicator 218 is shown in more detail in FIG. 17. The communicator has links to the server 212 through message terminus 238, real time terminus 240, and a connector 242. Media is input from the live input 224 or from the stored media 230 into the authoring tool or personal creator 222. The media is encoded into a stream as a real time format or as a message format. In the real time format, the stream is directed to the communicators of other users. In the message format, the stream is directed to a message center 244 that stores the message 246 and provides a message composer 248 and message reader 250.
  • A flow diagram of the rich media communications data or bit stream is shown in FIGS. 18A and 18B. Media is input into a multiplexer 252 which adds timestamp data and composes as a bit stream 254 after separating the data according to the data type features. The data includes information on the user's representation (video cutout or avatar animation values) and the user's audio and chat text messages. The multiplexer 256 composes the bit stream and provides the bit stream to either a network transmit layer 258 or an off-line message file 246. The transmitted bit stream is received by other users and a demultiplexer 260 decomposes the received bit stream into separate data streams. The data streams are separated into individual media elements which are provided to render scheduler 262. The render scheduler provides the media elements to a player 28 or external renderer 264.
  • Although the foregoing discloses the preferred embodiments of the present invention, it is understood that those skilled in the art may make various changes to the preferred embodiments without departing form the scope of the invention. The invention is defined only by the following claims.

Claims (22)

1-41. (canceled)
42. A rich media communication system, comprising:
a user interface having a background presentation scene with rich media targets onto which a user can direct rich media content, and having selectable graphical representations associated with the user;
a server to provide the user interface, having the rich media content and a selected graphical representation of the user therein, at a remote location; and
a directory to locate users that are capable of communicating with each other via their respective user interfaces using rich media presentations of rich media content in conjunction with their respective selected graphical representation, wherein users are organized into user-defined groups in the directory.
43. A rich media communication system as defined in claim 42 wherein the rich media content includes a video stream that can be placed onto a particular media target.
44. A rich media communication system as defined in claim 42 wherein the rich media content includes audio media that can be associated with a particular media target.
45. A rich media communication system as defined in claim 42 wherein the graphical representations includes a three-dimensional avatar representation that has selectable behaviors and that is driven by visual sensing of geometric features of the user.
46. A rich media communication system as defined in claim 45, further comprising a sensor to perform the visual sensing of the user using wavelet-based feature tracking.
47. A rich media communication system as defined in claim 46 wherein the sensor may be trained with varying expressions of the user.
48. A rich media communication system as defined in claim 42, further comprising an editor to allow construction of a personalized graphical representation that is based on an image of the user.
49. A rich media communication system as defined in claim 42 wherein the directory includes the user's personalized address book that includes a listing of users arranged in hierarchical levels, wherein one of the users can act as a moderator for a level and can control access to that level including blocking access by a particular user.
50. A rich media communication system as defined in claim 42 wherein the directory includes user blocking capability such that a user may block rich media communications from selected other users.
51. A rich media communication system as defined in claim 42 wherein the directory includes at least one rich media card having at least one user's rich media communication parameters, the at least one user being provided with capability to provide the card at selected one or more locations in the directory.
52. A method for rich media communications, the method comprising:
providing a communicator window that can present rich media content;
presenting a particular character in the communicator window, wherein the presentation of the particular character is user-selectable from a plurality of different graphical representations, the selected particular character corresponding to a user of the communicator window;
providing capability to switch between different graphical representations of the particular character during communication in the communicator window; and
organizing rich media communications users in a directory of groups, each user being associated with their own respective independent communicator windows that can present rich media content and respective graphical representations.
53. A method for rich media communication as defined in claim 52 wherein the providing the communicator window that can present rich media content includes providing capability to select a background presentation scene that contains a non-Earth-equivalent background.
54. A system, comprising:
means for providing an independently customizable user interface window having a representation associated with a particular rich media communication user;
means for providing a media target in the user interface window onto which the particular user may direct rich media content;
means for communicating the user interface window to a remote location; and
means for organizing rich media communications users in a directory of user-defined communities, each user being associated with their own respective independent user interface having rich media content, the communities being organizable in hierarchical levels, at least one hierarchical level being associated with a moderator for that level.
55. The system of claim 54, further comprising:
means for receiving rich media elements from a plurality of media sources and generating a multiplexed rich media communication bit stream; and
means for transmitting the bit stream to a receiver to allow the receiver to decompose the bit stream into rich media elements, and to render the rich media elements in the user interface.
56. A rich media communication system, comprising:
a first window usable to invoke a plurality of rich media communication tools, the rich media communication tools including:
a second window usable to allow a user of the first window to select a three-dimensional avatar representation associated with the user and further usable to allow the user to control presentation of the selected avatar representation and of rich media content to other rich media communications users;
a third window usable to present rich media content associated with the other rich media communications users, at least some of the other rich media communication users being associated with their own first windows that are usable to invoke rich media communication tools; and
a hierarchical directory to organize the rich media communications users into user defined groups.
57. The system of claim 56, further comprising a fourth window to present messaging information that is communicated between the user and at least one of the other rich media communications users.
58. The system of claim 56 wherein the second window is further usable to allow the user to select a non-three-dimensional representation of the user, including two-dimensional representations, textual representations, and audio representations.
59. The system of claim 56 wherein the hierarchical directory includes at least one hierarchical level that is associated with a moderator for that level.
60. An apparatus, comprising:
a user interface usable to invoke a plurality of tools, the tools including:
a first tool usable to allow a user of the user interface to select from among a plurality of graphical representations associated with the user and further usable to allow the user to control presentation of a selected graphical representation and of rich media content to other rich media communications users, the first tool further being usable to allow the user to switch between different graphical representations associated with the user during a communication session on the user interface;
a second tool usable to allow the user to create at least one of the selectable graphical representations associated with the user; and
a third tool usable to allow the user to control presentation of graphical communications from other rich media communications users that have their own user interfaces; and
a hierarchical directory to organize the rich media communications users into user defined groups.
61. The apparatus of claim 60 wherein the first tool is further usable to allow rich media content to be placed onto rich media targets on the user interface for presentation to the other rich media communication users.
62. The apparatus of claim 60 wherein the hierarchical directory includes at least one hierarchical level being associated with a moderator for that level, the moderator comprising one of the rich media communication users and having capability to control other users' access to that level, at least some of the hierarchical levels providing capability via users' user interfaces to allow users to provide at user-selected hierarchical levels a rich media card having at least one user's rich media communication parameters.
US11/192,979 2000-03-08 2005-07-29 Communication system and method including rich media tools Abandoned US20060064645A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/192,979 US20060064645A1 (en) 2000-03-08 2005-07-29 Communication system and method including rich media tools

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/520,479 US6948131B1 (en) 2000-03-08 2000-03-08 Communication system and method including rich media tools
US11/192,979 US20060064645A1 (en) 2000-03-08 2005-07-29 Communication system and method including rich media tools

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/520,479 Continuation US6948131B1 (en) 2000-03-08 2000-03-08 Communication system and method including rich media tools

Publications (1)

Publication Number Publication Date
US20060064645A1 true US20060064645A1 (en) 2006-03-23

Family

ID=24072771

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/520,479 Expired - Fee Related US6948131B1 (en) 2000-03-08 2000-03-08 Communication system and method including rich media tools
US11/192,979 Abandoned US20060064645A1 (en) 2000-03-08 2005-07-29 Communication system and method including rich media tools

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/520,479 Expired - Fee Related US6948131B1 (en) 2000-03-08 2000-03-08 Communication system and method including rich media tools

Country Status (9)

Country Link
US (2) US6948131B1 (en)
EP (1) EP1264479A2 (en)
JP (1) JP2003526292A (en)
KR (1) KR100854253B1 (en)
AU (2) AU2001241645B2 (en)
BR (1) BR0109090A (en)
CA (1) CA2402418A1 (en)
MX (1) MXPA02008729A (en)
WO (1) WO2001067759A2 (en)

Cited By (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020129089A1 (en) * 2001-02-23 2002-09-12 Vendaria, Inc. Method and system for delivering technology agnostic rich media content within an email, banner ad, and Web page
US20040119758A1 (en) * 2002-12-19 2004-06-24 Grossman Joel K. Contact controls
US20040119732A1 (en) * 2002-12-19 2004-06-24 Grossman Joel K. Contact picker
US20040122822A1 (en) * 2002-12-19 2004-06-24 Thompson J. Patrick Contact schema
US20040179038A1 (en) * 2003-03-03 2004-09-16 Blattner Patrick D. Reactive avatars
US20040221224A1 (en) * 2002-11-21 2004-11-04 Blattner Patrick D. Multiple avatar personalities
US20040228531A1 (en) * 2003-05-14 2004-11-18 Microsoft Corporation Instant messaging user interfaces
US20050182741A1 (en) * 2004-02-17 2005-08-18 Microsoft Corporation Simplifying application access to schematized contact data
US20070067315A1 (en) * 2001-01-12 2007-03-22 Vendaria, Inc., F/K/A Broadcastzone, Inc. Method and system for generating and providing rich media presentations optimized for a device over a network
US20070113181A1 (en) * 2003-03-03 2007-05-17 Blattner Patrick D Using avatars to communicate real-time information
US20070120969A1 (en) * 2005-09-15 2007-05-31 Alpha Omega International Audio visual communication system and method
US20070168863A1 (en) * 2003-03-03 2007-07-19 Aol Llc Interacting avatars in an instant messaging communication session
US20070240081A1 (en) * 2002-12-19 2007-10-11 Microsoft Corporation, Inc. Contact page
US20080046823A1 (en) * 2006-08-15 2008-02-21 Scott Anson Korbin Web-based sales transaction interface tool with dynamic personal branding and method of use
US20080066102A1 (en) * 2006-09-11 2008-03-13 Tammy Tova Abraham Techniques and Graphical User Interfaces for Review of Media Items
US7360174B2 (en) 2002-12-19 2008-04-15 Microsoft Corporation Contact user interface
US7386799B1 (en) 2002-11-21 2008-06-10 Forterra Systems, Inc. Cinematic techniques in avatar-centric communication during a multi-user online simulation
US20080168387A1 (en) * 2007-01-05 2008-07-10 Starz Entertainment, Llc User interface for a multimedia service
US7418663B2 (en) 2002-12-19 2008-08-26 Microsoft Corporation Contact picker interface
US7430719B2 (en) 2004-07-07 2008-09-30 Microsoft Corporation Contact text box
US20080306817A1 (en) * 2007-06-07 2008-12-11 Qurio Holdings, Inc. Methods and Systems of Presenting Advertisements in Consumer-Defined Environments
US7468729B1 (en) 2004-12-21 2008-12-23 Aol Llc, A Delaware Limited Liability Company Using an avatar to generate user profile information
US20090063983A1 (en) * 2007-08-27 2009-03-05 Qurio Holdings, Inc. System and method for representing content, user presence and interaction within virtual world advertising environments
US20090225075A1 (en) * 2008-03-06 2009-09-10 Bates Cary L Sharing Virtual Environments Using Multi-User Cache Data
US20090225074A1 (en) * 2008-03-06 2009-09-10 Bates Cary L Reconstruction of Virtual Environments Using Cached Data
US20100062819A1 (en) * 1999-08-30 2010-03-11 Hannigan Brett T Methods and Related Toy and Game Applications Using Encoded Information
US20100082686A1 (en) * 2008-09-25 2010-04-01 Air Products And Chemicals, Inc. Methods for storing data
US20100146419A1 (en) * 2008-12-04 2010-06-10 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US20100153869A1 (en) * 2008-12-15 2010-06-17 International Business Machines Corporation System and method to visualize activities through the use of avatars
US7779004B1 (en) 2006-02-22 2010-08-17 Qurio Holdings, Inc. Methods, systems, and products for characterizing target systems
US20100278170A1 (en) * 2007-12-26 2010-11-04 Sk Telecom Co., Ltd. Server, system and method that providing additional contents
US7840903B1 (en) 2007-02-26 2010-11-23 Qurio Holdings, Inc. Group content representations
US7849420B1 (en) 2007-02-26 2010-12-07 Qurio Holdings, Inc. Interactive content representations enabling content sharing
US20100312828A1 (en) * 2009-06-03 2010-12-09 Mobixell Networks Ltd. Server-controlled download of streaming media files
US7908554B1 (en) 2003-03-03 2011-03-15 Aol Inc. Modifying avatar behavior based on user action or mood
US7913176B1 (en) 2003-03-03 2011-03-22 Aol Inc. Applying access controls to communications with avatars
US20110167337A1 (en) * 2010-01-05 2011-07-07 Joseph Paley Auto-Trimming of Media Files
US20110225315A1 (en) * 2010-03-09 2011-09-15 Mobixell Networks Ltd. Multi-stream bit rate adaptation
US20120096371A1 (en) * 2010-08-02 2012-04-19 Be In, Inc. System and method for online interactive recording studio
US8261307B1 (en) 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US8260266B1 (en) 2007-06-26 2012-09-04 Qurio Holdings, Inc. Method and system for third-party discovery of proximity-based services
US20120246585A9 (en) * 2008-07-14 2012-09-27 Microsoft Corporation System for editing an avatar
RU2493599C2 (en) * 2007-02-02 2013-09-20 Конинклейке Филипс Электроникс Н.В. Medical video communication systems and methods
US8560387B2 (en) 2007-06-07 2013-10-15 Qurio Holdings, Inc. Systems and methods of providing collaborative consumer-controlled advertising environments
US8688074B2 (en) 2011-02-28 2014-04-01 Moisixell Networks Ltd. Service classification of web traffic
US8832709B2 (en) 2010-07-19 2014-09-09 Flash Networks Ltd. Network optimization
US9098167B1 (en) 2007-02-26 2015-08-04 Qurio Holdings, Inc. Layered visualization of content representations
US9215095B2 (en) 2002-11-21 2015-12-15 Microsoft Technology Licensing, Llc Multiple personalities
US9264649B2 (en) 2009-07-30 2016-02-16 Koninklijke Philips N.V. Medical video communication systems and methods
US9329743B2 (en) * 2006-10-04 2016-05-03 Brian Mark Shuster Computer simulation method with user-defined transportation and layout
USD764485S1 (en) * 2010-07-02 2016-08-23 Arris Enterprises, Inc. Display screen or portion thereof with graphical user interface
USD779502S1 (en) 2013-06-25 2017-02-21 Microsoft Corporation Display screen with graphical user interface
US9652809B1 (en) * 2004-12-21 2017-05-16 Aol Inc. Using user profile information to determine an avatar and/or avatar characteristics
USD807392S1 (en) 2010-07-02 2018-01-09 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
USD1015346S1 (en) * 2020-10-19 2024-02-20 Gopro, Inc. Display screen of a computing device with a graphical user interface

Families Citing this family (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4660879B2 (en) 2000-04-27 2011-03-30 ソニー株式会社 Information providing apparatus and method, and program
US20020019845A1 (en) 2000-06-16 2002-02-14 Hariton Nicholas T. Method and system for distributed scripting of presentations
US6952716B1 (en) * 2000-07-12 2005-10-04 Treehouse Solutions, Inc. Method and system for presenting data over a network based on network user choices and collecting real-time data related to said choices
KR100363952B1 (en) * 2000-08-08 2002-12-12 학교법인 인하학원 A Method for Multimedia Communication on Mobile PCs
US8932136B2 (en) * 2000-08-25 2015-01-13 Opentv, Inc. Method and system for initiating an interactive game
MXPA03002027A (en) * 2000-09-08 2005-06-30 United Virtualities Inc Computerized advertising method and system.
US20060129933A1 (en) * 2000-12-19 2006-06-15 Sparkpoint Software, Inc. System and method for multimedia authoring and playback
JP3945160B2 (en) * 2000-12-25 2007-07-18 日本電気株式会社 Information providing server, client, information providing system processing method, and recording medium recording program
NO315679B1 (en) * 2001-10-19 2003-10-06 Dmates As Rich communication over the internet
US7349000B2 (en) * 2002-04-30 2008-03-25 Tandberg Telecom As Method and system for display of video device status information
GB0220748D0 (en) * 2002-09-06 2002-10-16 Saw You Com Ltd Improved communication using avatars
JP2004135051A (en) * 2002-10-10 2004-04-30 Sony Corp Information processing system, apparatus and method for providing service, apparatus and method for processing information, recording medium, and program
JP4218336B2 (en) * 2002-12-12 2009-02-04 ソニー株式会社 Information processing system, service providing apparatus and method, information processing apparatus and method, and program
US20050015809A1 (en) * 2003-07-16 2005-01-20 Boys Donald R.M. Method and apparatus for picture sharing over cable and other consumer subscribed television networks
US7644008B1 (en) 2003-08-15 2010-01-05 Sprint Communications Company L.P. Web-based system and method for user role assignment in an enterprise
KR100834747B1 (en) * 2003-09-17 2008-06-05 삼성전자주식회사 Method And Apparatus For Providing Digital Television Viewer With Friendly User Interface Using Avatar
MXPA06003890A (en) * 2003-10-06 2006-07-03 Disney Entpr Inc System and method of playback and feature control for video players.
US20050080849A1 (en) * 2003-10-09 2005-04-14 Wee Susie J. Management system for rich media environments
US7590941B2 (en) * 2003-10-09 2009-09-15 Hewlett-Packard Development Company, L.P. Communication and collaboration system using rich media environments
US7559030B2 (en) * 2003-12-09 2009-07-07 Skyums Co. Ltd Method of providing notification service of electronic mail transfer
WO2005103874A2 (en) * 2004-04-16 2005-11-03 Cascade Basic Research Corp. Modelling relationships within an on-line connectivity universe
US9460346B2 (en) * 2004-04-19 2016-10-04 Google Inc. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US20080020837A1 (en) * 2004-05-03 2008-01-24 Alfred Thomas Presenting Media In A Gaming Device
JP4075883B2 (en) * 2004-05-12 2008-04-16 セイコーエプソン株式会社 Droplet ejection device, electro-optical device manufacturing method, and electro-optical device
US9626437B2 (en) * 2004-06-10 2017-04-18 International Business Machines Corporation Search scheduling and delivery tool for scheduling a search using a search framework profile
US20060064643A1 (en) 2004-09-14 2006-03-23 Hariton Nicholas T Distributed scripting for presentations with touch screen displays
CA2600884C (en) 2005-02-28 2017-05-02 James Monro Productions Inc. Method and apparatus for editing media
US8606950B2 (en) 2005-06-08 2013-12-10 Logitech Europe S.A. System and method for transparently processing multimedia data
KR100678206B1 (en) * 2005-07-22 2007-02-02 삼성전자주식회사 Method for displaying emotion in video telephone mode of wireless terminal
TWI275975B (en) * 2005-10-04 2007-03-11 Wistron Corp Method for integrating operating interfaces of multimedia files
WO2007066918A1 (en) * 2005-12-05 2007-06-14 Ja-Yong Koo Network system for contents collaboration on a real-time community based on items of contents and method thereof
KR100793293B1 (en) * 2005-12-05 2008-01-10 (주) 오픈유 Network System for contents collaboration on a real-time community based on items of contents and Method thereof
US8002619B2 (en) * 2006-01-05 2011-08-23 Wms Gaming Inc. Augmented reality wagering game system
US20070214106A1 (en) * 2006-03-10 2007-09-13 Johnston Julia K Iconographic-based attribute mapping system and method
US20070239839A1 (en) * 2006-04-06 2007-10-11 Buday Michael E Method for multimedia review synchronization
US7673005B2 (en) * 2006-06-27 2010-03-02 Martin Tremblay Method, apparatus, and computer-readable storage medium comprising program element for electronic mail communication
US20080183467A1 (en) * 2007-01-25 2008-07-31 Yuan Eric Zheng Methods and apparatuses for recording an audio conference
US8073475B2 (en) * 2007-02-02 2011-12-06 Disney Enterprises, Inc. Method and system for transmission and display of rich-media alerts
WO2008106196A1 (en) * 2007-03-01 2008-09-04 Sony Computer Entertainment America Inc. Virtual world avatar control, interactivity and communication interactive messaging
US20080275769A1 (en) * 2007-05-04 2008-11-06 Shao Billy Jye-En Network-based interactive entertainment center
US20080281685A1 (en) * 2007-05-07 2008-11-13 Christopher Jaffe Media with embedded advertising
US8212856B2 (en) 2007-05-15 2012-07-03 Radvision Ltd. Methods, media, and devices for providing visual resources of video conference participants
US8339418B1 (en) * 2007-06-25 2012-12-25 Pacific Arts Corporation Embedding a real time video into a virtual environment
US9177283B2 (en) * 2007-06-29 2015-11-03 Verizon Patent And Licensing Inc. System and method for providing a community portal for chat-based support services
US8146005B2 (en) * 2007-08-07 2012-03-27 International Business Machines Corporation Creating a customized avatar that reflects a user's distinguishable attributes
US20090049392A1 (en) * 2007-08-17 2009-02-19 Nokia Corporation Visual navigation
EP2203895B1 (en) 2007-09-26 2020-03-25 AQ Media, INC. Audio-visual navigation and communication dynamic memory architectures
US20090132357A1 (en) * 2007-11-19 2009-05-21 Ganz, An Ontario Partnership Consisting Of S.H. Ganz Holdings Inc. And 816877 Ontario Limited Transfer of rewards from a central website to other websites
US8088002B2 (en) * 2007-11-19 2012-01-03 Ganz Transfer of rewards between websites
US8612302B2 (en) 2007-11-19 2013-12-17 Ganz Credit swap in a virtual world
US8626819B2 (en) 2007-11-19 2014-01-07 Ganz Transfer of items between social networking websites
US8464166B2 (en) * 2008-02-11 2013-06-11 Ganz Friends list management
CA2623188C (en) * 2008-03-20 2011-02-15 Ganz, An Ontario Partnership Consisting Of 2121200 Ontario Inc. And 2121812 Ontario Inc. Social networking in a non-personalized environment
CA2623966A1 (en) * 2008-04-01 2009-01-12 Ganz, An Ontario Partnership Consisting Of 2121200 Ontario Inc. And 2121 812 Ontario Inc. Reverse product purchase in a virtual environment
US7953255B2 (en) * 2008-05-01 2011-05-31 At&T Intellectual Property I, L.P. Avatars in social interactive television
KR101594861B1 (en) * 2008-06-03 2016-02-19 삼성전자주식회사 Web server for supporting collaborative animation production service and method thereof
US8627209B2 (en) * 2008-06-10 2014-01-07 Ganz Social networking in a non-personalized environment
US9015778B2 (en) 2008-06-25 2015-04-21 AT&T Intellectual Property I. LP Apparatus and method for media on demand commentaries
US8839327B2 (en) * 2008-06-25 2014-09-16 At&T Intellectual Property Ii, Lp Method and apparatus for presenting media programs
KR20100031091A (en) * 2008-09-11 2010-03-19 (주) 오픈유 Network system for collaborating contents and method for collaborating contents
US20100070858A1 (en) * 2008-09-12 2010-03-18 At&T Intellectual Property I, L.P. Interactive Media System and Method Using Context-Based Avatar Configuration
US8225348B2 (en) 2008-09-12 2012-07-17 At&T Intellectual Property I, L.P. Moderated interactive media sessions
US9412126B2 (en) 2008-11-06 2016-08-09 At&T Intellectual Property I, Lp System and method for commercializing avatars
US8255807B2 (en) 2008-12-23 2012-08-28 Ganz Item customization and website customization
JP5527721B2 (en) * 2009-01-28 2014-06-25 任天堂株式会社 Program and information processing apparatus
JP5813912B2 (en) * 2009-01-28 2015-11-17 任天堂株式会社 Program, information processing apparatus, and information processing system
JP5229484B2 (en) 2009-01-28 2013-07-03 任天堂株式会社 Information processing system, program, and information processing apparatus
JP5690473B2 (en) * 2009-01-28 2015-03-25 任天堂株式会社 Program and information processing apparatus
US8767081B2 (en) * 2009-02-23 2014-07-01 Microsoft Corporation Sharing video data associated with the same event
US9276761B2 (en) * 2009-03-04 2016-03-01 At&T Intellectual Property I, L.P. Method and apparatus for group media consumption
US8275623B2 (en) 2009-03-06 2012-09-25 At&T Intellectual Property I, L.P. Method and apparatus for analyzing discussion regarding media programs
JP5620134B2 (en) * 2009-03-30 2014-11-05 アバイア インク. A system and method for managing trust relationships in a communication session using a graphical display.
US8788943B2 (en) * 2009-05-15 2014-07-22 Ganz Unlocking emoticons using feature codes
US20100325182A1 (en) * 2009-06-17 2010-12-23 Ganz, An Ontario Partnership Consisting Of 2121200 Ontario Inc., And 2121812 Ontario Inc. Downloadable multimedia with access codes
WO2011022841A1 (en) * 2009-08-31 2011-03-03 Ganz System and method for limiting the number of characters displayed in a common area
US8795072B2 (en) * 2009-10-13 2014-08-05 Ganz Method and system for providing a virtual presentation including a virtual companion and virtual photography
US8266652B2 (en) 2009-10-15 2012-09-11 At&T Intellectual Property I, L.P. Apparatus and method for transmitting media content
US20110093780A1 (en) * 2009-10-16 2011-04-21 Microsoft Corporation Advertising avatar
US9830605B2 (en) * 2009-10-30 2017-11-28 At&T Intellectual Property I, L.P. Apparatus and method for product marketing
US8224756B2 (en) 2009-11-05 2012-07-17 At&T Intellectual Property I, L.P. Apparatus and method for managing a social network
US8760469B2 (en) * 2009-11-06 2014-06-24 At&T Intellectual Property I, L.P. Apparatus and method for managing marketing
US9031379B2 (en) * 2009-11-10 2015-05-12 At&T Intellectual Property I, L.P. Apparatus and method for transmitting media content
US8316303B2 (en) 2009-11-10 2012-11-20 At&T Intellectual Property I, L.P. Method and apparatus for presenting media programs
US8387088B2 (en) * 2009-11-13 2013-02-26 At&T Intellectual Property I, Lp Method and apparatus for presenting media programs
US10708663B2 (en) 2009-11-13 2020-07-07 At&T Intellectual Property I, L.P. Apparatus and method for media on demand commentaries
US9100550B2 (en) 2009-11-20 2015-08-04 At&T Intellectual Property I, L.P. Apparatus and method for managing a social network
US8839306B2 (en) 2009-11-20 2014-09-16 At&T Intellectual Property I, Lp Method and apparatus for presenting media programs
US8373741B2 (en) * 2009-11-20 2013-02-12 At&T Intellectual Property I, Lp Apparatus and method for collaborative network in an enterprise setting
US9094726B2 (en) 2009-12-04 2015-07-28 At&T Intellectual Property I, Lp Apparatus and method for tagging media content and managing marketing
US8323068B2 (en) 2010-04-23 2012-12-04 Ganz Villagers in a virtual world with upgrading via codes
US8122142B1 (en) * 2010-10-12 2012-02-21 Lemi Technology, Llc Obtaining and displaying status updates for presentation during playback of a media content stream based on proximity to the point of capture
US9165285B2 (en) 2010-12-08 2015-10-20 Microsoft Technology Licensing, Llc Shared attachments
CA2767720C (en) 2011-02-10 2015-11-17 Ganz Method and system for creating a virtual world where user-controlled characters interact with non-player characters
US8937620B1 (en) 2011-04-07 2015-01-20 Google Inc. System and methods for generation and control of story animation
US10552799B2 (en) 2011-04-28 2020-02-04 Microsoft Technology Licensing, Llc Upload of attachment and insertion of link into electronic messages
US9137185B2 (en) 2011-04-28 2015-09-15 Microsoft Technology Licensing, Llc Uploading attachment to shared location and replacing with a link
US20120278402A1 (en) * 2011-04-28 2012-11-01 Microsoft Corporation Presenting links to content as attachments in electronic messages
US11308449B2 (en) 2011-04-28 2022-04-19 Microsoft Technology Licensing, Llc Storing metadata inside file to reference shared version of file
US8682989B2 (en) 2011-04-28 2014-03-25 Microsoft Corporation Making document changes by replying to electronic messages
US10185932B2 (en) 2011-05-06 2019-01-22 Microsoft Technology Licensing, Llc Setting permissions for links forwarded in electronic messages
US8721456B2 (en) 2012-02-17 2014-05-13 Ganz Incentivizing playing between websites
GB2501145A (en) * 2012-04-12 2013-10-16 Supercell Oy Rendering and modifying objects on a graphical user interface
DE102013224785A1 (en) 2013-12-03 2015-06-03 Smjl Gmbh System for interactive presentation of a presentation on a virtual stage
US10133443B2 (en) 2015-06-14 2018-11-20 Google Llc Systems and methods for smart home automation using a multifunction status and entry point icon
US9361011B1 (en) 2015-06-14 2016-06-07 Google Inc. Methods and systems for presenting multiple live video feeds in a user interface
USD803241S1 (en) 2015-06-14 2017-11-21 Google Inc. Display screen with animated graphical user interface for an alert screen
USD812076S1 (en) * 2015-06-14 2018-03-06 Google Llc Display screen with graphical user interface for monitoring remote video camera
USD882583S1 (en) 2016-07-12 2020-04-28 Google Llc Display screen with graphical user interface
US10386999B2 (en) 2016-10-26 2019-08-20 Google Llc Timeline-video relationship presentation for alert events
USD843398S1 (en) 2016-10-26 2019-03-19 Google Llc Display screen with graphical user interface for a timeline-video relationship presentation for alert events
US11238290B2 (en) 2016-10-26 2022-02-01 Google Llc Timeline-video relationship processing for alert events
AT519722B1 (en) 2017-02-27 2021-09-15 Revolutionary Tech Systems Ag Method for the detection of at least one token object
US10972685B2 (en) 2017-05-25 2021-04-06 Google Llc Video camera assembly having an IR reflector
US10352496B2 (en) 2017-05-25 2019-07-16 Google Llc Stand assembly for an electronic device providing multiple degrees of freedom and built-in cables
US10819921B2 (en) 2017-05-25 2020-10-27 Google Llc Camera assembly having a single-piece cover element
WO2019043597A1 (en) * 2017-09-04 2019-03-07 Aggarwal Abhinav Systems and methods for mixed reality interactions with avatar
CN108305636B (en) * 2017-11-06 2019-11-15 腾讯科技(深圳)有限公司 A kind of audio file processing method and processing device

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5767897A (en) * 1994-10-31 1998-06-16 Picturetel Corporation Video conferencing system
US5778222A (en) * 1994-06-27 1998-07-07 International Business Machines Corporation Method and system for managing access to objects
US5795228A (en) * 1996-07-03 1998-08-18 Ridefilm Corporation Interactive computer-based entertainment system
US5801754A (en) * 1995-11-16 1998-09-01 United Artists Theatre Circuit, Inc. Interactive theater network system
US5880731A (en) * 1995-12-14 1999-03-09 Microsoft Corporation Use of avatars with automatic gesturing and bounded interaction in on-line chat session
US5923737A (en) * 1995-08-31 1999-07-13 U.S. Philips Corporation Terminal
US5977968A (en) * 1997-03-14 1999-11-02 Mindmeld Multimedia Inc. Graphical user interface to communicate attitude or emotion to a computer program
US5999208A (en) * 1998-07-15 1999-12-07 Lucent Technologies Inc. System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room
US6020885A (en) * 1995-07-11 2000-02-01 Sony Corporation Three-dimensional virtual reality space sharing method and system using local and global object identification codes
US6157945A (en) * 1998-07-01 2000-12-05 Ricoh Company, Ltd. Digital communication device and method including a routing function
US6212547B1 (en) * 1993-10-01 2001-04-03 Collaboration Properties, Inc. UTP based video and data conferencing
US6227974B1 (en) * 1997-06-27 2001-05-08 Nds Limited Interactive game system
US6249292B1 (en) * 1998-05-04 2001-06-19 Compaq Computer Corporation Technique for controlling a presentation of a computer generated object having a plurality of movable components
US6272231B1 (en) * 1998-11-06 2001-08-07 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6330022B1 (en) * 1998-11-05 2001-12-11 Lucent Technologies Inc. Digital processing apparatus and method to support video conferencing in variable contexts
US6476830B1 (en) * 1996-08-02 2002-11-05 Fujitsu Software Corporation Virtual objects for building a community in a virtual world
US20030080989A1 (en) * 1998-01-23 2003-05-01 Koichi Matsuda Information processing apparatus, method and medium using a virtual reality space
US6580810B1 (en) * 1999-02-26 2003-06-17 Cyberlink Corp. Method of image processing using three facial feature points in three-dimensional head motion tracking
US6609147B1 (en) * 1998-01-20 2003-08-19 Sony Corporation Information processing apparatus, information processing method, and information providing medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5347306A (en) * 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
CA2180899A1 (en) 1995-07-12 1997-01-13 Yasuaki Honda Synchronous updating of sub objects in a three dimensional virtual reality space sharing system and method therefore
TW387073B (en) * 1997-03-28 2000-04-11 Ibm Computer network-Based video conferencing with messaging capability
EP1072018B1 (en) * 1998-04-13 2003-08-27 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
JP2000048224A (en) * 1998-07-31 2000-02-18 Sony Corp Device and method for information processing and provided medium
US6697869B1 (en) 1998-08-24 2004-02-24 Koninklijke Philips Electronics N.V. Emulation of streaming over the internet in a broadcast application

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6212547B1 (en) * 1993-10-01 2001-04-03 Collaboration Properties, Inc. UTP based video and data conferencing
US5778222A (en) * 1994-06-27 1998-07-07 International Business Machines Corporation Method and system for managing access to objects
US5767897A (en) * 1994-10-31 1998-06-16 Picturetel Corporation Video conferencing system
US6020885A (en) * 1995-07-11 2000-02-01 Sony Corporation Three-dimensional virtual reality space sharing method and system using local and global object identification codes
US5923737A (en) * 1995-08-31 1999-07-13 U.S. Philips Corporation Terminal
US5801754A (en) * 1995-11-16 1998-09-01 United Artists Theatre Circuit, Inc. Interactive theater network system
US5880731A (en) * 1995-12-14 1999-03-09 Microsoft Corporation Use of avatars with automatic gesturing and bounded interaction in on-line chat session
US5795228A (en) * 1996-07-03 1998-08-18 Ridefilm Corporation Interactive computer-based entertainment system
US6476830B1 (en) * 1996-08-02 2002-11-05 Fujitsu Software Corporation Virtual objects for building a community in a virtual world
US5977968A (en) * 1997-03-14 1999-11-02 Mindmeld Multimedia Inc. Graphical user interface to communicate attitude or emotion to a computer program
US6227974B1 (en) * 1997-06-27 2001-05-08 Nds Limited Interactive game system
US6609147B1 (en) * 1998-01-20 2003-08-19 Sony Corporation Information processing apparatus, information processing method, and information providing medium
US20030080989A1 (en) * 1998-01-23 2003-05-01 Koichi Matsuda Information processing apparatus, method and medium using a virtual reality space
US6249292B1 (en) * 1998-05-04 2001-06-19 Compaq Computer Corporation Technique for controlling a presentation of a computer generated object having a plurality of movable components
US6157945A (en) * 1998-07-01 2000-12-05 Ricoh Company, Ltd. Digital communication device and method including a routing function
US5999208A (en) * 1998-07-15 1999-12-07 Lucent Technologies Inc. System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room
US6330022B1 (en) * 1998-11-05 2001-12-11 Lucent Technologies Inc. Digital processing apparatus and method to support video conferencing in variable contexts
US6272231B1 (en) * 1998-11-06 2001-08-07 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6580810B1 (en) * 1999-02-26 2003-06-17 Cyberlink Corp. Method of image processing using three facial feature points in three-dimensional head motion tracking

Cited By (103)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100062819A1 (en) * 1999-08-30 2010-03-11 Hannigan Brett T Methods and Related Toy and Game Applications Using Encoded Information
US8615471B2 (en) 1999-08-30 2013-12-24 Digimarc Corporation Methods and related toy and game applications using encoded information
US8122004B2 (en) 2001-01-12 2012-02-21 Dandia Audio Kg Limited Liability Company Generating and providing rich media presentations optimized for a device over a network
US20100100636A1 (en) * 2001-01-12 2010-04-22 Kiran Venkatesh Hegde Generating and Providing Rich Media Presentations Optimized for a Device over a Network
US20070067315A1 (en) * 2001-01-12 2007-03-22 Vendaria, Inc., F/K/A Broadcastzone, Inc. Method and system for generating and providing rich media presentations optimized for a device over a network
US7818321B2 (en) * 2001-01-12 2010-10-19 Kiran Venkatesh Hegde Method and system for generating and providing rich media presentations optimized for a device over a network
US20020129089A1 (en) * 2001-02-23 2002-09-12 Vendaria, Inc. Method and system for delivering technology agnostic rich media content within an email, banner ad, and Web page
US8046672B2 (en) 2001-02-23 2011-10-25 Dandia Audio Kg Limited Liability Company Method and system for delivering technology agnostic rich media content within an email, banner ad, and web page
US20040221224A1 (en) * 2002-11-21 2004-11-04 Blattner Patrick D. Multiple avatar personalities
US10291556B2 (en) 2002-11-21 2019-05-14 Microsoft Technology Licensing, Llc Multiple personalities
US7636755B2 (en) 2002-11-21 2009-12-22 Aol Llc Multiple avatar personalities
US9807130B2 (en) 2002-11-21 2017-10-31 Microsoft Technology Licensing, Llc Multiple avatar personalities
US8250144B2 (en) 2002-11-21 2012-08-21 Blattner Patrick D Multiple avatar personalities
US7386799B1 (en) 2002-11-21 2008-06-10 Forterra Systems, Inc. Cinematic techniques in avatar-centric communication during a multi-user online simulation
US9215095B2 (en) 2002-11-21 2015-12-15 Microsoft Technology Licensing, Llc Multiple personalities
US7313760B2 (en) 2002-12-19 2007-12-25 Microsoft Corporation Contact picker
US8407600B2 (en) 2002-12-19 2013-03-26 Microsoft Corporation Contact picker interface
US7360172B2 (en) * 2002-12-19 2008-04-15 Microsoft Corporation Contact controls
US7360174B2 (en) 2002-12-19 2008-04-15 Microsoft Corporation Contact user interface
US20070240081A1 (en) * 2002-12-19 2007-10-11 Microsoft Corporation, Inc. Contact page
US7802191B2 (en) 2002-12-19 2010-09-21 Microsoft Corporation Contact picker interface
US7418663B2 (en) 2002-12-19 2008-08-26 Microsoft Corporation Contact picker interface
US7814438B2 (en) 2002-12-19 2010-10-12 Microsoft Corporation Contact page
US20080307306A1 (en) * 2002-12-19 2008-12-11 Microsoft Corporation Contact picker interface
US20110010391A1 (en) * 2002-12-19 2011-01-13 Microsoft Corporation Contact picker interface
US20040122822A1 (en) * 2002-12-19 2004-06-24 Thompson J. Patrick Contact schema
US20040119732A1 (en) * 2002-12-19 2004-06-24 Grossman Joel K. Contact picker
US20040119758A1 (en) * 2002-12-19 2004-06-24 Grossman Joel K. Contact controls
US10616367B2 (en) 2003-03-03 2020-04-07 Microsoft Technology Licensing, Llc Modifying avatar behavior based on user action or mood
US8402378B2 (en) 2003-03-03 2013-03-19 Microsoft Corporation Reactive avatars
US9256861B2 (en) 2003-03-03 2016-02-09 Microsoft Technology Licensing, Llc Modifying avatar behavior based on user action or mood
US7484176B2 (en) 2003-03-03 2009-01-27 Aol Llc, A Delaware Limited Liability Company Reactive avatars
US9483859B2 (en) 2003-03-03 2016-11-01 Microsoft Technology Licensing, Llc Reactive avatars
US7913176B1 (en) 2003-03-03 2011-03-22 Aol Inc. Applying access controls to communications with avatars
US10504266B2 (en) 2003-03-03 2019-12-10 Microsoft Technology Licensing, Llc Reactive avatars
US20040179037A1 (en) * 2003-03-03 2004-09-16 Blattner Patrick D. Using avatars to communicate context out-of-band
US20070168863A1 (en) * 2003-03-03 2007-07-19 Aol Llc Interacting avatars in an instant messaging communication session
US8627215B2 (en) 2003-03-03 2014-01-07 Microsoft Corporation Applying access controls to communications with avatars
US20070113181A1 (en) * 2003-03-03 2007-05-17 Blattner Patrick D Using avatars to communicate real-time information
US7908554B1 (en) 2003-03-03 2011-03-15 Aol Inc. Modifying avatar behavior based on user action or mood
US20040179038A1 (en) * 2003-03-03 2004-09-16 Blattner Patrick D. Reactive avatars
US20040228531A1 (en) * 2003-05-14 2004-11-18 Microsoft Corporation Instant messaging user interfaces
US7953759B2 (en) 2004-02-17 2011-05-31 Microsoft Corporation Simplifying application access to schematized contact data
US20110179367A1 (en) * 2004-02-17 2011-07-21 Microsoft Corporation Simplifying application access to schematized contact data
US8195711B2 (en) 2004-02-17 2012-06-05 Microsoft Corporation Simplifying application access to schematized contact data
US20050182741A1 (en) * 2004-02-17 2005-08-18 Microsoft Corporation Simplifying application access to schematized contact data
US7430719B2 (en) 2004-07-07 2008-09-30 Microsoft Corporation Contact text box
US7468729B1 (en) 2004-12-21 2008-12-23 Aol Llc, A Delaware Limited Liability Company Using an avatar to generate user profile information
US9652809B1 (en) * 2004-12-21 2017-05-16 Aol Inc. Using user profile information to determine an avatar and/or avatar characteristics
US20070120969A1 (en) * 2005-09-15 2007-05-31 Alpha Omega International Audio visual communication system and method
US7779004B1 (en) 2006-02-22 2010-08-17 Qurio Holdings, Inc. Methods, systems, and products for characterizing target systems
US20080046823A1 (en) * 2006-08-15 2008-02-21 Scott Anson Korbin Web-based sales transaction interface tool with dynamic personal branding and method of use
US20080066102A1 (en) * 2006-09-11 2008-03-13 Tammy Tova Abraham Techniques and Graphical User Interfaces for Review of Media Items
US8689254B2 (en) * 2006-09-11 2014-04-01 Apple Inc. Techniques and graphical user interfaces for preview of media items
US9329743B2 (en) * 2006-10-04 2016-05-03 Brian Mark Shuster Computer simulation method with user-defined transportation and layout
US8060824B2 (en) * 2007-01-05 2011-11-15 Starz Entertainment Llc User interface for a multimedia service
US20080168387A1 (en) * 2007-01-05 2008-07-10 Starz Entertainment, Llc User interface for a multimedia service
RU2493599C2 (en) * 2007-02-02 2013-09-20 Конинклейке Филипс Электроникс Н.В. Medical video communication systems and methods
US7840903B1 (en) 2007-02-26 2010-11-23 Qurio Holdings, Inc. Group content representations
US9098167B1 (en) 2007-02-26 2015-08-04 Qurio Holdings, Inc. Layered visualization of content representations
US7849420B1 (en) 2007-02-26 2010-12-07 Qurio Holdings, Inc. Interactive content representations enabling content sharing
US8560387B2 (en) 2007-06-07 2013-10-15 Qurio Holdings, Inc. Systems and methods of providing collaborative consumer-controlled advertising environments
US8600808B2 (en) 2007-06-07 2013-12-03 Qurio Holdings, Inc. Methods and systems of presenting advertisements in consumer-defined environments
US20080306817A1 (en) * 2007-06-07 2008-12-11 Qurio Holdings, Inc. Methods and Systems of Presenting Advertisements in Consumer-Defined Environments
US8260266B1 (en) 2007-06-26 2012-09-04 Qurio Holdings, Inc. Method and system for third-party discovery of proximity-based services
US20090063983A1 (en) * 2007-08-27 2009-03-05 Qurio Holdings, Inc. System and method for representing content, user presence and interaction within virtual world advertising environments
US9111285B2 (en) 2007-08-27 2015-08-18 Qurio Holdings, Inc. System and method for representing content, user presence and interaction within virtual world advertising environments
US8261307B1 (en) 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US8695044B1 (en) 2007-10-25 2014-04-08 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US8699479B2 (en) * 2007-12-26 2014-04-15 Sk Telecom Co., Ltd. Server, system and method that providing additional contents
US20100278170A1 (en) * 2007-12-26 2010-11-04 Sk Telecom Co., Ltd. Server, system and method that providing additional contents
US20090225074A1 (en) * 2008-03-06 2009-09-10 Bates Cary L Reconstruction of Virtual Environments Using Cached Data
US20090225075A1 (en) * 2008-03-06 2009-09-10 Bates Cary L Sharing Virtual Environments Using Multi-User Cache Data
US20120246585A9 (en) * 2008-07-14 2012-09-27 Microsoft Corporation System for editing an avatar
US20100082686A1 (en) * 2008-09-25 2010-04-01 Air Products And Chemicals, Inc. Methods for storing data
US8073870B2 (en) * 2008-09-25 2011-12-06 Air Products And Chemicals, Inc. Methods for storing data
US8850331B2 (en) 2008-12-04 2014-09-30 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US10937067B2 (en) 2008-12-04 2021-03-02 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US10423988B2 (en) 2008-12-04 2019-09-24 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US8458601B2 (en) 2008-12-04 2013-06-04 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US9552595B2 (en) 2008-12-04 2017-01-24 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US20100146419A1 (en) * 2008-12-04 2010-06-10 International Business Machines Corporation System and method for item inquiry and information presentation via standard communication paths
US20100153869A1 (en) * 2008-12-15 2010-06-17 International Business Machines Corporation System and method to visualize activities through the use of avatars
US9075901B2 (en) * 2008-12-15 2015-07-07 International Business Machines Corporation System and method to visualize activities through the use of avatars
US10244012B2 (en) 2008-12-15 2019-03-26 International Business Machines Corporation System and method to visualize activities through the use of avatars
US20100312828A1 (en) * 2009-06-03 2010-12-09 Mobixell Networks Ltd. Server-controlled download of streaming media files
US9264649B2 (en) 2009-07-30 2016-02-16 Koninklijke Philips N.V. Medical video communication systems and methods
US20110167337A1 (en) * 2010-01-05 2011-07-07 Joseph Paley Auto-Trimming of Media Files
US9300722B2 (en) * 2010-01-05 2016-03-29 Qualcomm Incorporated Auto-trimming of media files
US8527649B2 (en) 2010-03-09 2013-09-03 Mobixell Networks Ltd. Multi-stream bit rate adaptation
US20110225315A1 (en) * 2010-03-09 2011-09-15 Mobixell Networks Ltd. Multi-stream bit rate adaptation
USD813256S1 (en) 2010-07-02 2018-03-20 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
USD810120S1 (en) 2010-07-02 2018-02-13 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
USD801366S1 (en) 2010-07-02 2017-10-31 Arris Enterprises, Inc. Display screen or portion thereof with graphical user interface
USD813258S1 (en) 2010-07-02 2018-03-20 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
USD813257S1 (en) 2010-07-02 2018-03-20 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
USD764485S1 (en) * 2010-07-02 2016-08-23 Arris Enterprises, Inc. Display screen or portion thereof with graphical user interface
USD807392S1 (en) 2010-07-02 2018-01-09 Arris Enterprises Llc Display screen or portion thereof with graphical user interface
US8832709B2 (en) 2010-07-19 2014-09-09 Flash Networks Ltd. Network optimization
US20120096371A1 (en) * 2010-08-02 2012-04-19 Be In, Inc. System and method for online interactive recording studio
US8688074B2 (en) 2011-02-28 2014-04-01 Moisixell Networks Ltd. Service classification of web traffic
USD779502S1 (en) 2013-06-25 2017-02-21 Microsoft Corporation Display screen with graphical user interface
USD1015346S1 (en) * 2020-10-19 2024-02-20 Gopro, Inc. Display screen of a computing device with a graphical user interface

Also Published As

Publication number Publication date
KR100854253B1 (en) 2008-08-26
BR0109090A (en) 2003-06-03
WO2001067759A2 (en) 2001-09-13
KR20020089385A (en) 2002-11-29
US6948131B1 (en) 2005-09-20
CA2402418A1 (en) 2001-09-13
MXPA02008729A (en) 2004-09-06
AU2001241645B2 (en) 2006-08-10
AU4164501A (en) 2001-09-17
JP2003526292A (en) 2003-09-02
WO2001067759A3 (en) 2002-04-04
EP1264479A2 (en) 2002-12-11

Similar Documents

Publication Publication Date Title
AU2001241645B2 (en) Communication system and method including rich media tools
AU2001241645A1 (en) Communication system and method including rich media tools
US20210349604A1 (en) Shared Virtual Area Communication Environment Based Apparatus and Methods
US20180054466A1 (en) Multiple avatar personalities
US9483859B2 (en) Reactive avatars
US20110244954A1 (en) Online social media game
US20110225519A1 (en) Social media platform for simulating a live experience
CA2517909A1 (en) Using avatars to communicate
US8954862B1 (en) System and method for collaborative viewing of a four dimensional model requiring decision by the collaborators
KR100481588B1 (en) A method for manufacuturing and displaying a real type 2d video information program including a video, a audio, a caption and a message information
KR100554374B1 (en) A Method for manufacuturing and displaying a real type 2D video information program including a video, a audio, a caption and a message information, and a memory devices recorded a program for displaying thereof
US20220398002A1 (en) Editing techniques for interactive videos
GB2606131A (en) Communication platform

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION