US20130100142A1 - Interfacing with a spatial virtual communication environment - Google Patents

Interfacing with a spatial virtual communication environment Download PDF

Info

Publication number
US20130100142A1
US20130100142A1 US13/666,717 US201213666717A US2013100142A1 US 20130100142 A1 US20130100142 A1 US 20130100142A1 US 201213666717 A US201213666717 A US 201213666717A US 2013100142 A1 US2013100142 A1 US 2013100142A1
Authority
US
United States
Prior art keywords
user
virtual area
communicants
virtual
communicant
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/666,717
Other versions
US9483157B2 (en
Inventor
Matthew Leacock
David Van Wie
Paul J. Brody
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sococo Inc
Original Assignee
Social Communications Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/923,634 external-priority patent/US7844724B2/en
Priority claimed from US11/923,629 external-priority patent/US7769806B2/en
Application filed by Social Communications Co filed Critical Social Communications Co
Priority to US13/666,717 priority Critical patent/US9483157B2/en
Publication of US20130100142A1 publication Critical patent/US20130100142A1/en
Assigned to Sococo, Inc. reassignment Sococo, Inc. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SOCIAL COMMUNICATIONS COMPANY
Application granted granted Critical
Publication of US9483157B2 publication Critical patent/US9483157B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827Network arrangements for conference optimisation or adaptation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the invention features a method in accordance with which a spatial layout of zones of a virtual area in a network communication environment is displayed.
  • a user can have a respective presence in each of one or more of the zones.
  • Navigation controls and interaction controls are presented.
  • the navigation controls enable the user to specify where to establish a presence in the virtual area.
  • the interaction controls enable the user to manage interactions with one or more other communicants in the network communication environment.
  • a respective presence of the user is established in each of one or more of the zones on response to input received via the navigation controls.
  • Respective graphical representations of the communicants are depicted in each of the zones where the communicants respectively have presence.
  • the invention also features apparatus operable to implement the inventive methods described above and computer-readable media storing computer-readable instructions causing a computer to implement the inventive methods described above.
  • FIG. 1 is a diagrammatic view of an embodiment of a network communication environment that includes a first client network node, a second client network node, and a virtual environment creator.
  • FIG. 2 is a diagrammatic view of an embodiment of a network node that includes a graphical user interface presenting a depiction of a virtual area.
  • FIG. 3 is a block diagram of the network communication environment of FIG. 1 that shows components of an embodiment of a client network node.
  • FIG. 4 is a flow diagram of an embodiment of a method of interfacing a user with a spatial communication environment.
  • FIG. 5 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 6 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 7 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 8 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 9 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 10 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 11 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 12 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 13 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 14 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 15 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 16 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 17 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 18 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 19 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 20 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 21 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 22 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 23 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 24 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 25 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 26 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 27 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 28 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 29 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 30 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 31 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 32 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 33 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 34 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 35 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 36 is a diagrammatic view of an embodiment of a graphical user interface.
  • a “communicant” is a person who communicates or otherwise interacts with other persons over one or more network connections, where the communication or interaction may or may not occur in the context of a virtual area.
  • a “user” is a communicant who is operating a particular network node that defines a particular perspective for descriptive purposes.
  • a “realtime contact” of a user is a communicant or other person who has communicated with the user via a realtime communications platform.
  • a “computer” is any machine, device, or apparatus that processes data according to computer-readable instructions that are stored on a computer-readable medium either temporarily or permanently.
  • a “computer operating system” is a software component of a computer system that manages and coordinates the performance of tasks and the sharing of computing and hardware resources.
  • a “software application” (also referred to as software, an application, computer software, a computer application, a program, and a computer program) is a set of instructions that a computer can interpret and execute to perform one or more specific tasks.
  • a “computer data file” is a block of information that durably stores data for use by a software application.
  • a “database” is an organized collection of records that are presented in a standardized format that can be searched by computers.
  • a database may be stored on a single computer-readable data storage medium on a single computer or it may be distributed across multiple computer-readable data storage media on one or more computers.
  • a “data sink” (referred to herein simply as a “sink”) is any of a device (e.g., a computer), part of a device, or software that receives data.
  • a “data source” (referred to herein simply as a “source”) is any of a device (e.g., a computer), part of a device, or software that originates data.
  • a “network node” (also referred to simply as a “node”) is a junction or connection point in a communications network.
  • exemplary network nodes include, but are not limited to, a terminal, a computer, and a network switch.
  • a “server” network node is a host computer on a network that responds to requests for information or service.
  • a “client” network node is a computer on a network that requests information or service from a server.
  • a “network connection” is a link between two communicating network nodes.
  • the term “local network node” refers to a network node that currently is the primary subject of discussion.
  • the term “remote network node” refers to a network node that is connected to a local network node by a network communications link.
  • a “connection handle” is a pointer or identifier (e.g., a uniform resource identifier (URI)) that can be used to establish a network connection with a communicant, resource, or service on a network node.
  • a “network communication” can include any type of information (e.g., text, voice, audio, video, electronic mail message, data file, motion data stream, and data packet) that is transmitted or otherwise conveyed from one network node to another network node over a network connection.
  • a “communicant interaction” is any type of direct or indirect action or influence between a communicant and another network entity, which may include for example another communicant, a virtual area, or a network service.
  • Exemplary types of communicant interactions include communicants communicating with each other in realtime, a communicant entering a virtual area, and a communicant requesting access to a resource from a network service.
  • Presence refers to the ability and willingness of a networked entity (e.g., a communicant, service, or device) to communicate, where such willingness affects the ability to detect and obtain information about the state of the entity on a network and the ability to connect to the entity.
  • a networked entity e.g., a communicant, service, or device
  • a “realtime data stream” is data that is structured and processed in a continuous flow and is designed to be received with no delay or only imperceptible delay.
  • Realtime data streams include digital representations of voice, video, user movements, facial expressions and other physical phenomena, as well as data within the computing environment that may benefit from rapid transmission, rapid execution, or both rapid transmission and rapid execution, including for example, avatar movement instructions, text chat, realtime data feeds (e.g., sensor data, machine control instructions, transaction streams and stock quote information feeds), and file transfers.
  • a “virtual area” (also referred to as an “area” or a “place”) is a representation of a computer-managed space or scene.
  • Virtual areas typically are one-dimensional, two-dimensional, or three-dimensional representations; although in some embodiments a virtual area may correspond to a single point.
  • a virtual area is designed to simulate a physical, real-world space. For example, using a traditional computer monitor, a virtual area may be visualized as a two-dimensional graphic of a three-dimensional computer-generated space.
  • virtual areas do not require an associated visualization to implement switching rules.
  • a virtual area typically refers to an instance of a virtual area schema, where the schema defines the structure and contents of a virtual area in terms of variables and the instance defines the structure and contents of a virtual area in terms of values that have been resolved from a particular context.
  • a “virtual area application” (also referred to as a “virtual area specification”) is a description of a virtual area that is used in creating a virtual environment.
  • the virtual area application typically includes definitions of geometry, physics, and realtime switching rules that are associated with one or more zones of the virtual area.
  • a “virtual environment” is a representation of a computer-managed space that includes at least one virtual area and supports realtime communications between communicants.
  • a “zone” is a region of a virtual area that is associated with at least one switching rule or governance rule.
  • a “switching rule” is an instruction that specifies a connection or disconnection of one or more realtime data sources and one or more realtime data sinks subject to one or more conditions precedent.
  • a switching rule controls switching (e.g., routing, connecting, and disconnecting) of realtime data streams between network nodes communicating in the context of a virtual area.
  • a governance rule controls a communicant's access to a resource (e.g., an area, a region of an area, or the contents of that area or region), the scope of that access, and follow-on consequences of that access (e.g., a requirement that audit records relating to that access must be recorded).
  • a “renderable zone” is a zone that is associated with a respective visualization.
  • a “position” in a virtual area refers to a location of a point or an area or a volume in the virtual area.
  • a point typically is represented by a single set of one-dimensional, two-dimensional, or three-dimensional coordinates (e.g., x, y, z) that define a spot in the virtual area.
  • An area typically is represented by the three-dimensional coordinates of three or more coplanar vertices that define a boundary of a closed two-dimensional shape in the virtual area.
  • a volume typically is represented by the three-dimensional coordinates of four or more non-coplanar vertices that define a closed boundary of a three-dimensional shape in the virtual area.
  • a “spatial state” is an attribute that describes where a user has presence in a virtual area.
  • the spatial state attribute typically has a respective value (e.g., a zone_ID value) for each of the zones in which the user has presence.
  • a “placemark” is a stored reference (e.g., a hyperlink) to a location in a virtual area.
  • a placemark typically can be selected to present a view of the associated location in the virtual area to a user.
  • the verb “placemark” means the act or operation of creating a placemark.
  • an “object” is any type of discrete element in a virtual area that may be usefully treated separately from the geometry of the virtual area.
  • exemplary objects include doors, portals, windows, view screens, and speakerphone.
  • An object typically has attributes or properties that are separate and distinct from the attributes and properties of the virtual area.
  • An “avatar” is an object that represents a communicant in a virtual area.
  • double-click refers to the act or operation of entering or inputting an execution command (e.g., double-clicking the left computer mouse button or by single-clicking a user interface button associated with an execute command, e.g., enter zone or view object).
  • shift-click refers to the act or operation of entering or inputting a selection command (e.g., clicking the left computer mouse button) while the Shift key of an alphanumeric input device is activated.
  • shift-double-click refers to the act or operation of entering or inputting an execution command while the Shift key of an alphanumeric input device is activated.
  • the term “includes” means includes but not limited to, the term “including” means including but not limited to.
  • the term “based on” means based at least in part on.
  • the embodiments that are described herein provide improved systems and methods for navigating and interacting in spatial virtual communication environments. These embodiments provide an interface that includes navigation controls that enable a user to navigate virtual areas and interaction controls that enable the user to interact with other communicants in the virtual areas.
  • the navigation controls allow the user to change his or her focus (e.g., the current view of the virtual area or the current zone or zones where the user has presence) using a variety of intuitive point-and-click browsing methods in the context of a hierarchical spatial model of a virtual area.
  • the interface adaptively presents navigation controls and interaction controls that are appropriate to the user's needs in the context of the user's current focus.
  • FIG. 1 shows an embodiment of an exemplary network communications environment 10 that includes a first client network node 12 , a second client network node 14 , and a virtual environment creator 16 that are interconnected by a network 18 .
  • the first client network node 12 includes a computer-readable memory 20 , a processor 22 , and input/output (I/O) hardware 24 .
  • the processor 22 executes at least one communications application 26 that is stored in the memory 20 .
  • the second client network node 14 typically is configured in substantially the same way as the first client network node 12 .
  • the virtual environment creator 16 includes at least one server network node 28 that provides a network infrastructure service environment 30 .
  • the communications application 26 and the network infrastructure service environment 30 together provide a platform (referred to herein as “the platform”) for creating a spatial virtual communication environment (also referred to herein simply as a “virtual environment”).
  • the network infrastructure service environment 30 manages sessions of the first and second client nodes 12 , 14 in a virtual area 32 in accordance with a virtual area application 34 .
  • the virtual area application 34 is hosted by the virtual area 32 and includes a description of the virtual area 32 .
  • the communications applications 26 operating on the first and second client network nodes 12 , 14 present respective views of the virtual area 32 in accordance with data received from the network infrastructure service environment 30 and provide respective interfaces for receiving commands from the communicants.
  • the communicants typically are represented in the virtual area 32 by respective avatars, which move about the virtual area 32 in response to commands that are input by the communicants at their respective network nodes.
  • Each communicant's view of the virtual area 32 typically is presented from the perspective of the communicant's avatar, which increases the level of immersion experienced by the communicant. Each communicant typically is able to view any part of the virtual area 32 around his or her avatar.
  • the communications applications 26 establish realtime data stream connections between the first and second client network nodes 12 , 14 and other network nodes sharing the virtual area 32 based on the positions of the communicants' avatars in the virtual area 32 .
  • the network infrastructure service environment 30 also maintains a relationship database 36 that contains records 38 of interactions between communicants. Each interaction record 38 describes the context of an interaction between a pair of communicants.
  • the network 18 may include any of a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN) (e.g., the internet).
  • the network 18 typically includes a number of different computing platforms and transport facilities that support the transmission of a wide variety of different media types (e.g., text, voice, audio, and video) between network nodes.
  • the communications application 26 typically operates on a client network node that includes software and hardware resources which, together with administrative policies, user preferences (including preferences regarding the exportation of the user's presence and the connection of the user to areas and other users), and other settings, define a local configuration that influences the administration of realtime connections with other network nodes.
  • the network connections between network nodes may be arranged in a variety of different stream handling topologies, including a peer-to-peer architecture, a server-mediated architecture, and hybrid architectures that combine aspects of peer-to-peer and server-mediated architectures. Exemplary topologies of these types are described in U.S. application Ser. Nos. 11/923,629 and 11/923,634, both of which were filed on Oct. 24, 2007.
  • the network infrastructure service environment 30 typically includes one or more network infrastructure services that cooperate with the communications applications 26 in the process of establishing and administering network connections between the client nodes 12 , 14 and other network nodes (see FIG. 1 ).
  • the network infrastructure services may run on a single network node or may be distributed across multiple network nodes.
  • the network infrastructure services typically run on one or more dedicated network nodes (e.g., a server computer or a network device that performs one or more edge services, such as routing and switching). In some embodiments, however, one or more of the network infrastructure services run on at least one of the communicants' network nodes.
  • the network infrastructure services that are included in the exemplary embodiment of the network infrastructure service environment 30 are an account service, a security service, an area service, a rendezvous service, and an interaction service.
  • the account service manages communicant accounts for the virtual environment.
  • the account service also manages the creation and issuance of authentication tokens that can be used by client network nodes to authenticate themselves to any of the network infrastructure services.
  • the security service controls communicants' access to the assets and other resources of the virtual environment.
  • the access control method implemented by the security service typically is based on one or more of capabilities (where access is granted to entities having proper capabilities or permissions) and an access control list (where access is granted to entities having identities that are on the list). After a particular communicant has been granted access to a resource, that communicant typically uses the functionality provided by the other network infrastructure services to interact in the network communications environment 10 .
  • the area service administers virtual areas.
  • the area service remotely configures the communications applications 26 operating on the first and second client network nodes 12 , 14 in accordance with the virtual area application 34 subject to a set of constraints 47 (see FIG. 1 ).
  • the constraints 47 typically include controls on access to the virtual area.
  • the access controls typically are based on one or more of capabilities (where access is granted to communicants or client nodes having proper capabilities or permissions) and an access control list (where access is granted to communicants or client nodes having identities that are on the list).
  • the area service also manages network connections that are associated with the virtual area subject to the capabilities of the requesting entities, maintains global state information for the virtual area, and serves as a data server for the client network nodes participating in a shared communication session in a context defined by the virtual area 32 .
  • the global state information includes a list of all the objects that are in the virtual area and their respective locations in the virtual area.
  • the area service sends instructions that configure the client network nodes.
  • the area service also registers and transmits initialization information to other client network nodes that request to join the communication session. In this process, the area service may transmit to each joining client network node a list of components (e.g., plugins) that are needed to render the virtual area 32 on the client network node in accordance with the virtual area application 34 .
  • the area service also ensures that the client network nodes can synchronize to a global state if a communications fault occurs.
  • the area service typically manages communicant interactions with virtual areas via governance rules that are associated with the virtual areas.
  • the rendezvous service manages the collection, storage, and distribution of presence information and provides mechanisms for network nodes to communicate with one another (e.g., by managing the distribution of connection handles) subject to the capabilities of the requesting entities.
  • the rendezvous service typically stores the presence information in a presence database.
  • the rendezvous service typically manages communicant interactions with each other via communicant privacy preferences.
  • the interaction service maintains the relationship database 36 that contains the records 38 of interactions between communicants. For every interaction between communicants, one or more services of the network infrastructure service environment 30 (e.g., the area service) transmit interaction data to the interaction service. In response, the interaction service generates one or more respective interaction records and stores them in the relationship database. Each interaction record describes the context of an interaction between a pair of communicants.
  • an interaction record contains an identifier for each of the communicants, an identifier for the place of interaction (e.g., a virtual area instance), a description of the hierarchy of the interaction place (e.g., a description of how the interaction room relates to a larger area), start and end times of the interaction, and a list of all files and other data streams that are shared or recorded during the interaction.
  • the interaction service tracks when it occurred, where it occurred, and what happened during the interaction in terms of communicants involved (e.g., entering and exiting), objects that are activated/deactivated, and the files that were shared.
  • the interaction service also supports queries on the relationship database 36 subject to the capabilities of the requesting entities.
  • the interaction service presents the results of queries on the interaction database records in a sorted order (e.g., most frequent or most recent) based on virtual area.
  • the query results can be used to drive a frequency sort of contacts whom a communicant has met in which virtual areas, as well as sorts of who the communicant has met with regardless of virtual area and sorts of the virtual areas the communicant frequents most often.
  • the query results also may be used by application developers as part of a heuristic system that automates certain tasks based on relationships.
  • a heuristic of this type is a heuristic that permits communicants who have visited a particular virtual area more than five times to enter without knocking by default, or a heuristic that allows communicants who were present in an area at a particular time to modify and delete files created by another communicant who was present in the same area at the same time.
  • Queries on the relationship database 36 can be combined with other searches. For example, queries on the relationship database may be combined with queries on contact history data generated for interactions with contacts using a communication system (e.g., Skype, Facebook, and Flickr) that is outside the domain of the network infrastructure service environment 30 .
  • a communication system e.g., Skype, Facebook, and Flickr
  • the communications application 26 and the network infrastructure service environment 30 typically administer the realtime connections with network nodes in a communication context that is defined by an instance of a virtual area.
  • the virtual area instance may correspond to an abstract (non-geometric) virtual space that is defined with respect to abstract coordinates.
  • the virtual area instance may correspond to a visual virtual space that is defined with respect to one-, two- or three-dimensional geometric coordinates that are associated with a particular visualization.
  • Abstract virtual areas may or may not be associated with respective visualizations, whereas visual virtual areas are associated with respective visualizations.
  • communicants typically are represented by respective avatars in a virtual area that has an associated visualization.
  • the avatars move about the virtual area in response to commands that are input by the communicants at their respective network nodes.
  • the communicant's view of a virtual area instance typically is presented from the perspective of the communicant's avatar, and each communicant typically is able to view any part of the visual virtual area around his or her avatar, increasing the level of immersion that is experienced by the communicant.
  • FIG. 2 shows an embodiment of an exemplary network node that is implemented by a computer system 48 .
  • the computer system 48 includes a display monitor 50 , a computer mouse 52 , a keyboard 54 , speakers 56 , 58 , and a microphone 60 .
  • the display monitor 50 displays a graphical user interface 62 .
  • the graphical user interface 62 is a windows-based graphical user interface that can include multiple windows, icons, and a pointer 64 .
  • the graphical user interface 62 presents a two-dimensional depiction of a shared virtual area 66 that is associated with a three-dimensional visualization representing an art gallery.
  • Communicants are represented in the virtual area 66 by respective avatars 68 , 70 , 72 , each of which may have a respective role (e.g., a curator, an artist, and a visitor) in the context of the virtual area 66 .
  • the virtual area 66 includes zones 74 , 76 , 78 , 80 , 82 that are associated with respective rules that govern the switching of realtime data streams between the network nodes that are represented by the avatars 68 - 72 in the virtual area 66 .
  • the switching rules dictate how local connection processes executing on each of the network nodes establishes communications with the other network nodes based on the locations of the communicants' avatars 68 - 72 in the zones 74 - 82 of the virtual area 66 .
  • a virtual area is defined by a specification that includes a description of geometric elements of the virtual area and one or more rules, including switching rules and governance rules.
  • the switching rules govern realtime stream connections between the network nodes.
  • the governance rules control a communicant's access to resources, such as the virtual area itself, regions with the virtual area, and objects within the virtual area.
  • the geometric elements of the virtual area are described in accordance with the COLLADA—Digital Asset Schema Release 1.4.1 Apr.
  • the geometric elements of the virtual area typically include physical geometry and collision geometry of the virtual area.
  • the physical geometry describes the shape of the virtual area.
  • the physical geometry typically is formed from surfaces of triangles, quadrilaterals, or polygons. Colors and textures are mapped onto the physical geometry to create a more realistic appearance for the virtual area. Lighting effects may be provided, for example, by painting lights onto the visual geometry and modifying the texture, color, or intensity near the lights.
  • the collision geometry describes invisible surfaces that determine the ways in which objects can move in the virtual area.
  • the collision geometry may coincide with the visual geometry, correspond to a simpler approximation of the visual geometry, or relate to application-specific requirements of a virtual area designer.
  • the switching rules typically include a description of conditions for connecting sources and sinks of realtime data streams in terms of positions in the virtual area.
  • Each rule typically includes attributes that define the realtime data stream type to which the rule applies and the location or locations in the virtual area where the rule applies.
  • each of the rules optionally may include one or more attributes that specify a required role of the source, a required role of the sink, a priority level of the stream, and a requested stream handling topology.
  • one or more implicit or default switching rules may apply to that part of the virtual area.
  • One exemplary default switching rule is a rule that connects every source to every compatible sink within an area, subject to policy rules.
  • Policy rules may apply globally to all connections between the client nodes or only to respective connections with individual client nodes.
  • An example of a policy rule is a proximity policy rule that only allows connections of sources with compatible sinks that are associated with respective objects that are within a prescribed distance (or radius) of each other in the virtual area.
  • governance rules are associated with a virtual area to control who has access to the virtual area, who has access to its contents, what is the scope of that access to the contents of the virtual area (e.g., what can a user do with the contents), and what are the follow-on consequences of accessing those contents (e.g., record keeping, such as audit logs, and payment requirements).
  • an entire virtual area or a zone of the virtual area is associated with a “governance mesh.”
  • a governance mesh is implemented in a way that is analogous to the implementation of the zone mesh described in U.S. application Ser. Nos. 11/923,629 and 11/923,634.
  • a governance mesh enables a software application developer to associate governance rules with a virtual area or a zone of a virtual area. This avoids the need for the creation of individual permissions for every file in a virtual area and avoids the need to deal with the complexity that potentially could arise when there is a need to treat the same document differently depending on the context.
  • a virtual area is associated with a governance mesh that associates one or more zones of the virtual area with a digital rights management (DRM) function.
  • the DRM function controls access to one or more of the virtual area or one or more zones within the virtual area or objects within the virtual area.
  • the DRM function is triggered every time a communicant crosses a governance mesh boundary within the virtual area.
  • the DRM function determines whether the triggering action is permitted and, if so, what is the scope of the permitted action, whether payment is needed, and whether audit records need to be generated.
  • the associated governance mesh is configured such that if a communicant is able to enter the virtual area he or she is able to perform actions on all the documents that are associated with the virtual area, including manipulating the documents, viewing the documents, downloading the documents, deleting the documents, modifying the documents and re-uploading the documents.
  • the virtual area can become a repository for information that was shared and discussed in the context defined by the virtual area.
  • the communications application 26 includes:
  • the local HIDs enable a communicant to input commands and other signals into the client network node while participating in a virtual area communications session.
  • exemplary HIDs include a computer keyboard, a computer mouse, a touch screen display, and a microphone.
  • the audio playback devices enable a communicant to playback audio signals that are received during a virtual area communications session.
  • Exemplary audio playback devices include audio processing hardware (e.g., a sound card) for manipulating (e.g., mixing and applying special effects) audio signals, and speakers for outputting sounds.
  • the So3D engine is a three-dimensional visualization engine that controls the presentation of a respective view of a virtual area and objects in the virtual area on a display monitor.
  • the So3D engine typically interfaces with a graphical user interface driver and the HID devices to present the views of the virtual area and to allow the communicant to control the operation of the communications application 26 .
  • the So3D engine receives graphics rendering instructions from the area service.
  • the So3D engine also may read a local communicant avatar database that contains images needed for rendering the communicant's avatar in the virtual area. Based on this information, the So3D engine generates a visual representation (i.e., an image) of the virtual area and the objects in the virtual area from the point of view (position and orientation) of the communicant's avatar in the virtual area.
  • the visual representation typically is passed to the graphics rendering components of the operating system, which drive the graphics rendering hardware to render the visual representation of the virtual area on the client network node.
  • the communicant can control the presented view of the virtual area by inputting view control commands via a HID device (e.g., a computer mouse).
  • the So3D engine updates the view of the virtual area in accordance with the view control commands.
  • the So3D engine also updates the graphic representation of the virtual area on the display monitor in accordance with updated object position information received from the area service 26 .
  • the system database and storage facility stores various kinds of information that is used by the platform.
  • Exemplary information that typically is stored by the storage facility includes the presence database, the relationship database, an avatar database, a real user id (RUID) database, an art cache database, and an area application database. This information may be stored on a single network node or it may be distributed across multiple network nodes.
  • a communicant typically connects to the network 18 from a client network node.
  • the client network node typically is implemented by a general-purpose computer system or a dedicated communications computer system (or “console”, such as a network-enabled video game console).
  • the client network node executes communications processes that establish realtime data stream connections with other network nodes and typically executes visualization rendering processes that present a view of each virtual area entered by the communicant.
  • FIG. 3 shows an embodiment of a client network node that is implemented by a computer system 120 .
  • the computer system 120 includes a processing unit 122 , a system memory 124 , and a system bus 126 that couples the processing unit 122 to the various components of the computer system 120 .
  • the processing unit 122 may include one or more data processors, each of which may be in the form of any one of various commercially available computer processors.
  • the system memory 124 includes one or more computer-readable media that typically are associated with a software application addressing space that defines the addresses that are available to software applications.
  • the system memory 124 may include a read only memory (ROM) that stores a basic input/output system (BIOS) that contains start-up routines for the computer system 120 , and a random access memory (RAM).
  • ROM read only memory
  • BIOS basic input/output system
  • RAM random access memory
  • the system bus 126 may be a memory bus, a peripheral bus or a local bus, and may be compatible with any of a variety of bus protocols, including PCI, VESA, Microchannel, ISA, and EISA.
  • the computer system 120 also includes a persistent storage memory 128 (e.g., a hard drive, a floppy drive, a CD ROM drive, magnetic tape drives, flash memory devices, and digital video disks) that is connected to the system bus 126 and contains one or more computer-readable media disks that provide non-volatile or persistent storage for data, data structures and computer-executable instructions.
  • a persistent storage memory 128 e.g., a hard drive, a floppy drive, a CD ROM drive, magnetic tape drives, flash memory devices, and digital video disks
  • a communicant may interact (e.g., input commands or data) with the computer system 120 using one or more input devices 130 (e.g. one or more keyboards, computer mice, microphones, cameras, joysticks, physical motion sensors such Wii input devices, and touch pads). Information may be presented through a graphical user interface (GUI) that is presented to the communicant on a display monitor 132 , which is controlled by a display controller 134 .
  • GUI graphical user interface
  • the computer system 120 also may include other input/output hardware (e.g., peripheral output devices, such as speakers and a printer).
  • the computer system 120 connects to other network nodes through a network adapter 136 (also referred to as a “network interface card” or NIC).
  • NIC network interface card
  • a number of program modules may be stored in the system memory 124 , including application programming interfaces 138 (APIs), an operating system (OS) 140 (e.g., the Windows XP® operating system available from Microsoft Corporation of Redmond, Wash. U.S.A.), the communications application 26 , drivers 142 (e.g., a GUI driver), network transport protocols 144 , and data 146 (e.g., input data, output data, program data, a registry, and configuration settings).
  • APIs application programming interfaces 138
  • OS 140 e.g., the Windows XP® operating system available from Microsoft Corporation of Redmond, Wash. U.S.A.
  • drivers 142 e.g., a GUI driver
  • network transport protocols 144 e.g., input data, output data, program data, a registry, and configuration settings.
  • the one or more server network nodes of the virtual environment creator 16 are implemented by respective general-purpose computer systems of the same type as the client network node 120 , except that each server network node typically includes one or more server software applications.
  • the one or more server network nodes of the virtual environment creator 16 are implemented by respective network devices that perform edge services (e.g., routing and switching).
  • each of the client network nodes generates a respective set of realtime data streams (e.g., motion data streams, audio data streams, chat data streams, file transfer data streams, and video data streams).
  • each communicant manipulates one or more input devices (e.g., the computer mouse 52 and the keyboard 54 ) that generate motion data streams, which control the movement of his or her avatar in the virtual area 66 .
  • the communicant's voice and other sounds that are generated locally in the vicinity of the computer system 48 are captured by the microphone 60 .
  • the microphone 60 generates audio signals that are converted into realtime audio streams. Respective copies of the audio streams are transmitted to the other network nodes that are represented by avatars in the virtual area 66 .
  • the sounds that are generated locally at these other network nodes are converted into realtime audio signals and transmitted to the computer system 48 .
  • the computer system 48 converts the audio streams generated by the other network nodes into audio signals that are rendered by the speakers 56 , 58 .
  • the motion data streams and audio streams may be transmitted from each of the communicant nodes to the other client network nodes either directly or indirectly.
  • each of the client network nodes receives copies of the realtime data streams that are transmitted by the other client network nodes.
  • one or more of the client network nodes receives one or more stream mixes that are derived from realtime data streams that are sourced (or originated) from other ones of the network nodes.
  • the area service maintains global state information that includes a current specification of the virtual area, a current register of the objects that are in the virtual area, and a list of any stream mixes that currently are being generated by the network node hosting the area service.
  • the objects register typically includes for each object in the virtual area a respective object identifier (e.g., a label that uniquely identifies the object), a connection handle (e.g., a URI, such as an IP address) that enables a network connection to be established with a network node that is associated with the object, and interface data that identifies the realtime data sources and sinks that are associated with the object (e.g., the sources and sinks of the network node that is associated with the object).
  • a respective object identifier e.g., a label that uniquely identifies the object
  • a connection handle e.g., a URI, such as an IP address
  • the objects register also typically includes one or more optional role identifiers for each object; the role identifiers may be assigned explicitly to the objects by either the communicants or the area service, or may be inferred from other attributes of the objects or the user.
  • the objects register also includes the current position of each of the objects in the virtual area as determined by the area service from an analysis of the realtime motion data streams received from the network nodes associated with objects in the virtual area.
  • the area service receives realtime motion data streams from the network nodes associated with objects in the virtual area, tracks the communicants' avatars and other objects that enter, leave, and move around in the virtual area based on the motion data.
  • the area service updates the objects register in accordance with the current locations of the tracked objects.
  • the area service maintains for each of the client network nodes a set of configuration data, including interface data, a zone list, and the positions of the objects that currently are in the virtual area.
  • the interface data includes for each object associated with each of the client network nodes a respective list of all the sources and sinks of realtime data stream types that are associated with the object.
  • the zone list is a register of all the zones in the virtual area that currently are occupied by the avatar associated with the corresponding client network node.
  • the communications application 26 also includes a graphical navigation and interaction interface (referred to herein as a “seeker interface”) that interfaces the user with the spatial virtual communication environment.
  • the seeker interface includes navigation controls that enable the user to navigate the virtual environment and interaction controls that enable the user to control his or her interactions with other communicants in the virtual communication environment.
  • the navigation and interaction controls typically are responsive to user selections that are made using any type of input device, including a computer mouse, a touch pad, a touch screen display, a keyboard, and a video game controller.
  • the seeker interface is an application that operates on each client network node.
  • the seeker interface is a small, lightweight interface that a user can keep up and running all the time on his or her desktop.
  • the seeker interface allows the user to launch virtual area applications and provides the user with immediate access to realtime contacts and realtime collaborative places (or areas).
  • the seeker interface is integrated with realtime communications applications and/or realtime communications components of the underlying operating system such that the seeker interface can initiate and receive realtime communications with other network nodes.
  • a virtual area is integrated with the user's desktop through the seeker interface such that the user can upload files into the virtual environment created by the virtual environment creator 16 , use files stored in association with the virtual area using the native client software applications independently of the virtual environment while still present in a virtual area, and more generally treat presence and position within a virtual area as an aspect of their operating environment analogous to other operating system functions rather than just one of several applications.
  • FIG. 4 shows an embodiment of a method of interfacing the user with the spatial virtual communication environment.
  • a spatial layout of zones of a virtual area in a network communication environment is displayed on the display monitor 132 ( FIG. 4 , block 150 ).
  • a user can have a respective presence in each of one or more of the zones.
  • Each of the zones can be used to define a respective spatial state in which the user can have a presence.
  • the zones typically are associated with a respective identifier (zone_ID) and one or more rules governing one or more of the user's interactions with the virtual area and with other communicants.
  • Navigation controls and interaction controls are presented on the display monitor 132 ( FIG. 4 , block 152 ).
  • the navigation controls enable the user to specify where to establish a presence in the virtual area and the interaction controls enable the user to manage interactions with one or more other communicants in the network communication environment.
  • a respective presence of the user is established in each of one or more of the zones in response to input received via the navigation controls ( FIG. 4 , block 154 ).
  • this process involves creating for each of the zones one or more interaction database records that associate a respective zone identifier (zone_ID) with each of the communicants that have a presence in the zone.
  • Zone_ID zone identifier
  • Respective graphical representations of the communicants in each of the zones where the communicants respectively have presence are depicted on the display monitor 132 ( FIG. 4 , block 156 ).
  • the communicants typically are represented by two- or three-dimensional avatar images, which may represent the communicants pseudo-realistically (e.g., with human-like forms) or iconographically (e.g., with circular or spherical sprites or other icons).
  • the spatial virtual communication environment typically can be modeled as a spatial hierarchy of places (also referred to herein as “locations”) and objects.
  • the spatial hierarchy includes an ordered sequence of levels ranging from a top level to a bottom level.
  • Each of the places in a successive one of the levels of the spatial hierarchy is contained in a respective one of the places in a preceding one of the levels.
  • Each of the objects in the spatial hierarchy is contained in a respective one of the places.
  • the levels of the spatial hierarchy typically are associated with respective visualizations that are consistent with a geographical, architectural, or urban metaphor, and are labeled accordingly.
  • each virtual area is defined by respective meshes, some of which define elements of a physical environment (e.g., spaces, such as rooms and courtyards, that are associated with a building) that may contain objects (e.g., avatars and props, such as view screen objects and conferencing objects).
  • a physical environment e.g., spaces, such as rooms and courtyards, that are associated with a building
  • objects e.g., avatars and props, such as view screen objects and conferencing objects.
  • the navigational controls of the seeker interface allow the user to traverse a path through the virtual environment in accordance with a navigational model that is tied to the underlying spatial hierarchy of places and objects.
  • the network infrastructure service environment 30 records the path traversed by the user.
  • the network infrastructure service environment 30 records a history that includes a temporally ordered list of views of the virtual area that are presented to the user as the user navigates through the virtual area. Each view typically corresponds to a view of a respective renderable zone of the virtual area.
  • the navigation controls enable the user to move to selected ones of the zones in the history.
  • the navigation controls also include a graphical representation of a depth path that shows the location in the spatial hierarchy that corresponds to the user's current view of the virtual area.
  • the graphical representation of the depth path includes a respective user-selectable link to a respective view of each of the preceding levels in the spatial hierarchical model of the virtual area above the current view.
  • the interaction controls of the seeker interface allow the user to manage interactions with other communicants.
  • the interaction options that available to the user typically depend on the zones in which the user has a presence. In some embodiments, the interaction options that are available to communicants who have presence in a particular zone are different from the options that are available to other communicants who do not have presence in that zone.
  • the level of detail and interactivity of the user typically depend on whether or not the user has a presence the particular zone.
  • the user if the user is outside the virtual area, the user is provided with a minimal level of detail of the interactions occurring within the virtual area (e.g., the user can see an outline of the floorplan, background textures, and plants of the area, but the user cannot see where other communicants are present in the area); if the user is within the virtual area but outside a particular zone of the area, the user is provided with a medium level of detail of the interactions occurring within the particular zone (e.g., the user can see where other communicants are present in the area, see a visualization of their current states—talking, typing a chat message, whether or not their headphones and microphones are turned-on—and see whether any of the view screens are active); if the user is within the particular zone of the area, the user is provided with full level of detail of the interactions occurring with the particular zone (e.g., the user can see a thumbnail of the file being shared on a view screen, hear and speak with other communicants in the area, and see elements of a log of chat messages that
  • FIG. 5 shows an embodiment 160 of the seeker interface that is displayed in a window 162 and includes one or more tabs 164 , each of which has a browsing area 166 and a toolbar 168 .
  • Each of the tabs 164 typically is associated with a respective view of the virtual environment.
  • the view presented in the tab 164 (labeled “My Areas”) is associated with a respective set of virtual areas, which may be a default set of virtual areas in the virtual environment or it may be a set of virtual areas that is identified by a respective filter on the interaction database.
  • the tab 164 is associated with a set of three virtual areas (i.e., Acme, Sococo Help Area, and Personal Space), which may be a default set of areas that are associated with the user or may be identified by a filter that identifies all of the areas that are associated with the user (e.g., all of the areas in which the user has interacted). Additional tabs may be created by selecting the “+” button 170 .
  • the browsing area 166 of each tab shows graphic representations of the elements of the virtual environment that are associated with the tab.
  • the browsing area 166 shows top-level views 172 , 174 , 176 of the virtual areas that are associated with the tab 164 .
  • the user may navigate to the next lower level in the spatial hierarchical model of any of the virtual areas by selecting the corresponding graphic representation of the virtual area.
  • the toolbar 168 includes an adaptive set of navigational and interaction tools that automatically are selected by the seeker interface based on the current location of the user in the virtual environment.
  • the toolbar 168 includes a back button 178 , a forward button 180 , a placemarks button 182 , and a home button 184 .
  • the back button 178 corresponds to a backward control that enables the user to incrementally move backward to preceding ones of the zones in the history of the zones that were traversed by the user.
  • the forward button 180 corresponds to a forward control that enables the user to incrementally move forward to successive ones of the zones in the history of the zones that were traversed by the user.
  • the placemarks button 182 provides a placemarking control for storing links to zones and a placemark navigation control for viewing a list of links to previously placemarked zones.
  • a placemark is created by storing an image of the location shown in the current view in association with a hyperlink to the corresponding location in the virtual area.
  • a placemarks window is presented to the user.
  • the placemarks window includes live visualizations of all locations that have been placemarked by the user.
  • Each of the images in the placemarks window is associated with a respective user-selectable hyperlink.
  • a view of the virtual area corresponding to the location associated with the selected hyperlink is automatically displayed in the browsing area 166 of the seeker interface window 162 .
  • the home button 184 corresponds to a control that returns the user to a view of a designated “home” location in the virtual environment (e.g., the view shown in FIG. 5 ).
  • the platform moves the user into a default zone of the virtual area, automatically establishes a presence for the user in the default zone, and automatically establishes a network connection between the user and each of the other communicants occupying the selected zone.
  • the platform multiplexes the specified realtime data streams (e.g., streams from the microphones and speakers) of all the communicants in default zone such that they can both see each others' sprites or avatars and communicate with (e.g., speak to and hear) each other.
  • the seeker interface shows a top or floorplan view of the Acme virtual area in the browsing area 166 of the tab 164 and provides the user with a default set of interaction options.
  • a presence automatically is established in a courtyard zone 190 of the virtual area, and the user's microphone and default speakers (e.g., headphones) are turned-on.
  • the user is represented by a circular sprite 192 ; the other users in the Acme virtual area also are represented by respective circular sprites 194 - 202 .
  • the state of the user's speakers is depicted by the presence or absence of a headphones graphic 203 on the user's sprite 192 : when the speakers are on, the headphones graphic 203 is present and, when the speakers are off, the headphones graphic 203 is absent.
  • the state of the user's microphone is depicted by the presence or absence of a microphone graphic 206 on the user's sprite 192 and a series of concentric circles 204 around the user's sprite 192 : when the microphone is on, the microphone graphic 206 and the concentric circles 204 are present and, when the microphone is off, the microphone graphic 206 and the concentric circles 204 are absent.
  • the headphones graphic 203 , the concentric circles 204 , and the microphone graphic 206 serve as visual reminders of the states of the user's sound playback and microphone devices.
  • the toolbar 168 also includes a series of one or more breadcrumb buttons 207 that originate from and include the home button 184 .
  • the breadcrumb buttons 207 correspond to a hierarchical sequence of successive, user-selectable links. Each of the successive links corresponds to a view of a respective level in the hierarchical model of the virtual area in which each successive level is contained by preceding ones of the levels.
  • the breadcrumb buttons 207 include the home button 184 and an Acme button 208 that corresponds to the current view of the Acme virtual area shown in FIG. 6 .
  • the breadcrumb buttons 207 provide the user with single button selection access to respective views of different levels of the virtual environment.
  • the toolbar 168 additionally includes a button 210 and a settings button 212 .
  • the button 210 When an area is selected or in focus, the button 210 appears as an iconographic representation of two people and is labeled “members,” and allows members and moderators to see the list of people associated with an area. When an audio or chat zone is in focus, the button 210 has a different image (e.g., an image of an arrow pointing downward onto a plane to represent the operation of getting) and is labeled “get”.
  • a list of all the members of the Acme virtual area 166 is displayed in a user interface. The user may select any of the communicants in the list and click a get button that is presented in the user interface; in response, the platform transmits an invitation to the selected communicant to join the user in a designated one of the zones.
  • the settings button 212 provides the user with access to a set of controls for specifying default settings that are associated with the current area.
  • the user may navigate from the view of the Acme virtual area shown in FIG. 6 back to the view shown in FIG. 5 in a variety of different ways.
  • the user may select any of the back button 178 , the home button 184 , or any part of the zone 211 that is outside the boundary of the graphic representation of the Acme virtual area shown in FIG. 6 .
  • the user may navigate to any of the zones of the Acme virtual area.
  • the user in order to move to a zone, transmits a command to execute one of the zones displayed on the monitor, (e.g., by selecting the zone and then clicking the Enter button (in the toolbar), or, as a shortcut, double-clicking the zone) and, in response, the platform depicts the user's avatar in the zone corresponding to the zone object.
  • the seeker interface outlines the zone (indicating to the user that it is selected) and updates the breadcrumb buttons 207 to show the selected zone location in the hierarchy. Toolbar buttons specific to the selection will also appear to the right of the breadcrumb buttons 207 .
  • the user also may interact with any objects (e.g., a screen, table, or file) that are present in a zone.
  • the user transmits a command to execute one of the objects displayed on the monitor, (e.g., by selecting the object and then clicking the View button (in the toolbar), or, as a shortcut, double-clicking the object) and, in response, the platform performs an operation with respect to the object (e.g., present a zoomed-in view of the object, open an interaction interface window, etc.).
  • the seeker interface outlines or otherwise highlights the prop (indicating to the user that it is selected) and updates the breadcrumb buttons 207 to show the selected object location in the hierarchy. Toolbar buttons specific to the selection will also appear to the right of the breadcrumb buttons 207 .
  • the platform in response to the user entering a Main space 213 , the platform automatically establishes a network connection between the user and each of the other communicants occupying the selected zone.
  • the user also may enter (and thereby establish a presence in) a space by selecting the space and clicking the Enter button; this causes the platform to move the user's sprite from its current location (i.e., Courtyard) to the selected space (i.e., Main) (see FIG. 8 ).
  • the settings of user's speakers and microphone typically do not change when the user is moved from one location to another.
  • the user may navigate to a different view of the virtual area by inputting a command to execute (typically double-clicking) any part of the current view surrounding the Main space 213 .
  • a command to execute typically double-clicking
  • the seeker interface displays the zoomed-out view of the Acme virtual area that is shown in FIG. 9 .
  • the user also may navigate to a different view of the virtual area by selecting another space in the virtual area (e.g., the West Conference space 214 , the East Conference space 215 , or the Courtyard space 190 ) and by clicking Enter, by double-clicking the zone, or by selecting one of the breadcrumb buttons 207 (e.g., the Acme breadcrumb button 208 ).
  • another space in the virtual area e.g., the West Conference space 214 , the East Conference space 215 , or the Courtyard space 190
  • the breadcrumb buttons 207 e.g., the Acme breadcrumb button 208
  • navigating to a different view changes the user's presence state, whereas panning and zooming only changes the user's view state. In some cases, navigating will also change view state as a convenience to the user. The following examples illustrate this interface feature.
  • the navigation to a different view does not affect the presence of the user in the Main space 213 .
  • the toolbar 168 automatically is modified to include a leave button 216 .
  • the leave button 216 In response to a user selection of the leave button 216 , the user's presence in the Main space 213 is terminated and the user's avatar 192 is removed from the Main space 213 , as shown in FIG. 9 .
  • the leave button 216 automatically is removed from the toolbar 168 because it is no longer relevant in the current selection.
  • the user may toggle one or both of the headphones button 218 and the microphone button 220 in order to selectively turn-on and turn-off one or both of the user's speakers and microphone.
  • the headphones graphic 203 , the concentric circles 204 around the user's sprite 192 , and the microphone graphic 206 on the user's sprite 192 are omitted when the user's speakers and microphone both are turned-off.
  • the user may initiate a chat with the communicants in the zone by selecting a chat button 222 in the toolbar 168 .
  • a separate chat window 224 is opened.
  • the chat window 224 includes a toolbar 226 , a chat log area 228 , a text box 230 , and a Send button 232 .
  • the toolbar 226 includes an independent set of navigation and interaction control buttons, including a headphones button 234 for toggling on and off the user's speakers, a microphone button 236 for toggling on and off the user's microphone, a get button 238 for getting people (discussed above), a minimap button 240 for opening a minimap view (discussed below), a leave button 242 for leaving the current zone (discussed above), and a rooms button 244 for opening a separate navigation interface window that displays a list of spaces (e.g., rooms) in the virtual area (discussed below). As shown in FIGS.
  • the chat log area 228 displays a log of events that are associated with the currently active space (i.e., Main) and sequences of text messages that the user has exchanged with other communicants in the currently active space (i.e., Main).
  • An exemplary set of events that are recorded in the chat log area 228 include changes in the presence status of communicants in the currently active space and changes in the speaker and microphone settings of the communicants in the currently active space.
  • the user may enter text messages in the text box 230 and transmit the text messages to the other communicants in the currently active space by selecting the Send button 232 .
  • the communicants in a particular room zone send their chat message to all other communicants in a separate chat zone (which often shares a similar boundary with the room zone).
  • a given room can have more than one chat zone and a chat zone can span more than one room if the needs of the application require it.
  • the user may toggle the minimap button 240 in the chat window 224 to open a minimap 246 that shows a view of the currently active space in the chat window 224 .
  • the minimap view 246 shows a view of the currently active area (i.e., the Main space 213 ) as well as adjacent areas of the virtual area.
  • the minimap 246 provides the same type of navigation functionality as the browsing area 166 of the tab 164 .
  • the user may inputting a command to execute (typically by double-clicking) a space represented in the minimap 246 to navigate to the corresponding space of the virtual area; and the user also may inputting a command to execute (typically by double-clicking) a region surrounding the currently presented space in order to navigate to a view of the next higher level in the hierarchical spatial model of the virtual area.
  • the minimap 246 also includes an open in seeker button 248 for opening the currently selected zone in the seeker window.
  • the chat window 224 is separate and distinct from the seeker interface window 168 .
  • the chat window 224 can overlap the seeker interface window 168 ( FIG. 15 ) and vice versa ( FIG. 16 ).
  • the seeker interface window 168 can be closed, and the user can continue to interact with other communicants ( FIG. 17 ) and navigate to other spaces in the virtual area ( FIG. 18 ) using the interface controls available through the chat window 224 .
  • FIG. 18 shows the situation in which the user has navigated to a view of the East Conference space 215 by double-clicking on the corresponding region of the minimap 246 , and the platform has established a presence for the user in the East Conference space 215 .
  • a list of available communicants is displayed in a separate pop-up window 250 .
  • the get button 210 is presented in association with a respective one of the zones in which the user has presence.
  • the platform transmits an invitation to the selected communicant to join the user in the respective zone.
  • FIG. 19 shows a situation in which the get button 210 is presented in association with the Main space (where the user has a presence).
  • the user has selected “Elizabeth Baker” in the list of available communicants displayed in the window 250 .
  • the platform transmits an invitation to the communicant associated with the name Elizabeth Baker to join the user in the Main space 213 (e.g., “Please join me in Main.”).
  • the seeker interface additionally includes a contacts window that has a get button and a list of contacts that are associated with the user, along with an indication of respective ones of the zones in which the contacts have presence.
  • the user can select one or more of the contacts in the list and, in response to a user selection of the get button, the system transmits an invitation to each of the selected contacts to join the user in a respective one of the zones in which the user has presence.
  • the graphic representations of the other communicants in a space are selectable like other objects.
  • the seeker interface displays a contacts window that contains information and user-selectable controls relating to the communicant associated with the selected graphical representation.
  • the user selectable controls include a mute button that enables the user to selectively mute audio signals received from the communicant associated with the selected graphical representation.
  • FIG. 20 shows an exemplary contacts window 247 that allows a user to view his or her communication history with any of his or her realtime contacts.
  • the platform opens the contacts window 247 , which displays all the recent communications history with that communicant (e.g., text chat, voice conversations, files shared etc).
  • the interface contains a recent text chat with Karen in which the messages between the user and Karen are listed vertically in chronological order, with the user's messages displayed in left-shifted message blocks and Karen's messages displayed in right-shifted message blocks.
  • the interface also displays the basic methods for connecting with another user on Sococo:
  • the toolbar 168 also includes a minimap button 254 .
  • the user may select the minimap button 254 to open a minimap 256 that is overlaid on the view of the currently active space.
  • the minimap 256 shows a view of the virtual area from a perspective that is one level higher in the hierarchical spatial model of a virtual area above the current view that is presented in the browsing area 166 of the tab 164 .
  • FIG. 21 In the exemplary situation shown in FIG.
  • the currently active space is the Main space 213 and the view shown in the minimap 256 corresponds to the floorplan view of the Acme space, which is the next higher level in the hierarchical spatial model of the virtual area above the view of the Main space 213 shown in the browsing area 166 .
  • Every pixel in the minimap 256 is associated with a respective reference to a corresponding location in the view shown in the minimap 256 .
  • the seeker interface presents a view of the corresponding location in the browsing area 166 of the tab 164 and (if the target is a zone, moves the communicant to that new location).
  • the user can double-click on any part of the West Conference space 214 , the Courtyard space 190 , the East Conference space 215 , etc., and the seeker interface will present in the browsing area 166 a view of the selected space along with surrounding areas of the virtual area immediately adjacent the selected space and move the user's presence there.
  • the user also can select any of the objects in the currently active area, and the minimap 256 will update the toolbar to show commands relevant to the selection.
  • FIG. 22 shows a situation in which the user has double-clicked a table object 258 in the view of the Main space 213 shown in FIG. 21 .
  • the seeker interface presents in the browsing area 166 of the tab 164 a zoomed-in view of the table object 258 and the areas of the Main space 213 surrounding the table object 258 .
  • the seeker interface shows in the minimap 256 a view of the Main space 213 and the areas of the Acme space surrounding the Main space 213 .
  • the breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a Table button 259 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • the toolbar 168 also includes an upload button 261 that allows the user to upload a data file from the client node 12 to a repository that is maintained by the network infrastructure service environment 30 .
  • the network infrastructure service environment 30 stores the uploaded file in the repository and creates a database record that associates the data file with the table object 258 .
  • Other communicants who enter the Main space 213 are able to view the contents of the uploaded data file and, subject to governance rules associated with the Main space 213 , optionally may be able to modify or delete the data file.
  • FIG. 23 shows a situation in which the user has selected a file object 260 on the table object 258 in the view of the Main space 213 shown in FIG. 21 and clicked View (or double-clicked the file object).
  • the seeker interface presents in the browsing area 166 of the tab 164 a zoomed-in view of the contents of the data file associated with the file object 260 and areas of the table object 258 surrounding the file object 260 .
  • the seeker interface shows in the minimap 256 a view of the table object 258 and areas of the Main space 213 surrounding the table object 258 .
  • the minimap 256 also shows a highlighted view 262 of the selected data file 260 on the table object 258 .
  • the breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a proposal.pdf button 264 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • the toolbar 168 also includes a download button 266 that allows the user to download the selected data file 260 from the repository that is maintained by the network infrastructure service environment 30 to the client node 12 .
  • FIG. 24 shows a situation in which the user has double-clicked a conferencing object 270 on the table object 258 in the view of the Main space 213 shown in FIG. 21 .
  • the seeker interface presents in the browsing area 166 of the tab 164 a view of a teleconferencing interface 272 and areas of the table object 258 surrounding the conferencing object 270 .
  • the teleconferencing interface 272 includes a text box 271 for receiving a telephone number and a dial button 273 for transmitting the telephone number to a telephony service that connects the client node 12 to a network node that is associated with the telephone number.
  • the seeker interface also shows in the minimap 256 a view of the table object 258 and areas of the Main space 213 surrounding the table object 258 .
  • the minimap 256 also shows a highlighted view 274 of the selected conferencing object 270 on the table object 258 .
  • the breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a Polycom button 276 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • the minimap 256 is associated with the following interaction and navigation controls that operate as described above: a speakers button 280 , a microphone button 282 , a chat button 284 , a get (or people) button 286 , and a leave button 288 .
  • the minimap 256 is presented as a picture-in-picture view that is superimposed on the view of the successively lower view of the hierarchical spatial model of the virtual area that is presented in the browsing area 166 of the tab 164 .
  • the minimap 256 may be presented in a separate and discrete window that may be tiled over or under the main window 162 or presented in a separate tab of the seeker interface window 162 .
  • FIG. 25 shows a situation in which the user has double-clicked a wall object 290 in the view of the Main space 213 shown in FIG. 21 .
  • the seeker interface presents in the browsing area 166 of the tab 164 a 2.5-dimensional view of the contents of the wall object 290 and areas of the Main space 213 surrounding the wall object 290 .
  • the selected wall object 290 corresponds to a North Wall of the Main space 213 .
  • the North Wall contains a pair of view screen objects 289 , 291 (labeled “2” and “3”, respectively) that are presented on the North Wall object 290 .
  • the view screen objects 289 , 291 can be used to present the contents of data files that are associated with the North Wall of the Main space 213 .
  • the 2.5-dimensional view also shows a West Wall object 293 and an East Wall object 295 that are located on the left and right sides of the North Wall object 290 , respectively.
  • Each of the West Wall object 293 and the East Wall object 295 includes a respective view screen object 293 , 295 (labeled “1” and 4′′, respectively) that can be used to present the contents of respective data files.
  • the interface also shows in the minimap 256 a view of the Main space 213 and areas of the Acme space surrounding the Main space 213 .
  • the minimap 256 also shows a highlighted view 292 of the selected North Wall object 290 in the Main space 213 .
  • the breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a North Wall button 294 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • the toolbar 168 includes a rotate left button 296 and a rotate right button 298 that allow the user to rotate the current view left and right by ninety degrees (90°) so that the user can view the contents of different walls of the Main space in the central viewing area of the 2.5-dimensional view of the Main space 213 .
  • the user also can double-click a different one of the walls that are shown in the minimap 256 in order to change the contents that are presented in the central viewing area of the 2.5-dimensional view of the Main space 213 .
  • FIG. 26 shows the seeker interface after the user has selected the view screen object 291 (labeled “3”) on the North Wall in the view of the Main space 213 shown in FIG. 25 .
  • the user may have executed the view screen object 291 either by double-clicking any part of the view screen object 291 shown in the central viewing area of the 2.5-dimensional view shown in the browsing area 166 of the tab 164 or by double-clicking the corresponding view screen object in the minimap 256 shown in FIG. 25 .
  • the browsing area 166 of the tab 164 shows a zoomed-in view of the view screen object 291 and areas of the North Wall object 290 surrounding the view screen object 291 , as shown in FIG. 26 .
  • the user may double-click on any of the areas of the North Wall object 290 surrounding the view screen object 291 in the browsing area 166 shown in FIG. 26 in order to return to the browsing area and minimap views of the Main space 213 that are shown in FIG. 25 , in which the user's avatar 192 has moved from adjacent the table object 258 to a position adjacent the selected viewscreen object 291 .
  • FIG. 25 the browsing area 166 of the tab 164 shows a zoomed-in view of the view screen object 291 and areas of the North Wall object 290 surrounding the view screen object 291 , as shown in FIG. 26 .
  • the user may double-click on any of the areas of the North Wall object 290 surrounding the view screen object 291 in the browsing area 166 shown in FIG. 26 in order to return to the browsing area and mini
  • the minimap 256 shows a 2.5-dimensional view of the contents of the wall object 290 along with areas of the Main space surrounding the wall object 290 ; this view corresponds to the preceding level in the hierarchical spatial model of the virtual area.
  • the breadcrumb buttons 207 include a Screen 3 button 302 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • the toolbar 168 includes a Share button 304 that allows a user to designate a shared data file whose contents will be presented on the view screen object 291 (i.e., Screen 3 ) and thereby allow all communicants in the Main space 213 to simultaneously share the data file.
  • the view screen object 291 shown in the browsing area 166 includes a Share link 306 that also allows the user to designate the shared data file.
  • the seeker interface opens a separate Select Source interface window 310 that allows the user to designate a data file whose contents will be shared on the view screen object 291 .
  • the Select Source interface includes a text box 312 for receiving a data file identifier (e.g., a local data file storage path name or a Uniform Resource Identifier (URI)) and a Browse button 314 that enables the user to browse different locations for the data file identifier.
  • the data file identifier may be located on the client node 12 or another network node.
  • the Select Source interface window 310 also includes a favorites button 316 that allows the user to browse a list of previously bookmarked files, applications, or URIs for the data file identifier.
  • the contents of the selected data file are displayed on the view screen object 291 in both the browsing area 166 and the minimap 256 .
  • the designated data file corresponds to a PowerPoint® data file that contains a slide of a pie chart. The user can terminate the presentation of the data file on the view screen object 291 by selecting the clear icon 318 .
  • the user establishes a respective presence in each of multiple locations by inputting a copy presence command through the seeker interface.
  • the user inputs the copy presence command either by shift-clicking the target zone where the user intends to establish an additional presence or by shift-clicking a reference (e.g., a hyperlink) to the target zone (e.g., by shift-double-clicking a breadcrumb or placemark that is linked to the target zone).
  • a reference e.g., a hyperlink
  • the system depicts a respective graphical representation of the user in the selected zone while continuing to depict a respective graphical representation of the user in each of the zones where the user had presence before the selection of the zone.
  • each of the graphical representations of the user is depicted in a respective view that is presented in a separate window on the display.
  • the windows may be associated with respective user-selectable tabs and, in response to a user selection of any of the tabs, the seeker interface displays only content of the window respectively associated with the selected tab in a common display area.
  • FIG. 29 shows the situation in which the user has shift-clicked a link to the Courtyard space 190 via the seeker interface window 162 shown in FIG. 28 (e.g., by using the placemarks navigation control).
  • the platform creates a second seeker interface window 320 that is independent and discrete from the first seeker interface window 162 .
  • the second seeker interface window 320 is identical in all respects to the first seeker interface window 162 , except that it shows a copy 322 of the user's sprite in the view of the Courtyard space 190 that is presented in the browsing area 324 of the second seeker interface window 320 .
  • the second seeker interface window 320 includes one or more tabs, each of which has a respective browsing area and a toolbar.
  • the toolbar includes a back button, a forward button, a placemarks button, and a home button.
  • the toolbar also includes a speakers button 326 , which enable the user to independently control local (i.e., at the client node 12 ) sound rendering of audio associated with the Courtyard space 190 , and a microphone button 328 , which allows the user to turn-on and turn-off the microphone at the client node 12 .
  • the platform allows the user to selectively transmit local microphone signals to only one of the zones in which the user has presence at a time.
  • the user can manipulate the second seeker interface window 320 independently of the first seeker interface window 162 .
  • the user can close the second seeker interface window 320 without affecting the first seeker interface window 162 as shown in FIG. 30 .
  • the user also can move the second seeker interface window 320 to a different location on the display relative to the first window 162 as shown in FIG. 31 .
  • Other window operations e.g., resizing, tiling over or under other windows also can be performed on the second seeker interface window 320 .
  • the navigation interface window 340 includes an Areas tab 342 and a Rooms tab 344 .
  • the Areas tab 342 shows a list of graphical representations of the virtual areas that are associated with the user (e.g., the Acme area 172 and the Sococo Help Desk 174 ).
  • the virtual area list may be a static list or it may be generated dynamically based on the results of a query on the relationship database 36 for virtual areas that are associated with the user.
  • the system In response to the user's selection of any of the graphical representations of the virtual areas shown in the Areas tab 342 , the system automatically updates the view that is displayed in the seeker interface window 162 , the user's presence state, and the user's network connections to reflect the user's entry into the selected area.
  • the Rooms tab 344 shows a set of floating windows 350 , 352 each of which is associated with a filtered list of the renderable zones of one or more of the virtual areas that are associated with the user.
  • the “Present At” window 350 is associated with a list of graphical representations of all the renderable zones in which the user has a respective presence
  • the “All” window 352 is associated with a list of all of the renderable zones in each of the virtual areas in which the user has a respective presence. Additional filtered lists of spaces are possible.
  • the Rooms tab 344 includes a floating window that is associated with a list of graphical representations of all the renderable zones of a virtual area that are active (i.e., that have at least one person in them).
  • the Rooms tab 344 includes a floating window that is associated with a list of graphical representations of all the renderable zones that the user has associated with a placemark (e.g., a zone corresponding to the user's office).
  • the system In response to the user's selection of any of the graphical representations of the zones shown in the Rooms tab 344 , the system automatically updates the view in the seeker interface window 162 , the user's presence state, and the user's network connections to reflect the user's entry into the selected zone.
  • FIGS. 34 , 35 , and 36 some embodiments display various notifications of events occurring in the zones of one or more virtual areas.
  • Each notification window typically describes a single event that is associated with a respective one of the zones (e.g., reception of a new chat message, reception of an invitation to join another communicant in a particular zone, and a change in a communicant's presence state in a zone).
  • FIG. 34 shows an embodiment in which a notification window 360 is displayed each time a communicant leaves a renderable zone in which the user has a respective presence (e.g., “Frank Rodriguez has left Main”).
  • FIG. 35 shows an embodiment in which a notification window 362 is displayed each time a communicant enters a renderable zone in which the user has a respective presence (e.g., “Frank Rodriguez has entered Main”).
  • FIG. 36 shows an embodiment in which a notification window 364 is displayed each time the user receives an invitation to join another communicant in a particular zone (e.g., a message from Hand Kim to “Please join me in the courtyard”).
  • the notification windows 360 , 362 are implemented by so-called “toast” windows that dynamically pops up out of corner of the user's desktop.
  • the notification window includes a hyperlink to the respective zone that is the subject of the notification.
  • the notification window 364 includes a minimap 366 that shows a graphical representation of the Courtyard space 190 that is associated with a hyperlink reference to the Courtyard space 190 .
  • the platform moves the graphical representation of the user to the respective zone (e.g., the Courtyard space 190 ) from the zone (e.g., the Main space 213 ) where the user had presence before the selection and establishes a presence for the user in the respective zone (e.g., the Courtyard space 190 ).
  • the embodiments that are described herein provide improved systems and methods for navigating and interacting in spatial virtual communication environments. These embodiments provide an interface that includes navigation controls that enable a user to navigate virtual areas and interaction controls that enable the user to interact with other communicants in the virtual areas.
  • the navigation controls allow the user to change his or her focus (e.g., the current view of the virtual area or the current zone or zones where the user has presence) using a variety of intuitive point-and-click browsing methods in the context of a hierarchical spatial model of a virtual area.
  • the interface adaptively presents navigation controls and interaction controls that are appropriate to the user's needs in the context of the user's current focus.

Abstract

A spatial layout of zones of a virtual area in a network communication environment is displayed. A user can have a respective presence in each of one or more of the zones. Navigation controls and interaction controls are presented. The navigation controls enable the user to specify where to establish a presence in the virtual area. The interaction controls enable the user to manage interactions with one or more other communicants in the network communication environment. A respective presence of the user is established in each of one or more of the zones on response to input received via the navigation controls. Respective graphical representations of the communicants are depicted in each of the zones where the communicants respectively have presence.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of prior U.S. patent application Ser. No. 12/354,709, filed Jan. 15, 2009, which claims the benefit of U.S. Provisional Application No. 61/042,714, filed Apr. 5, 2008, the entirety of which is incorporated herein by reference.
  • This application also relates to the following co-pending patent applications, the entirety of each of which is incorporated herein by reference: U.S. patent application Ser. No. 11/923,629, filed Oct. 24, 2007; and U.S. patent application Ser. No. 11/923,634, filed Oct. 24, 2007.
  • BACKGROUND OF THE INVENTION
  • When face-to-face communications are not practical, people often rely on one or more technological solutions to meet their communications needs. These solutions typically are designed to simulate one or more aspects of face-to-face communications. Traditional telephony systems enable voice communications between callers. Instant messaging (also referred to as “chat”) communications systems enable users to communicate text messages in real time through instant message computer clients that are interconnected by an instant message server. Some instant messaging systems additionally allow users to be represented in a virtual environment by user-controllable graphic objects (referred to as “avatars”). Interactive virtual reality communication systems enable users in remote locations to communicate over multiple real-time channels and to interact with each other by manipulating their respective avatars in three-dimensional virtual spaces. What are needed are improved systems and methods for interfacing with spatial virtual communication environments.
  • BRIEF SUMMARY OF THE INVENTION
  • In one aspect, the invention features a method in accordance with which a spatial layout of zones of a virtual area in a network communication environment is displayed. A user can have a respective presence in each of one or more of the zones. Navigation controls and interaction controls are presented. The navigation controls enable the user to specify where to establish a presence in the virtual area. The interaction controls enable the user to manage interactions with one or more other communicants in the network communication environment. A respective presence of the user is established in each of one or more of the zones on response to input received via the navigation controls. Respective graphical representations of the communicants are depicted in each of the zones where the communicants respectively have presence.
  • The invention also features apparatus operable to implement the inventive methods described above and computer-readable media storing computer-readable instructions causing a computer to implement the inventive methods described above.
  • Other features and advantages of the invention will become apparent from the following description, including the drawings and the claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagrammatic view of an embodiment of a network communication environment that includes a first client network node, a second client network node, and a virtual environment creator.
  • FIG. 2 is a diagrammatic view of an embodiment of a network node that includes a graphical user interface presenting a depiction of a virtual area.
  • FIG. 3 is a block diagram of the network communication environment of FIG. 1 that shows components of an embodiment of a client network node.
  • FIG. 4 is a flow diagram of an embodiment of a method of interfacing a user with a spatial communication environment.
  • FIG. 5 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 6 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 7 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 8 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 9 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 10 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 11 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 12 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 13 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 14 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 15 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 16 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 17 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 18 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 19 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 20 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 21 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 22 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 23 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 24 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 25 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 26 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 27 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 28 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 29 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 30 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 31 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 32 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 33 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 34 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 35 is a diagrammatic view of an embodiment of a graphical user interface.
  • FIG. 36 is a diagrammatic view of an embodiment of a graphical user interface.
  • DETAILED DESCRIPTION OF THE INVENTION
  • In the following description, like reference numbers are used to identify like elements. Furthermore, the drawings are intended to illustrate major features of exemplary embodiments in a diagrammatic manner. The drawings are not intended to depict every feature of actual embodiments nor relative dimensions of the depicted elements, and are not drawn to scale.
  • I. DEFINITION OF TERMS
  • A “communicant” is a person who communicates or otherwise interacts with other persons over one or more network connections, where the communication or interaction may or may not occur in the context of a virtual area. A “user” is a communicant who is operating a particular network node that defines a particular perspective for descriptive purposes.
  • A “realtime contact” of a user is a communicant or other person who has communicated with the user via a realtime communications platform.
  • A “computer” is any machine, device, or apparatus that processes data according to computer-readable instructions that are stored on a computer-readable medium either temporarily or permanently. A “computer operating system” is a software component of a computer system that manages and coordinates the performance of tasks and the sharing of computing and hardware resources. A “software application” (also referred to as software, an application, computer software, a computer application, a program, and a computer program) is a set of instructions that a computer can interpret and execute to perform one or more specific tasks. A “computer data file” is a block of information that durably stores data for use by a software application.
  • A “database” is an organized collection of records that are presented in a standardized format that can be searched by computers. A database may be stored on a single computer-readable data storage medium on a single computer or it may be distributed across multiple computer-readable data storage media on one or more computers.
  • A “data sink” (referred to herein simply as a “sink”) is any of a device (e.g., a computer), part of a device, or software that receives data.
  • A “data source” (referred to herein simply as a “source”) is any of a device (e.g., a computer), part of a device, or software that originates data.
  • A “network node” (also referred to simply as a “node”) is a junction or connection point in a communications network. Exemplary network nodes include, but are not limited to, a terminal, a computer, and a network switch. A “server” network node is a host computer on a network that responds to requests for information or service. A “client” network node is a computer on a network that requests information or service from a server. A “network connection” is a link between two communicating network nodes. The term “local network node” refers to a network node that currently is the primary subject of discussion. The term “remote network node” refers to a network node that is connected to a local network node by a network communications link. A “connection handle” is a pointer or identifier (e.g., a uniform resource identifier (URI)) that can be used to establish a network connection with a communicant, resource, or service on a network node. A “network communication” can include any type of information (e.g., text, voice, audio, video, electronic mail message, data file, motion data stream, and data packet) that is transmitted or otherwise conveyed from one network node to another network node over a network connection.
  • A “communicant interaction” is any type of direct or indirect action or influence between a communicant and another network entity, which may include for example another communicant, a virtual area, or a network service. Exemplary types of communicant interactions include communicants communicating with each other in realtime, a communicant entering a virtual area, and a communicant requesting access to a resource from a network service.
  • “Presence” refers to the ability and willingness of a networked entity (e.g., a communicant, service, or device) to communicate, where such willingness affects the ability to detect and obtain information about the state of the entity on a network and the ability to connect to the entity.
  • A “realtime data stream” is data that is structured and processed in a continuous flow and is designed to be received with no delay or only imperceptible delay. Realtime data streams include digital representations of voice, video, user movements, facial expressions and other physical phenomena, as well as data within the computing environment that may benefit from rapid transmission, rapid execution, or both rapid transmission and rapid execution, including for example, avatar movement instructions, text chat, realtime data feeds (e.g., sensor data, machine control instructions, transaction streams and stock quote information feeds), and file transfers.
  • A “virtual area” (also referred to as an “area” or a “place”) is a representation of a computer-managed space or scene. Virtual areas typically are one-dimensional, two-dimensional, or three-dimensional representations; although in some embodiments a virtual area may correspond to a single point. Oftentimes, a virtual area is designed to simulate a physical, real-world space. For example, using a traditional computer monitor, a virtual area may be visualized as a two-dimensional graphic of a three-dimensional computer-generated space. However, virtual areas do not require an associated visualization to implement switching rules. A virtual area typically refers to an instance of a virtual area schema, where the schema defines the structure and contents of a virtual area in terms of variables and the instance defines the structure and contents of a virtual area in terms of values that have been resolved from a particular context.
  • A “virtual area application” (also referred to as a “virtual area specification”) is a description of a virtual area that is used in creating a virtual environment. The virtual area application typically includes definitions of geometry, physics, and realtime switching rules that are associated with one or more zones of the virtual area.
  • A “virtual environment” is a representation of a computer-managed space that includes at least one virtual area and supports realtime communications between communicants.
  • A “zone” is a region of a virtual area that is associated with at least one switching rule or governance rule. A “switching rule” is an instruction that specifies a connection or disconnection of one or more realtime data sources and one or more realtime data sinks subject to one or more conditions precedent. A switching rule controls switching (e.g., routing, connecting, and disconnecting) of realtime data streams between network nodes communicating in the context of a virtual area. A governance rule controls a communicant's access to a resource (e.g., an area, a region of an area, or the contents of that area or region), the scope of that access, and follow-on consequences of that access (e.g., a requirement that audit records relating to that access must be recorded). A “renderable zone” is a zone that is associated with a respective visualization.
  • A “position” in a virtual area refers to a location of a point or an area or a volume in the virtual area. A point typically is represented by a single set of one-dimensional, two-dimensional, or three-dimensional coordinates (e.g., x, y, z) that define a spot in the virtual area. An area typically is represented by the three-dimensional coordinates of three or more coplanar vertices that define a boundary of a closed two-dimensional shape in the virtual area. A volume typically is represented by the three-dimensional coordinates of four or more non-coplanar vertices that define a closed boundary of a three-dimensional shape in the virtual area.
  • A “spatial state” is an attribute that describes where a user has presence in a virtual area. The spatial state attribute typically has a respective value (e.g., a zone_ID value) for each of the zones in which the user has presence.
  • A “placemark” is a stored reference (e.g., a hyperlink) to a location in a virtual area. A placemark typically can be selected to present a view of the associated location in the virtual area to a user. The verb “placemark” means the act or operation of creating a placemark.
  • In the context of a virtual area, an “object” is any type of discrete element in a virtual area that may be usefully treated separately from the geometry of the virtual area. Exemplary objects include doors, portals, windows, view screens, and speakerphone. An object typically has attributes or properties that are separate and distinct from the attributes and properties of the virtual area. An “avatar” is an object that represents a communicant in a virtual area.
  • The term “double-click” refers to the act or operation of entering or inputting an execution command (e.g., double-clicking the left computer mouse button or by single-clicking a user interface button associated with an execute command, e.g., enter zone or view object). The term “shift-click” refers to the act or operation of entering or inputting a selection command (e.g., clicking the left computer mouse button) while the Shift key of an alphanumeric input device is activated. The term “shift-double-click” refers to the act or operation of entering or inputting an execution command while the Shift key of an alphanumeric input device is activated.
  • As used herein, the term “includes” means includes but not limited to, the term “including” means including but not limited to. The term “based on” means based at least in part on.
  • II. INTRODUCTION
  • The embodiments that are described herein provide improved systems and methods for navigating and interacting in spatial virtual communication environments. These embodiments provide an interface that includes navigation controls that enable a user to navigate virtual areas and interaction controls that enable the user to interact with other communicants in the virtual areas. The navigation controls allow the user to change his or her focus (e.g., the current view of the virtual area or the current zone or zones where the user has presence) using a variety of intuitive point-and-click browsing methods in the context of a hierarchical spatial model of a virtual area. In some embodiments, the interface adaptively presents navigation controls and interaction controls that are appropriate to the user's needs in the context of the user's current focus.
  • III. OVERVIEW
  • A. An Exemplary Operating Environment
  • 1. Introduction
  • FIG. 1 shows an embodiment of an exemplary network communications environment 10 that includes a first client network node 12, a second client network node 14, and a virtual environment creator 16 that are interconnected by a network 18. The first client network node 12 includes a computer-readable memory 20, a processor 22, and input/output (I/O) hardware 24. The processor 22 executes at least one communications application 26 that is stored in the memory 20. The second client network node 14 typically is configured in substantially the same way as the first client network node 12. The virtual environment creator 16 includes at least one server network node 28 that provides a network infrastructure service environment 30. The communications application 26 and the network infrastructure service environment 30 together provide a platform (referred to herein as “the platform”) for creating a spatial virtual communication environment (also referred to herein simply as a “virtual environment”).
  • In some embodiments, the network infrastructure service environment 30 manages sessions of the first and second client nodes 12, 14 in a virtual area 32 in accordance with a virtual area application 34. The virtual area application 34 is hosted by the virtual area 32 and includes a description of the virtual area 32. The communications applications 26 operating on the first and second client network nodes 12, 14 present respective views of the virtual area 32 in accordance with data received from the network infrastructure service environment 30 and provide respective interfaces for receiving commands from the communicants. The communicants typically are represented in the virtual area 32 by respective avatars, which move about the virtual area 32 in response to commands that are input by the communicants at their respective network nodes. Each communicant's view of the virtual area 32 typically is presented from the perspective of the communicant's avatar, which increases the level of immersion experienced by the communicant. Each communicant typically is able to view any part of the virtual area 32 around his or her avatar. In some embodiments, the communications applications 26 establish realtime data stream connections between the first and second client network nodes 12, 14 and other network nodes sharing the virtual area 32 based on the positions of the communicants' avatars in the virtual area 32.
  • The network infrastructure service environment 30 also maintains a relationship database 36 that contains records 38 of interactions between communicants. Each interaction record 38 describes the context of an interaction between a pair of communicants.
  • 2. Network Environment
  • The network 18 may include any of a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN) (e.g., the internet). The network 18 typically includes a number of different computing platforms and transport facilities that support the transmission of a wide variety of different media types (e.g., text, voice, audio, and video) between network nodes.
  • The communications application 26 (see FIG. 1) typically operates on a client network node that includes software and hardware resources which, together with administrative policies, user preferences (including preferences regarding the exportation of the user's presence and the connection of the user to areas and other users), and other settings, define a local configuration that influences the administration of realtime connections with other network nodes. The network connections between network nodes may be arranged in a variety of different stream handling topologies, including a peer-to-peer architecture, a server-mediated architecture, and hybrid architectures that combine aspects of peer-to-peer and server-mediated architectures. Exemplary topologies of these types are described in U.S. application Ser. Nos. 11/923,629 and 11/923,634, both of which were filed on Oct. 24, 2007.
  • 3. Network Infrastructure Services
  • The network infrastructure service environment 30 typically includes one or more network infrastructure services that cooperate with the communications applications 26 in the process of establishing and administering network connections between the client nodes 12, 14 and other network nodes (see FIG. 1). The network infrastructure services may run on a single network node or may be distributed across multiple network nodes. The network infrastructure services typically run on one or more dedicated network nodes (e.g., a server computer or a network device that performs one or more edge services, such as routing and switching). In some embodiments, however, one or more of the network infrastructure services run on at least one of the communicants' network nodes. Among the network infrastructure services that are included in the exemplary embodiment of the network infrastructure service environment 30 are an account service, a security service, an area service, a rendezvous service, and an interaction service.
  • Account Service
  • The account service manages communicant accounts for the virtual environment. The account service also manages the creation and issuance of authentication tokens that can be used by client network nodes to authenticate themselves to any of the network infrastructure services.
  • Security Service
  • The security service controls communicants' access to the assets and other resources of the virtual environment. The access control method implemented by the security service typically is based on one or more of capabilities (where access is granted to entities having proper capabilities or permissions) and an access control list (where access is granted to entities having identities that are on the list). After a particular communicant has been granted access to a resource, that communicant typically uses the functionality provided by the other network infrastructure services to interact in the network communications environment 10.
  • Area Service
  • The area service administers virtual areas. In some embodiments, the area service remotely configures the communications applications 26 operating on the first and second client network nodes 12, 14 in accordance with the virtual area application 34 subject to a set of constraints 47 (see FIG. 1). The constraints 47 typically include controls on access to the virtual area. The access controls typically are based on one or more of capabilities (where access is granted to communicants or client nodes having proper capabilities or permissions) and an access control list (where access is granted to communicants or client nodes having identities that are on the list).
  • The area service also manages network connections that are associated with the virtual area subject to the capabilities of the requesting entities, maintains global state information for the virtual area, and serves as a data server for the client network nodes participating in a shared communication session in a context defined by the virtual area 32. The global state information includes a list of all the objects that are in the virtual area and their respective locations in the virtual area. The area service sends instructions that configure the client network nodes. The area service also registers and transmits initialization information to other client network nodes that request to join the communication session. In this process, the area service may transmit to each joining client network node a list of components (e.g., plugins) that are needed to render the virtual area 32 on the client network node in accordance with the virtual area application 34. The area service also ensures that the client network nodes can synchronize to a global state if a communications fault occurs. The area service typically manages communicant interactions with virtual areas via governance rules that are associated with the virtual areas.
  • Rendezvous Service
  • The rendezvous service manages the collection, storage, and distribution of presence information and provides mechanisms for network nodes to communicate with one another (e.g., by managing the distribution of connection handles) subject to the capabilities of the requesting entities. The rendezvous service typically stores the presence information in a presence database. The rendezvous service typically manages communicant interactions with each other via communicant privacy preferences.
  • Interaction Service
  • The interaction service maintains the relationship database 36 that contains the records 38 of interactions between communicants. For every interaction between communicants, one or more services of the network infrastructure service environment 30 (e.g., the area service) transmit interaction data to the interaction service. In response, the interaction service generates one or more respective interaction records and stores them in the relationship database. Each interaction record describes the context of an interaction between a pair of communicants. For example, in some embodiments, an interaction record contains an identifier for each of the communicants, an identifier for the place of interaction (e.g., a virtual area instance), a description of the hierarchy of the interaction place (e.g., a description of how the interaction room relates to a larger area), start and end times of the interaction, and a list of all files and other data streams that are shared or recorded during the interaction. Thus, for each realtime interaction, the interaction service tracks when it occurred, where it occurred, and what happened during the interaction in terms of communicants involved (e.g., entering and exiting), objects that are activated/deactivated, and the files that were shared.
  • The interaction service also supports queries on the relationship database 36 subject to the capabilities of the requesting entities. The interaction service presents the results of queries on the interaction database records in a sorted order (e.g., most frequent or most recent) based on virtual area. The query results can be used to drive a frequency sort of contacts whom a communicant has met in which virtual areas, as well as sorts of who the communicant has met with regardless of virtual area and sorts of the virtual areas the communicant frequents most often. The query results also may be used by application developers as part of a heuristic system that automates certain tasks based on relationships. An example of a heuristic of this type is a heuristic that permits communicants who have visited a particular virtual area more than five times to enter without knocking by default, or a heuristic that allows communicants who were present in an area at a particular time to modify and delete files created by another communicant who was present in the same area at the same time. Queries on the relationship database 36 can be combined with other searches. For example, queries on the relationship database may be combined with queries on contact history data generated for interactions with contacts using a communication system (e.g., Skype, Facebook, and Flickr) that is outside the domain of the network infrastructure service environment 30.
  • 4. Virtual Areas
  • The communications application 26 and the network infrastructure service environment 30 typically administer the realtime connections with network nodes in a communication context that is defined by an instance of a virtual area. The virtual area instance may correspond to an abstract (non-geometric) virtual space that is defined with respect to abstract coordinates. Alternatively, the virtual area instance may correspond to a visual virtual space that is defined with respect to one-, two- or three-dimensional geometric coordinates that are associated with a particular visualization. Abstract virtual areas may or may not be associated with respective visualizations, whereas visual virtual areas are associated with respective visualizations.
  • As explained above, communicants typically are represented by respective avatars in a virtual area that has an associated visualization. The avatars move about the virtual area in response to commands that are input by the communicants at their respective network nodes. In some embodiments, the communicant's view of a virtual area instance typically is presented from the perspective of the communicant's avatar, and each communicant typically is able to view any part of the visual virtual area around his or her avatar, increasing the level of immersion that is experienced by the communicant.
  • FIG. 2 shows an embodiment of an exemplary network node that is implemented by a computer system 48. The computer system 48 includes a display monitor 50, a computer mouse 52, a keyboard 54, speakers 56, 58, and a microphone 60. The display monitor 50 displays a graphical user interface 62. The graphical user interface 62 is a windows-based graphical user interface that can include multiple windows, icons, and a pointer 64. In the illustrated embodiment, the graphical user interface 62 presents a two-dimensional depiction of a shared virtual area 66 that is associated with a three-dimensional visualization representing an art gallery. Communicants are represented in the virtual area 66 by respective avatars 68, 70, 72, each of which may have a respective role (e.g., a curator, an artist, and a visitor) in the context of the virtual area 66.
  • As explained in detail below, the virtual area 66 includes zones 74, 76, 78, 80, 82 that are associated with respective rules that govern the switching of realtime data streams between the network nodes that are represented by the avatars 68-72 in the virtual area 66. (During a typical communication session, the dashed lines demarcating the zones 74-82 in FIG. 2 are not visible to the communicants although there may be visual cues associated with such zone boundaries.) The switching rules dictate how local connection processes executing on each of the network nodes establishes communications with the other network nodes based on the locations of the communicants' avatars 68-72 in the zones 74-82 of the virtual area 66.
  • A virtual area is defined by a specification that includes a description of geometric elements of the virtual area and one or more rules, including switching rules and governance rules. The switching rules govern realtime stream connections between the network nodes. The governance rules control a communicant's access to resources, such as the virtual area itself, regions with the virtual area, and objects within the virtual area. In some embodiments, the geometric elements of the virtual area are described in accordance with the COLLADA—Digital Asset Schema Release 1.4.1 Apr. 2006 specification (available from http://www.khronos.org/collada/), and the switching rules are described using an extensible markup language (XML) text format (referred to herein as a virtual space description format (VSDL)) in accordance with the COLLADA Streams Reference specification described in U.S. application Ser. Nos. 11/923,629 and 11/923,634.
  • The geometric elements of the virtual area typically include physical geometry and collision geometry of the virtual area. The physical geometry describes the shape of the virtual area. The physical geometry typically is formed from surfaces of triangles, quadrilaterals, or polygons. Colors and textures are mapped onto the physical geometry to create a more realistic appearance for the virtual area. Lighting effects may be provided, for example, by painting lights onto the visual geometry and modifying the texture, color, or intensity near the lights. The collision geometry describes invisible surfaces that determine the ways in which objects can move in the virtual area. The collision geometry may coincide with the visual geometry, correspond to a simpler approximation of the visual geometry, or relate to application-specific requirements of a virtual area designer.
  • The switching rules typically include a description of conditions for connecting sources and sinks of realtime data streams in terms of positions in the virtual area. Each rule typically includes attributes that define the realtime data stream type to which the rule applies and the location or locations in the virtual area where the rule applies. In some embodiments, each of the rules optionally may include one or more attributes that specify a required role of the source, a required role of the sink, a priority level of the stream, and a requested stream handling topology. In some embodiments, if there are no explicit switching rules defined for a particular part of the virtual area, one or more implicit or default switching rules may apply to that part of the virtual area. One exemplary default switching rule is a rule that connects every source to every compatible sink within an area, subject to policy rules. Policy rules may apply globally to all connections between the client nodes or only to respective connections with individual client nodes. An example of a policy rule is a proximity policy rule that only allows connections of sources with compatible sinks that are associated with respective objects that are within a prescribed distance (or radius) of each other in the virtual area.
  • In some embodiments, governance rules are associated with a virtual area to control who has access to the virtual area, who has access to its contents, what is the scope of that access to the contents of the virtual area (e.g., what can a user do with the contents), and what are the follow-on consequences of accessing those contents (e.g., record keeping, such as audit logs, and payment requirements). In some embodiments, an entire virtual area or a zone of the virtual area is associated with a “governance mesh.” In some embodiments, a governance mesh is implemented in a way that is analogous to the implementation of the zone mesh described in U.S. application Ser. Nos. 11/923,629 and 11/923,634. A governance mesh enables a software application developer to associate governance rules with a virtual area or a zone of a virtual area. This avoids the need for the creation of individual permissions for every file in a virtual area and avoids the need to deal with the complexity that potentially could arise when there is a need to treat the same document differently depending on the context.
  • In some embodiments, a virtual area is associated with a governance mesh that associates one or more zones of the virtual area with a digital rights management (DRM) function. The DRM function controls access to one or more of the virtual area or one or more zones within the virtual area or objects within the virtual area. The DRM function is triggered every time a communicant crosses a governance mesh boundary within the virtual area. The DRM function determines whether the triggering action is permitted and, if so, what is the scope of the permitted action, whether payment is needed, and whether audit records need to be generated. In an exemplary implementation of a virtual area, the associated governance mesh is configured such that if a communicant is able to enter the virtual area he or she is able to perform actions on all the documents that are associated with the virtual area, including manipulating the documents, viewing the documents, downloading the documents, deleting the documents, modifying the documents and re-uploading the documents. In this way, the virtual area can become a repository for information that was shared and discussed in the context defined by the virtual area.
  • Additional details regarding the specification of a virtual area are described in U.S. application Ser. Nos. 61/042,714 (which was filed on Apr. 4, 2008), 11/923,629 (which was filed on Oct. 24, 2007), and 11/923,634 (which was filed on Oct. 24, 2007).
  • 5. Communications Application
  • In some embodiments, the communications application 26 includes:
      • a. local Human Interface Devices (HIDs) and audio playback devices;
      • b. a So3D graphical display, avatar, and physics engine;
      • c. a system database and storage facility.
  • a. Local Human Interface Devices (HIDs) and Audio Playback Devices
  • The local HIDs enable a communicant to input commands and other signals into the client network node while participating in a virtual area communications session. Exemplary HIDs include a computer keyboard, a computer mouse, a touch screen display, and a microphone.
  • The audio playback devices enable a communicant to playback audio signals that are received during a virtual area communications session. Exemplary audio playback devices include audio processing hardware (e.g., a sound card) for manipulating (e.g., mixing and applying special effects) audio signals, and speakers for outputting sounds.
  • b. So3D Graphical Display, Avatar, and Physics Engine
  • The So3D engine is a three-dimensional visualization engine that controls the presentation of a respective view of a virtual area and objects in the virtual area on a display monitor. The So3D engine typically interfaces with a graphical user interface driver and the HID devices to present the views of the virtual area and to allow the communicant to control the operation of the communications application 26.
  • In some embodiments, the So3D engine receives graphics rendering instructions from the area service. The So3D engine also may read a local communicant avatar database that contains images needed for rendering the communicant's avatar in the virtual area. Based on this information, the So3D engine generates a visual representation (i.e., an image) of the virtual area and the objects in the virtual area from the point of view (position and orientation) of the communicant's avatar in the virtual area. The visual representation typically is passed to the graphics rendering components of the operating system, which drive the graphics rendering hardware to render the visual representation of the virtual area on the client network node.
  • The communicant can control the presented view of the virtual area by inputting view control commands via a HID device (e.g., a computer mouse). The So3D engine updates the view of the virtual area in accordance with the view control commands. The So3D engine also updates the graphic representation of the virtual area on the display monitor in accordance with updated object position information received from the area service 26.
  • c. System Database and Storage Facility
  • The system database and storage facility stores various kinds of information that is used by the platform. Exemplary information that typically is stored by the storage facility includes the presence database, the relationship database, an avatar database, a real user id (RUID) database, an art cache database, and an area application database. This information may be stored on a single network node or it may be distributed across multiple network nodes.
  • 6. Client Node Architecture
  • A communicant typically connects to the network 18 from a client network node. The client network node typically is implemented by a general-purpose computer system or a dedicated communications computer system (or “console”, such as a network-enabled video game console). The client network node executes communications processes that establish realtime data stream connections with other network nodes and typically executes visualization rendering processes that present a view of each virtual area entered by the communicant.
  • FIG. 3 shows an embodiment of a client network node that is implemented by a computer system 120. The computer system 120 includes a processing unit 122, a system memory 124, and a system bus 126 that couples the processing unit 122 to the various components of the computer system 120. The processing unit 122 may include one or more data processors, each of which may be in the form of any one of various commercially available computer processors. The system memory 124 includes one or more computer-readable media that typically are associated with a software application addressing space that defines the addresses that are available to software applications. The system memory 124 may include a read only memory (ROM) that stores a basic input/output system (BIOS) that contains start-up routines for the computer system 120, and a random access memory (RAM). The system bus 126 may be a memory bus, a peripheral bus or a local bus, and may be compatible with any of a variety of bus protocols, including PCI, VESA, Microchannel, ISA, and EISA. The computer system 120 also includes a persistent storage memory 128 (e.g., a hard drive, a floppy drive, a CD ROM drive, magnetic tape drives, flash memory devices, and digital video disks) that is connected to the system bus 126 and contains one or more computer-readable media disks that provide non-volatile or persistent storage for data, data structures and computer-executable instructions.
  • A communicant may interact (e.g., input commands or data) with the computer system 120 using one or more input devices 130 (e.g. one or more keyboards, computer mice, microphones, cameras, joysticks, physical motion sensors such Wii input devices, and touch pads). Information may be presented through a graphical user interface (GUI) that is presented to the communicant on a display monitor 132, which is controlled by a display controller 134. The computer system 120 also may include other input/output hardware (e.g., peripheral output devices, such as speakers and a printer). The computer system 120 connects to other network nodes through a network adapter 136 (also referred to as a “network interface card” or NIC).
  • A number of program modules may be stored in the system memory 124, including application programming interfaces 138 (APIs), an operating system (OS) 140 (e.g., the Windows XP® operating system available from Microsoft Corporation of Redmond, Wash. U.S.A.), the communications application 26, drivers 142 (e.g., a GUI driver), network transport protocols 144, and data 146 (e.g., input data, output data, program data, a registry, and configuration settings).
  • 7. Server Node Architecture
  • In some embodiments, the one or more server network nodes of the virtual environment creator 16 are implemented by respective general-purpose computer systems of the same type as the client network node 120, except that each server network node typically includes one or more server software applications.
  • In other embodiments, the one or more server network nodes of the virtual environment creator 16 are implemented by respective network devices that perform edge services (e.g., routing and switching).
  • B. Exemplary Communication Session
  • Referring back to FIG. 2, during a communication session, each of the client network nodes generates a respective set of realtime data streams (e.g., motion data streams, audio data streams, chat data streams, file transfer data streams, and video data streams). For example, each communicant manipulates one or more input devices (e.g., the computer mouse 52 and the keyboard 54) that generate motion data streams, which control the movement of his or her avatar in the virtual area 66. In addition, the communicant's voice and other sounds that are generated locally in the vicinity of the computer system 48 are captured by the microphone 60. The microphone 60 generates audio signals that are converted into realtime audio streams. Respective copies of the audio streams are transmitted to the other network nodes that are represented by avatars in the virtual area 66. The sounds that are generated locally at these other network nodes are converted into realtime audio signals and transmitted to the computer system 48. The computer system 48 converts the audio streams generated by the other network nodes into audio signals that are rendered by the speakers 56, 58. The motion data streams and audio streams may be transmitted from each of the communicant nodes to the other client network nodes either directly or indirectly. In some stream handling topologies, each of the client network nodes receives copies of the realtime data streams that are transmitted by the other client network nodes. In other stream handling topologies, one or more of the client network nodes receives one or more stream mixes that are derived from realtime data streams that are sourced (or originated) from other ones of the network nodes.
  • In some embodiments, the area service maintains global state information that includes a current specification of the virtual area, a current register of the objects that are in the virtual area, and a list of any stream mixes that currently are being generated by the network node hosting the area service. The objects register typically includes for each object in the virtual area a respective object identifier (e.g., a label that uniquely identifies the object), a connection handle (e.g., a URI, such as an IP address) that enables a network connection to be established with a network node that is associated with the object, and interface data that identifies the realtime data sources and sinks that are associated with the object (e.g., the sources and sinks of the network node that is associated with the object). The objects register also typically includes one or more optional role identifiers for each object; the role identifiers may be assigned explicitly to the objects by either the communicants or the area service, or may be inferred from other attributes of the objects or the user. In some embodiments, the objects register also includes the current position of each of the objects in the virtual area as determined by the area service from an analysis of the realtime motion data streams received from the network nodes associated with objects in the virtual area. In this regard, the area service receives realtime motion data streams from the network nodes associated with objects in the virtual area, tracks the communicants' avatars and other objects that enter, leave, and move around in the virtual area based on the motion data. The area service updates the objects register in accordance with the current locations of the tracked objects.
  • In the process of administering realtime data stream connections with other network nodes, the area service maintains for each of the client network nodes a set of configuration data, including interface data, a zone list, and the positions of the objects that currently are in the virtual area. The interface data includes for each object associated with each of the client network nodes a respective list of all the sources and sinks of realtime data stream types that are associated with the object. The zone list is a register of all the zones in the virtual area that currently are occupied by the avatar associated with the corresponding client network node. When a communicant first enters a virtual area, the area service typically initializes the current object positions database with position initialization information. Thereafter, the area service updates the current object positions database with the current positions of the objects in the virtual area as determined from an analysis of the realtime motion data streams received from the other client network nodes sharing the virtual area.
  • IV. INTERFACING WITH A SPATIAL VIRTUAL COMMUNICATION ENVIRONMENT
  • A. Introduction
  • In addition to the local Human Interface Device (HID) and audio playback devices, the So3D graphical display, avatar, and physics engine, and the system database and storage facility, the communications application 26 also includes a graphical navigation and interaction interface (referred to herein as a “seeker interface”) that interfaces the user with the spatial virtual communication environment. The seeker interface includes navigation controls that enable the user to navigate the virtual environment and interaction controls that enable the user to control his or her interactions with other communicants in the virtual communication environment. The navigation and interaction controls typically are responsive to user selections that are made using any type of input device, including a computer mouse, a touch pad, a touch screen display, a keyboard, and a video game controller. The seeker interface is an application that operates on each client network node. The seeker interface is a small, lightweight interface that a user can keep up and running all the time on his or her desktop. The seeker interface allows the user to launch virtual area applications and provides the user with immediate access to realtime contacts and realtime collaborative places (or areas). The seeker interface is integrated with realtime communications applications and/or realtime communications components of the underlying operating system such that the seeker interface can initiate and receive realtime communications with other network nodes. A virtual area is integrated with the user's desktop through the seeker interface such that the user can upload files into the virtual environment created by the virtual environment creator 16, use files stored in association with the virtual area using the native client software applications independently of the virtual environment while still present in a virtual area, and more generally treat presence and position within a virtual area as an aspect of their operating environment analogous to other operating system functions rather than just one of several applications.
  • FIG. 4 shows an embodiment of a method of interfacing the user with the spatial virtual communication environment. In accordance with this method, a spatial layout of zones of a virtual area in a network communication environment is displayed on the display monitor 132 (FIG. 4, block 150). A user can have a respective presence in each of one or more of the zones. Each of the zones can be used to define a respective spatial state in which the user can have a presence. The zones typically are associated with a respective identifier (zone_ID) and one or more rules governing one or more of the user's interactions with the virtual area and with other communicants. Navigation controls and interaction controls are presented on the display monitor 132 (FIG. 4, block 152). The navigation controls enable the user to specify where to establish a presence in the virtual area and the interaction controls enable the user to manage interactions with one or more other communicants in the network communication environment. A respective presence of the user is established in each of one or more of the zones in response to input received via the navigation controls (FIG. 4, block 154). In some embodiments, this process involves creating for each of the zones one or more interaction database records that associate a respective zone identifier (zone_ID) with each of the communicants that have a presence in the zone. Respective graphical representations of the communicants in each of the zones where the communicants respectively have presence are depicted on the display monitor 132 (FIG. 4, block 156). The communicants typically are represented by two- or three-dimensional avatar images, which may represent the communicants pseudo-realistically (e.g., with human-like forms) or iconographically (e.g., with circular or spherical sprites or other icons).
  • The spatial virtual communication environment typically can be modeled as a spatial hierarchy of places (also referred to herein as “locations”) and objects. The spatial hierarchy includes an ordered sequence of levels ranging from a top level to a bottom level. Each of the places in a successive one of the levels of the spatial hierarchy is contained in a respective one of the places in a preceding one of the levels. Each of the objects in the spatial hierarchy is contained in a respective one of the places. The levels of the spatial hierarchy typically are associated with respective visualizations that are consistent with a geographical, architectural, or urban metaphor, and are labeled accordingly. The zones of each virtual area are defined by respective meshes, some of which define elements of a physical environment (e.g., spaces, such as rooms and courtyards, that are associated with a building) that may contain objects (e.g., avatars and props, such as view screen objects and conferencing objects).
  • The navigational controls of the seeker interface allow the user to traverse a path through the virtual environment in accordance with a navigational model that is tied to the underlying spatial hierarchy of places and objects. The network infrastructure service environment 30 records the path traversed by the user. In some embodiments, the network infrastructure service environment 30 records a history that includes a temporally ordered list of views of the virtual area that are presented to the user as the user navigates through the virtual area. Each view typically corresponds to a view of a respective renderable zone of the virtual area. In these embodiments, the navigation controls enable the user to move to selected ones of the zones in the history. The navigation controls also include a graphical representation of a depth path that shows the location in the spatial hierarchy that corresponds to the user's current view of the virtual area. In some embodiments, the graphical representation of the depth path includes a respective user-selectable link to a respective view of each of the preceding levels in the spatial hierarchical model of the virtual area above the current view.
  • The interaction controls of the seeker interface allow the user to manage interactions with other communicants. The interaction options that available to the user typically depend on the zones in which the user has a presence. In some embodiments, the interaction options that are available to communicants who have presence in a particular zone are different from the options that are available to other communicants who do not have presence in that zone. The level of detail and interactivity of the user typically depend on whether or not the user has a presence the particular zone. In one exemplary embodiment, if the user is outside the virtual area, the user is provided with a minimal level of detail of the interactions occurring within the virtual area (e.g., the user can see an outline of the floorplan, background textures, and plants of the area, but the user cannot see where other communicants are present in the area); if the user is within the virtual area but outside a particular zone of the area, the user is provided with a medium level of detail of the interactions occurring within the particular zone (e.g., the user can see where other communicants are present in the area, see a visualization of their current states—talking, typing a chat message, whether or not their headphones and microphones are turned-on—and see whether any of the view screens are active); if the user is within the particular zone of the area, the user is provided with full level of detail of the interactions occurring with the particular zone (e.g., the user can see a thumbnail of the file being shared on a view screen, hear and speak with other communicants in the area, and see elements of a log of chat messages that were generated by communicants in the zone). In some embodiments, the switching and governance rules that are associated with the zones of the virtual area control how the network infrastructure services distinguish between those who have presence in the particular zone from those who do not.
  • B. Navigating and Interacting in a Spatial Virtual Communication Environment
  • 1. Basic Navigation and Interaction Model
  • FIG. 5 shows an embodiment 160 of the seeker interface that is displayed in a window 162 and includes one or more tabs 164, each of which has a browsing area 166 and a toolbar 168.
  • Each of the tabs 164 typically is associated with a respective view of the virtual environment. In the illustrated embodiment, the view presented in the tab 164 (labeled “My Areas”) is associated with a respective set of virtual areas, which may be a default set of virtual areas in the virtual environment or it may be a set of virtual areas that is identified by a respective filter on the interaction database. In particular, the tab 164 is associated with a set of three virtual areas (i.e., Acme, Sococo Help Area, and Personal Space), which may be a default set of areas that are associated with the user or may be identified by a filter that identifies all of the areas that are associated with the user (e.g., all of the areas in which the user has interacted). Additional tabs may be created by selecting the “+” button 170.
  • The browsing area 166 of each tab shows graphic representations of the elements of the virtual environment that are associated with the tab. For example, in the illustrated embodiment, the browsing area 166 shows top- level views 172, 174, 176 of the virtual areas that are associated with the tab 164. The user may navigate to the next lower level in the spatial hierarchical model of any of the virtual areas by selecting the corresponding graphic representation of the virtual area.
  • The toolbar 168 includes an adaptive set of navigational and interaction tools that automatically are selected by the seeker interface based on the current location of the user in the virtual environment. In the illustrated embodiment, the toolbar 168 includes a back button 178, a forward button 180, a placemarks button 182, and a home button 184. The back button 178 corresponds to a backward control that enables the user to incrementally move backward to preceding ones of the zones in the history of the zones that were traversed by the user. The forward button 180 corresponds to a forward control that enables the user to incrementally move forward to successive ones of the zones in the history of the zones that were traversed by the user. The placemarks button 182 provides a placemarking control for storing links to zones and a placemark navigation control for viewing a list of links to previously placemarked zones. In response to a user selection of the placemarking control, a placemark is created by storing an image of the location shown in the current view in association with a hyperlink to the corresponding location in the virtual area. In response to a user selection of the placemark navigation control, a placemarks window is presented to the user. The placemarks window includes live visualizations of all locations that have been placemarked by the user. Each of the images in the placemarks window is associated with a respective user-selectable hyperlink. In response to user selection of one of the hyperlinks in the placemarks window, a view of the virtual area corresponding to the location associated with the selected hyperlink is automatically displayed in the browsing area 166 of the seeker interface window 162. The home button 184 corresponds to a control that returns the user to a view of a designated “home” location in the virtual environment (e.g., the view shown in FIG. 5).
  • Referring to FIG. 6, in response to a user selection of the graphic representation 172 of the Acme virtual area shown in FIG. 5, the platform moves the user into a default zone of the virtual area, automatically establishes a presence for the user in the default zone, and automatically establishes a network connection between the user and each of the other communicants occupying the selected zone. Based on the switching rules established by the area designer, the platform multiplexes the specified realtime data streams (e.g., streams from the microphones and speakers) of all the communicants in default zone such that they can both see each others' sprites or avatars and communicate with (e.g., speak to and hear) each other.
  • The seeker interface shows a top or floorplan view of the Acme virtual area in the browsing area 166 of the tab 164 and provides the user with a default set of interaction options. In the illustrated embodiment, a presence automatically is established in a courtyard zone 190 of the virtual area, and the user's microphone and default speakers (e.g., headphones) are turned-on. In the floorplan view shown in FIG. 6, the user is represented by a circular sprite 192; the other users in the Acme virtual area also are represented by respective circular sprites 194-202. The state of the user's speakers is depicted by the presence or absence of a headphones graphic 203 on the user's sprite 192: when the speakers are on, the headphones graphic 203 is present and, when the speakers are off, the headphones graphic 203 is absent. The state of the user's microphone is depicted by the presence or absence of a microphone graphic 206 on the user's sprite 192 and a series of concentric circles 204 around the user's sprite 192: when the microphone is on, the microphone graphic 206 and the concentric circles 204 are present and, when the microphone is off, the microphone graphic 206 and the concentric circles 204 are absent. The headphones graphic 203, the concentric circles 204, and the microphone graphic 206 serve as visual reminders of the states of the user's sound playback and microphone devices.
  • In addition to the backward button 178, the forward button 180, the placemarks button 182, and the home button 184, the toolbar 168 also includes a series of one or more breadcrumb buttons 207 that originate from and include the home button 184. The breadcrumb buttons 207 correspond to a hierarchical sequence of successive, user-selectable links. Each of the successive links corresponds to a view of a respective level in the hierarchical model of the virtual area in which each successive level is contained by preceding ones of the levels. In the illustrated embodiment, the breadcrumb buttons 207 include the home button 184 and an Acme button 208 that corresponds to the current view of the Acme virtual area shown in FIG. 6. The breadcrumb buttons 207 provide the user with single button selection access to respective views of different levels of the virtual environment. The toolbar 168 additionally includes a button 210 and a settings button 212.
  • When an area is selected or in focus, the button 210 appears as an iconographic representation of two people and is labeled “members,” and allows members and moderators to see the list of people associated with an area. When an audio or chat zone is in focus, the button 210 has a different image (e.g., an image of an arrow pointing downward onto a plane to represent the operation of getting) and is labeled “get”. In response to a user selection of the button 210, a list of all the members of the Acme virtual area 166 is displayed in a user interface. The user may select any of the communicants in the list and click a get button that is presented in the user interface; in response, the platform transmits an invitation to the selected communicant to join the user in a designated one of the zones.
  • The settings button 212 provides the user with access to a set of controls for specifying default settings that are associated with the current area.
  • The user may navigate from the view of the Acme virtual area shown in FIG. 6 back to the view shown in FIG. 5 in a variety of different ways. For example, the user may select any of the back button 178, the home button 184, or any part of the zone 211 that is outside the boundary of the graphic representation of the Acme virtual area shown in FIG. 6.
  • The user may navigate to any of the zones of the Acme virtual area. In some embodiments, in order to move to a zone, the user transmits a command to execute one of the zones displayed on the monitor, (e.g., by selecting the zone and then clicking the Enter button (in the toolbar), or, as a shortcut, double-clicking the zone) and, in response, the platform depicts the user's avatar in the zone corresponding to the zone object. In response to the zone execution command, the seeker interface outlines the zone (indicating to the user that it is selected) and updates the breadcrumb buttons 207 to show the selected zone location in the hierarchy. Toolbar buttons specific to the selection will also appear to the right of the breadcrumb buttons 207.
  • The user also may interact with any objects (e.g., a screen, table, or file) that are present in a zone. In some embodiments, in order to interact with an object, the user transmits a command to execute one of the objects displayed on the monitor, (e.g., by selecting the object and then clicking the View button (in the toolbar), or, as a shortcut, double-clicking the object) and, in response, the platform performs an operation with respect to the object (e.g., present a zoomed-in view of the object, open an interaction interface window, etc.). In response to the object execution command, the seeker interface outlines or otherwise highlights the prop (indicating to the user that it is selected) and updates the breadcrumb buttons 207 to show the selected object location in the hierarchy. Toolbar buttons specific to the selection will also appear to the right of the breadcrumb buttons 207.
  • As shown in FIG. 7, in some embodiments, in response to the user entering a Main space 213, the platform automatically establishes a network connection between the user and each of the other communicants occupying the selected zone. The user also may enter (and thereby establish a presence in) a space by selecting the space and clicking the Enter button; this causes the platform to move the user's sprite from its current location (i.e., Courtyard) to the selected space (i.e., Main) (see FIG. 8). The settings of user's speakers and microphone typically do not change when the user is moved from one location to another.
  • After the user has moved into the Main space 213 (see FIG. 8), the user may navigate to a different view of the virtual area by inputting a command to execute (typically double-clicking) any part of the current view surrounding the Main space 213. For example, in response to a user double-clicking of any part of the zone 211 that is outside the boundary of the Main space 213 and the Acme virtual area, the seeker interface displays the zoomed-out view of the Acme virtual area that is shown in FIG. 9. The user also may navigate to a different view of the virtual area by selecting another space in the virtual area (e.g., the West Conference space 214, the East Conference space 215, or the Courtyard space 190) and by clicking Enter, by double-clicking the zone, or by selecting one of the breadcrumb buttons 207 (e.g., the Acme breadcrumb button 208).
  • In some embodiments, navigating to a different view changes the user's presence state, whereas panning and zooming only changes the user's view state. In some cases, navigating will also change view state as a convenience to the user. The following examples illustrate this interface feature.
  • Example 1
      • User is in the Courtyard, selects Main, and clicks the Enter button (or double-clicks Main). The user is now present in the Main space and is no longer present in the Courtyard space. The user's view of the map doesn't change except to paint his avatar in his new position (and any other changes that relate to the capabilities he now has because of his new location).
    Example 2
      • User is in Main, selects a Viewscreen, and clicks View (or double-clicks the Viewscreen). The user continues to be present in Main. The user's seeker window updates to show the contents of the Viewscreen.
  • In other embodiments, the navigation to a different view does not affect the presence of the user in the Main space 213.
  • Referring back to FIG. 8, in response to the context change resulting from the user's entry into the Main space 213, the toolbar 168 automatically is modified to include a leave button 216. In response to a user selection of the leave button 216, the user's presence in the Main space 213 is terminated and the user's avatar 192 is removed from the Main space 213, as shown in FIG. 9. After the user has left the Main space 213, the leave button 216 automatically is removed from the toolbar 168 because it is no longer relevant in the current selection.
  • After the user has moved into the Main space 213 (see FIG. 8), the user may toggle one or both of the headphones button 218 and the microphone button 220 in order to selectively turn-on and turn-off one or both of the user's speakers and microphone. As shown in FIG. 11, the headphones graphic 203, the concentric circles 204 around the user's sprite 192, and the microphone graphic 206 on the user's sprite 192 are omitted when the user's speakers and microphone both are turned-off.
  • 2. Chat Interaction Model
  • Referring to FIG. 12, the user may initiate a chat with the communicants in the zone by selecting a chat button 222 in the toolbar 168. In response to a user selection of the chat button 222, a separate chat window 224 is opened. The chat window 224 includes a toolbar 226, a chat log area 228, a text box 230, and a Send button 232. The toolbar 226 includes an independent set of navigation and interaction control buttons, including a headphones button 234 for toggling on and off the user's speakers, a microphone button 236 for toggling on and off the user's microphone, a get button 238 for getting people (discussed above), a minimap button 240 for opening a minimap view (discussed below), a leave button 242 for leaving the current zone (discussed above), and a rooms button 244 for opening a separate navigation interface window that displays a list of spaces (e.g., rooms) in the virtual area (discussed below). As shown in FIGS. 12-14, the chat log area 228 displays a log of events that are associated with the currently active space (i.e., Main) and sequences of text messages that the user has exchanged with other communicants in the currently active space (i.e., Main). An exemplary set of events that are recorded in the chat log area 228 include changes in the presence status of communicants in the currently active space and changes in the speaker and microphone settings of the communicants in the currently active space. The user may enter text messages in the text box 230 and transmit the text messages to the other communicants in the currently active space by selecting the Send button 232. In some embodiments, the communicants in a particular room zone send their chat message to all other communicants in a separate chat zone (which often shares a similar boundary with the room zone). In this way, a given room can have more than one chat zone and a chat zone can span more than one room if the needs of the application require it.
  • As shown in FIG. 15, the user may toggle the minimap button 240 in the chat window 224 to open a minimap 246 that shows a view of the currently active space in the chat window 224. The minimap view 246 shows a view of the currently active area (i.e., the Main space 213) as well as adjacent areas of the virtual area. The minimap 246 provides the same type of navigation functionality as the browsing area 166 of the tab 164. For example, the user may inputting a command to execute (typically by double-clicking) a space represented in the minimap 246 to navigate to the corresponding space of the virtual area; and the user also may inputting a command to execute (typically by double-clicking) a region surrounding the currently presented space in order to navigate to a view of the next higher level in the hierarchical spatial model of the virtual area. The minimap 246 also includes an open in seeker button 248 for opening the currently selected zone in the seeker window.
  • Referring to FIGS. 16-18, the chat window 224 is separate and distinct from the seeker interface window 168. The chat window 224 can overlap the seeker interface window 168 (FIG. 15) and vice versa (FIG. 16). The seeker interface window 168 can be closed, and the user can continue to interact with other communicants (FIG. 17) and navigate to other spaces in the virtual area (FIG. 18) using the interface controls available through the chat window 224. FIG. 18 shows the situation in which the user has navigated to a view of the East Conference space 215 by double-clicking on the corresponding region of the minimap 246, and the platform has established a presence for the user in the East Conference space 215.
  • 3. Get Interaction Model
  • Referring to FIG. 19, in response to a user selection of the get button 210, a list of available communicants is displayed in a separate pop-up window 250. The get button 210 is presented in association with a respective one of the zones in which the user has presence. In response to a user selection of one of the communicants in the list of available communicants, the platform transmits an invitation to the selected communicant to join the user in the respective zone. For example, FIG. 19 shows a situation in which the get button 210 is presented in association with the Main space (where the user has a presence). The user has selected “Elizabeth Baker” in the list of available communicants displayed in the window 250. In response to the selection of the Send button 251, the platform transmits an invitation to the communicant associated with the name Elizabeth Baker to join the user in the Main space 213 (e.g., “Please join me in Main.”).
  • 4. Contacts Window
  • In some embodiments, the seeker interface additionally includes a contacts window that has a get button and a list of contacts that are associated with the user, along with an indication of respective ones of the zones in which the contacts have presence. The user can select one or more of the contacts in the list and, in response to a user selection of the get button, the system transmits an invitation to each of the selected contacts to join the user in a respective one of the zones in which the user has presence.
  • In some embodiments, the graphic representations of the other communicants in a space are selectable like other objects. For example, in response to a user selection of one of the graphical representations of the other communicants, the seeker interface displays a contacts window that contains information and user-selectable controls relating to the communicant associated with the selected graphical representation. The user selectable controls include a mute button that enables the user to selectively mute audio signals received from the communicant associated with the selected graphical representation.
  • FIG. 20 shows an exemplary contacts window 247 that allows a user to view his or her communication history with any of his or her realtime contacts. In response to the positioning of a mouse pointer over the contact's avatar, the platform opens the contacts window 247, which displays all the recent communications history with that communicant (e.g., text chat, voice conversations, files shared etc). In the illustrated embodiment, the interface contains a recent text chat with Karen in which the messages between the user and Karen are listed vertically in chronological order, with the user's messages displayed in left-shifted message blocks and Karen's messages displayed in right-shifted message blocks. The interface also displays the basic methods for connecting with another user on Sococo:
      • Go—takes the user to the place where that contact is
      • Get—brings that communicant into the place the user is in
      • Text—sends an instant message
      • Whisper—sends a short voice message (scrap of voice) that is mixed into a contact's headset such that only the contact can hear it. The HUD shows the user where the contact is and what the contact is doing and, thereby, provides the user with useful context information that can inform the user's selection of the content of the voice message.
        The platform typically includes smart defaults such that the user can Go or Get people that the user communicates with continuously, but might have to ask permission to Go to or Get a communicant that is a more casual contact. Additional details regarding the construction and operation of embodiments of this type are contained in U.S. Patent Application No. 61/042,714, filed Apr. 4, 2008 (see, e.g., § VII entitled “HEADS-UP DISPLAY”).
  • 5. Minimap Navigation and Interaction
  • Referring to FIG. 21, in addition to the controls described above, the toolbar 168 also includes a minimap button 254. The user may select the minimap button 254 to open a minimap 256 that is overlaid on the view of the currently active space. The minimap 256 shows a view of the virtual area from a perspective that is one level higher in the hierarchical spatial model of a virtual area above the current view that is presented in the browsing area 166 of the tab 164. In the exemplary situation shown in FIG. 21, the currently active space is the Main space 213 and the view shown in the minimap 256 corresponds to the floorplan view of the Acme space, which is the next higher level in the hierarchical spatial model of the virtual area above the view of the Main space 213 shown in the browsing area 166. Every pixel in the minimap 256 is associated with a respective reference to a corresponding location in the view shown in the minimap 256. In response to a user inputting a command to execute (typically by double-clicking) of any part of the minimap 256, the seeker interface presents a view of the corresponding location in the browsing area 166 of the tab 164 and (if the target is a zone, moves the communicant to that new location). Thus, the user can double-click on any part of the West Conference space 214, the Courtyard space 190, the East Conference space 215, etc., and the seeker interface will present in the browsing area 166 a view of the selected space along with surrounding areas of the virtual area immediately adjacent the selected space and move the user's presence there.
  • The user also can select any of the objects in the currently active area, and the minimap 256 will update the toolbar to show commands relevant to the selection.
  • For example, FIG. 22 shows a situation in which the user has double-clicked a table object 258 in the view of the Main space 213 shown in FIG. 21. In response to the user's selection of the table object 258, the seeker interface presents in the browsing area 166 of the tab 164 a zoomed-in view of the table object 258 and the areas of the Main space 213 surrounding the table object 258. In addition, the seeker interface shows in the minimap 256 a view of the Main space 213 and the areas of the Acme space surrounding the Main space 213. The breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a Table button 259 that corresponds to the current level in the hierarchical spatial model of the virtual area. The toolbar 168 also includes an upload button 261 that allows the user to upload a data file from the client node 12 to a repository that is maintained by the network infrastructure service environment 30. In response to a user selection of a data file to upload, the network infrastructure service environment 30 stores the uploaded file in the repository and creates a database record that associates the data file with the table object 258. Other communicants who enter the Main space 213 are able to view the contents of the uploaded data file and, subject to governance rules associated with the Main space 213, optionally may be able to modify or delete the data file.
  • FIG. 23 shows a situation in which the user has selected a file object 260 on the table object 258 in the view of the Main space 213 shown in FIG. 21 and clicked View (or double-clicked the file object). In response to the user command, the seeker interface presents in the browsing area 166 of the tab 164 a zoomed-in view of the contents of the data file associated with the file object 260 and areas of the table object 258 surrounding the file object 260. In addition, the seeker interface shows in the minimap 256 a view of the table object 258 and areas of the Main space 213 surrounding the table object 258. The minimap 256 also shows a highlighted view 262 of the selected data file 260 on the table object 258. The breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a proposal.pdf button 264 that corresponds to the current level in the hierarchical spatial model of the virtual area. The toolbar 168 also includes a download button 266 that allows the user to download the selected data file 260 from the repository that is maintained by the network infrastructure service environment 30 to the client node 12.
  • FIG. 24 shows a situation in which the user has double-clicked a conferencing object 270 on the table object 258 in the view of the Main space 213 shown in FIG. 21. In response to the user selection of the conferencing object 270, the seeker interface presents in the browsing area 166 of the tab 164 a view of a teleconferencing interface 272 and areas of the table object 258 surrounding the conferencing object 270. The teleconferencing interface 272 includes a text box 271 for receiving a telephone number and a dial button 273 for transmitting the telephone number to a telephony service that connects the client node 12 to a network node that is associated with the telephone number. The seeker interface also shows in the minimap 256 a view of the table object 258 and areas of the Main space 213 surrounding the table object 258. The minimap 256 also shows a highlighted view 274 of the selected conferencing object 270 on the table object 258. The breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a Polycom button 276 that corresponds to the current level in the hierarchical spatial model of the virtual area.
  • As shown in FIGS. 21-24, at the room level of the hierarchical spatial model of the virtual area and lower, the minimap 256 is associated with the following interaction and navigation controls that operate as described above: a speakers button 280, a microphone button 282, a chat button 284, a get (or people) button 286, and a leave button 288.
  • In the embodiment shown in FIGS. 21-24, the minimap 256 is presented as a picture-in-picture view that is superimposed on the view of the successively lower view of the hierarchical spatial model of the virtual area that is presented in the browsing area 166 of the tab 164. In other embodiments, the minimap 256 may be presented in a separate and discrete window that may be tiled over or under the main window 162 or presented in a separate tab of the seeker interface window 162.
  • 6. View Screen Objects
  • FIG. 25 shows a situation in which the user has double-clicked a wall object 290 in the view of the Main space 213 shown in FIG. 21.
  • In response to the user's command to execute the wall object 290, the seeker interface presents in the browsing area 166 of the tab 164 a 2.5-dimensional view of the contents of the wall object 290 and areas of the Main space 213 surrounding the wall object 290. In the embodiment shown in FIG. 25, the selected wall object 290 corresponds to a North Wall of the Main space 213. The North Wall contains a pair of view screen objects 289, 291 (labeled “2” and “3”, respectively) that are presented on the North Wall object 290. The view screen objects 289, 291 can be used to present the contents of data files that are associated with the North Wall of the Main space 213. The 2.5-dimensional view also shows a West Wall object 293 and an East Wall object 295 that are located on the left and right sides of the North Wall object 290, respectively. Each of the West Wall object 293 and the East Wall object 295 includes a respective view screen object 293, 295 (labeled “1” and 4″, respectively) that can be used to present the contents of respective data files.
  • The interface also shows in the minimap 256 a view of the Main space 213 and areas of the Acme space surrounding the Main space 213. The minimap 256 also shows a highlighted view 292 of the selected North Wall object 290 in the Main space 213.
  • The breadcrumb buttons 207 shown in the toolbar 168 of the tab 164 include a North Wall button 294 that corresponds to the current level in the hierarchical spatial model of the virtual area. The toolbar 168 includes a rotate left button 296 and a rotate right button 298 that allow the user to rotate the current view left and right by ninety degrees (90°) so that the user can view the contents of different walls of the Main space in the central viewing area of the 2.5-dimensional view of the Main space 213. The user also can double-click a different one of the walls that are shown in the minimap 256 in order to change the contents that are presented in the central viewing area of the 2.5-dimensional view of the Main space 213.
  • FIG. 26 shows the seeker interface after the user has selected the view screen object 291 (labeled “3”) on the North Wall in the view of the Main space 213 shown in FIG. 25. The user may have executed the view screen object 291 either by double-clicking any part of the view screen object 291 shown in the central viewing area of the 2.5-dimensional view shown in the browsing area 166 of the tab 164 or by double-clicking the corresponding view screen object in the minimap 256 shown in FIG. 25. In response to the user double-clicking on the view screen object 291 shown in FIG. 25, the browsing area 166 of the tab 164 shows a zoomed-in view of the view screen object 291 and areas of the North Wall object 290 surrounding the view screen object 291, as shown in FIG. 26. The user may double-click on any of the areas of the North Wall object 290 surrounding the view screen object 291 in the browsing area 166 shown in FIG. 26 in order to return to the browsing area and minimap views of the Main space 213 that are shown in FIG. 25, in which the user's avatar 192 has moved from adjacent the table object 258 to a position adjacent the selected viewscreen object 291. In the embodiment shown in FIG. 26, the minimap 256 shows a 2.5-dimensional view of the contents of the wall object 290 along with areas of the Main space surrounding the wall object 290; this view corresponds to the preceding level in the hierarchical spatial model of the virtual area. The breadcrumb buttons 207 include a Screen 3 button 302 that corresponds to the current level in the hierarchical spatial model of the virtual area. The toolbar 168 includes a Share button 304 that allows a user to designate a shared data file whose contents will be presented on the view screen object 291 (i.e., Screen 3) and thereby allow all communicants in the Main space 213 to simultaneously share the data file. The view screen object 291 shown in the browsing area 166 includes a Share link 306 that also allows the user to designate the shared data file.
  • In response to a user selection of the Share button 304 or the Share link 306, the seeker interface opens a separate Select Source interface window 310 that allows the user to designate a data file whose contents will be shared on the view screen object 291. The Select Source interface includes a text box 312 for receiving a data file identifier (e.g., a local data file storage path name or a Uniform Resource Identifier (URI)) and a Browse button 314 that enables the user to browse different locations for the data file identifier. The data file identifier may be located on the client node 12 or another network node. The Select Source interface window 310 also includes a favorites button 316 that allows the user to browse a list of previously bookmarked files, applications, or URIs for the data file identifier.
  • Referring to FIG. 28, after the user has selected a data file identifier in the Select Source interface, the contents of the selected data file are displayed on the view screen object 291 in both the browsing area 166 and the minimap 256. In the illustrated embodiment, the designated data file corresponds to a PowerPoint® data file that contains a slide of a pie chart. The user can terminate the presentation of the data file on the view screen object 291 by selecting the clear icon 318.
  • 7. Multiple Presence
  • Users are able to concurrently have a respective presence in multiple locations in a virtual area. In this way, users can monitor and participate in the interactions occurring in multiple locations at the same time. In some embodiments, the user establishes a respective presence in each of multiple locations by inputting a copy presence command through the seeker interface. In some embodiments, the user inputs the copy presence command either by shift-clicking the target zone where the user intends to establish an additional presence or by shift-clicking a reference (e.g., a hyperlink) to the target zone (e.g., by shift-double-clicking a breadcrumb or placemark that is linked to the target zone). Note that the user can shift-double click an object or zone (since clicking would merely select it), whereas the user can merely shift-click a reference, since the reference can't be selected. In response to receipt of a copy presence command in connection with a user selection of one of the zones displayed on the monitor, the system depicts a respective graphical representation of the user in the selected zone while continuing to depict a respective graphical representation of the user in each of the zones where the user had presence before the selection of the zone. In some embodiments, each of the graphical representations of the user is depicted in a respective view that is presented in a separate window on the display. The windows may be associated with respective user-selectable tabs and, in response to a user selection of any of the tabs, the seeker interface displays only content of the window respectively associated with the selected tab in a common display area.
  • FIG. 29 shows the situation in which the user has shift-clicked a link to the Courtyard space 190 via the seeker interface window 162 shown in FIG. 28 (e.g., by using the placemarks navigation control). In response to the shift-click selection of the Courtyard space link, the platform creates a second seeker interface window 320 that is independent and discrete from the first seeker interface window 162. The second seeker interface window 320 is identical in all respects to the first seeker interface window 162, except that it shows a copy 322 of the user's sprite in the view of the Courtyard space 190 that is presented in the browsing area 324 of the second seeker interface window 320. The second seeker interface window 320 includes one or more tabs, each of which has a respective browsing area and a toolbar. The toolbar includes a back button, a forward button, a placemarks button, and a home button. The toolbar also includes a speakers button 326, which enable the user to independently control local (i.e., at the client node 12) sound rendering of audio associated with the Courtyard space 190, and a microphone button 328, which allows the user to turn-on and turn-off the microphone at the client node 12. In some embodiments, the platform allows the user to selectively transmit local microphone signals to only one of the zones in which the user has presence at a time.
  • The user can manipulate the second seeker interface window 320 independently of the first seeker interface window 162. For example, the user can close the second seeker interface window 320 without affecting the first seeker interface window 162 as shown in FIG. 30. The user also can move the second seeker interface window 320 to a different location on the display relative to the first window 162 as shown in FIG. 31. Other window operations (e.g., resizing, tiling over or under other windows) also can be performed on the second seeker interface window 320.
  • 8. Browsing Areas and Spaces
  • Referring to FIGS. 32 and 33, in addition to the seeker interface window 162, some embodiments allow the user to open a separate navigation interface window 340 that provides the user with additional tools for navigating the virtual environment. The navigation interface window 340 includes an Areas tab 342 and a Rooms tab 344.
  • As shown in FIG. 32, the Areas tab 342 shows a list of graphical representations of the virtual areas that are associated with the user (e.g., the Acme area 172 and the Sococo Help Desk 174). The virtual area list may be a static list or it may be generated dynamically based on the results of a query on the relationship database 36 for virtual areas that are associated with the user. In response to the user's selection of any of the graphical representations of the virtual areas shown in the Areas tab 342, the system automatically updates the view that is displayed in the seeker interface window 162, the user's presence state, and the user's network connections to reflect the user's entry into the selected area.
  • As shown in FIG. 33, the Rooms tab 344 shows a set of floating windows 350, 352 each of which is associated with a filtered list of the renderable zones of one or more of the virtual areas that are associated with the user. In the illustrated embodiment, the “Present At” window 350 is associated with a list of graphical representations of all the renderable zones in which the user has a respective presence, and the “All” window 352 is associated with a list of all of the renderable zones in each of the virtual areas in which the user has a respective presence. Additional filtered lists of spaces are possible. For example, in some embodiments, the Rooms tab 344 includes a floating window that is associated with a list of graphical representations of all the renderable zones of a virtual area that are active (i.e., that have at least one person in them). In some embodiments, the Rooms tab 344 includes a floating window that is associated with a list of graphical representations of all the renderable zones that the user has associated with a placemark (e.g., a zone corresponding to the user's office). In response to the user's selection of any of the graphical representations of the zones shown in the Rooms tab 344, the system automatically updates the view in the seeker interface window 162, the user's presence state, and the user's network connections to reflect the user's entry into the selected zone.
  • 9. Notifications
  • Referring to FIGS. 34, 35, and 36, some embodiments display various notifications of events occurring in the zones of one or more virtual areas. Each notification window typically describes a single event that is associated with a respective one of the zones (e.g., reception of a new chat message, reception of an invitation to join another communicant in a particular zone, and a change in a communicant's presence state in a zone). For example, FIG. 34 shows an embodiment in which a notification window 360 is displayed each time a communicant leaves a renderable zone in which the user has a respective presence (e.g., “Frank Rodriguez has left Main”). FIG. 35 shows an embodiment in which a notification window 362 is displayed each time a communicant enters a renderable zone in which the user has a respective presence (e.g., “Frank Rodriguez has entered Main”). FIG. 36 shows an embodiment in which a notification window 364 is displayed each time the user receives an invitation to join another communicant in a particular zone (e.g., a message from Hand Kim to “Please join me in the courtyard”).
  • In some embodiments, the notification windows 360, 362 are implemented by so-called “toast” windows that dynamically pops up out of corner of the user's desktop.
  • In some embodiments, the notification window includes a hyperlink to the respective zone that is the subject of the notification. For example, in the embodiment shown in FIG. 36, the notification window 364 includes a minimap 366 that shows a graphical representation of the Courtyard space 190 that is associated with a hyperlink reference to the Courtyard space 190. In response to a user selection of the hyperlink, the platform moves the graphical representation of the user to the respective zone (e.g., the Courtyard space 190) from the zone (e.g., the Main space 213) where the user had presence before the selection and establishes a presence for the user in the respective zone (e.g., the Courtyard space 190).
  • V. CONCLUSION
  • The embodiments that are described herein provide improved systems and methods for navigating and interacting in spatial virtual communication environments. These embodiments provide an interface that includes navigation controls that enable a user to navigate virtual areas and interaction controls that enable the user to interact with other communicants in the virtual areas. The navigation controls allow the user to change his or her focus (e.g., the current view of the virtual area or the current zone or zones where the user has presence) using a variety of intuitive point-and-click browsing methods in the context of a hierarchical spatial model of a virtual area. In some embodiments, the interface adaptively presents navigation controls and interaction controls that are appropriate to the user's needs in the context of the user's current focus.
  • Other embodiments are within the scope of the claims.

Claims (16)

1-65. (canceled)
66. A method, in a network communication environment in which a user and one or more other communicants operating respective network nodes establish respective presences in virtual locations in which the communicants are represented by respective avatars, the method comprising:
displaying respective graphical representations of a virtual area, a first viewscreen object in the virtual area, a second viewscreen object in the virtual area, and the avatars of the user and one or more other communicants who are co-present with the user in the virtual area;
based on communicant input in connection with the first viewscreen object, simultaneously sharing renderings of contents of a first data file the among ones of the communicants who are co-present in the virtual area; and
based on communicant input in connection with the second viewscreen object, simultaneously sharing renderings of contents of a second data file among ones of the communicants who are co-present in the virtual area.
67. The method of claim 66, wherein the sharing of the renderings of contents of the first data file is initiated by input of the user in connection with the first viewscreen object, and the sharing of the renderings of contents of the second data file is initiated by input of the user in connection with the second viewscreen object.
68. The method of claim 67, wherein the renderings of contents of the first data file in connection with the first viewscreen object are viewable by ones of the communicants who are co-present with the user in the virtual area, and the renderings of contents of the second data file in connection with the second viewscreen object are viewable by ones of the communicants who are co-present with the user in the virtual area.
69. The method of claim 66, wherein the sharing of the renderings of contents of the first data file is initiated by input of the user in connection with the first viewscreen object, and the sharing of the renderings of contents of the second data file is initiated by input of respective one of the other communicants who is co-present with the user in the virtual area in connection with the second viewscreen object.
70. The method of claim 69, wherein the renderings of contents of the first data file in connection with the first viewscreen object are viewable by ones of the communicants who are co-present with the user in the virtual area, and the renderings of contents of the second data file in connection with the second viewscreen object are viewable by the user and ones of the communicants who are co-present with the user in the virtual area.
71. The method of claim 66, further comprising: based on the communicant input in connection with the first viewscreen object, depicting a visual indication that the respective communicant is sharing renderings of contents of the first data file.
72. The method of claim 71, wherein the depicting comprises moving an avatar of the respective communicant to a position adjacent the graphical representation of the first viewscreen object in the graphical representation of the virtual area.
73. The method of claim 71, further comprising: based on the communicant input in connection with the second viewscreen object, showing a visual indication that the respective communicant is sharing renderings of contents of the second data file.
74. The method of claim 73, wherein the depicting comprises moving an avatar of the respective communicant to a position adjacent the graphical representation of the first viewscreen object in the graphical representation of the virtual area, and the showing comprises moving an avatar of the respective communicant to a position adjacent the graphical representation of the second viewscreen object in the graphical representation of the virtual area.
75. The method of claim 66, wherein the virtual area comprises zones, each of the zones defines a respective virtual location of communicant presence that supports establishment of communication sessions between network nodes of communicants who are co-present in the zone, and the first and second viewscreen objects are in a respective one of the zones.
76. The method of claim 75, wherein the displaying comprises displaying a spatial layout of respective ones of the zones in the graphical representation of the virtual area with the zones being demarcated by respective visual boundaries in the spatial layout.
77. The method of claim 76, wherein each of ones of the zones is associated with at least one respective viewscreen object, and each viewscreen object is represented by a graphical representation of a viewscreen and is associated with functionality for sharing renderings of contents of data files between communicants who are co-present present in the associated zone.
78. The method of claim 77, wherein:
based on communicant selection of a graphical representation of a viewscreen in a particular one of the zones, displaying an interface for selecting data to be shared with other communicants in the particular zone in connection with the associated viewscreen object; and
based on a user selection of the data to be shared in connection with the viewscreen object associated with the selected graphical representation of the viewscreen, sharing renderings of contents of the data file with other communicants who are present in the particular zone.
79. At least one computer-readable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed by a computer to perform operations in a network communication environment in which a user and one or more other communicants operating respective network nodes establish respective presences in virtual locations in which the communicants are represented by respective avatars, the operations comprising:
displaying respective graphical representations of a virtual area, a first viewscreen object in the virtual area, a second viewscreen object in the virtual area, and the avatars of the user and one or more other communicants who are co-present with the user in the virtual area;
based on communicant input in connection with the first viewscreen object, simultaneously sharing renderings of contents of a first data file the among ones of the communicants who are co-present in the virtual area; and
based on communicant input in connection with the second viewscreen object, simultaneously sharing renderings of contents of a second data file among ones of the communicants who are co-present in the virtual area.
80. Apparatus, comprising:
a computer-readable medium storing computer-readable instructions; and
a data processing unit coupled to the computer-readable medium, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations in a network communication environment in which a user and one or more other communicants operating respective network nodes establish respective presences in virtual locations in which the communicants are represented by respective avatars, the operations comprising
displaying respective graphical representations of a virtual area, a first viewscreen object in the virtual area, a second viewscreen object in the virtual area, and the avatars of the user and one or more other communicants who are co-present with the user in the virtual area,
based on communicant input in connection with the first viewscreen object, simultaneously sharing renderings of contents of a first data file the among ones of the communicants who are co-present in the virtual area, and
based on communicant input in connection with the second viewscreen object, simultaneously sharing renderings of contents of a second data file among ones of the communicants who are co-present in the virtual area.
US13/666,717 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment Active 2031-03-30 US9483157B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/666,717 US9483157B2 (en) 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US11/923,634 US7844724B2 (en) 2007-10-24 2007-10-24 Automated real-time data stream switching in a shared virtual area communication environment
US11/923,629 US7769806B2 (en) 2007-10-24 2007-10-24 Automated real-time data stream switching in a shared virtual area communication environment
US4271408P 2008-04-05 2008-04-05
US12/354,709 US8397168B2 (en) 2008-04-05 2009-01-15 Interfacing with a spatial virtual communication environment
US13/666,717 US9483157B2 (en) 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/354,709 Continuation US8397168B2 (en) 2007-10-24 2009-01-15 Interfacing with a spatial virtual communication environment

Publications (2)

Publication Number Publication Date
US20130100142A1 true US20130100142A1 (en) 2013-04-25
US9483157B2 US9483157B2 (en) 2016-11-01

Family

ID=42340581

Family Applications (4)

Application Number Title Priority Date Filing Date
US12/354,709 Active 2030-11-25 US8397168B2 (en) 2007-10-24 2009-01-15 Interfacing with a spatial virtual communication environment
US13/666,633 Active 2030-11-21 US9411489B2 (en) 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment
US13/666,717 Active 2031-03-30 US9483157B2 (en) 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment
US13/666,777 Abandoned US20130061158A1 (en) 2009-01-15 2012-11-01 Interfacing with a spatial virtual communication environment

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/354,709 Active 2030-11-25 US8397168B2 (en) 2007-10-24 2009-01-15 Interfacing with a spatial virtual communication environment
US13/666,633 Active 2030-11-21 US9411489B2 (en) 2007-10-24 2012-11-01 Interfacing with a spatial virtual communication environment

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/666,777 Abandoned US20130061158A1 (en) 2009-01-15 2012-11-01 Interfacing with a spatial virtual communication environment

Country Status (7)

Country Link
US (4) US8397168B2 (en)
EP (1) EP2377038A4 (en)
JP (1) JP2012515398A (en)
KR (2) KR20110113633A (en)
CN (1) CN102356386A (en)
IL (1) IL213868A0 (en)
WO (1) WO2010083119A2 (en)

Families Citing this family (153)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7616561B1 (en) 2005-01-19 2009-11-10 Juniper Networks, Inc. Systems and methods for routing data in a communications network
US8788319B2 (en) * 2005-12-30 2014-07-22 Microsoft Corporation Social context monitor
US8584013B1 (en) * 2007-03-20 2013-11-12 Google Inc. Temporal layers for presenting personalization markers on imagery
US8514842B1 (en) * 2007-09-28 2013-08-20 Adobe Systems Incorporated Systems and methods for enabling communication between users of common virtual spaces
US9357025B2 (en) 2007-10-24 2016-05-31 Social Communications Company Virtual area based telephony communications
US8397168B2 (en) * 2008-04-05 2013-03-12 Social Communications Company Interfacing with a spatial virtual communication environment
US9009603B2 (en) 2007-10-24 2015-04-14 Social Communications Company Web browser interface for spatial communication environments
US8578000B2 (en) 2008-12-05 2013-11-05 Social Communications Company Realtime kernel
US9514444B2 (en) 2009-01-15 2016-12-06 Sococo, Inc. Encapsulating virtual area based communicant assemblies
EP2279472A4 (en) 2008-04-05 2013-11-20 Social Communications Co Shared virtual area communication environment based apparatus and methods
US8499250B2 (en) * 2008-05-13 2013-07-30 Cyandia, Inc. Apparatus and methods for interacting with multiple information forms across multiple types of computing devices
US8751948B2 (en) * 2008-05-13 2014-06-10 Cyandia, Inc. Methods, apparatus and systems for providing and monitoring secure information via multiple authorized channels and generating alerts relating to same
US9002820B2 (en) * 2008-06-05 2015-04-07 Gary Stephen Shuster Forum search with time-dependent activity weighting
US8914854B2 (en) * 2008-09-11 2014-12-16 International Business Machines Corporation User credential verification indication in a virtual universe
US9069851B2 (en) * 2009-01-15 2015-06-30 Social Communications Company Client application integrating web browsing and network data stream processing for realtime communications
US9065874B2 (en) 2009-01-15 2015-06-23 Social Communications Company Persistent network resource and virtual area associations for realtime collaboration
US9853922B2 (en) * 2012-02-24 2017-12-26 Sococo, Inc. Virtual area communications
US9319357B2 (en) 2009-01-15 2016-04-19 Social Communications Company Context based virtual area creation
US10356136B2 (en) 2012-10-19 2019-07-16 Sococo, Inc. Bridging physical and virtual spaces
US20130283166A1 (en) 2012-04-24 2013-10-24 Social Communications Company Voice-based virtual area navigation
WO2011013805A1 (en) 2009-07-31 2011-02-03 日本電気株式会社 Control server, service-providing system, and method of providing a virtual infrastructure
US8806355B2 (en) * 2009-11-06 2014-08-12 Cisco Technology, Inc. Method and apparatus for visualizing and navigating within an immersive collaboration environment
US8631334B2 (en) * 2009-12-31 2014-01-14 International Business Machines Corporation Virtual world presentation composition and management
US8244754B2 (en) 2010-02-01 2012-08-14 International Business Machines Corporation System and method for object searching in virtual worlds
JP5488011B2 (en) * 2010-02-04 2014-05-14 ソニー株式会社 COMMUNICATION CONTROL DEVICE, COMMUNICATION CONTROL METHOD, AND PROGRAM
US9417691B2 (en) * 2010-03-26 2016-08-16 Nokia Technologies Oy Method and apparatus for ad-hoc peer-to-peer augmented reality environment
US9955209B2 (en) 2010-04-14 2018-04-24 Alcatel-Lucent Usa Inc. Immersive viewer, a method of providing scenes on a display and an immersive viewing system
US9294716B2 (en) 2010-04-30 2016-03-22 Alcatel Lucent Method and system for controlling an imaging system
US9189143B2 (en) * 2010-04-30 2015-11-17 American Teleconferencing Services, Ltd. Sharing social networking content in a conference user interface
US8453212B2 (en) * 2010-07-27 2013-05-28 Raytheon Company Accessing resources of a secure computing network
US10140000B2 (en) * 2010-07-30 2018-11-27 Autodesk, Inc. Multiscale three-dimensional orientation
WO2012034044A2 (en) * 2010-09-11 2012-03-15 Social Communications Company Relationship based presence indicating in virtual area contexts
US8754925B2 (en) 2010-09-30 2014-06-17 Alcatel Lucent Audio source locator and tracker, a method of directing a camera to view an audio source and a video conferencing terminal
US8819726B2 (en) 2010-10-14 2014-08-26 Cyandia, Inc. Methods, apparatus, and systems for presenting television programming and related information
KR101741551B1 (en) * 2010-12-20 2017-06-15 엘지전자 주식회사 Mobile terminal and Method for controlling application thereof
US20120216129A1 (en) * 2011-02-17 2012-08-23 Ng Hock M Method and apparatus for providing an immersive meeting experience for remote meeting participants
WO2012135231A2 (en) 2011-04-01 2012-10-04 Social Communications Company Creating virtual areas for realtime communications
US9369543B2 (en) * 2011-05-27 2016-06-14 Microsoft Technology Licensing, Llc Communication between avatars in different games
WO2013016165A1 (en) * 2011-07-22 2013-01-31 Social Communications Company Communicating between a virtual area and a physical space
WO2013039748A2 (en) * 2011-09-16 2013-03-21 Social Communications Company Capabilities based management of virtual areas
CN104025538B (en) * 2011-11-03 2018-04-13 Glowbl公司 Communication interface and communication means, corresponding computer program and medium is registered accordingly
US20130145293A1 (en) * 2011-12-01 2013-06-06 Avaya Inc. Methods, apparatuses, and computer-readable media for providing availability metaphor(s) representing communications availability in an interactive map
US9008487B2 (en) 2011-12-06 2015-04-14 Alcatel Lucent Spatial bookmarking
US20130159875A1 (en) * 2011-12-14 2013-06-20 Microsoft Corporation Graphical user interface to facilitate selectable presentation point of message list
CN104584566A (en) * 2012-01-08 2015-04-29 汤姆逊许可公司 Method and appartus for providing media asset recommendations
WO2013119802A1 (en) 2012-02-11 2013-08-15 Social Communications Company Routing virtual area based communications
JP5927966B2 (en) 2012-02-14 2016-06-01 ソニー株式会社 Display control apparatus, display control method, and program
US9310955B2 (en) 2012-04-11 2016-04-12 Myriata, Inc. System and method for generating a virtual tour within a virtual environment
US9563902B2 (en) 2012-04-11 2017-02-07 Myriata, Inc. System and method for transporting a virtual avatar within multiple virtual environments
US9047690B2 (en) 2012-04-11 2015-06-02 Myriata, Inc. System and method for facilitating creation of a rich virtual environment
EP2856280A4 (en) * 2012-06-01 2016-05-18 Sas Ip User interface and method of data navigation in the user interface of engineering analysis applications
WO2013181026A1 (en) 2012-06-02 2013-12-05 Social Communications Company Interfacing with a spatial virtual communications environment
CN102739183B (en) * 2012-06-13 2013-08-21 天地融科技股份有限公司 Audio interface matching identification method and device for mobile terminal, and electronic signature tool
KR101426994B1 (en) * 2012-06-29 2014-08-05 인텔렉추얼디스커버리 주식회사 Apparatus and method of sharing data using topology of mobile portable devices
US9241017B2 (en) * 2012-07-03 2016-01-19 Salesforce.Com, Inc. Systems and methods for cross domain service component interaction
KR101542592B1 (en) * 2012-07-13 2015-08-07 네이버 주식회사 Method of Managing Toolbar Button Specialized for Each Domain
WO2014100374A2 (en) * 2012-12-19 2014-06-26 Rabbit, Inc. Method and system for content sharing and discovery
EP2749327A1 (en) * 2012-12-26 2014-07-02 Disney Enterprises, Inc. Managing objectives, an environment, and/or a theme associated with a virtual space based on characters made accessible responsive to corresponding tokens being detected
US8924388B2 (en) 2013-03-15 2014-12-30 Palantir Technologies Inc. Computer-implemented systems and methods for comparing and associating objects
JP6721285B2 (en) * 2013-08-21 2020-07-15 任天堂株式会社 Information processing apparatus, information processing system, information processing program, and information processing method
KR102078867B1 (en) * 2013-09-17 2020-02-18 삼성전자주식회사 Method for managing control right, client device thereof, and master device thereof
KR101627169B1 (en) * 2013-09-27 2016-06-07 한국과학기술연구원 System for authorting and providing augmented reality cotents
US10484189B2 (en) 2013-11-13 2019-11-19 Microsoft Technology Licensing, Llc Enhanced collaboration services
US10356032B2 (en) 2013-12-26 2019-07-16 Palantir Technologies Inc. System and method for detecting confidential information emails
US9418482B1 (en) * 2014-01-22 2016-08-16 Google Inc. Discovering visited travel destinations from a set of digital images
US9916082B2 (en) * 2014-03-28 2018-03-13 Kyocera Document Solutions Inc. Display input apparatus and computer-readable non-transitory recording medium with display input control program recorded thereon
US20150277689A1 (en) * 2014-03-28 2015-10-01 Kyocera Document Solutions Inc. Display input apparatus and computer-readable non-transitory recording medium with display input control program recorded thereon
USD776140S1 (en) 2014-04-30 2017-01-10 Yahoo! Inc. Display screen with graphical user interface for displaying search results as a stack of overlapping, actionable cards
US9830388B2 (en) * 2014-04-30 2017-11-28 Excalibur Ip, Llc Modular search object framework
US9535974B1 (en) 2014-06-30 2017-01-03 Palantir Technologies Inc. Systems and methods for identifying key phrase clusters within documents
US9619557B2 (en) 2014-06-30 2017-04-11 Palantir Technologies, Inc. Systems and methods for key phrase characterization of documents
US9256664B2 (en) 2014-07-03 2016-02-09 Palantir Technologies Inc. System and method for news events detection and visualization
CN104266642B (en) * 2014-10-16 2017-05-03 崔永锋 Displaying and navigating method for visual dormitory beds based on mobile indoor map of campus
US9483546B2 (en) 2014-12-15 2016-11-01 Palantir Technologies Inc. System and method for associating related records to common entities across multiple lists
US10359905B2 (en) 2014-12-19 2019-07-23 Entit Software Llc Collaboration with 3D data visualizations
US9335911B1 (en) * 2014-12-29 2016-05-10 Palantir Technologies Inc. Interactive user interface for dynamic data analysis exploration and query processing
CN105847670B (en) * 2015-02-04 2019-06-21 佳能株式会社 Electronic equipment, video camera controller and its control method
US9727560B2 (en) 2015-02-25 2017-08-08 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US9984428B2 (en) 2015-09-04 2018-05-29 Palantir Technologies Inc. Systems and methods for structuring data from unstructured electronic data files
US9639580B1 (en) 2015-09-04 2017-05-02 Palantir Technologies, Inc. Computer-implemented systems and methods for data management and visualization
AU2016327973B2 (en) 2015-09-24 2019-09-26 Circadence Corporation Mission-based, game-implemented cyber training system and method
US10238948B2 (en) 2015-09-24 2019-03-26 Circadence Corporation Mission-based, game-implemented cyber training system and method
US10672289B2 (en) 2015-09-24 2020-06-02 Circadence Corporation System for dynamically provisioning cyber training environments
US10706056B1 (en) 2015-12-02 2020-07-07 Palantir Technologies Inc. Audit log report generator
US9760556B1 (en) 2015-12-11 2017-09-12 Palantir Technologies Inc. Systems and methods for annotating and linking electronic documents
US9514414B1 (en) 2015-12-11 2016-12-06 Palantir Technologies Inc. Systems and methods for identifying and categorizing electronic documents through machine learning
US10871878B1 (en) 2015-12-29 2020-12-22 Palantir Technologies Inc. System log analysis and object user interaction correlation system
US9792020B1 (en) 2015-12-30 2017-10-17 Palantir Technologies Inc. Systems for collecting, aggregating, and storing data, generating interactive user interfaces for analyzing data, and generating alerts based upon collected data
US10698938B2 (en) 2016-03-18 2020-06-30 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US10068199B1 (en) 2016-05-13 2018-09-04 Palantir Technologies Inc. System to catalogue tracking data
US10545975B1 (en) 2016-06-22 2020-01-28 Palantir Technologies Inc. Visual analysis of data using sequenced dataset reduction
WO2018005671A1 (en) 2016-06-28 2018-01-04 Against Gravity Corp. Systems and methods for transferring object authority in a shared virtual environment
JP6844139B2 (en) * 2016-07-13 2021-03-17 株式会社リコー Imaging device, system
US10552002B1 (en) 2016-09-27 2020-02-04 Palantir Technologies Inc. User interface based variable machine modeling
JP6764996B2 (en) * 2016-10-05 2020-10-07 モックス ネットワークス,エルエルシー RFID-based rack inventory management system
CN106327942A (en) * 2016-10-21 2017-01-11 上海申电教育培训有限公司 Distributed electric power training system based on virtual reality
CN106453602B (en) * 2016-10-28 2019-10-29 深圳多哚新技术有限责任公司 A kind of data processing method and device based on VR glasses
US10726507B1 (en) 2016-11-11 2020-07-28 Palantir Technologies Inc. Graphical representation of a complex task
US10318630B1 (en) 2016-11-21 2019-06-11 Palantir Technologies Inc. Analysis of large bodies of textual data
CN107066182B (en) * 2016-11-30 2019-10-22 深圳市中视典数字科技有限公司 The method and device of guide to visitors figure amplification based on three-dimensional scenic interactive table
GB201621434D0 (en) 2016-12-16 2017-02-01 Palantir Technologies Inc Processing sensor logs
US10249033B1 (en) 2016-12-20 2019-04-02 Palantir Technologies Inc. User interface for managing defects
US11373752B2 (en) 2016-12-22 2022-06-28 Palantir Technologies Inc. Detection of misuse of a benefit system
US10360238B1 (en) 2016-12-22 2019-07-23 Palantir Technologies Inc. Database systems and user interfaces for interactive data association, analysis, and presentation
US10762471B1 (en) 2017-01-09 2020-09-01 Palantir Technologies Inc. Automating management of integrated workflows based on disparate subsidiary data sources
US10133621B1 (en) 2017-01-18 2018-11-20 Palantir Technologies Inc. Data analysis system to facilitate investigative process
US10509844B1 (en) 2017-01-19 2019-12-17 Palantir Technologies Inc. Network graph parser
US10515109B2 (en) 2017-02-15 2019-12-24 Palantir Technologies Inc. Real-time auditing of industrial equipment condition
CN106873597B (en) * 2017-03-24 2020-11-10 上海思岚科技有限公司 Method for realizing setting of virtual track for mobile robot through computer client
US10866936B1 (en) 2017-03-29 2020-12-15 Palantir Technologies Inc. Model object management and storage system
US10581954B2 (en) 2017-03-29 2020-03-03 Palantir Technologies Inc. Metric collection and aggregation for distributed software services
US10133783B2 (en) 2017-04-11 2018-11-20 Palantir Technologies Inc. Systems and methods for constraint driven database searching
WO2018195280A1 (en) * 2017-04-21 2018-10-25 Walmart Apollo, Llc Virtual reality network management user interface
US10563990B1 (en) 2017-05-09 2020-02-18 Palantir Technologies Inc. Event-based route planning
US10795749B1 (en) 2017-05-31 2020-10-06 Palantir Technologies Inc. Systems and methods for providing fault analysis user interface
US10430444B1 (en) 2017-07-24 2019-10-01 Palantir Technologies Inc. Interactive geospatial map and geospatial visualization systems
US10732811B1 (en) 2017-08-08 2020-08-04 Wells Fargo Bank, N.A. Virtual reality trading tool
WO2019040613A1 (en) * 2017-08-24 2019-02-28 Circadence Corporation System for dynamically provisioning cyber training environments
US11368351B1 (en) * 2017-09-19 2022-06-21 Lockheed Martin Corporation Simulation view network streamer
US10791082B2 (en) * 2017-11-21 2020-09-29 D8AI Inc. Systems and methods for delivery and use of interactive objects
US10877984B1 (en) 2017-12-07 2020-12-29 Palantir Technologies Inc. Systems and methods for filtering and visualizing large scale datasets
US10769171B1 (en) 2017-12-07 2020-09-08 Palantir Technologies Inc. Relationship analysis and mapping for interrelated multi-layered datasets
US11314721B1 (en) 2017-12-07 2022-04-26 Palantir Technologies Inc. User-interactive defect analysis for root cause
US11263382B1 (en) 2017-12-22 2022-03-01 Palantir Technologies Inc. Data normalization and irregularity detection system
CN108415563A (en) * 2017-12-27 2018-08-17 广东鸿威国际会展集团有限公司 Immersion three-dimensional display system and method
US10885021B1 (en) 2018-05-02 2021-01-05 Palantir Technologies Inc. Interactive interpreter and graphical user interface
US11126638B1 (en) 2018-09-13 2021-09-21 Palantir Technologies Inc. Data visualization and parsing system
US11294928B1 (en) 2018-10-12 2022-04-05 Palantir Technologies Inc. System architecture for relating and linking data objects
AU2021276760A1 (en) * 2020-05-19 2022-03-17 Ovice, Inc. Information processing system, information processing apparatus, and program
CN112311754B (en) * 2020-06-02 2022-09-30 北京字节跳动网络技术有限公司 Interaction method and device and electronic equipment
US10979672B1 (en) 2020-10-20 2021-04-13 Katmai Tech Holdings LLC Web-based videoconference virtual environment with navigable avatars, and applications thereof
US11457178B2 (en) 2020-10-20 2022-09-27 Katmai Tech Inc. Three-dimensional modeling inside a virtual video conferencing environment with a navigable avatar, and applications thereof
US11095857B1 (en) 2020-10-20 2021-08-17 Katmai Tech Holdings LLC Presenter mode in a three-dimensional virtual conference space, and applications thereof
US11070768B1 (en) 2020-10-20 2021-07-20 Katmai Tech Holdings LLC Volume areas in a three-dimensional virtual conference space, and applications thereof
US10952006B1 (en) 2020-10-20 2021-03-16 Katmai Tech Holdings LLC Adjusting relative left-right sound to provide sense of an avatar's position in a virtual space, and applications thereof
US11076128B1 (en) 2020-10-20 2021-07-27 Katmai Tech Holdings LLC Determining video stream quality based on relative position in a virtual space, and applications thereof
CN112115500A (en) * 2020-11-20 2020-12-22 北京联想协同科技有限公司 Method, device and system for accessing file
GB2606131A (en) * 2021-03-12 2022-11-02 Palringo Ltd Communication platform
US11743430B2 (en) 2021-05-06 2023-08-29 Katmai Tech Inc. Providing awareness of who can hear audio in a virtual conference, and applications thereof
US11184362B1 (en) 2021-05-06 2021-11-23 Katmai Tech Holdings LLC Securing private audio in a virtual conference, and applications thereof
JP7158781B1 (en) * 2021-11-29 2022-10-24 クラスター株式会社 Terminal device, server, virtual reality space providing system, program, and virtual reality space providing method
US11789602B1 (en) * 2022-04-18 2023-10-17 Spatial Systems Inc. Immersive gallery with linear scroll
US11876630B1 (en) 2022-07-20 2024-01-16 Katmai Tech Inc. Architecture to control zones
US11651108B1 (en) 2022-07-20 2023-05-16 Katmai Tech Inc. Time access control in virtual environment application
US11700354B1 (en) 2022-07-21 2023-07-11 Katmai Tech Inc. Resituating avatars in a virtual environment
US11741664B1 (en) 2022-07-21 2023-08-29 Katmai Tech Inc. Resituating virtual cameras and avatars in a virtual environment
US11593989B1 (en) 2022-07-28 2023-02-28 Katmai Tech Inc. Efficient shadows for alpha-mapped models
US11682164B1 (en) 2022-07-28 2023-06-20 Katmai Tech Inc. Sampling shadow maps at an offset
US11562531B1 (en) 2022-07-28 2023-01-24 Katmai Tech Inc. Cascading shadow maps in areas of a three-dimensional environment
US11711494B1 (en) 2022-07-28 2023-07-25 Katmai Tech Inc. Automatic instancing for efficient rendering of three-dimensional virtual environment
US11776203B1 (en) 2022-07-28 2023-10-03 Katmai Tech Inc. Volumetric scattering effect in a three-dimensional virtual environment with navigable video avatars
US11704864B1 (en) 2022-07-28 2023-07-18 Katmai Tech Inc. Static rendering for a combination of background and foreground objects
US11748939B1 (en) 2022-09-13 2023-09-05 Katmai Tech Inc. Selecting a point to navigate video avatars in a three-dimensional environment

Citations (109)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471318A (en) * 1993-04-22 1995-11-28 At&T Corp. Multimedia communications network
US5491743A (en) * 1994-05-24 1996-02-13 International Business Machines Corporation Virtual conference system and terminal apparatus therefor
US5737533A (en) * 1995-10-26 1998-04-07 Wegener Internet Projects Bv System for generating a virtual reality scene in response to a database search
US5793365A (en) * 1996-01-02 1998-08-11 Sun Microsystems, Inc. System and method providing a computer user interface enabling access to distributed workgroup members
US5956038A (en) * 1995-07-12 1999-09-21 Sony Corporation Three-dimensional virtual reality space sharing method and system, an information recording medium and method, an information transmission medium and method, an information processing method, a client terminal, and a shared server terminal
US5982372A (en) * 1996-11-14 1999-11-09 International Business Machines Corp. Visual metaphor for shortcut navigation in a virtual world
US5999208A (en) * 1998-07-15 1999-12-07 Lucent Technologies Inc. System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room
US6005578A (en) * 1997-09-25 1999-12-21 Mindsphere, Inc. Method and apparatus for visual navigation of information objects
US6057856A (en) * 1996-09-30 2000-05-02 Sony Corporation 3D virtual reality multi-user interaction with superimposed positional information display for each user
US6119147A (en) * 1998-07-28 2000-09-12 Fuji Xerox Co., Ltd. Method and system for computer-mediated, multi-modal, asynchronous meetings in a virtual space
US6219045B1 (en) * 1995-11-13 2001-04-17 Worlds, Inc. Scalable virtual world chat client-server system
US6335927B1 (en) * 1996-11-18 2002-01-01 Mci Communications Corporation System and method for providing requested quality of service in a hybrid network
US20020026388A1 (en) * 2000-08-01 2002-02-28 Chris Roebuck Method of distributing a product, providing incentives to a consumer, and collecting data on the activities of a consumer
US20020033848A1 (en) * 2000-04-21 2002-03-21 Sciammarella Eduardo Agusto System for managing data objects
US20020049814A1 (en) * 2000-08-31 2002-04-25 Yoo Hwan Soo System and method for book-marking a specific location in virtual space
US20020052918A1 (en) * 2000-09-07 2002-05-02 Junichi Rekimoto Method and system for supporting virtual conversation, and storage medium
US6396509B1 (en) * 1998-02-21 2002-05-28 Koninklijke Philips Electronics N.V. Attention-based interaction in a virtual environment
US20030065558A1 (en) * 2001-09-12 2003-04-03 Cameron Shaw Method and apparatus for multi-vendor powered business portal with intelligent service promotion and user profile gathering
US20030149731A1 (en) * 2002-01-23 2003-08-07 Sony Corporation Information processing device and method, and program
US20030215779A1 (en) * 2002-05-08 2003-11-20 Anne Dupont Telecommunications virtual simulator
US6704784B2 (en) * 1998-01-23 2004-03-09 Sony Corporation Information processing apparatus and method, information processing system and program providing medium
US6708172B1 (en) * 1999-12-22 2004-03-16 Urbanpixel, Inc. Community-based shared multiple browser environment
US6714222B1 (en) * 2000-06-21 2004-03-30 E2 Home Ab Graphical user interface for communications
US6731314B1 (en) * 1998-08-17 2004-05-04 Muse Corporation Network-based three-dimensional multiple-user shared environment apparatus and method
US6772195B1 (en) * 1999-10-29 2004-08-03 Electronic Arts, Inc. Chat clusters for a virtual world application
US6784901B1 (en) * 2000-05-09 2004-08-31 There Method, system and computer program product for the delivery of a chat message in a 3D multi-user environment
US20040179038A1 (en) * 2003-03-03 2004-09-16 Blattner Patrick D. Reactive avatars
US20040268451A1 (en) * 2003-04-25 2004-12-30 Apple Computer, Inc. Graphical user interface for browsing, searching and presenting media items
US20050021624A1 (en) * 2003-05-16 2005-01-27 Michael Herf Networked chat and media sharing systems and methods
US6862625B1 (en) * 1996-09-27 2005-03-01 Avaya Technology Corp. Method and apparatus for real time network communication
US20050075885A1 (en) * 2003-09-25 2005-04-07 Danieli Damon V. Visual indication of current voice speaker
US20050080866A1 (en) * 2003-10-14 2005-04-14 Kent Larry G. Selectively displaying time indications for instant messaging (IM) messages
US20050086612A1 (en) * 2003-07-25 2005-04-21 David Gettman Graphical user interface for an information display system
US20050144247A1 (en) * 2003-12-09 2005-06-30 Christensen James E. Method and system for voice on demand private message chat
US20050166154A1 (en) * 2004-01-22 2005-07-28 Wilson Richard M. Enhanced instant message status message area containing time/date stamped entries and editable by others
US20050261980A1 (en) * 2004-05-22 2005-11-24 Altaf Hadi System and method for delivering real time remote buying, selling, meeting, and interacting in a virtual reality environment
US7036082B1 (en) * 2000-09-21 2006-04-25 Nortel Networks Limited Controlling communications through a virtual reality environment
US7058896B2 (en) * 2002-01-16 2006-06-06 Silicon Graphics, Inc. System, method and computer program product for intuitive interactive navigation control in virtual environments
US20060136837A1 (en) * 2002-04-03 2006-06-22 Microsoft Corporation Application sharing single document sharing
US7080096B1 (en) * 1999-11-02 2006-07-18 Matsushita Electric Works, Ltd. Housing space-related commodity sale assisting system, housing space-related commodity sale assisting method, program for assisting housing space-related commodity sale, and computer-readable recorded medium on which program for assisting housing space-related commodity sale is recorded
US20060167996A1 (en) * 2005-01-13 2006-07-27 Orsolini Garry S System and method for enabling electronic presentations
US20060184886A1 (en) * 1999-12-22 2006-08-17 Urbanpixel Inc. Spatial chat in a multiple browser environment
US20060212147A1 (en) * 2002-01-09 2006-09-21 Mcgrath David S Interactive spatalized audiovisual system
US7145898B1 (en) * 1996-11-18 2006-12-05 Mci Communications Corporation System, method and article of manufacture for selecting a gateway of a hybrid communication system architecture
US20060293103A1 (en) * 2005-06-24 2006-12-28 Seth Mendelsohn Participant interaction with entertainment in real and virtual environments
US7165213B1 (en) * 1996-10-30 2007-01-16 Avaya Technology Corp. Method and system for coordinating media and messaging operations in an information processing system
US20070070066A1 (en) * 2005-09-13 2007-03-29 Bakhash E E System and method for providing three-dimensional graphical user interface
US20070156908A1 (en) * 2005-12-30 2007-07-05 Nokia Corporation Network entity, method and computer program product for effectuating a conference session
US20070184855A1 (en) * 2006-02-03 2007-08-09 Research In Motion Limited Visual representation of contact location
US20070192427A1 (en) * 2006-02-16 2007-08-16 Viktors Berstis Ease of use feature for audio communications within chat conferences
US20070226357A1 (en) * 2006-03-22 2007-09-27 Mcmurry Kathleen A Providing an Aggregate Reachability Status
US20070233785A1 (en) * 2006-03-30 2007-10-04 International Business Machines Corporation Communicating using collaboration spaces
US20070279484A1 (en) * 2006-05-31 2007-12-06 Mike Derocher User interface for a video teleconference
US20080086696A1 (en) * 2006-03-03 2008-04-10 Cadcorporation.Com Inc. System and Method for Using Virtual Environments
US20080091692A1 (en) * 2006-06-09 2008-04-17 Christopher Keith Information collection in multi-participant online communities
US20080250115A1 (en) * 2007-04-04 2008-10-09 Vaidy Iyer Enterprise Notification System
US20080252637A1 (en) * 2007-04-14 2008-10-16 Philipp Christian Berndt Virtual reality-based teleconferencing
US20080263460A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Connect People for Virtual Meeting in Virtual Reality
US20080262910A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Connect People via Virtual Reality for Real Time Communications
US20080262911A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Search in Virtual Reality for Real Time Communications
US20080301557A1 (en) * 2007-06-04 2008-12-04 Igor Kotlyar Systems, methods and software products for online dating
US20090018912A1 (en) * 2007-07-12 2009-01-15 Utbk, Inc. Systems and Methods to Provide Communication Connections via Partners
US20090079816A1 (en) * 2007-09-24 2009-03-26 Fuji Xerox Co., Ltd. Method and system for modifying non-verbal behavior for social appropriateness in video conferencing and other computer mediated communications
US20090089685A1 (en) * 2007-09-28 2009-04-02 Mordecai Nicole Y System and Method of Communicating Between A Virtual World and Real World
US20090089364A1 (en) * 2007-10-02 2009-04-02 Hamilton Ii Rick A Arrangements for interactivity between a virtual universe and the world wide web
US20090113066A1 (en) * 2007-10-24 2009-04-30 David Van Wie Automated real-time data stream switching in a shared virtual area communication environment
US20090112997A1 (en) * 2007-10-25 2009-04-30 Cisco Technology, Inc. Utilizing Presence Data Associated with Web Item
US20090113314A1 (en) * 2007-10-30 2009-04-30 Dawson Christopher J Location and placement of avatars in virtual worlds
US7530028B2 (en) * 2002-08-28 2009-05-05 Microsoft Corporation Shared online experience encapsulation system and method
US20090128567A1 (en) * 2007-11-15 2009-05-21 Brian Mark Shuster Multi-instance, multi-user animation with coordinated chat
US20090193077A1 (en) * 2008-01-25 2009-07-30 Hiroshi Horii Communication control
US20090199095A1 (en) * 2008-02-01 2009-08-06 International Business Machines Corporation Avatar cloning in a virtual world
US20090254842A1 (en) * 2008-04-05 2009-10-08 Social Communication Company Interfacing with a spatial virtual communication environment
US20090254843A1 (en) * 2008-04-05 2009-10-08 Social Communications Company Shared virtual area communication environment based apparatus and methods
US20090254840A1 (en) * 2008-04-04 2009-10-08 Yahoo! Inc. Local map chat
US20090251457A1 (en) * 2008-04-03 2009-10-08 Cisco Technology, Inc. Reactive virtual environment
US20090259948A1 (en) * 2008-04-15 2009-10-15 Hamilton Ii Rick A Surrogate avatar control in a virtual universe
US20090286605A1 (en) * 2008-05-19 2009-11-19 Hamilton Ii Rick A Event determination in a virtual universe
US20090288007A1 (en) * 2008-04-05 2009-11-19 Social Communications Company Spatial interfaces for realtime networked communications
US20090307620A1 (en) * 2008-06-10 2009-12-10 Hamilton Ii Rick A System for concurrently managing multiple avatars
US7640300B2 (en) * 2002-06-10 2009-12-29 Microsoft Corporation Presence and notification system for maintaining and communicating information
US20100077034A1 (en) * 2008-09-22 2010-03-25 International Business Machines Corporation Modifying environmental chat distance based on avatar population density in an area of a virtual world
US7734692B1 (en) * 2005-07-22 2010-06-08 Oracle America, Inc. Network collaboration system with private voice chat
US20100169796A1 (en) * 2008-12-28 2010-07-01 Nortel Networks Limited Visual Indication of Audio Context in a Computer-Generated Virtual Environment
US20100169801A1 (en) * 2002-11-21 2010-07-01 Aol Llc Multiple avatar personalities
US20100169837A1 (en) * 2008-12-29 2010-07-01 Nortel Networks Limited Providing Web Content in the Context of a Virtual Environment
US20100211880A1 (en) * 2009-02-13 2010-08-19 International Business Machines Corporation Virtual world viewer
US20100221693A1 (en) * 2006-03-31 2010-09-02 Rakesh Kumar Gupta Instant Messaging For A Virtual Learning Community
US20100228547A1 (en) * 2009-03-06 2010-09-09 At&T Intellectual Property I, Lp. Method and apparatus for analyzing discussion regarding media programs
US20100251177A1 (en) * 2009-03-30 2010-09-30 Avaya Inc. System and method for graphically managing a communication session with a context based contact set
US20100257450A1 (en) * 2009-04-03 2010-10-07 Social Communications Company Application sharing
US7813488B2 (en) * 2003-09-29 2010-10-12 Siemens Enterprise Communications, Inc. System and method for providing information regarding an identity's media availability
US20100274848A1 (en) * 2008-12-05 2010-10-28 Social Communications Company Managing network communications between network nodes and stream transport protocol
US7844724B2 (en) * 2007-10-24 2010-11-30 Social Communications Company Automated real-time data stream switching in a shared virtual area communication environment
US20110029898A1 (en) * 2002-10-17 2011-02-03 At&T Intellectual Property I, L.P. Merging Instant Messaging (IM) Chat Sessions
US7908663B2 (en) * 2004-04-20 2011-03-15 Microsoft Corporation Abstractions and automation for enhanced sharing and collaboration
US7958453B1 (en) * 2006-09-29 2011-06-07 Len Bou Taing System and method for real-time, multi-user, interactive and collaborative environments on the web
US7979574B2 (en) * 2007-03-01 2011-07-12 Sony Computer Entertainment America Llc System and method for routing communications among real and virtual communication devices
US20110169927A1 (en) * 2010-01-13 2011-07-14 Coco Studios Content Presentation in a Three Dimensional Environment
US20110196930A1 (en) * 2004-09-20 2011-08-11 Jitendra Chawla Methods and apparatuses for reporting based on attention of a user during a collaboration session
US20110231781A1 (en) * 2010-03-19 2011-09-22 International Business Machines Corporation System and method for virtual object sharing and management in virtual worlds
US20110274104A1 (en) * 2007-10-24 2011-11-10 Social Communications Company Virtual area based telephony communications
US20110302509A1 (en) * 2007-10-24 2011-12-08 Social Communications Company Promoting communicant interactions in a network communications environment
US20120066306A1 (en) * 2010-09-11 2012-03-15 Social Communications Company Relationship based presence indicating in virtual area contexts
US20120216131A1 (en) * 2009-01-15 2012-08-23 Social Communications Company Persistent network resource and virtual area associations for realtime collaboration
US20120246582A1 (en) * 2008-04-05 2012-09-27 Social Communications Company Interfacing with a spatial virtual communications environment
US20120254858A1 (en) * 2009-01-15 2012-10-04 Social Communications Company Creating virtual areas for realtime communications
US8285785B2 (en) * 2004-11-19 2012-10-09 Nokia Corporation Method, apparatus and computer program product providing graphical user interface that facilitates management of multiple simultaneous communication sessions
US20130073978A1 (en) * 2011-09-16 2013-03-21 Social Communications Company Capabilities based management of virtual areas

Family Cites Families (420)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4280135A (en) 1979-06-01 1981-07-21 Schlossberg Howard R Remote pointing system
US5414801A (en) 1991-06-11 1995-05-09 Virtus Corporation Computerized method and apparatus using containment relationships to represent objects in a three-dimensional space, and for moving therethrough
US5745711A (en) 1991-10-23 1998-04-28 Hitachi, Ltd. Display control method and apparatus for an electronic conference
US6608636B1 (en) 1992-05-13 2003-08-19 Ncr Corporation Server based virtual conferencing
US5675746A (en) 1992-09-30 1997-10-07 Marshall; Paul S. Virtual reality generator for use with financial information
EP0622930A3 (en) 1993-03-19 1996-06-05 At & T Global Inf Solution Application sharing for computer collaboration system.
US5689641A (en) * 1993-10-01 1997-11-18 Vicor, Inc. Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal
DE69523593T2 (en) 1994-06-17 2002-09-26 Intel Corp DEVICE AND METHOD FOR DIVIDING THE APPLICATION IN A GRAPHIC USER INTERFACE
US5727155A (en) 1994-09-09 1998-03-10 Intel Corporation Method and apparatus for dynamically controlling a remote system's access to shared applications on a host system
US5627978A (en) * 1994-12-16 1997-05-06 Lucent Technologies Inc. Graphical user interface for multimedia call set-up and call handling in a virtual conference on a desktop computer conferencing system
US6304283B1 (en) 1995-01-31 2001-10-16 Canon Kabushiki Kaisha Conference apparatus and method for realistically reproducing image data and shared board data
US5774628A (en) 1995-04-10 1998-06-30 Texas Instruments Incorporated Speaker-independent dynamic vocabulary and grammar in speech recognition
US5880731A (en) 1995-12-14 1999-03-09 Microsoft Corporation Use of avatars with automatic gesturing and bounded interaction in on-line chat session
US6167432A (en) 1996-02-29 2000-12-26 Webex Communications, Inc., Method for creating peer-to-peer connections over an interconnected network to facilitate conferencing among users
US5889843A (en) 1996-03-04 1999-03-30 Interval Research Corporation Methods and systems for creating a spatial auditory environment in an audio conference system
EP0795991A1 (en) 1996-03-11 1997-09-17 Hewlett-Packard Company Communications system
FI102867B (en) 1996-03-20 1999-02-26 Helsingin Puhelin Oyj Method and apparatus for connecting a virtual reality and a real world to each other to provide a real-time telecommunication connection, such as a telephone connection
US5933597A (en) 1996-04-04 1999-08-03 Vtel Corporation Method and system for sharing objects between local and remote terminals
US6323857B1 (en) 1996-04-19 2001-11-27 U.S. Philips Corporation Method and system enabling users to interact, via mutually coupled terminals, by reference to a virtual space
US7167897B2 (en) 1996-05-08 2007-01-23 Apple Computer, Inc. Accessories providing a telephone conference application one or more capabilities independent of the teleconference application
US6304893B1 (en) 1996-07-01 2001-10-16 Sun Microsystems, Inc. Object-oriented system, method and article of manufacture for a client-server event driven message framework in an interprise computing framework system
JP3685877B2 (en) 1996-07-19 2005-08-24 富士通株式会社 Communication device
US6570587B1 (en) 1996-07-26 2003-05-27 Veon Ltd. System and method and linking information to a video
JP3139615B2 (en) 1996-08-08 2001-03-05 日本電信電話株式会社 Three-dimensional virtual space sound communication method and apparatus
US6275490B1 (en) * 1996-08-21 2001-08-14 Netspeak Corporation Method and apparatus for establishing communications from browser application
US6421047B1 (en) 1996-09-09 2002-07-16 De Groot Marc Multi-user virtual reality system for simulating a three-dimensional environment
US5896129A (en) 1996-09-13 1999-04-20 Sony Corporation User friendly passenger interface including audio menuing for the visually impaired and closed captioning for the hearing impaired for an interactive flight entertainment system
US5764916A (en) * 1996-09-27 1998-06-09 Ichat, Inc. Method and apparatus for real time communication over a computer network
US5926179A (en) 1996-09-30 1999-07-20 Sony Corporation Three-dimensional virtual reality space display processing apparatus, a three-dimensional virtual reality space display processing method, and an information providing medium
US5944791A (en) * 1996-10-04 1999-08-31 Contigo Software Llc Collaborative web browser
US5890172A (en) 1996-10-08 1999-03-30 Tenretni Dynamics, Inc. Method and apparatus for retrieving data from a network using location identifiers
US6785708B1 (en) 1996-10-30 2004-08-31 Avaya Inc. Method and apparatus for synchronizing browse and chat functions on a computer network
JP3679526B2 (en) 1996-10-31 2005-08-03 キヤノン株式会社 Image sharing apparatus, screen control method, and computer-readable memory
US6175831B1 (en) 1997-01-17 2001-01-16 Six Degrees, Inc. Method and apparatus for constructing a networking database and system
US6119166A (en) 1997-03-28 2000-09-12 International Business Machines Corporation Controlling communications with local applications using a browser application
US7379961B2 (en) 1997-04-30 2008-05-27 Computer Associates Think, Inc. Spatialized audio in a three-dimensional computer-based scene
US6014145A (en) 1997-07-07 2000-01-11 International Business Machines Corporation Navagation with optimum viewpoints in three-dimensional workspace interactive displays having three-dimensional objects with collision barriers
JP3753207B2 (en) 1997-08-11 2006-03-08 富士ゼロックス株式会社 Collaborative work support system and collaborative work support method
US6567980B1 (en) 1997-08-14 2003-05-20 Virage, Inc. Video cataloger system with hyperlinked output
GB9721667D0 (en) 1997-10-14 1997-12-10 Philips Electronics Nv Virtual environment navigation aid
GB9722343D0 (en) 1997-10-22 1997-12-17 British Telecomm Distributed virtual environment
JPH11177628A (en) 1997-12-15 1999-07-02 Mitsubishi Electric Corp Three-dimension virtual space common share system for broad area environment
US6310629B1 (en) 1997-12-19 2001-10-30 Texas Instruments Incorporated System and method for advanced interfaces for virtual environments
US6999945B1 (en) 1998-01-29 2006-02-14 Automated Business Companies Multiple customer and multiple location PC service provider system
US6833863B1 (en) 1998-02-06 2004-12-21 Intel Corporation Method and apparatus for still image capture during video streaming operations of a tethered digital camera
US6275493B1 (en) 1998-04-02 2001-08-14 Nortel Networks Limited Method and apparatus for caching switched virtual circuits in an ATM network
US6426778B1 (en) 1998-04-03 2002-07-30 Avid Technology, Inc. System and method for providing interactive components in motion video
US6380952B1 (en) 1998-04-07 2002-04-30 International Business Machines Corporation System for continuous display and navigation in a virtual-reality world
US6094189A (en) 1998-04-17 2000-07-25 Quillen; Wendell A. Visual echo remote laser pointer
EP0950956A1 (en) 1998-04-17 1999-10-20 BRITISH TELECOMMUNICATIONS public limited company Computer network
US6362817B1 (en) 1998-05-18 2002-03-26 In3D Corporation System for creating and viewing 3D environments using symbolic descriptors
US5999206A (en) 1998-05-22 1999-12-07 Futaba Denshi Kogyo Kabushiki Kaisha Device for expanding light-amount correction dynamic range
JP2000076487A (en) 1998-09-03 2000-03-14 Sony Corp Device and method for processing information, and providing medium
US6215498B1 (en) 1998-09-10 2001-04-10 Lionhearth Technologies, Inc. Virtual command post
JP3846666B2 (en) 1998-09-24 2006-11-15 富士通株式会社 Shared screen controller
US8332478B2 (en) 1998-10-01 2012-12-11 Digimarc Corporation Context sensitive connected content
JP3826604B2 (en) 1998-10-16 2006-09-27 富士ゼロックス株式会社 Scenario generation apparatus and scenario generation method for presentation materials
US6389458B2 (en) 1998-10-30 2002-05-14 Ideaflood, Inc. Method, apparatus and system for directing access to content on a computer network
WO2005015880A1 (en) 1998-12-29 2005-02-17 Tpresence, Inc. Computer network architecture for persistent, distributed virtual environments
US6342906B1 (en) 1999-02-02 2002-01-29 International Business Machines Corporation Annotation layer for synchronous collaboration
US6370565B1 (en) 1999-03-01 2002-04-09 Sony Corporation Of Japan Method of sharing computation load within a distributed virtual environment system
US7168048B1 (en) 1999-03-24 2007-01-23 Microsoft Corporation Method and structure for implementing a layered object windows
US7007235B1 (en) 1999-04-02 2006-02-28 Massachusetts Institute Of Technology Collaborative agent interaction control and synchronization system
US6909443B1 (en) 1999-04-06 2005-06-21 Microsoft Corporation Method and apparatus for providing a three-dimensional task gallery computer interface
US6388688B1 (en) 1999-04-06 2002-05-14 Vergics Corporation Graph-based visual navigation through spatial environments
GB2349055B (en) 1999-04-16 2004-03-24 Mitel Corp Virtual meeting rooms with spatial audio
US6763371B1 (en) 1999-05-10 2004-07-13 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for collaborative communication in a communication network
JP4425407B2 (en) 1999-05-13 2010-03-03 富士通株式会社 Conversation sending method and conversation system
AU5012300A (en) 1999-05-14 2000-12-05 Graphic Gems Method and apparatus for registering lots in a shared virtual world
US7006616B1 (en) 1999-05-21 2006-02-28 Terayon Communication Systems, Inc. Teleconferencing bridge with EdgePoint mixing
US7222309B2 (en) 1999-06-02 2007-05-22 Earthlink, Inc. System and method of a web browser with integrated features and controls
US6400381B1 (en) 1999-06-11 2002-06-04 International Business Machines Corporation Web places
US7308080B1 (en) 1999-07-06 2007-12-11 Nippon Telegraph And Telephone Corporation Voice communications method, voice communications system and recording medium therefor
US6292188B1 (en) 1999-07-28 2001-09-18 Alltrue Networks, Inc. System and method for navigating in a digital information environment
KR19990078775A (en) 1999-08-06 1999-11-05 신유진 Electronic commerce system in the virtual reality space and method thereof
US6636242B2 (en) 1999-08-31 2003-10-21 Accenture Llp View configurer in a presentation services patterns environment
US6480191B1 (en) 1999-09-28 2002-11-12 Ricoh Co., Ltd. Method and apparatus for recording and playback of multidimensional walkthrough narratives
KR100644579B1 (en) 1999-10-26 2006-11-13 삼성전자주식회사 Real-time audio/video communication device in internet and method thereof
US7630986B1 (en) 1999-10-27 2009-12-08 Pinpoint, Incorporated Secure data interchange
US6671818B1 (en) 1999-11-22 2003-12-30 Accenture Llp Problem isolation through translating and filtering events into a standard object format in a network based supply chain
US6789119B1 (en) 1999-11-24 2004-09-07 Webex Communication, Inc. Emulating a persistent connection using http
JP2001154966A (en) 1999-11-29 2001-06-08 Sony Corp System and method for supporting virtual conversation being participation possible by users in shared virtual space constructed and provided on computer network and medium storing program
US6832245B1 (en) 1999-12-01 2004-12-14 At&T Corp. System and method for analyzing communications of user messages to rank users and contacts based on message content
US7028267B1 (en) 1999-12-07 2006-04-11 Microsoft Corporation Method and apparatus for capturing and rendering text annotations for non-modifiable electronic content
WO2001046794A1 (en) 1999-12-23 2001-06-28 M.H. Segan Limited Partnership System for viewing content over a network and method therefor
US6721741B1 (en) 2000-01-24 2004-04-13 Friskit, Inc. Streaming media search system
KR100694028B1 (en) 2000-01-25 2007-03-12 삼성전자주식회사 Authoring apparatus and method for creating multimedia file
US7689696B2 (en) * 2000-01-31 2010-03-30 Telecommunication Systems, Inc. System and method for re-directing requests from browsers for communications over non-IP based networks
US6559863B1 (en) 2000-02-11 2003-05-06 International Business Machines Corporation System and methodology for video conferencing and internet chatting in a cocktail party style
US20020085035A1 (en) 2000-02-14 2002-07-04 Julian Orbanes Method and apparatus for creating custom formats for viewing information in virtual space
WO2001061483A2 (en) 2000-02-14 2001-08-23 Geophoenix, Inc. System and method for graphical programming
US20010034740A1 (en) 2000-02-14 2001-10-25 Andruid Kerne Weighted interactive grid presentation system and method for streaming a multimedia collage
CA2299150A1 (en) * 2000-02-23 2001-08-23 Hummingbird Communications Ltd A system and method for providing real-time information to a web browser
US7240093B1 (en) 2000-02-29 2007-07-03 Microsoft Corporation Use of online messaging to facilitate selection of participants in game play
US6396837B1 (en) 2000-03-03 2002-05-28 3Com Corporation Method and system for mapping virtual connections to asymmetric digital subscriber line latency paths
KR100369640B1 (en) 2000-03-03 2003-01-29 신유진 Exhibition system in three dimensional virtual reality space and method thereof
US7111060B2 (en) 2000-03-14 2006-09-19 Aep Networks, Inc. Apparatus and accompanying methods for providing, through a centralized server site, a secure, cost-effective, web-enabled, integrated virtual office environment remotely accessible through a network-connected web browser
US7392306B1 (en) * 2000-04-07 2008-06-24 Aol Llc Instant messaging client having an embedded browser
JP3345600B2 (en) 2000-04-10 2002-11-18 コナミ株式会社 Game system and computer-readable storage medium
US6728356B1 (en) 2000-04-14 2004-04-27 Lucent Technologies Inc. Method and apparatus for providing telephony services by switch-based processing of media streams
US7124164B1 (en) 2001-04-17 2006-10-17 Chemtob Helen J Method and apparatus for providing group interaction via communications networks
KR100382854B1 (en) 2000-05-04 2003-05-09 주식회사 쿼터뷰 System for and method of information exchange by recording and playing avatar action
US6920478B2 (en) 2000-05-11 2005-07-19 Chikka Pte Ltd. Method and system for tracking the online status of active users of an internet-based instant messaging system
US20060067500A1 (en) 2000-05-15 2006-03-30 Christofferson Frank C Teleconferencing bridge with edgepoint mixing
IL136408A0 (en) 2000-05-28 2001-06-14 Kaufman Yosef A jigsaw puzzle system
US7191394B1 (en) * 2000-06-21 2007-03-13 Microsoft Corporation Authoring arbitrary XML documents using DHTML and XSLT
US7047202B2 (en) 2000-07-13 2006-05-16 Amit Jaipuria Method and apparatus for optimizing networking potential using a secured system for an online community
JP4657631B2 (en) 2000-07-28 2011-03-23 株式会社ソニー・コンピュータエンタテインメント Information providing system, method, and computer program
JP3633888B2 (en) 2000-07-28 2005-03-30 株式会社ソニー・コンピュータエンタテインメント Information providing system, method, and computer program
US7054508B2 (en) 2000-08-03 2006-05-30 Canon Kabushiki Kaisha Data editing apparatus and method
JP2002149580A (en) * 2000-11-15 2002-05-24 Canon Inc Server equipment, user terminal equipment, virtual space system, method for distributing user information, method for displaying user information, method for distributing and displaying user information and storage medium
WO2002017579A1 (en) 2000-08-25 2002-02-28 British Telecommunications Public Limited Company Audio data processing
US7319992B2 (en) 2000-09-25 2008-01-15 The Mission Corporation Method and apparatus for delivering a virtual reality environment
US8117281B2 (en) 2006-11-02 2012-02-14 Addnclick, Inc. Using internet content as a means to establish live social networks by linking internet users to each other who are simultaneously engaged in the same and/or similar content
US8234218B2 (en) 2000-10-10 2012-07-31 AddnClick, Inc Method of inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, N-dimensional virtual environments and/or other value derivable from the content
US7168051B2 (en) 2000-10-10 2007-01-23 Addnclick, Inc. System and method to configure and provide a network-enabled three-dimensional computing environment
US7203741B2 (en) 2000-10-12 2007-04-10 Peerapp Ltd. Method and system for accelerating receipt of data in a client-to-client network
JP2002123479A (en) 2000-10-17 2002-04-26 Hitachi Ltd Disk control device and method for controlling its cache
GB2368223B (en) 2000-10-17 2004-01-07 Hewlett Packard Co Associating parties with communication sessions
JP2002123478A (en) 2000-10-17 2002-04-26 Isao:Kk Chat system, device and method for processing chat information and recording medium
AU2002232928A1 (en) 2000-11-03 2002-05-15 Zoesis, Inc. Interactive character system
US20020083193A1 (en) 2000-11-03 2002-06-27 Henry Terefenko Parallel network data transmission
WO2002041164A1 (en) 2000-11-17 2002-05-23 Wheretheheckisit.Com,Llp Virtual directory
US20030177187A1 (en) 2000-11-27 2003-09-18 Butterfly.Net. Inc. Computing grid for massively multi-player online games and other multi-user immersive persistent-state and session-based applications
US20020116458A1 (en) * 2000-12-14 2002-08-22 Jonathan Bricklin Web-based dating service
US20020075305A1 (en) * 2000-12-18 2002-06-20 Beaton Brian F. Graphical user interface for a virtual team environment
US7925703B2 (en) 2000-12-26 2011-04-12 Numedeon, Inc. Graphical interactive interface for immersive online communities
US6937986B2 (en) 2000-12-28 2005-08-30 Comverse, Inc. Automatic dynamic speech recognition vocabulary based on external sources of information
WO2002054264A1 (en) 2000-12-29 2002-07-11 Webex Communications, Inc. Distributed network system architecture for collaborative computing
AU2002234258A1 (en) 2001-01-22 2002-07-30 Sun Microsystems, Inc. Peer-to-peer network computing platform
JP2004537082A (en) 2001-01-26 2004-12-09 ザクセル システムズ インコーポレイテッド Real-time virtual viewpoint in virtual reality environment
JP2002224447A (en) * 2001-01-31 2002-08-13 Square Co Ltd Video game device, method for controlling the same, video game program, and recording medium able to read computer in which the program is recorded
US7904194B2 (en) 2001-02-09 2011-03-08 Roy-G-Biv Corporation Event management systems and methods for motion control systems
US7076503B2 (en) 2001-03-09 2006-07-11 Microsoft Corporation Managing media objects in a database
US20040030741A1 (en) 2001-04-02 2004-02-12 Wolton Richard Ernest Method and apparatus for search, visual navigation, analysis and retrieval of information from networks with remote notification and content delivery
US20020165922A1 (en) 2001-04-13 2002-11-07 Songxiang Wei Application based screen sampling
US20060161624A1 (en) 2001-04-13 2006-07-20 Elaine Montgomery Methods and apparatuses for dynamically sharing a portion of a display for application based screen sampling
US20020178072A1 (en) 2001-05-24 2002-11-28 International Business Machines Corporation Online shopping mall virtual association
US20020188959A1 (en) 2001-06-12 2002-12-12 Koninklijke Philips Electronics N.V. Parallel and synchronized display of augmented multimedia information
US7188317B1 (en) 2001-06-13 2007-03-06 Microsoft Corporation Dynamic multiple window display having independently linked windows
US20030002634A1 (en) 2001-06-29 2003-01-02 Virad Gupta Event notification in a unified message system using an event notification server
US7133900B1 (en) 2001-07-06 2006-11-07 Yahoo! Inc. Sharing and implementing instant messaging environments
US7203753B2 (en) 2001-07-31 2007-04-10 Sun Microsystems, Inc. Propagating and updating trust relationships in distributed peer-to-peer networks
US20030043200A1 (en) 2001-08-09 2003-03-06 Urbanpixel Inc Interactive multi-level mapping in a multiple browser environment
JP2003058482A (en) 2001-08-14 2003-02-28 Fujitsu Ltd Method for providing area chat room, method for processing terminal side area chat, recording medium recording area chat room providing/processing program and area chat room providing device
US7266583B2 (en) 2001-08-20 2007-09-04 International Business Machines Corporation Method and system for providing contact management to chat session participants
JP2003067317A (en) * 2001-08-30 2003-03-07 Fuji Xerox Co Ltd Message exchange method, computer, management device and recording medium
US7660875B2 (en) * 2001-08-31 2010-02-09 Sony Corporation Bidirectional remote communication via browser plug-in
US7454464B2 (en) 2001-09-10 2008-11-18 Intel Corporation Peer discovery and connection management based on context sensitive social networks
US7284201B2 (en) 2001-09-20 2007-10-16 Koninklijke Philips Electronics N.V. User attention-based adaptation of quality level to improve the management of real-time multi-media content delivery and distribution
JP4104313B2 (en) 2001-10-03 2008-06-18 株式会社デンソー Voice recognition device, program, and navigation system
US20030077561A1 (en) 2001-10-18 2003-04-24 Abraham Alsop Web server for printable whiteboards
US7415502B2 (en) 2001-11-16 2008-08-19 Sbc Technology Resources, Inc. Method and system for intelligent routing based on presence detection
US7673246B2 (en) 2001-12-12 2010-03-02 Canon Kabushiki Kaisha Image information processing apparatus and method, virtual space presentation apparatus, information administration apparatus, and control methods thereof
US7644144B1 (en) * 2001-12-21 2010-01-05 Microsoft Corporation Methods, tools, and interfaces for the dynamic assignment of people to groups to enable enhanced communication and collaboration
KR100453225B1 (en) 2001-12-26 2004-10-15 한국전자통신연구원 Client system for embodying 3-dimension virtual reality and method for embodying virtual reality using same
AU2003201032A1 (en) 2002-01-07 2003-07-24 Stephen James Crampton Method and apparatus for an avatar user interface system
US7167831B2 (en) 2002-02-04 2007-01-23 Microsoft Corporation Systems and methods for managing multiple grammars in a speech recognition system
US7730063B2 (en) 2002-12-10 2010-06-01 Asset Trust, Inc. Personalized medicine service
US7587317B2 (en) 2002-02-15 2009-09-08 Microsoft Corporation Word training interface
US7689667B2 (en) 2002-02-21 2010-03-30 International Business Machines Corporation Protocol to fix broken links on the world wide web
US7051049B2 (en) * 2002-02-21 2006-05-23 International Business Machines Corporation Real-time chat and conference contact information manager
US7336779B2 (en) * 2002-03-15 2008-02-26 Avaya Technology Corp. Topical dynamic chat
US20030177019A1 (en) 2002-03-18 2003-09-18 Santos Richard A. System and method for visual representation of an electroni community
US20040128350A1 (en) 2002-03-25 2004-07-01 Lou Topfl Methods and systems for real-time virtual conferencing
US7167899B2 (en) 2002-03-26 2007-01-23 Matsushita Electric Industrial Co., Ltd. Web-content aware automatic call transfer system and process for mobile users and operators
US7263660B2 (en) 2002-03-29 2007-08-28 Microsoft Corporation System and method for producing a video skim
US7028266B2 (en) 2002-04-05 2006-04-11 Microsoft Corporation Processing occluded windows during application sharing
US7062712B2 (en) 2002-04-09 2006-06-13 Fuji Xerox Co., Ltd. Binding interactive multichannel digital document system
US7483945B2 (en) 2002-04-19 2009-01-27 Akamai Technologies, Inc. Method of, and system for, webcasting with just-in-time resource provisioning, automated telephone signal acquisition and streaming, and fully-automated event archival
US7036089B2 (en) 2002-04-23 2006-04-25 Hewlett-Packard Development Company, L.P. Distribution of application windows in a computing device display
US7711847B2 (en) 2002-04-26 2010-05-04 Sony Computer Entertainment America Inc. Managing users in a multi-user network game environment
US7016978B2 (en) * 2002-04-29 2006-03-21 Bellsouth Intellectual Property Corporation Instant messaging architecture and system for interoperability and presence management
US7039677B2 (en) 2002-05-07 2006-05-02 International Business Machines Corporation Threaded text-based chat collaboration
US7293243B1 (en) 2002-05-22 2007-11-06 Microsoft Corporation Application sharing viewer presentation
US7356563B1 (en) 2002-06-06 2008-04-08 Microsoft Corporation Methods of annotating a collaborative application display
US20040002878A1 (en) 2002-06-28 2004-01-01 International Business Machines Corporation Method and system for user-determined authentication in a federated environment
US7769606B2 (en) 2002-07-01 2010-08-03 Boone H Keith Interactive health insurance system
GB2391420A (en) * 2002-07-25 2004-02-04 Samsung Electronics Co Ltd Method for serving audio and image communication in web browser using session initiation protocol
KR20040011825A (en) 2002-07-30 2004-02-11 김동현 Cyber department store managing system based on the internet and its managing method
US7802008B2 (en) 2002-08-12 2010-09-21 Matsushita Electric Industrial Co., Ltd. Quality of service management in network gateways
US20040210634A1 (en) 2002-08-23 2004-10-21 Miguel Ferrer Method enabling a plurality of computer users to communicate via a set of interconnected terminals
US7035942B2 (en) 2002-09-17 2006-04-25 Bellsouth Intellectual Property Corp. Server-based message protocol translation
US7434167B2 (en) 2002-09-30 2008-10-07 Microsoft Corporation Accessibility system and method
JP2004135051A (en) 2002-10-10 2004-04-30 Sony Corp Information processing system, apparatus and method for providing service, apparatus and method for processing information, recording medium, and program
US20060031288A1 (en) 2002-10-21 2006-02-09 Koninklijke Philips Electronics N.V. Method of and system for presenting media content to a user or group of users
US7215324B2 (en) 2002-10-22 2007-05-08 Mitsubishi Electric Research Laboratories, Inc. Automatic indicator system and method
WO2004045154A1 (en) 2002-11-13 2004-05-27 Intel Corporation Multi-modal web interaction over wireless network
US7298834B1 (en) 2002-11-22 2007-11-20 3Com Corporation System and method for large capacity conference calls
US7676542B2 (en) * 2002-12-02 2010-03-09 Sap Ag Establishing a collaboration environment
US7474741B2 (en) * 2003-01-20 2009-01-06 Avaya Inc. Messaging advise in presence-aware networks
US20040158610A1 (en) 2003-02-10 2004-08-12 Davis Joel A. Client proxying for instant messaging
US20050128212A1 (en) 2003-03-06 2005-06-16 Edecker Ada M. System and method for minimizing the amount of data necessary to create a virtual three-dimensional environment
US7570261B1 (en) 2003-03-06 2009-08-04 Xdyne, Inc. Apparatus and method for creating a virtual three-dimensional environment, and method of generating revenue therefrom
JP2004272579A (en) 2003-03-07 2004-09-30 Toshiba Corp Online service provision system, communication management device and program therefor, and communication management method
US7200675B2 (en) 2003-03-13 2007-04-03 Microsoft Corporation Summary-based routing for content-based event distribution networks
US7213228B2 (en) 2003-03-17 2007-05-01 Macrovision Corporation Methods and apparatus for implementing a remote application over a network
US8484576B2 (en) 2003-04-17 2013-07-09 Supersonic Aerospace International, Llc System and method for customizing multiple windows of information on a display
US7260784B2 (en) 2003-05-07 2007-08-21 International Business Machines Corporation Display data mapping method, system, and program product
US8347313B2 (en) * 2003-05-21 2013-01-01 Resilient Networks, Inc. Method and apparatus for automating organization of processes
WO2004110018A1 (en) 2003-06-04 2004-12-16 Sony Computer Entertainment, Inc. Content distribution overlay network for a peer to peer network
US7069308B2 (en) 2003-06-16 2006-06-27 Friendster, Inc. System, method and apparatus for connecting users in an online computer system based on their relationships within social networks
US8001187B2 (en) 2003-07-01 2011-08-16 Apple Inc. Peer-to-peer active content sharing
US20080021870A1 (en) 2003-07-15 2008-01-24 Scott Birnbaum Social Network of Identities and Query Method Therefor
US7317716B1 (en) * 2003-07-25 2008-01-08 Verizon Laboratories Inc. Methods and systems for presence-based telephony communications
CA2535103A1 (en) 2003-08-07 2005-02-17 Simple Com Tools, Llc Realtime electronic communications system and method
WO2005027369A1 (en) 2003-09-16 2005-03-24 Research In Motion Limited Handheld electronic device and associated method providing availability data in a messaging environment
US7092002B2 (en) 2003-09-19 2006-08-15 Applied Minds, Inc. Systems and method for enhancing teleconferencing collaboration
US7752268B2 (en) 2003-09-25 2010-07-06 Oracle America, Inc. Method and system for presence state assignment based on schedule information in an instant messaging system
US8489769B2 (en) 2003-10-02 2013-07-16 Accenture Global Services Limited Intelligent collaborative expression in support of socialization of devices
US7506072B2 (en) * 2003-10-14 2009-03-17 Sun Microsystems, Inc. Web browser as web service server in interaction with business process engine
US7817163B2 (en) 2003-10-23 2010-10-19 Microsoft Corporation Dynamic window anatomy
US8528003B2 (en) * 2003-10-27 2013-09-03 Yahoo! Inc. Communication among browser windows
US8032555B2 (en) 2003-11-26 2011-10-04 Buy.Com, Inc. Method and apparatus for constructing a networking database and system proactively
US7606772B2 (en) 2003-11-28 2009-10-20 Manyworlds, Inc. Adaptive social computing methods
US7975035B2 (en) 2003-12-01 2011-07-05 International Business Machines Corporation Method and apparatus to support application and network awareness of collaborative applications using multi-attribute clustering
ITPI20030101A1 (en) 2003-12-05 2005-06-06 Cdc Srl METHOD AND APPARATUS FOR THE MANAGEMENT OF GLOBALITY
US10152190B2 (en) 2003-12-15 2018-12-11 Open Invention Network, Llc Systems and methods for improved application sharing in a multimedia collaboration session
US7734691B2 (en) * 2003-12-18 2010-06-08 International Business Machines Corporation Providing collaboration services to a wireless device
JP2005182331A (en) * 2003-12-18 2005-07-07 Sony Corp Information processing system, service providing device and method, information processor and information processing method, program and recording medium
US7707503B2 (en) 2003-12-22 2010-04-27 Palo Alto Research Center Incorporated Methods and systems for supporting presentation tools using zoomable user interface
US7852997B2 (en) * 2004-01-28 2010-12-14 Managed Inventions, Llc Internet telephony communications adapter for web browsers
US7707122B2 (en) 2004-01-29 2010-04-27 Yahoo ! Inc. System and method of information filtering using measures of affinity of a relationship
US7843959B2 (en) 2004-01-30 2010-11-30 Telefonaktiebolaget Lm Ericsson Prioritising data elements of a data stream
US7478402B2 (en) 2004-02-12 2009-01-13 Microsoft Corporation Configurable message pipelines
US7800614B2 (en) 2004-02-17 2010-09-21 Oracle America, Inc. Efficient communication in a client-server scene graph system
US7985138B2 (en) 2004-02-17 2011-07-26 International Business Machines Corporation SIP based VoIP multiplayer network games
US20050210008A1 (en) 2004-03-18 2005-09-22 Bao Tran Systems and methods for analyzing documents over a network
KR100566263B1 (en) 2004-03-26 2006-03-29 삼성전자주식회사 System and method for providing messenger service changing information of user's status by using schedule
EP1594287B1 (en) 2004-04-12 2008-06-25 Industry Academic Cooperation Foundation Kyunghee University Method, apparatus and medium for providing multimedia service considering terminal capability
US7856469B2 (en) 2004-04-15 2010-12-21 International Business Machines Corporation Searchable instant messaging chat repositories using topic and identifier metadata
US20060031779A1 (en) 2004-04-15 2006-02-09 Citrix Systems, Inc. Selectively sharing screen data
US7680885B2 (en) 2004-04-15 2010-03-16 Citrix Systems, Inc. Methods and apparatus for synchronization of data set representations in a bandwidth-adaptive manner
JP2005326987A (en) 2004-05-13 2005-11-24 Sony Corp Audio signal transmission system, audio signal transmission method, server, network terminal device, program and recording medium
FR2864659A1 (en) 2004-05-14 2005-07-01 France Telecom Entities searching method in virtual environment, involves transmitting request by one entity of virtual environment towards another entity, where entities belong to group of nearby entities
US7546342B2 (en) 2004-05-14 2009-06-09 Microsoft Corporation Distributed hosting of web content using partial replication
US7996785B2 (en) 2004-06-30 2011-08-09 Microsoft Corporation Systems and methods for integrating application windows in a virtual machine environment
KR100875485B1 (en) 2004-07-02 2008-12-22 후지쯔 가부시끼가이샤 Communication control method and computer system
US7860922B2 (en) 2004-08-18 2010-12-28 Time Warner, Inc. Method and device for the wireless exchange of media content between mobile devices based on content preferences
US7412657B2 (en) 2004-08-26 2008-08-12 International Business Machines Corporation Systems, methods, and media for updating an instant messaging system
US20060048064A1 (en) 2004-08-31 2006-03-02 Microsoft Corporation Ambient display of data in a user interface
US8010460B2 (en) 2004-09-02 2011-08-30 Linkedin Corporation Method and system for reputation evaluation of online users in a social networking scheme
US7707249B2 (en) * 2004-09-03 2010-04-27 Open Text Corporation Systems and methods for collaboration
US7342587B2 (en) 2004-10-12 2008-03-11 Imvu, Inc. Computer-implemented system and method for home page customization and e-commerce support
US7995064B2 (en) 2004-10-12 2011-08-09 Imvu, Inc. Computer-implemented chat system having dual channel communications and self-defining product structures
US7711681B2 (en) 2004-11-05 2010-05-04 Accenture Global Services Gmbh System for distributed information presentation and interaction
CA2587644C (en) 2004-11-12 2015-01-13 Mok3, Inc. Method for inter-scene transitions
KR20060060788A (en) 2004-11-30 2006-06-05 전경열 Virtual reality system using character and realizing method of the same
US8876606B2 (en) 2004-12-07 2014-11-04 Microsoft Corporation User-centric method of aggregating information sources to reinforce digital identity
US7677970B2 (en) 2004-12-08 2010-03-16 Microsoft Corporation System and method for social matching of game players on-line
US7240826B2 (en) 2005-01-25 2007-07-10 Seriosity, Inc. Attention economy for attention to messages, tasks and resources
EP1686552B1 (en) 2005-01-26 2009-09-16 Alcatel Lucent Method for establishing an emergency call in a local area network, terminal, gateways and server for such a method
US7460495B2 (en) 2005-02-23 2008-12-02 Microsoft Corporation Serverless peer-to-peer multi-party real-time audio communication system and method
CN100456751C (en) 2005-03-19 2009-01-28 腾讯科技(深圳)有限公司 Instant communication method and system
EP1710973A1 (en) 2005-04-06 2006-10-11 Alcatel Specific stream redirection of a multimedia telecommunication
US7657837B2 (en) 2005-04-06 2010-02-02 Ericom Software Ltd. Seamless windows functionality to remote desktop sessions regarding z-order
US20060242235A1 (en) 2005-04-22 2006-10-26 Microsoft Corporation Presence monitoring in a serverless peer-to-peer system
US7506264B2 (en) 2005-04-28 2009-03-17 International Business Machines Corporation Method and apparatus for presenting navigable data center information in virtual reality using leading edge rendering engines
US20070064851A1 (en) 2005-09-02 2007-03-22 Sbc Knowledge Ventures Lp Method for synchronizing a customer edge router or customer premise equipment associated therewith
US20060244818A1 (en) 2005-04-28 2006-11-02 Comotiv Systems, Inc. Web-based conferencing system
US20060248573A1 (en) 2005-04-28 2006-11-02 Content Guard Holdings, Inc. System and method for developing and using trusted policy based on a social model
US20060253584A1 (en) 2005-05-03 2006-11-09 Dixon Christopher J Reputation of an entity associated with a content item
US20060271877A1 (en) 2005-05-25 2006-11-30 Citrix Systems, Inc. A system and methods for selective sharing of an application window
US20060271460A1 (en) 2005-05-31 2006-11-30 Ebay Inc. Method and system to provide user created social networks in a distributed commerce system
US7944448B2 (en) 2005-06-14 2011-05-17 Omron Corporation Apparatus and method for socially intelligent virtual entity
US20070011232A1 (en) 2005-07-06 2007-01-11 Microsoft Corporation User interface for starting presentations in a meeting
KR100686382B1 (en) 2005-07-08 2007-02-22 엔에이치엔(주) Messenger Notification System and Method Using Synchronization Server
US8588210B2 (en) 2005-07-22 2013-11-19 Motorola Solutions, Inc. Method and apparatus for floor control in a communication system
US20070050838A1 (en) 2005-08-25 2007-03-01 Derek Liu Multi-protocol game engine
US7925000B2 (en) * 2005-08-29 2011-04-12 Avaya Inc. Managing held telephone calls from a remote telecommunications terminal
JP2007072739A (en) 2005-09-07 2007-03-22 Hitachi Communication Technologies Ltd Multipoint conference system, multipoint conference apparatus, and client terminal
US7765483B2 (en) 2005-09-12 2010-07-27 Microsoft Corporation Filtering obscured data from a remote client display
US20080214204A1 (en) 2005-11-01 2008-09-04 Jorey Ramer Similarity based location mapping of mobile comm facility users
US20070074114A1 (en) * 2005-09-29 2007-03-29 Conopco, Inc., D/B/A Unilever Automated dialogue interface
US20070077993A1 (en) 2005-09-30 2007-04-05 Midgley Timothy M Method and apparatus for collecting user game play data and crediting users in a gaming environment
US20070094325A1 (en) 2005-10-21 2007-04-26 Nucleoid Corp. Hybrid peer-to-peer data communication and management
JP4271181B2 (en) 2005-10-28 2009-06-03 ソフトバンクテレコム株式会社 User interface system and server for realizing user interface
US20070098238A1 (en) 2005-10-31 2007-05-03 Pere Obrador Imaging methods, imaging systems, and articles of manufacture
CN100413249C (en) 2005-11-19 2008-08-20 腾讯科技(深圳)有限公司 Contact management method
KR101267912B1 (en) 2005-12-02 2013-05-27 에스케이커뮤니케이션즈 주식회사 System, apparatus and method for providing shared information by connecting a tag to the internet resource and computer readable medium processing the method
US8146002B2 (en) 2005-12-08 2012-03-27 International Business Machines Corporation Screen sharing session with selective pop-ups
US7827288B2 (en) 2005-12-08 2010-11-02 International Business Machines Corporation Model autocompletion for composite services synchronization
US20070133436A1 (en) 2005-12-09 2007-06-14 Sun Microsystems, Inc. Audio bridge for network conferencing
EP1969785A2 (en) 2005-12-09 2008-09-17 Ebuddy Holding B.V. Message history display system and method
US7725492B2 (en) 2005-12-23 2010-05-25 Facebook, Inc. Managing information about relationships in a social network via a social timeline
US9183599B2 (en) 2005-12-14 2015-11-10 Facebook, Inc. Mapping relationships between members in a social network
US20070150498A1 (en) 2005-12-23 2007-06-28 Xerox Corporation Social network for distributed content management
US7921153B2 (en) * 2005-12-29 2011-04-05 Webex Communications, Inc. Methods and apparatuses for selectively displaying information to an invited participant
US7783592B2 (en) 2006-01-10 2010-08-24 Aol Inc. Indicating recent content publication activity by a user
US8266214B2 (en) * 2006-01-24 2012-09-11 Simulat, Inc. System and method for collaborative web-based multimedia layered platform with recording and selective playback of content
US7643436B2 (en) 2006-02-01 2010-01-05 Sun Microsystems, Inc. Apparatus and method for combining network conferences that are not co-located
KR100632955B1 (en) 2006-02-07 2006-10-11 (주)심비오 A system and a method for cyber-expo operating multi-exhibition and managing cumulative data
CN100486168C (en) * 2006-02-11 2009-05-06 腾讯科技(深圳)有限公司 A method for pushing the chat scenario to instant communication users
US20070198645A1 (en) 2006-02-21 2007-08-23 Yen-Fu Chen Method for providing in-context responses to instant messaging conversations
US7996776B2 (en) 2006-02-27 2011-08-09 Microsoft Corporation Shared telepointer
US20070214424A1 (en) 2006-03-13 2007-09-13 International Business Machines Corporation Networked chat technique
US20070220111A1 (en) 2006-03-15 2007-09-20 Andrew Lin Personal communications browser client for remote use in enterprise communications
US7567844B2 (en) 2006-03-17 2009-07-28 Honeywell International Inc. Building management system
US20070286366A1 (en) 2006-03-17 2007-12-13 Scott Deboy Chat presence system
DE202007019706U1 (en) 2006-03-22 2016-02-22 Media Tek Inc. Device and data carrier for improving the performance of the services of a multi-task system and a corresponding multi-task system
US7689926B2 (en) 2006-03-31 2010-03-30 Microsoft Corporation Selective window exclusion for captured content
EP1844827A1 (en) 2006-04-11 2007-10-17 Palo Alto Research Center Incorporated Method, device, and program product to monitor the social health of a persistent virtual environment
US7720777B2 (en) 2006-04-11 2010-05-18 Palo Alto Research Center Incorporated Method, device, and program product to monitor the social health of a persistent virtual environment
KR20070105088A (en) 2006-04-25 2007-10-30 함현주 Shopping mall system based character and management method thereof
US7636779B2 (en) 2006-04-28 2009-12-22 Yahoo! Inc. Contextual mobile local search based on social network vitality information
US20080052373A1 (en) 2006-05-01 2008-02-28 Sms.Ac Systems and methods for a community-based user interface
US7643459B2 (en) 2006-06-16 2010-01-05 Alcatel-Lucent Usa Inc. Methods, devices and architectures for establishing peer-to-peer sessions
US20070291034A1 (en) 2006-06-20 2007-12-20 Dones Nelson C System for presenting a navigable virtual subway system, and method for operating and using the same
US7734705B1 (en) 2006-06-21 2010-06-08 Wheeler Jr Roland E System and method for flexibly managing heterogeneous message delivery
US20070299778A1 (en) 2006-06-22 2007-12-27 Microsoft Corporation Local peer-to-peer digital content distribution
US20080005282A1 (en) 2006-07-03 2008-01-03 Dewey Gaedcke Method for displaying user generated content in a web browser
US7933955B2 (en) 2006-07-11 2011-04-26 Igor Khalatian One-click universal screen sharing
US7680098B2 (en) * 2006-07-20 2010-03-16 Avaya Inc. Determining group availability on different communication media
US8295206B2 (en) * 2006-07-20 2012-10-23 Avaya Inc. Rule-based system for determining user availability
US7616624B2 (en) 2006-07-20 2009-11-10 Avaya Inc. Determining user availability based on the expected duration of a new event
US7680480B2 (en) * 2006-07-20 2010-03-16 Avaya Inc. Determining user availability based on a past event
WO2008017001A2 (en) * 2006-08-02 2008-02-07 Moka5, Inc. Sharing live appliances
US20080033941A1 (en) * 2006-08-07 2008-02-07 Dale Parrish Verfied network identity with authenticated biographical information
US7991401B2 (en) 2006-08-08 2011-08-02 Samsung Electronics Co., Ltd. Apparatus, a method, and a system for animating a virtual scene
US8743703B2 (en) 2006-08-22 2014-06-03 Centurylink Intellectual Property Llc System and method for tracking application resource usage
JP5115058B2 (en) 2006-08-28 2013-01-09 株式会社Jvcケンウッド Electronic device control apparatus and electronic device control method
US8726195B2 (en) * 2006-09-05 2014-05-13 Aol Inc. Enabling an IM user to navigate a virtual world
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8645463B2 (en) * 2006-09-25 2014-02-04 Cisco Technology, Inc. Methods and apparatuses for managing resources within a virtual room
WO2008066623A2 (en) 2006-10-20 2008-06-05 Biometric Lingerie, Inc. Biometric garment and method of operation
CN101170572A (en) 2006-10-23 2008-04-30 日电(中国)有限公司 Multimedia network communication system based on P2P SIP technology
US20080098123A1 (en) 2006-10-24 2008-04-24 Microsoft Corporation Hybrid Peer-to-Peer Streaming with Server Assistance
US7805406B2 (en) 2006-10-27 2010-09-28 Xystar Technologies, Inc. Cross-population of virtual communities
WO2008064483A1 (en) 2006-11-30 2008-06-05 James Andrew Wanless A method and system for providing automated real-time contact information
US7765259B2 (en) * 2006-12-05 2010-07-27 Avaya Inc. System and method for aggregation of user conversations and visualizing personal communications map
US8706169B2 (en) 2006-12-28 2014-04-22 Yahoo! Inc. Interface overlay
US8654954B2 (en) 2007-01-03 2014-02-18 Alcatel Lucent System and method for controlling access to conference calls
US8554868B2 (en) 2007-01-05 2013-10-08 Yahoo! Inc. Simultaneous sharing communication interface
US7696992B2 (en) 2007-01-16 2010-04-13 Motorola, Inc. Method and apparatus to facilitate multi-setting virtual reality experiences
CN101237336B (en) 2007-02-01 2011-10-05 华为技术有限公司 Multi-party communication method, system and method for distribution event status
US9530142B2 (en) 2007-02-13 2016-12-27 Claudia Juliana Minsky Method and system for creating a multifunctional collage useable for client/server communication
US20080209075A1 (en) 2007-02-22 2008-08-28 Yahoo! Inc. Synchronous delivery of media content and real-time communication for online dating
EP2132650A4 (en) * 2007-03-01 2010-10-27 Sony Comp Entertainment Us System and method for communicating with a virtual world
US20080215974A1 (en) 2007-03-01 2008-09-04 Phil Harrison Interactive user controlled avatar animations
WO2008106196A1 (en) * 2007-03-01 2008-09-04 Sony Computer Entertainment America Inc. Virtual world avatar control, interactivity and communication interactive messaging
US20110060587A1 (en) 2007-03-07 2011-03-10 Phillips Michael S Command and control utilizing ancillary information in a mobile voice-to-speech application
US20080229215A1 (en) 2007-03-14 2008-09-18 Samuel Pierce Baron Interaction In A Virtual Social Environment
US8437281B2 (en) 2007-03-27 2013-05-07 Cisco Technology, Inc. Distributed real-time data mixing for conferencing
US7930212B2 (en) 2007-03-29 2011-04-19 Susan Perry Electronic menu system with audio output for the visually impaired
US8135018B1 (en) 2007-03-29 2012-03-13 Qurio Holdings, Inc. Message propagation in a distributed virtual world
US8108799B2 (en) 2007-03-30 2012-01-31 Microsoft Corporation Remoting of windows presentation framework based applications in a non-composed desktop
US8078468B2 (en) 2007-05-21 2011-12-13 Sony Ericsson Mobile Communications Ab Speech recognition for identifying advertisements and/or web pages
US8000328B1 (en) 2007-05-22 2011-08-16 Qurio Holdings, Inc. Filtering messages in a distributed virtual world based on virtual space properties
US7840668B1 (en) 2007-05-24 2010-11-23 Avaya Inc. Method and apparatus for managing communication between participants in a virtual environment
WO2009000028A1 (en) 2007-06-22 2008-12-31 Global Coordinate Software Limited Virtual 3d environments
US20090077475A1 (en) 2007-09-17 2009-03-19 Areae, Inc. System for providing virtual spaces with separate places and/or acoustic areas
US20090089293A1 (en) * 2007-09-28 2009-04-02 Bccg Ventures, Llc Selfish data browsing
US20090096810A1 (en) 2007-10-11 2009-04-16 Green Brian D Method for selectively remoting windows
US20090106671A1 (en) 2007-10-22 2009-04-23 Olson Donald E Digital multimedia sharing in virtual worlds
US8209384B2 (en) * 2007-10-23 2012-06-26 Yahoo! Inc. Persistent group-based instant messaging
US8578000B2 (en) 2008-12-05 2013-11-05 Social Communications Company Realtime kernel
US7499926B1 (en) 2007-11-16 2009-03-03 International Business Machines Corporation Maintaining and replicating chat histories
US20090170479A1 (en) * 2007-12-31 2009-07-02 Sony Ericsson Mobile Communications Ab Virtual rooms for portable communication device and method
US8739180B2 (en) 2008-01-25 2014-05-27 International Business Machines Corporation Processing of MTOM messages
CN101499080A (en) 2008-02-01 2009-08-05 网秦无限(北京)科技有限公司 Method and system for fast acquiring information service on mobile terminal
US20090199275A1 (en) 2008-02-06 2009-08-06 David Brock Web-browser based three-dimensional media aggregation social networking application
US8231465B2 (en) 2008-02-21 2012-07-31 Palo Alto Research Center Incorporated Location-aware mixed-reality gaming platform
US7895208B2 (en) 2008-02-26 2011-02-22 International Business Machines Corporation Device, system, and method of creating virtual social networks based on web-extracted features
US8473851B2 (en) 2008-02-27 2013-06-25 Cisco Technology, Inc. Multi-party virtual desktop
US20090222742A1 (en) 2008-03-03 2009-09-03 Cisco Technology, Inc. Context sensitive collaboration environment
US20090234948A1 (en) 2008-03-11 2009-09-17 Garbow Zachary A Using Multiple Servers to Divide a Virtual World
CN101539856B (en) 2008-03-17 2013-01-16 国际商业机器公司 Method and device for restoring overlapped window in application sharing software
US8605863B1 (en) 2008-03-18 2013-12-10 Avaya Inc. Method and apparatus for providing state indication on a telephone call
KR101467767B1 (en) 2008-03-31 2014-12-03 엘지전자 주식회사 Terminal and method of performing instant messaging service therein
CN102150116B (en) 2008-04-09 2014-03-12 惠普开发有限公司 Remote-controlled pointer, remote-controlled pointing method and device
US8028021B2 (en) 2008-04-23 2011-09-27 International Business Machines Corporation Techniques for providing presentation material in an on-going virtual meeting
FI123499B (en) 2008-05-05 2013-06-14 Sensinode Oy Method and device for processing messages
US9268454B2 (en) 2008-05-14 2016-02-23 International Business Machines Corporation Trigger event based data feed of virtual universe data
US8042051B2 (en) 2008-05-30 2011-10-18 International Business Machines Corporation Apparatus for navigation and interaction in a virtual meeting place
US20090307189A1 (en) 2008-06-04 2009-12-10 Cisco Technology, Inc. Asynchronous workflow participation within an immersive collaboration environment
TWI418993B (en) 2008-06-27 2013-12-11 Ind Tech Res Inst System and method for establishing personal social network, trusted network and social networking system
US20100214243A1 (en) 2008-07-15 2010-08-26 Immersion Corporation Systems and Methods For Interpreting Physical Interactions With A Graphical User Interface
US20100037151A1 (en) 2008-08-08 2010-02-11 Ginger Ackerman Multi-media conferencing system
US20100058202A1 (en) * 2008-08-28 2010-03-04 Mohamed Rostom Method system and program product for providing enabling an interactive and social search engine
US8384738B2 (en) 2008-09-02 2013-02-26 Hewlett-Packard Development Company, L.P. Compositing windowing system
US8082245B2 (en) 2008-09-11 2011-12-20 International Business Machines Corporation Providing location information within a virtual world
JP2010086163A (en) 2008-09-30 2010-04-15 Oki Electric Ind Co Ltd Information processor, program, and communication system
US20100100851A1 (en) 2008-10-16 2010-04-22 International Business Machines Corporation Mapping a real-world object in a personal virtual world
US20100100487A1 (en) * 2008-10-16 2010-04-22 International Business Machines Corporation Virtual world contest, auction, election, sales method for notification and interaction with the real world
US8468253B2 (en) * 2008-12-02 2013-06-18 At&T Intellectual Property I, L.P. Method and apparatus for multimedia collaboration using a social network system
WO2010065909A2 (en) 2008-12-05 2010-06-10 Social Communications Company Managing interactions in a network communications environment
CN102362268A (en) 2008-12-05 2012-02-22 社会传播公司 Pervasive realtime framework
US20100162121A1 (en) * 2008-12-22 2010-06-24 Nortel Networks Limited Dynamic customization of a virtual world
US8542232B2 (en) * 2008-12-28 2013-09-24 Avaya Inc. Method and apparatus for monitoring user attention with a computer-generated virtual environment
US20110004701A1 (en) 2008-12-29 2011-01-06 Debashish Panda Provisioning highly available services for integrated enterprise and communication
US20100169799A1 (en) * 2008-12-30 2010-07-01 Nortel Networks Limited Method and Apparatus for Enabling Presentations to Large Numbers of Users in a Virtual Environment
US8424075B1 (en) 2008-12-31 2013-04-16 Qurio Holdings, Inc. Collaborative firewall for a distributed virtual environment
US20130283166A1 (en) 2012-04-24 2013-10-24 Social Communications Company Voice-based virtual area navigation
US8516396B2 (en) 2009-01-30 2013-08-20 International Business Machines Corporation Object organization based on user interactions within a virtual environment
US8425326B2 (en) 2009-02-20 2013-04-23 Activision Publishing, Inc. Social network system and method for use with and integration into a video game
US20100228560A1 (en) 2009-03-04 2010-09-09 Avaya Inc. Predictive buddy list-reorganization based on call history information
US8499085B2 (en) 2009-03-16 2013-07-30 Avaya, Inc. Advanced availability detection
US8386255B2 (en) 2009-03-17 2013-02-26 Avaya Inc. Providing descriptions of visually presented information to video teleconference participants who are not video-enabled
US20100246570A1 (en) 2009-03-24 2010-09-30 Avaya Inc. Communications session preparation method and apparatus
US20100251141A1 (en) 2009-03-25 2010-09-30 Jason Allen Sabin Method of Sharing Information Associated with a Webpage
US20100262550A1 (en) 2009-04-08 2010-10-14 Avaya Inc. Inter-corporate collaboration overlay solution for professional social networks
US8396960B2 (en) 2009-05-08 2013-03-12 Canon Kabushiki Kaisha Efficient network utilization using multiple physical interfaces
US8051195B1 (en) 2009-06-04 2011-11-01 Qurio Holdings, Inc. Method and system for providing data streams in a virtual environment
US20100325206A1 (en) 2009-06-18 2010-12-23 Umeshwar Dayal Providing collaborative business intelligence
US8442189B2 (en) 2009-06-22 2013-05-14 Avaya Inc. Unified communications appliance
US20100332998A1 (en) 2009-06-26 2010-12-30 Xerox Corporation Collaborative document environments in three-dimensional virtual worlds
US8924261B2 (en) 2009-10-30 2014-12-30 Etsy, Inc. Method for performing interactive online shopping
US8689307B2 (en) 2010-03-19 2014-04-01 Damaka, Inc. System and method for providing a virtual peer-to-peer environment
JP5204155B2 (en) 2010-06-21 2013-06-05 株式会社スクウェア・エニックス Video game system
US9378296B2 (en) 2010-08-24 2016-06-28 International Business Machines Corporation Virtual world construction
US8542264B2 (en) 2010-11-18 2013-09-24 Cisco Technology, Inc. System and method for managing optics in a video environment
US20120142429A1 (en) 2010-12-03 2012-06-07 Muller Marcus S Collaborative electronic game play employing player classification and aggregation
US8581958B2 (en) 2011-04-18 2013-11-12 Hewlett-Packard Development Company, L.P. Methods and systems for establishing video conferences using portable electronic devices
US20120268468A1 (en) 2011-04-20 2012-10-25 Idle Games System and method for stochastically generating maps of places in a virtual space
US9075561B2 (en) 2011-07-29 2015-07-07 Apple Inc. Systems, methods, and computer-readable media for managing collaboration on a virtual work of art
EP2745462B1 (en) 2011-08-18 2021-10-20 Pfaqutruma Research LLC Systems and methods of virtual world interaction
US8935328B2 (en) 2011-09-15 2015-01-13 Ramakrishna J Tumuluri System and method for collaborative 3D visualization and real-time interaction on a computer network
WO2013078062A1 (en) 2011-11-23 2013-05-30 Social Communications Company Creating and managing virtual areas
WO2013119802A1 (en) 2012-02-11 2013-08-15 Social Communications Company Routing virtual area based communications
US9563902B2 (en) 2012-04-11 2017-02-07 Myriata, Inc. System and method for transporting a virtual avatar within multiple virtual environments

Patent Citations (118)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471318A (en) * 1993-04-22 1995-11-28 At&T Corp. Multimedia communications network
US5491743A (en) * 1994-05-24 1996-02-13 International Business Machines Corporation Virtual conference system and terminal apparatus therefor
US5956038A (en) * 1995-07-12 1999-09-21 Sony Corporation Three-dimensional virtual reality space sharing method and system, an information recording medium and method, an information transmission medium and method, an information processing method, a client terminal, and a shared server terminal
US5737533A (en) * 1995-10-26 1998-04-07 Wegener Internet Projects Bv System for generating a virtual reality scene in response to a database search
US6219045B1 (en) * 1995-11-13 2001-04-17 Worlds, Inc. Scalable virtual world chat client-server system
US5793365A (en) * 1996-01-02 1998-08-11 Sun Microsystems, Inc. System and method providing a computer user interface enabling access to distributed workgroup members
US6862625B1 (en) * 1996-09-27 2005-03-01 Avaya Technology Corp. Method and apparatus for real time network communication
US6057856A (en) * 1996-09-30 2000-05-02 Sony Corporation 3D virtual reality multi-user interaction with superimposed positional information display for each user
US7165213B1 (en) * 1996-10-30 2007-01-16 Avaya Technology Corp. Method and system for coordinating media and messaging operations in an information processing system
US5982372A (en) * 1996-11-14 1999-11-09 International Business Machines Corp. Visual metaphor for shortcut navigation in a virtual world
US7145898B1 (en) * 1996-11-18 2006-12-05 Mci Communications Corporation System, method and article of manufacture for selecting a gateway of a hybrid communication system architecture
US6335927B1 (en) * 1996-11-18 2002-01-01 Mci Communications Corporation System and method for providing requested quality of service in a hybrid network
US6005578A (en) * 1997-09-25 1999-12-21 Mindsphere, Inc. Method and apparatus for visual navigation of information objects
US6704784B2 (en) * 1998-01-23 2004-03-09 Sony Corporation Information processing apparatus and method, information processing system and program providing medium
US6396509B1 (en) * 1998-02-21 2002-05-28 Koninklijke Philips Electronics N.V. Attention-based interaction in a virtual environment
US5999208A (en) * 1998-07-15 1999-12-07 Lucent Technologies Inc. System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room
US6119147A (en) * 1998-07-28 2000-09-12 Fuji Xerox Co., Ltd. Method and system for computer-mediated, multi-modal, asynchronous meetings in a virtual space
US6731314B1 (en) * 1998-08-17 2004-05-04 Muse Corporation Network-based three-dimensional multiple-user shared environment apparatus and method
US6772195B1 (en) * 1999-10-29 2004-08-03 Electronic Arts, Inc. Chat clusters for a virtual world application
US7080096B1 (en) * 1999-11-02 2006-07-18 Matsushita Electric Works, Ltd. Housing space-related commodity sale assisting system, housing space-related commodity sale assisting method, program for assisting housing space-related commodity sale, and computer-readable recorded medium on which program for assisting housing space-related commodity sale is recorded
US6708172B1 (en) * 1999-12-22 2004-03-16 Urbanpixel, Inc. Community-based shared multiple browser environment
US20060184886A1 (en) * 1999-12-22 2006-08-17 Urbanpixel Inc. Spatial chat in a multiple browser environment
US20020033848A1 (en) * 2000-04-21 2002-03-21 Sciammarella Eduardo Agusto System for managing data objects
US6784901B1 (en) * 2000-05-09 2004-08-31 There Method, system and computer program product for the delivery of a chat message in a 3D multi-user environment
US6714222B1 (en) * 2000-06-21 2004-03-30 E2 Home Ab Graphical user interface for communications
US20020026388A1 (en) * 2000-08-01 2002-02-28 Chris Roebuck Method of distributing a product, providing incentives to a consumer, and collecting data on the activities of a consumer
US20020049814A1 (en) * 2000-08-31 2002-04-25 Yoo Hwan Soo System and method for book-marking a specific location in virtual space
US20020052918A1 (en) * 2000-09-07 2002-05-02 Junichi Rekimoto Method and system for supporting virtual conversation, and storage medium
US7036082B1 (en) * 2000-09-21 2006-04-25 Nortel Networks Limited Controlling communications through a virtual reality environment
US20030065558A1 (en) * 2001-09-12 2003-04-03 Cameron Shaw Method and apparatus for multi-vendor powered business portal with intelligent service promotion and user profile gathering
US7533346B2 (en) * 2002-01-09 2009-05-12 Dolby Laboratories Licensing Corporation Interactive spatalized audiovisual system
US20060212147A1 (en) * 2002-01-09 2006-09-21 Mcgrath David S Interactive spatalized audiovisual system
US7058896B2 (en) * 2002-01-16 2006-06-06 Silicon Graphics, Inc. System, method and computer program product for intuitive interactive navigation control in virtual environments
US20030149731A1 (en) * 2002-01-23 2003-08-07 Sony Corporation Information processing device and method, and program
US20060136837A1 (en) * 2002-04-03 2006-06-22 Microsoft Corporation Application sharing single document sharing
US20030215779A1 (en) * 2002-05-08 2003-11-20 Anne Dupont Telecommunications virtual simulator
US7640300B2 (en) * 2002-06-10 2009-12-29 Microsoft Corporation Presence and notification system for maintaining and communicating information
US7530028B2 (en) * 2002-08-28 2009-05-05 Microsoft Corporation Shared online experience encapsulation system and method
US20110029898A1 (en) * 2002-10-17 2011-02-03 At&T Intellectual Property I, L.P. Merging Instant Messaging (IM) Chat Sessions
US20100169801A1 (en) * 2002-11-21 2010-07-01 Aol Llc Multiple avatar personalities
US20040179038A1 (en) * 2003-03-03 2004-09-16 Blattner Patrick D. Reactive avatars
US20040268451A1 (en) * 2003-04-25 2004-12-30 Apple Computer, Inc. Graphical user interface for browsing, searching and presenting media items
US20050021624A1 (en) * 2003-05-16 2005-01-27 Michael Herf Networked chat and media sharing systems and methods
US20050086612A1 (en) * 2003-07-25 2005-04-21 David Gettman Graphical user interface for an information display system
US7467356B2 (en) * 2003-07-25 2008-12-16 Three-B International Limited Graphical user interface for 3d virtual display browser using virtual display windows
US20050075885A1 (en) * 2003-09-25 2005-04-07 Danieli Damon V. Visual indication of current voice speaker
US7503006B2 (en) * 2003-09-25 2009-03-10 Microsoft Corporation Visual indication of current voice speaker
US7813488B2 (en) * 2003-09-29 2010-10-12 Siemens Enterprise Communications, Inc. System and method for providing information regarding an identity's media availability
US20050080866A1 (en) * 2003-10-14 2005-04-14 Kent Larry G. Selectively displaying time indications for instant messaging (IM) messages
US20050144247A1 (en) * 2003-12-09 2005-06-30 Christensen James E. Method and system for voice on demand private message chat
US7305438B2 (en) * 2003-12-09 2007-12-04 International Business Machines Corporation Method and system for voice on demand private message chat
US20050166154A1 (en) * 2004-01-22 2005-07-28 Wilson Richard M. Enhanced instant message status message area containing time/date stamped entries and editable by others
US7908663B2 (en) * 2004-04-20 2011-03-15 Microsoft Corporation Abstractions and automation for enhanced sharing and collaboration
US20050261980A1 (en) * 2004-05-22 2005-11-24 Altaf Hadi System and method for delivering real time remote buying, selling, meeting, and interacting in a virtual reality environment
US20110196930A1 (en) * 2004-09-20 2011-08-11 Jitendra Chawla Methods and apparatuses for reporting based on attention of a user during a collaboration session
US8285785B2 (en) * 2004-11-19 2012-10-09 Nokia Corporation Method, apparatus and computer program product providing graphical user interface that facilitates management of multiple simultaneous communication sessions
US20060167996A1 (en) * 2005-01-13 2006-07-27 Orsolini Garry S System and method for enabling electronic presentations
US20060293103A1 (en) * 2005-06-24 2006-12-28 Seth Mendelsohn Participant interaction with entertainment in real and virtual environments
US20080221998A1 (en) * 2005-06-24 2008-09-11 Disney Enterprises, Inc. Participant interaction with entertainment in real and virtual environments
US7734692B1 (en) * 2005-07-22 2010-06-08 Oracle America, Inc. Network collaboration system with private voice chat
US20110029907A1 (en) * 2005-09-13 2011-02-03 Bakhash E Eddie System and method for providing three-dimensional graphical user interface
US20070070066A1 (en) * 2005-09-13 2007-03-29 Bakhash E E System and method for providing three-dimensional graphical user interface
US20070156908A1 (en) * 2005-12-30 2007-07-05 Nokia Corporation Network entity, method and computer program product for effectuating a conference session
US20070184855A1 (en) * 2006-02-03 2007-08-09 Research In Motion Limited Visual representation of contact location
US20070192427A1 (en) * 2006-02-16 2007-08-16 Viktors Berstis Ease of use feature for audio communications within chat conferences
US20080086696A1 (en) * 2006-03-03 2008-04-10 Cadcorporation.Com Inc. System and Method for Using Virtual Environments
US20070226357A1 (en) * 2006-03-22 2007-09-27 Mcmurry Kathleen A Providing an Aggregate Reachability Status
US20070233785A1 (en) * 2006-03-30 2007-10-04 International Business Machines Corporation Communicating using collaboration spaces
US20100221693A1 (en) * 2006-03-31 2010-09-02 Rakesh Kumar Gupta Instant Messaging For A Virtual Learning Community
US20070279484A1 (en) * 2006-05-31 2007-12-06 Mike Derocher User interface for a video teleconference
US20080091692A1 (en) * 2006-06-09 2008-04-17 Christopher Keith Information collection in multi-participant online communities
US7958453B1 (en) * 2006-09-29 2011-06-07 Len Bou Taing System and method for real-time, multi-user, interactive and collaborative environments on the web
US7979574B2 (en) * 2007-03-01 2011-07-12 Sony Computer Entertainment America Llc System and method for routing communications among real and virtual communication devices
US20080250115A1 (en) * 2007-04-04 2008-10-09 Vaidy Iyer Enterprise Notification System
US20080252637A1 (en) * 2007-04-14 2008-10-16 Philipp Christian Berndt Virtual reality-based teleconferencing
US20080262910A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Connect People via Virtual Reality for Real Time Communications
US20080263460A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Connect People for Virtual Meeting in Virtual Reality
US20080262911A1 (en) * 2007-04-20 2008-10-23 Utbk, Inc. Methods and Systems to Search in Virtual Reality for Real Time Communications
US20080301557A1 (en) * 2007-06-04 2008-12-04 Igor Kotlyar Systems, methods and software products for online dating
US20090018912A1 (en) * 2007-07-12 2009-01-15 Utbk, Inc. Systems and Methods to Provide Communication Connections via Partners
US20090079816A1 (en) * 2007-09-24 2009-03-26 Fuji Xerox Co., Ltd. Method and system for modifying non-verbal behavior for social appropriateness in video conferencing and other computer mediated communications
US20090089685A1 (en) * 2007-09-28 2009-04-02 Mordecai Nicole Y System and Method of Communicating Between A Virtual World and Real World
US20090089364A1 (en) * 2007-10-02 2009-04-02 Hamilton Ii Rick A Arrangements for interactivity between a virtual universe and the world wide web
US7844724B2 (en) * 2007-10-24 2010-11-30 Social Communications Company Automated real-time data stream switching in a shared virtual area communication environment
US20090113066A1 (en) * 2007-10-24 2009-04-30 David Van Wie Automated real-time data stream switching in a shared virtual area communication environment
US20110274104A1 (en) * 2007-10-24 2011-11-10 Social Communications Company Virtual area based telephony communications
US20110302509A1 (en) * 2007-10-24 2011-12-08 Social Communications Company Promoting communicant interactions in a network communications environment
US20090112997A1 (en) * 2007-10-25 2009-04-30 Cisco Technology, Inc. Utilizing Presence Data Associated with Web Item
US20090113314A1 (en) * 2007-10-30 2009-04-30 Dawson Christopher J Location and placement of avatars in virtual worlds
US20090128567A1 (en) * 2007-11-15 2009-05-21 Brian Mark Shuster Multi-instance, multi-user animation with coordinated chat
US20090193077A1 (en) * 2008-01-25 2009-07-30 Hiroshi Horii Communication control
US20090199095A1 (en) * 2008-02-01 2009-08-06 International Business Machines Corporation Avatar cloning in a virtual world
US20090251457A1 (en) * 2008-04-03 2009-10-08 Cisco Technology, Inc. Reactive virtual environment
US20090254840A1 (en) * 2008-04-04 2009-10-08 Yahoo! Inc. Local map chat
US8397168B2 (en) * 2008-04-05 2013-03-12 Social Communications Company Interfacing with a spatial virtual communication environment
US20090288007A1 (en) * 2008-04-05 2009-11-19 Social Communications Company Spatial interfaces for realtime networked communications
US8191001B2 (en) * 2008-04-05 2012-05-29 Social Communications Company Shared virtual area communication environment based apparatus and methods
US20090254843A1 (en) * 2008-04-05 2009-10-08 Social Communications Company Shared virtual area communication environment based apparatus and methods
US20090254842A1 (en) * 2008-04-05 2009-10-08 Social Communication Company Interfacing with a spatial virtual communication environment
US20120246582A1 (en) * 2008-04-05 2012-09-27 Social Communications Company Interfacing with a spatial virtual communications environment
US20090259948A1 (en) * 2008-04-15 2009-10-15 Hamilton Ii Rick A Surrogate avatar control in a virtual universe
US20090286605A1 (en) * 2008-05-19 2009-11-19 Hamilton Ii Rick A Event determination in a virtual universe
US20090307620A1 (en) * 2008-06-10 2009-12-10 Hamilton Ii Rick A System for concurrently managing multiple avatars
US20100077034A1 (en) * 2008-09-22 2010-03-25 International Business Machines Corporation Modifying environmental chat distance based on avatar population density in an area of a virtual world
US20100274848A1 (en) * 2008-12-05 2010-10-28 Social Communications Company Managing network communications between network nodes and stream transport protocol
US20100169796A1 (en) * 2008-12-28 2010-07-01 Nortel Networks Limited Visual Indication of Audio Context in a Computer-Generated Virtual Environment
US20100169837A1 (en) * 2008-12-29 2010-07-01 Nortel Networks Limited Providing Web Content in the Context of a Virtual Environment
US20120254858A1 (en) * 2009-01-15 2012-10-04 Social Communications Company Creating virtual areas for realtime communications
US20120216131A1 (en) * 2009-01-15 2012-08-23 Social Communications Company Persistent network resource and virtual area associations for realtime collaboration
US20100211880A1 (en) * 2009-02-13 2010-08-19 International Business Machines Corporation Virtual world viewer
US20100228547A1 (en) * 2009-03-06 2010-09-09 At&T Intellectual Property I, Lp. Method and apparatus for analyzing discussion regarding media programs
US20100246800A1 (en) * 2009-03-30 2010-09-30 Avaya Inc. System and method for managing a contact center with a graphical call connection metaphor
US20100251177A1 (en) * 2009-03-30 2010-09-30 Avaya Inc. System and method for graphically managing a communication session with a context based contact set
US20100257450A1 (en) * 2009-04-03 2010-10-07 Social Communications Company Application sharing
US20110169927A1 (en) * 2010-01-13 2011-07-14 Coco Studios Content Presentation in a Three Dimensional Environment
US20110231781A1 (en) * 2010-03-19 2011-09-22 International Business Machines Corporation System and method for virtual object sharing and management in virtual worlds
US20120066306A1 (en) * 2010-09-11 2012-03-15 Social Communications Company Relationship based presence indicating in virtual area contexts
US20130073978A1 (en) * 2011-09-16 2013-03-21 Social Communications Company Capabilities based management of virtual areas

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Screenshot of Windows for Workgroups 3.11, manufactured by Microsoft, released on December 31, 1993. *

Also Published As

Publication number Publication date
KR20110113633A (en) 2011-10-17
IL213868A0 (en) 2011-07-31
JP2012515398A (en) 2012-07-05
US9411489B2 (en) 2016-08-09
EP2377038A4 (en) 2013-07-17
WO2010083119A2 (en) 2010-07-22
US20130104057A1 (en) 2013-04-25
KR20110110333A (en) 2011-10-06
CN102356386A (en) 2012-02-15
US9483157B2 (en) 2016-11-01
US20090254842A1 (en) 2009-10-08
WO2010083119A3 (en) 2010-10-21
US20130061158A1 (en) 2013-03-07
US8397168B2 (en) 2013-03-12
EP2377038A2 (en) 2011-10-19

Similar Documents

Publication Publication Date Title
US9483157B2 (en) Interfacing with a spatial virtual communication environment
USRE46309E1 (en) Application sharing
US20210349604A1 (en) Shared Virtual Area Communication Environment Based Apparatus and Methods
US10534507B1 (en) System and method for cooperative sharing of resources of an environment
US8930472B2 (en) Promoting communicant interactions in a network communications environment
US9813463B2 (en) Phoning into virtual communication environments
US20090288007A1 (en) Spatial interfaces for realtime networked communications
US20200020135A1 (en) Promoting Communicant Interactions in a Network Communications Environment
US20220292732A1 (en) Promoting Communicant Interactions in a Network Communications Environment

Legal Events

Date Code Title Description
AS Assignment

Owner name: SOCOCO, INC., OREGON

Free format text: CHANGE OF NAME;ASSIGNOR:SOCIAL COMMUNICATIONS COMPANY;REEL/FRAME:040017/0709

Effective date: 20151020

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4