US9270717B1 - Wireless multimedia content brokerage service for real time selective content provisioning - Google Patents

Wireless multimedia content brokerage service for real time selective content provisioning Download PDF

Info

Publication number
US9270717B1
US9270717B1 US14/245,040 US201414245040A US9270717B1 US 9270717 B1 US9270717 B1 US 9270717B1 US 201414245040 A US201414245040 A US 201414245040A US 9270717 B1 US9270717 B1 US 9270717B1
Authority
US
United States
Prior art keywords
content
mobile device
multimedia content
data
multimedia
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US14/245,040
Inventor
Fred Neill
Christopher Amidon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qurio Holdings Inc
Original Assignee
Qurio Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qurio Holdings Inc filed Critical Qurio Holdings Inc
Priority to US14/245,040 priority Critical patent/US9270717B1/en
Application granted granted Critical
Publication of US9270717B1 publication Critical patent/US9270717B1/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H04L65/4069
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • H04N21/4383Accessing a communication channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44227Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality

Definitions

  • Hand held personal mobile terminals such as cellular telephones
  • Hand held personal mobile terminals are becoming the constant companion of contemporary individuals who may encounter real time multimedia content numerous times a day.
  • a person may encounter multimedia content at an airport or other waiting room, at a cafeteria or restaurant, in a lounge, or such as at a hotel.
  • Some of this publicly-viewable content may comprise real time broadcasts provided via large display devices and/or other display devices.
  • public or other display devices viewed by an individual may present composite multimedia presentations.
  • a composite multimedia presentation can comprise multiple simultaneous streams of content.
  • a single large display may feature multiple video streams which may or may not include accompanying audio.
  • An individual viewing content (referred to herein also as a “user”) may desire to continue to view real time content, but may have any number of reasons to leave the area in which the display device can be perceived. Accordingly, the user may wish to view some or all of the content on a mobile device. If an entire composite multimedia presentation is simply mirrored on the mobile device, the content of the composite multimedia presentation may be difficult or impossible to fully view due to small screen size and/or low resolution of the mobile device. Furthermore, existing systems, such as video on demand systems, require effort on the part of the mobile user to locate the applicable content provider and, in some instances, to obtain a subscription or to perform other rights management activity before actually viewing the content. Thus, opportunities remain to improve the experience for users of mobile devices, such as by providing for partial content extraction onto a device.
  • a wireless multimedia content brokerage service can provide for real time selective content extraction in a manner that allows users to easily obtain, at a mobile device, one or more portions of a real time composite multimedia presentation.
  • the brokerage service ensures that the experience is transparent from the point of view of the user, and additionally does not require any specific interaction between the user and the display, or interaction between the user and the content service provider (or providers). Instead, the brokerage service handles the transactional details involved in obtaining subscriptions to content and in obtaining, formatting, and forwarding content to the mobile device. Additionally, since the content of interest is not forwarded from the display itself and since some embodiments of the system do not rely on any interactivity at the display to identify the display device or content, relatively unsophisticated display devices can be used. Furthermore, the user is not limited to proximity to a particular display device since the display device does not need to play a role in the transfer of content data to the mobile device.
  • a wireless multimedia content brokerage system can comprise at least one computing device (referred to as a “brokerage computing device” for clarity) adapted to access presentation identification data that identifies a realtime composite multimedia content presentation.
  • the composite multimedia content presentation can comprise a plurality of content streams, such as a plurality of real time video content streams and one or more audio feeds.
  • the particular manner in which the streams are provided to and by a display device does not matter.
  • a display device may receive a single data stream comprising the plurality of multimedia components.
  • the display device may receive several streams and combine the streams into a composite presentation at the display device.
  • the at least one brokerage computing device can be adapted to identify at least one content provider associated with the plurality of streams. For instance, in some embodiments, a single content provider assembles and provides the composite content presentation. However, in other embodiments, a composite content presentation may be assembled from streams provided by multiple content providers. In any event, the content provider(s) can be identified in any suitable way. For instance, a mobile device user may provide a suitable identifier, such as a display SIP or IP address, a content identifier (such as an indication of a channel, content provider, or content title or reference number), or the like via an interface that relays the information to the at least one brokerage computing device.
  • a suitable identifier such as a display SIP or IP address, a content identifier (such as an indication of a channel, content provider, or content title or reference number), or the like via an interface that relays the information to the at least one brokerage computing device.
  • the at least one brokerage computing device can cross-reference the content provider(s) for the presentation to determine what media stream(s) comprise the underlying components of the composite presentation and where to obtain the streams.
  • a composite presentation comprises a ticker, a feed of graphics (e.g. a graphical weather forecast), and a video feed of a newscaster
  • each such component may be made available by the content provider(s) as an individualized stream.
  • the individualized streams may be made available even if the composite presentation is sent as a single stream (e.g. as a single broadcast or cable channel).
  • the at least one brokerage computing device can be adapted to access data comprising the plurality of streams made available by the content provider(s) and, in some embodiments, to buffer the accessed data. For example, if the content provider(s) push content, the at least one brokerage computing device can issue one or more suitable push requests and receive and buffer the content. Additionally, the at least one brokerage computing device can provide selection interface data to a user's mobile device and access selection data provided by the mobile device, with the selection data identifying at least one of the plurality of streams for extraction to the mobile device. The brokerage computing device(s) can further be adapted to transmit the buffered data comprising the at least one identified stream to the mobile device.
  • the brokerage computing device(s) may be adapted to avoid buffering accessed data comprising at least one stream that is not identified in the selection data. For example, if a composite multimedia presentation comprises numerous video streams and a particular user elects to view only one stream, the brokerage service can discontinue buffering the other streams. However, in some embodiments, the brokerage service retains sufficient information for a user to revert back to the selection phase and select other streams. Further, buffering may continue if other users served by the brokerage computing device(s) continue to view the same stream. In some embodiments, the brokerage computing device or devices may not buffer content, but may instead act as a pass-through between the mobile device and the content provider(s).
  • the least one brokerage computing device may also be adapted to interface with the at least one content provider and, in response to the selection data provided by the mobile device, transmit data identifying at least one change in the display.
  • the mobile device may provide selection data indicating a particular portion or portions of the composite media stream as selected by the mobile device user.
  • the at least one brokerage computing device can send data to the appropriate content provider, and the content provider can highlight or otherwise annotate the selected portion(s) at the large display device. Accordingly, a mobile device user can receive feedback provided through a large (or other) display device in selecting which portion or portions to view at the mobile device.
  • Data defining the annotation(s) or highlight(s) may be included in data comprising the media sent to the large display device, or may comprise data sent as separate commands to the display device or other related components such as, e.g. a set-top box associated with the display device.
  • a display can appear to be responsive to a user
  • the present subject matter does not require any sort of specific data transfer with or between the display and the user device.
  • the present subject matter can be used with displays without requiring specialized functionality to support sending content to mobile devices.
  • the selection interface data comprises data defining the layout of a graphical user interface, with the graphical user interface comprising respective portions corresponding to locations of various streams in the composite multimedia presentation.
  • the graphical user interface may be presented at the mobile device based on the selection interface data so that a scaled replica of the large display is presented at the mobile device.
  • a mobile device user may then navigate through the graphical user interface to identify one or more portions of the composite multimedia display.
  • the individual streams may be represented as still images in some embodiments.
  • the brokerage computing device can be further adapted to determine whether one or more subscriptions are needed to access the plurality of streams and, if so, obtain the needed subscription or subscriptions. For instance, prior to accessing data comprising the streams, a database or other suitable set of information can be accessed to determine if a subscription is needed to access the stream and whether or not such a subscription is available. For content which is not subscription-based, other actions can be taken to ensure that the computing device has sufficient rights to obtain and provide the content stream(s) to the mobile device.
  • the present subject matter is not limited by the particular type(s) of rights clearance steps required to access content, and can even be used with regard to content that requires no rights management.
  • the at least one brokerage computing device can be adapted to interface with at least one content provider after identifying the content provider and obtain at least one structured data file identifying a network address for each of the plurality of content streams comprising the content display.
  • the structured so data file may also comprise data identifying the spatial arrangement of the composite media display.
  • the at least one brokerage computing device may be adapted to generate the selection interface data based on the structured data file.
  • a content provider may make one or more structured files such as XML files available and cross-referenced to specific display devices by display device SIP/IP address or other identifier(s).
  • the XML files may specify a network address, such as a SIP/IP address and/or other identifier(s), for each component of the composite media display provided at the display device.
  • the brokerage computing devices can be adapted to access presentation identification data and identify at least one content provider as part of a partial content service session.
  • the brokerage device(s) may further be adapted to determine the location of the mobile device and, based on the location of the mobile device and the identity of the content provider, determine whether a transfer of the partial content service session to a mirror brokerage device is needed.
  • the system can comprise multiple brokerage computing devices, at least one of which is configured to selectively act as a mirror device.
  • the brokerage device(s) configured as a mirror device can then access selection data, access data comprising the plurality of streams, buffer the data, and transmit the buffered data to the mobile device in response to a transfer of the partial content extraction session from a different brokerage computing device.
  • FIG. 1 is a block diagram showing an overview of an exemplary communications system comprising a wireless multimedia content brokerage service that supports partial content extraction to mobile devices;
  • FIG. 2 is a flowchart showing exemplary steps in a high-level process for providing wireless multimedia content brokerage services
  • FIG. 3 is a block diagram showing aspects of an exemplary wireless multimedia content brokerage service in closer detail
  • FIG. 4 is a block diagram showing another exemplary communication system comprising a wireless multimedia content brokerage service
  • FIG. 5 is a flowchart showing steps in an exemplary process for service management by a brokerage agent, including assigning an appropriate mirror agent when needed;
  • FIG. 6 is a flowchart showing steps in an exemplary process which may be carried out by a wireless multimedia content brokerage service in support of provisioning partial content.
  • server processes discussed herein may be implemented using a single server or multiple servers working in combination.
  • Databases and applications may be implemented on a single system or distributed across multiple systems. Distributed components may operate sequentially or in parallel.
  • the actual data may travel between the systems directly or indirectly. For example, if a first computer accesses a file or data from a second computer, the access may involve one or more intermediary computers, proxies, and the like.
  • the actual file or data may move between the computers, or one computer may provide a pointer or metafile that the second computer uses to access the actual data from a computer other than the first computer, for instance.
  • Embodiments of the methods and systems set forth herein may be implemented by one or more general-purpose or customized computing devices adapted in any suitable manner to provide desired functionality.
  • the device(s) may be adapted to provide additional functionality complementary or unrelated to the present subject matter, as well.
  • one or more computing devices may be adapted to provide desired functionality by accessing software instructions rendered in a computer-readable form.
  • any suitable programming, scripting, or other type of language or combinations of languages may be used to implement the teachings contained herein. However, software need not be used exclusively, or at all.
  • some embodiments of the methods and systems set forth herein may also be implemented by hard-wired logic or other circuitry, including, but not limited to application-specific circuits.
  • hard-wired logic or other circuitry including, but not limited to application-specific circuits.
  • combinations of computer-executed software and hard-wired logic or other circuitry may be suitable, as well.
  • a communications system may comprise one or more systems that can provide wireless multimedia content brokerage services.
  • Such system(s) may comprise one or more computing devices adapted to perform one or more embodiments of the methods disclosed herein.
  • computing devices may access one or more computer-readable media that embody computer-readable instructions which, when executed by at least one computer, cause the at least one computer to implement one or more embodiments of the methods of the present subject matter.
  • the computing device(s) may comprise circuitry that renders the device(s) operative to implement one or more of the methods of the present subject matter.
  • components of the presently-disclosed technology such as subscriber databases, may be implemented using one or more computer-readable media.
  • Any suitable computer-readable medium or media may be used to implement or practice the presently-disclosed subject matter, including, but not limited to, diskettes, drives, and other magnetic-based storage media, optical storage media, including disks (including CD-ROMS, DVD-ROMS, and variants thereof), flash, RAM, ROM, and other memory devices, and the like.
  • Software agents are utilized in some embodiments of the present subject matter. Generally speaking, any type of software agent may be used, with the actions of the software agent based on rules, parameters, profiles, and other data provided by the agent's principal or principals, i.e., the individual(s), group(s), or other entity (or entities) configuring the agent's behavior.
  • the degree of autonomy exercised by the agent may vary, and may depend on rules or preferences specified by the agent's principal.
  • the rules may provide for the agent to contact one or more persons and/or other agents for additional data, such as confirmation of a course of action or further information required by the agent to evaluate a situation.
  • Agent functionality may be handled by a single agent or coordinated amongst multiple agents.
  • Agent(s) may reside in one computing device or may be distributed amongst multiple computing devices. No particular level of autonomy or “intelligence” is required of a software agent; for instance, in some embodiments, the term “software agent” can refer to a routine or a collection of routines that provide particular functionality.
  • network communications can comprise sending and/or receiving information over one or more networks of various forms.
  • a network can comprise a dial-in network, a local area network (LAN), wide area network (WAN), public switched telephone network (PSTN), the Internet, Intranet or other type(s) of networks.
  • a network may comprise any number and/or combination of hard-wired, wireless, or other communication links.
  • FIG. 1 is a block diagram showing components in an exemplary communications system 10 that includes a wireless multimedia content brokerage service that includes support for partial/selective extraction of content displays provided via one or more large display devices and forwarding of such content to mobile devices.
  • the service is provided by way of one or more application servers 12 and 12 a , also labeled with exemplary SIP addresses “SIP AS-1” and “SIP AS-2.”
  • Each application server comprises one or more computing devices adapted to provide a wireless content brokerage agent (WCBA) 14 , 14 a .
  • a wireless content brokerage agent may comprise one or more processes, applications, or software agents which receive requests for content extraction, manage incoming and outgoing media streams, and coordinate transactional details, such as subscriptions and other rights management with regard to content.
  • application servers such as 12 and 12 a may, in some embodiments, be adapted to provide other services/functionality.
  • IMS core network 22 can comprise any all-IP telecom network that requires each end element to have an IP address expressed in a SIP (Session Initiation Protocol) format.
  • SIP Session Initiation Protocol
  • IMS has been standardized by the Third generation Partnership Project (3GPP) and has been accepted by the telecom world as the next generation telecom standard running on IPv6 (Internet Protocol Version 6).
  • media streams can be transferred using SIP/SDP/RTP protocol, which refers to Session Initiation Protocol/Session Description Protocol/Real Time Protocol.
  • application servers such as servers 12 , 12 a , and server 18 (discussed below) are in the service layer of IMS.
  • Mobile terminals such as exemplary mobile terminal 32 , communicate with other mobile terminals, other devices in the IMS network, and IMS services by way of IMS core network 22 .
  • FIG. 1 further illustrates several elements as generalized block diagrams.
  • HSS home subscription server/database
  • CSCF call session control function
  • BF border functions
  • MF media functions
  • HSS 24 serves as a clearinghouse for data regarding various devices in the IMS network, such as user or device profiles.
  • CSCF 26 provides for call session control functions governing telephone and other communications functionality.
  • Border Functions 28 handle communication between different IMS core networks, while media functions 30 process or manipulate multimedia for optimal transit through the network.
  • Content service provider 18 comprises any entity which, via one or more computing devices, makes multimedia content available to consumers via the IMS network 22 .
  • multimedia content displays can be provided via one or more large display devices viewable in public or other areas.
  • content service provider 18 may additionally or alternatively provide content without the use of an IMS network.
  • the present subject matter can be implemented in a system using broadband data communication standards other than IMS, such as an IP-based distribution system accessible by a wireless service provider.
  • multiple network types may be used. For instance, content may be made available to display devices through one type of network, such as a broadcast or cable television network, while identification of displays, communications with mobile devices, and streaming of components occur over another network, such as a cellular telephone network and/or wireless Internet.
  • multimedia content presented via a large display device it is to be understood that the present subject matter is not intended to be limited to particular types of content or particular mode or manner of presentation.
  • other content presentation systems may provide 3-D content (with or without audio).
  • the display need not be large or public.
  • a user may view a composite content presentation at a friend's home or other private setting at a small screen (e.g. television, computer screen) and extract partial content using embodiments of the present subject matter.
  • the wireless content brokerage agent 14 provided via server 12 communicates with one or more mobile users to ascertain each user's media extraction requirements and arranges for multimedia flow from the appropriate content service provider or providers, such as content service provider 18 .
  • wireless content brokerage agents such as 14 can obtain content directly from content service providers, such as 18 , and provide the content in a suitable form to mobile terminals, such as terminal 32 . Accordingly, no rights management or other transactional details need to be handled directly by the user at mobile 32 for a particular content extraction session. Additionally, no interaction between the user and display device is required. Thus, relatively “dumb” large display devices can be used. In other embodiments the extraction experience can be enhanced through support of some interactivity/data transfer at the large display device, but this is not required.
  • the “home” wireless content brokerage agent ( 14 in this example) is responsible for maintaining a content service provider database 16 that references major contents service providers known to supply multimedia content to public display devices. Database 16 can be used to determine when a mirror application server should be utilized for best service quality.
  • mirror content brokerage services can be provided so that it is not necessary for content to be routed over excessive distances.
  • local content from local content service providers can be routed through local mirror wireless service provider application servers.
  • application server 12 a and content brokerage agent 14 a comprise a “mirror” service/agent supporting a different area than server 12 and agent 14 .
  • server 12 a when a user of mobile terminal 32 is far from his home network, such as on another continent, content may be routed through server 12 a rather than through home server 12 .
  • the user can associate with a given wireless service provider and obtain a subscription to the partial content extraction service.
  • the partial content extraction service may be provided by the user's communications carrier (e.g. cell phone company) or may be a separate service provided by one or more third parties.
  • the wireless service provider affiliates with content providers such as content service provider 18 in order to obtain sufficient rights to retrieve and forward selected content to mobile device 32 .
  • the wireless service provider may proactively or on a case-by-case basis obtain subscriptions to content service providers based on the location of mobile device 32 .
  • content brokerage agent 14 may engage in other rights clearance activities other than obtaining subscriptions.
  • FIG. 2 provides a high-level conceptual overview of some aspects of the present subject matter by illustrating exemplary steps in a process 50 for providing partial content provisioning via a wireless multimedia content brokerage service. Additionally, the exemplary steps of FIG. 2 are cross-referenced by letters to exemplary communications shown in FIG. 1 and identified by capital letters A through E.
  • the home wireless service provider maintains information on subscribing mobile users, content service providers, and wireless service provider mirror servers. For instance, the information can be arranged and/or accessed by algorithms, processes, or applications that are configured to determine the optimal component combinations for serving users based on location.
  • server 12 is in communication with terminal 32 to determine the location of terminal 32 . Location may be tracked in any suitable manner, such as by geographic coordinates (e.g., GPS) or network location (e.g. cell ID).
  • home wireless content brokerage agent 14 receives a request from the user of terminal 32 identifying a composite multimedia presentation comprising content which the user of terminal 32 wishes to have forwarded/routed to terminal 32 .
  • the home wireless content brokerage agent 14 assigns an appropriate mirror site to service the mobile user. This is shown at (B) in FIG. 1 , which represents one or more data transfers between server 12 and server 12 a which serve to alert mirror WCBA 14 a that content extraction is to be handled by wireless content brokerage agent 14 a .
  • the user of mobile terminal 32 may be physically closer to server 12 a rather than home server 12 .
  • such decisions may not depend on the relative location of the mobile terminal relative to the server, but instead may depend on the relative location of the server to the content provider. Of course, other network factors may be considered in addition to or instead of location.
  • the assigned WCBA establishes a suitable connection with a content service provider.
  • data provided by home server 12 may indicate that content from content service provider 18 is to be forwarded to device 32 .
  • mirror WCBA 14 a may establish a SIP/SDP/RTP multimedia session with content service provider 18 and obtain extractable multimedia content component streams.
  • (C) in FIG. 1 shows the connection that would be made between content service provider 18 and home server 12 if, for example, terminal 32 were to be served via home server 12 /home WCBA 14 .
  • the wireless multimedia content brokerage service can interface with mobile terminal 32 to receive selection data from a user.
  • the selection data can identify one or more of a plurality of multimedia streams displayed in a composite multimedia presentation which are of interest to the user.
  • the content brokerage agent 14 a can generate a graphical user interface that enables the mobile terminal user to navigate through a representation of a large display to indicate one or more streams of interest. If home agent 14 were handing the entire session, then home agent 14 would generate the graphical user interface.
  • the wireless content brokerage agent sends the selected stream or streams to the mobile terminal. In FIG. 1 , this is shown at (D). If home server 12 /home agent 14 were serving terminal 32 , then the content would flow over the same path as (A), although it will be understood that the multimedia flow can be entirely separate from the initial request.
  • step 60 shown in FIG. 2 the mobile user selected multimedia content component streams continue to flow to the mobile terminal via one or more SIP/SDP/RTP multimedia sessions established between the content service provider and content brokerage agent, and between the content brokerage agent and the terminal.
  • the streams can continue until any suitable end event, such as termination command by the user of terminal 32 , the end of the multimedia content stream, or other considerations.
  • FIG. 3 is a block diagram showing a closer view of an exemplary application server 12 .
  • application server 12 further comprises content service provider database 16 .
  • database 16 comprises table 40 that comprises a listing of content service providers, mirror sites, and other applicable information by geographic location.
  • Table 40 and any other databases or datasets discussed herein, can be provided by any number or type of databases in any suitable logical or physical format.
  • wireless content brokerage agent 14 accesses database 16 in order to determine optimal handling of partial content extraction and forwarding.
  • content brokerage agent comprises a service manager component 34 which handles initialization of content extraction sessions and a content manager component 36 which handles accessing and buffering content, generating selection interfaces, receiving selection data, and buffering and forwarding content to users.
  • content manager component 36 may be used to handle sessions initiated by service manager component 34 and to handle incoming sessions where application server 12 and agent 14 act as a mirror for other servers/agents.
  • service manager 34 accesses database 16 and, as needed, handles contacting and interacting with mirror service providers and/or content providers. For instance, by referencing home subscriber service 24 , service manager 34 may determine the location of mobile users and thereby make effective use of CSP database 16 . In embodiments which do not utilize IMS, another suitable source of information as to the location of mobile users can be used rather than HSS 24 .
  • a content manager 36 may utilize one or more buffers 38 a , 38 b , 38 c , and 38 d to buffer incoming content during the interval between a forwarding request and the actual provision of multimedia content to a mobile device.
  • one buffer may be used for each of a plurality of media streams that comprise a composite multimedia presentation of multimedia content.
  • four buffers are shown in this example, it will be understood that an application server may have access to more or fewer buffers in order to adequately service a desired number of mobile users.
  • buffer(s) used for a particular multimedia content stream may be used to provide data for multiple users.
  • the particular portion of content extracted from the buffer may differ between users in such cases.
  • Any suitable type of hardware and/or software-based buffering schemes can be used.
  • no buffering is performed, and content manager 36 provides a pass-through functionality (although some buffering may be incidental to the pass-through functionality).
  • service manager 34 can access a dynamic table of available content streams 19 to determine particular media stream addresses to access.
  • a composite multimedia presentation may comprise media from several different feeds.
  • several or all of the streams comprising the composite multimedia presentation can be accessed via their respective network addresses and can be buffered in a respective buffer.
  • the user can then be prompted to select one or more streams of Interest. Once the stream(s) of interest are identified, the buffered content can be forwarded to the user.
  • FIG. 4 provides a more detailed view of an exemplary communications system 100 comprising a wireless multimedia content brokerage service with support for partial content extraction.
  • This example also depicts an exemplary user 101 associated with mobile device 132 , with user 101 coming within perceptible range of a public fixed display device 102 .
  • public the particular conditions required to view display device (or lack of such conditions) can vary.
  • a “public” display can comprise any display that can be viewed by one or more users, and may vary in size.
  • the “display device” can comprise not only the screen, projection, and/or other equipment used to render a perceptible image, but additional components used to receive signals, such as one or more computing devices such as a set-top box (whether a separate component or integrated with other components) and the like.
  • the “display” can include ancillary components not related to visual aspects of the presentation, such as speakers for audio content.
  • public display device 102 provides a composite multimedia presentation of several different multimedia real-time content streams.
  • the display comprises a newscaster 103 , graphical weather forecast 104 , news clip 105 , scrolling stock ticker 106 , and scrolling news ticker 107 .
  • User 101 may wish to view some components on mobile device 132 , but it may not be feasible for all components to be displayed on the screen of mobile device 132 . For instance, the screen may be too small to show all components, or the bandwidth requirements for viewing all streams may be too excessive.
  • user 101 can request for partial content extraction of the content displayed at device 102 .
  • home application server 112 comprises home content brokerage agent 114 with access to database 116 in the same manner as home server 12 comprises home content brokerage agent 14 with access to database 16 .
  • mirror server 112 a mirror content brokerage agent 114 a , home subscriber server (HSS) 124 , IMS core network 122 , content service provider 118 , multimedia content source 120 , multimedia content component table 119 , and are not discussed in further detail.
  • IMS call support components are generally illustrated at 126 and may comprise, for instance, P-CSCF, I-CSCF, and S-CSCF.
  • FIGS. 5 and 6 illustrate steps in exemplary processes for operating such a service. Additionally, in a later example, reference will be made to communications occurring between components shown in FIG. 4 and labeled 201 through 222 .
  • FIG. 5 shows an exemplary process 70 comprising steps related to service management aspects of a wireless content brokerage agent.
  • Step 72 represents an initial state, where a wireless content brokerage agent has access to a database of content service providers in geographic (or other) locations which the content brokerage agent commits to provide content extraction and forwarding services.
  • Each home content brokerage agent also has access to a list of mirror service sites located in the committed geographic locations.
  • Step 74 represents an initial setup step between a wireless device user and the content brokerage agent, wherein the user obtains a subscription from the wireless service provider for selective content extraction services.
  • this service may be provided as a feature in a calling plan or other arrangement between a wireless service provider and a user, or may be provided as a third party service.
  • the home content brokerage agent updates the mobile user's profile in the home subscription database identifying the wireless service provider as the mobile user's home provider.
  • the content brokerage service is implemented as part of an IMS core network, such as network 122
  • such a profile update is necessary for authorizing an S-CSCF component of the core network to establish a SIP/SDP/RTP session between the content brokerage agent and the mobile terminal.
  • Step 76 represents service management activities that may be performed at some point after a user has subscribed or otherwise obtained the services of the wireless multimedia content brokerage system. For instance, a user may set up the content forwarding service sometime prior to encountering content, or may be prompted to subscribe to the content forwarding service at the time the user encounters content.
  • a mobile user such as user 101 in FIG. 4 , comes into the vicinity of fixed display device 102 and logs onto the user's home content brokerage service by contacting a brokerage agent to launch the content extraction service.
  • the home brokerage agent can verify authentication for the content extraction service by checking the home subscriber database.
  • the home content brokerage agent obtains information regarding the mobile user's current geographic or other location. This information may be obtained, for example, from the home subscriber service so database in implementations in a system supporting IMS functionality. Based on identification data provided by the user, the brokerage agent can determine the geographic or other location of the content provider for the display device of interest. As shown at 80 , the home content brokerage agent uses its content service provider database 116 to determine which mirror content brokerage agent (if any) would be best suited for servicing the mobile user for the particular content extraction service. As shown at 82 , if a home content brokerage agent is suitable for providing the content extraction service, process 70 skips to step 86 .
  • the home agent transfers the mobile user's web session to an appropriate mirror content brokerage agent. For instance, as was noted earlier, a user outside the geographic region served by the home content brokerage agent may be better served by a local brokerage agent with a closer or more robust connection to corresponding local content service providers.
  • the home content brokerage agent which is handling the mobile user session returns a web page (or other suitable interface) to the user that can be used to send a request to the appropriate content brokerage agent to launch the content extraction service.
  • the content brokerage agent which receives the request can then provide a suitable representation of the fixed display multimedia content for further selection by the user.
  • the mobile user provides data indicating a launch, such as pressing a content extraction service launch button, selecting a launch command using an interface on the phone, or in any other suitable manner.
  • a content management session begins between the assigned content brokerage agent and the mobile terminal. If no mirror agent is used, then the content management session is also handled by the home content brokerage agent.
  • FIG. 6 illustrates steps in an exemplary content management session 150 between a wireless content brokerage agent and a mobile terminal.
  • Step 152 represents an initial state wherein a user request for launching a multimedia content extraction session has arrived at an assigned content brokerage agent.
  • the agent has access to a dynamic multimedia component table showing which multimedia content components of a particular display of interest are extractable in real time.
  • a public display device may comprise a composite media display that includes elements which are not extractable.
  • the component table may include a place holder or other indication so that the content brokerage agent can inform the mobile user of which content streams are available.
  • the content brokerage agent obtains a subscription as a user of the target content service provider.
  • the content service provider may also use the home subscription server database of the IMS network to manage authorization for obtaining content.
  • the content service provider can update a user profile corresponding to the content brokerage agent to ensure authorization to the IMS components when required.
  • the content brokerage agent accesses the multimedia component table for the identified content service provider to determine the number and characteristics of communication sessions which are needed in order to obtain content comprising the composite multimedia presentation. For example, the content brokerage agent may determine which particular SIP/SDP/RTP sessions are required to access the data comprising the streams of interest.
  • the content brokerage agent establishes the required connections, such as an SIP/SDP/RTP multimedia session for each component stream of the content display.
  • the content brokerage agent extracts a thumbnail image of each multimedia stream incoming from the content service provider.
  • the thumbnail images are inserted into a web page.
  • This web page can be returned to the mobile device as part of a graphical user interface for the mobile user.
  • the mobile user can navigate through a replica of the composite multimedia presentation in order to provide selection data to the content brokerage agent.
  • the images may be placed into the webpage that is returned to the user in response to launching the service as noted at step 88 in FIG. 5 .
  • the graphical user interface need not necessarily comprise a web page, and other data formats/protocols could be used to provide the graphical user interface.
  • the content brokerage agent receives the user's selection of multimedia components for extraction.
  • the content brokerage agent establishes an SIP/SDP/RTP multimedia streaming session with the mobile terminal and sends the requested mobile streams to the terminal.
  • the content brokerage agent may buffer incoming content streams.
  • the streaming sessions to the user terminal may begin at the earliest point in the buffer so that the recipient can avoid missing any portions of the content of interest.
  • the multimedia content may be mirrored at the device in real time or near real time, with or without buffering at the content brokerage agent.
  • the brokerage agent acts as a pass-through only (although some incidental ‘buffering’ may occur during the pass-through operations).
  • the content brokerage agent terminates the SIP/SDP/RTP multimedia sessions of component streams that are not selected by the mobile user.
  • buffering may not be discontinued. For instance, if an agent is providing the same content to multiple users, the data may be maintained in a shared buffer which is continually updated until no more users are accessing the content.
  • the selected component streams continue to play back in real time at the mobile terminal. The component streams may continue until the end of the particular multimedia content in the streams and/or another termination event, such as termination of forwarding by the user.
  • a content service provider such as content service provider 118 , obtains multimedia content 120 which is sent to a public fixed display device 102 .
  • Multimedia content 120 may be obtained from any suitable sources, including stored data, live feeds, broadcast sources, and the like.
  • public fixed display device provides a multimedia display comprising a plurality of multimedia streams.
  • Each one of the streams 103 - 107 can comprise real time video content with or without accompanying audio.
  • the content service provider 118 updates multimedia component table 119 to identify the plurality of multimedia streams associated with display device 102 .
  • the data could be in the form of an XML file that would be configured for a content brokerage agent to sort via a style sheet associated with the XML file.
  • the XML file may comprise characteristics identifying each partial content stream in a manner such that content brokerage agents can establish appropriate SIP/SDP/RTP sessions with the content service provider if required.
  • the XML file may contain the coordinates of the partial content on the display screen so that the content brokerage agent can provide data to mobile users based on the special arrangement of content on the public display.
  • the home wireless service provider 112 obtains a subscription to content service provider 118 .
  • this subscription may be obtained in response to determining that user 101 is in a geographic or other location served by content service provider 118 on large display devices. If service provider 112 already has an adequate subscription, then no subscription is needed.
  • the content service provider updates one or more home subscription server database profiles to indicate that the wireless service provider and its brokerage agents (including the home and mirror content brokerage agents 114 and 114 A) as authorized user of its multimedia content.
  • the home content brokerage 114 maintains a table or other so suitable data mapping content service providers to suitable mirror content brokerage agents.
  • mobile user 101 becomes a subscriber of the selective content extraction service provided by the wireless multimedia content brokerage service.
  • Content brokerage agent 114 updates the profile of user 101 in home subscription server database 124 .
  • the display may include one or more public service identifiers indicating the source of the content. Additionally, the display itself may include one or more indications of its SIP address or other identifier(s). Although not required for the present subject matter, in some embodiments, the display includes communication functionality, such as Bluetooth or Wi-Fi connectivity for automatically providing its SIP address and/or content identifiers to interested users.
  • the mobile user launches a browser or other thin client application on terminal 132 and logs onto home service provider 112 to begin the multimedia content extraction service.
  • the home content brokerage agent 114 authenticates user 101 by referencing subscriber database 124 as shown at 209 .
  • Home content brokerage agent 114 returns a mobile web page or other suitable user interface data through which user 101 can use terminal 132 to identify the content of interest as shown at 210 .
  • the user may be provided with a mobile web page for entering a public service identifier of the content service provider and/or the SIP address of the display device. If the display supports local communication, such data may be obtained from the display. However, it is emphasized that the display does not need to have any such data transfer functionality, provided some sort of indication of the display identifier(s) is provided (e.g. a sign or panel).
  • the data identifying the display device is sent to the home content brokerage agent. In some embodiments, no explicit identification of the display is needed if the user can identify the content provider from available information (e.g. a program title, channel identifier, or the like).
  • the home content brokerage agent determines the mobile user's current geographic or other location from home subscriber database 124 . Also, as shown at 213 , based on content provider identification data (and/or display identification data) and the location of user 101 /terminal. 132 , the home content brokerage agent 114 identifies an appropriate mirror content brokerage agent ( 114 A in this example) suitable for serving terminal 132 . As shown at 214 , home content brokerage agent 114 informs the mirror content brokerage agent 114 A regarding the current extraction request. For example, 214 may represent transfer of session data to agent 114 A. As shown at 215 , the home content brokerage agent also updates user 101 profile with service authorization for the mirror agent 114 A.
  • home content brokerage agent 114 returns a webpage or other suitable interface data which allows user 101 to launch the content extraction service.
  • agent 114 may hand off the entire session to agent 114 A, making agent 114 A responsible for generating the launch webpage.
  • the mobile user sends a request to launch the component extraction service to the suitable content brokerage agent.
  • the launch request is sent to mirror content brokerage agent 114 A, although if the home agent 114 was handling this particular session, the request would be sent to the home agent.
  • Mirror content brokerage agent 114 obtains multimedia component streams corresponding to those shown on display 102 by establishing SIP/SDP/RTP multimedia sessions with content service provider 118 as shown at 218 .
  • mirror content brokerage agent 114 A provides terminal 132 with data so that terminal 132 can render an interface, such as a mobile terminal webpage, comprising thumbnail image representations of the multimedia component streams.
  • the thumbnail images may be static in some embodiments, or may be updated at a reduced frame rate.
  • content service provider 118 may dynamically generate thumbnail representations of its partial content streams and send the representations to content brokerage agents, such as part of or along with the XML or other files identifying the content streams.
  • user 101 provides input to terminal 132 and terminal 132 sends selection data to content brokerage agent 114 A, such as via a HTTP request.
  • content brokerage agent 114 A provides the selected multimedia component streams by establishing one or more SIP/SDP/RTP multimedia sessions with terminal 132 .
  • Mirror content brokerage agent 114 A then terminates the unused SIP/SDP/RTP session with content service provider 118 as shown at 222 .
  • User 101 can then view the requested stream(s) at terminal 132 until the end of the stream(s) or until another termination event occurs.

Abstract

A wireless multimedia content brokerage service can provide for real time selective content extraction in a manner that allows users to easily obtain, at a mobile device, one or more portions of a real time multimedia composite content presentation. The brokerage service ensures that the experience is transparent from the point of view of the user, and additionally does not require any specific interaction between the user and the display, or interaction between the user and the content service provider (or providers). Instead, the brokerage service handles the transactional details involved in subscribing to content and in obtaining, formatting, and forwarding content to the mobile device. Additionally, since the content of interest is not forwarded from the display itself and since some embodiments of the system do not rely on any interactivity at the display to identify the display device or content, relatively unsophisticated display devices can be used.

Description

CROSS-REFERENCE TO RELATED APPLICATION
The present application is a continuation of U.S. patent application Ser. No. 13/601,172, filed on Aug. 31, 2012, which was a continuation of U.S. Pat. No. 8,261,307, which issued on Sep. 4, 2012, the disclosures of which are hereby incorporated by reference in their entirety.
BACKGROUND
Hand held personal mobile terminals, such as cellular telephones, are becoming the constant companion of contemporary individuals who may encounter real time multimedia content numerous times a day. For example, a person may encounter multimedia content at an airport or other waiting room, at a cafeteria or restaurant, in a lounge, or such as at a hotel. Some of this publicly-viewable content may comprise real time broadcasts provided via large display devices and/or other display devices. In some instances, public or other display devices viewed by an individual may present composite multimedia presentations. Generally, a composite multimedia presentation can comprise multiple simultaneous streams of content. As an example, a single large display may feature multiple video streams which may or may not include accompanying audio.
An individual viewing content (referred to herein also as a “user”) may desire to continue to view real time content, but may have any number of reasons to leave the area in which the display device can be perceived. Accordingly, the user may wish to view some or all of the content on a mobile device. If an entire composite multimedia presentation is simply mirrored on the mobile device, the content of the composite multimedia presentation may be difficult or impossible to fully view due to small screen size and/or low resolution of the mobile device. Furthermore, existing systems, such as video on demand systems, require effort on the part of the mobile user to locate the applicable content provider and, in some instances, to obtain a subscription or to perform other rights management activity before actually viewing the content. Thus, opportunities remain to improve the experience for users of mobile devices, such as by providing for partial content extraction onto a device.
SUMMARY
In accordance with some aspects of the present subject matter, a wireless multimedia content brokerage service can provide for real time selective content extraction in a manner that allows users to easily obtain, at a mobile device, one or more portions of a real time composite multimedia presentation. The brokerage service ensures that the experience is transparent from the point of view of the user, and additionally does not require any specific interaction between the user and the display, or interaction between the user and the content service provider (or providers). Instead, the brokerage service handles the transactional details involved in obtaining subscriptions to content and in obtaining, formatting, and forwarding content to the mobile device. Additionally, since the content of interest is not forwarded from the display itself and since some embodiments of the system do not rely on any interactivity at the display to identify the display device or content, relatively unsophisticated display devices can be used. Furthermore, the user is not limited to proximity to a particular display device since the display device does not need to play a role in the transfer of content data to the mobile device.
A wireless multimedia content brokerage system can comprise at least one computing device (referred to as a “brokerage computing device” for clarity) adapted to access presentation identification data that identifies a realtime composite multimedia content presentation. For example, the composite multimedia content presentation can comprise a plurality of content streams, such as a plurality of real time video content streams and one or more audio feeds. The particular manner in which the streams are provided to and by a display device does not matter. For instance, in some embodiments, a display device may receive a single data stream comprising the plurality of multimedia components. In other embodiments, the display device may receive several streams and combine the streams into a composite presentation at the display device.
The at least one brokerage computing device can be adapted to identify at least one content provider associated with the plurality of streams. For instance, in some embodiments, a single content provider assembles and provides the composite content presentation. However, in other embodiments, a composite content presentation may be assembled from streams provided by multiple content providers. In any event, the content provider(s) can be identified in any suitable way. For instance, a mobile device user may provide a suitable identifier, such as a display SIP or IP address, a content identifier (such as an indication of a channel, content provider, or content title or reference number), or the like via an interface that relays the information to the at least one brokerage computing device. Based on the display device SIP/IP address, content identifier, and/or other relevant information, the at least one brokerage computing device can cross-reference the content provider(s) for the presentation to determine what media stream(s) comprise the underlying components of the composite presentation and where to obtain the streams.
For example, if a composite presentation comprises a ticker, a feed of graphics (e.g. a graphical weather forecast), and a video feed of a newscaster, each such component may be made available by the content provider(s) as an individualized stream. The individualized streams may be made available even if the composite presentation is sent as a single stream (e.g. as a single broadcast or cable channel).
The at least one brokerage computing device can be adapted to access data comprising the plurality of streams made available by the content provider(s) and, in some embodiments, to buffer the accessed data. For example, if the content provider(s) push content, the at least one brokerage computing device can issue one or more suitable push requests and receive and buffer the content. Additionally, the at least one brokerage computing device can provide selection interface data to a user's mobile device and access selection data provided by the mobile device, with the selection data identifying at least one of the plurality of streams for extraction to the mobile device. The brokerage computing device(s) can further be adapted to transmit the buffered data comprising the at least one identified stream to the mobile device.
In some embodiments, the brokerage computing device(s) may be adapted to avoid buffering accessed data comprising at least one stream that is not identified in the selection data. For example, if a composite multimedia presentation comprises numerous video streams and a particular user elects to view only one stream, the brokerage service can discontinue buffering the other streams. However, in some embodiments, the brokerage service retains sufficient information for a user to revert back to the selection phase and select other streams. Further, buffering may continue if other users served by the brokerage computing device(s) continue to view the same stream. In some embodiments, the brokerage computing device or devices may not buffer content, but may instead act as a pass-through between the mobile device and the content provider(s).
In some embodiments, the least one brokerage computing device may also be adapted to interface with the at least one content provider and, in response to the selection data provided by the mobile device, transmit data identifying at least one change in the display. For example, the mobile device may provide selection data indicating a particular portion or portions of the composite media stream as selected by the mobile device user. Based on the selection data, the at least one brokerage computing device can send data to the appropriate content provider, and the content provider can highlight or otherwise annotate the selected portion(s) at the large display device. Accordingly, a mobile device user can receive feedback provided through a large (or other) display device in selecting which portion or portions to view at the mobile device. Data defining the annotation(s) or highlight(s) may be included in data comprising the media sent to the large display device, or may comprise data sent as separate commands to the display device or other related components such as, e.g. a set-top box associated with the display device.
It should be noted that, although in accordance with some aspects of the present subject matter a display can appear to be responsive to a user, the present subject matter does not require any sort of specific data transfer with or between the display and the user device. Thus, the present subject matter can be used with displays without requiring specialized functionality to support sending content to mobile devices.
In some embodiments, the selection interface data comprises data defining the layout of a graphical user interface, with the graphical user interface comprising respective portions corresponding to locations of various streams in the composite multimedia presentation. For example, the graphical user interface may be presented at the mobile device based on the selection interface data so that a scaled replica of the large display is presented at the mobile device. A mobile device user may then navigate through the graphical user interface to identify one or more portions of the composite multimedia display. The individual streams may be represented as still images in some embodiments.
In some embodiments, the brokerage computing device can be further adapted to determine whether one or more subscriptions are needed to access the plurality of streams and, if so, obtain the needed subscription or subscriptions. For instance, prior to accessing data comprising the streams, a database or other suitable set of information can be accessed to determine if a subscription is needed to access the stream and whether or not such a subscription is available. For content which is not subscription-based, other actions can be taken to ensure that the computing device has sufficient rights to obtain and provide the content stream(s) to the mobile device. The present subject matter is not limited by the particular type(s) of rights clearance steps required to access content, and can even be used with regard to content that requires no rights management.
In some embodiments, the at least one brokerage computing device can be adapted to interface with at least one content provider after identifying the content provider and obtain at least one structured data file identifying a network address for each of the plurality of content streams comprising the content display. Further, in some embodiments, the structured so data file may also comprise data identifying the spatial arrangement of the composite media display. The at least one brokerage computing device may be adapted to generate the selection interface data based on the structured data file. As an example, a content provider may make one or more structured files such as XML files available and cross-referenced to specific display devices by display device SIP/IP address or other identifier(s). The XML files may specify a network address, such as a SIP/IP address and/or other identifier(s), for each component of the composite media display provided at the display device.
In some embodiments, the brokerage computing devices can be adapted to access presentation identification data and identify at least one content provider as part of a partial content service session. The brokerage device(s) may further be adapted to determine the location of the mobile device and, based on the location of the mobile device and the identity of the content provider, determine whether a transfer of the partial content service session to a mirror brokerage device is needed. Accordingly, in some embodiments, the system can comprise multiple brokerage computing devices, at least one of which is configured to selectively act as a mirror device. In handing a particular session, the brokerage device(s) configured as a mirror device can then access selection data, access data comprising the plurality of streams, buffer the data, and transmit the buffered data to the mobile device in response to a transfer of the partial content extraction session from a different brokerage computing device.
BRIEF DESCRIPTION OF THE DRAWINGS
A full and enabling disclosure including the best mode of practicing the appended claims and directed to one of ordinary skill in the art is set forth more particularly in the remainder of the specification. The specification makes reference to the appended figures, in which:
FIG. 1 is a block diagram showing an overview of an exemplary communications system comprising a wireless multimedia content brokerage service that supports partial content extraction to mobile devices;
FIG. 2 is a flowchart showing exemplary steps in a high-level process for providing wireless multimedia content brokerage services;
FIG. 3 is a block diagram showing aspects of an exemplary wireless multimedia content brokerage service in closer detail;
FIG. 4 is a block diagram showing another exemplary communication system comprising a wireless multimedia content brokerage service;
FIG. 5 is a flowchart showing steps in an exemplary process for service management by a brokerage agent, including assigning an appropriate mirror agent when needed; and
FIG. 6 is a flowchart showing steps in an exemplary process which may be carried out by a wireless multimedia content brokerage service in support of provisioning partial content.
Use of like reference numerals is intended to illustrate like or analogous components.
DETAILED DESCRIPTION
Reference will now be made in detail to various and alternative exemplary embodiments and to the accompanying drawings, with like numerals representing substantially identical structural elements. Each example is provided by way of explanation, and not as a limitation. In fact, it will be apparent to those skilled in the art that modifications and variations can be made without departing from the scope or spirit of the disclosure and claims. For instance, features illustrated or described as part of one embodiment may be used on another embodiment to yield a still further embodiment. Thus, it is intended that the present disclosure includes modifications and variations as come within the scope of the appended claims and their equivalents.
The technology discussed herein makes reference to servers, databases, software applications, and other computer-based systems, as well as actions taken and information sent to and from such systems. One of ordinary skill in the art will recognize that the inherent flexibility of computer-based systems allows for a great variety of possible configurations, combinations, and divisions of tasks and functionality between and among components. For instance, server processes discussed herein may be implemented using a single server or multiple servers working in combination. Databases and applications may be implemented on a single system or distributed across multiple systems. Distributed components may operate sequentially or in parallel.
When data is obtained or accessed between a first and second computer system or component thereof, the actual data may travel between the systems directly or indirectly. For example, if a first computer accesses a file or data from a second computer, the access may involve one or more intermediary computers, proxies, and the like. The actual file or data may move between the computers, or one computer may provide a pointer or metafile that the second computer uses to access the actual data from a computer other than the first computer, for instance.
The various computer systems discussed herein are not limited to any particular hardware architecture or configuration. Embodiments of the methods and systems set forth herein may be implemented by one or more general-purpose or customized computing devices adapted in any suitable manner to provide desired functionality. The device(s) may be adapted to provide additional functionality complementary or unrelated to the present subject matter, as well. For instance, one or more computing devices may be adapted to provide desired functionality by accessing software instructions rendered in a computer-readable form. When software is used, any suitable programming, scripting, or other type of language or combinations of languages may be used to implement the teachings contained herein. However, software need not be used exclusively, or at all. For example, some embodiments of the methods and systems set forth herein may also be implemented by hard-wired logic or other circuitry, including, but not limited to application-specific circuits. Of course, combinations of computer-executed software and hard-wired logic or other circuitry may be suitable, as well.
Embodiments of the methods disclosed herein may be executed by one or more suitable computing devices. For instance, as noted in further detail below, a communications system may comprise one or more systems that can provide wireless multimedia content brokerage services. Such system(s) may comprise one or more computing devices adapted to perform one or more embodiments of the methods disclosed herein. As noted above, such devices may access one or more computer-readable media that embody computer-readable instructions which, when executed by at least one computer, cause the at least one computer to implement one or more embodiments of the methods of the present subject matter. Additionally or alternatively, the computing device(s) may comprise circuitry that renders the device(s) operative to implement one or more of the methods of the present subject matter. Furthermore, components of the presently-disclosed technology, such as subscriber databases, may be implemented using one or more computer-readable media.
Any suitable computer-readable medium or media may be used to implement or practice the presently-disclosed subject matter, including, but not limited to, diskettes, drives, and other magnetic-based storage media, optical storage media, including disks (including CD-ROMS, DVD-ROMS, and variants thereof), flash, RAM, ROM, and other memory devices, and the like.
Software agents are utilized in some embodiments of the present subject matter. Generally speaking, any type of software agent may be used, with the actions of the software agent based on rules, parameters, profiles, and other data provided by the agent's principal or principals, i.e., the individual(s), group(s), or other entity (or entities) configuring the agent's behavior. The degree of autonomy exercised by the agent may vary, and may depend on rules or preferences specified by the agent's principal. In some instances, the rules may provide for the agent to contact one or more persons and/or other agents for additional data, such as confirmation of a course of action or further information required by the agent to evaluate a situation. Agent functionality may be handled by a single agent or coordinated amongst multiple agents. Agent(s) may reside in one computing device or may be distributed amongst multiple computing devices. No particular level of autonomy or “intelligence” is required of a software agent; for instance, in some embodiments, the term “software agent” can refer to a routine or a collection of routines that provide particular functionality.
The present disclosure also makes reference to the relay of communicated data over one or more communications networks. It should be appreciated that network communications can comprise sending and/or receiving information over one or more networks of various forms. For example, a network can comprise a dial-in network, a local area network (LAN), wide area network (WAN), public switched telephone network (PSTN), the Internet, Intranet or other type(s) of networks. A network may comprise any number and/or combination of hard-wired, wireless, or other communication links. Although several examples herein relate to an IMS-complaint network, in other embodiments, the subject matter may be implemented as part of a network (or networks) based on other public or proprietary standards.
FIG. 1 is a block diagram showing components in an exemplary communications system 10 that includes a wireless multimedia content brokerage service that includes support for partial/selective extraction of content displays provided via one or more large display devices and forwarding of such content to mobile devices. In this example, the service is provided by way of one or more application servers 12 and 12 a, also labeled with exemplary SIP addresses “SIP AS-1” and “SIP AS-2.” Each application server comprises one or more computing devices adapted to provide a wireless content brokerage agent (WCBA) 14, 14 a. For example, a wireless content brokerage agent may comprise one or more processes, applications, or software agents which receive requests for content extraction, manage incoming and outgoing media streams, and coordinate transactional details, such as subscriptions and other rights management with regard to content. Although not discussed in detail herein, application servers such as 12 and 12 a may, in some embodiments, be adapted to provide other services/functionality.
Other aspects of exemplary communications system 10 comprise IMS core network 22, which can comprise any all-IP telecom network that requires each end element to have an IP address expressed in a SIP (Session Initiation Protocol) format. IMS has been standardized by the Third generation Partnership Project (3GPP) and has been accepted by the telecom world as the next generation telecom standard running on IPv6 (Internet Protocol Version 6). Further, media streams can be transferred using SIP/SDP/RTP protocol, which refers to Session Initiation Protocol/Session Description Protocol/Real Time Protocol.
Generally speaking, in some embodiments, application servers, such as servers 12, 12 a, and server 18 (discussed below) are in the service layer of IMS. Mobile terminals, such as exemplary mobile terminal 32, communicate with other mobile terminals, other devices in the IMS network, and IMS services by way of IMS core network 22.
Although the full details of the IMS network are not explored herein, FIG. 1 further illustrates several elements as generalized block diagrams. Namely, the home subscription server/database (HSS) 24, call session control function (CSCF) 26, border functions (BF) 28, and media functions (MF) 30 are identified for sake of completeness. Briefly, HSS 24 serves as a clearinghouse for data regarding various devices in the IMS network, such as user or device profiles. CSCF 26 provides for call session control functions governing telephone and other communications functionality. Border Functions 28 handle communication between different IMS core networks, while media functions 30 process or manipulate multimedia for optimal transit through the network.
Content service provider 18 comprises any entity which, via one or more computing devices, makes multimedia content available to consumers via the IMS network 22. For instance, multimedia content displays can be provided via one or more large display devices viewable in public or other areas. In other embodiments, content service provider 18 may additionally or alternatively provide content without the use of an IMS network. For instance, the present subject matter can be implemented in a system using broadband data communication standards other than IMS, such as an IP-based distribution system accessible by a wireless service provider. Additionally, multiple network types may be used. For instance, content may be made available to display devices through one type of network, such as a broadcast or cable television network, while identification of displays, communications with mobile devices, and streaming of components occur over another network, such as a cellular telephone network and/or wireless Internet.
Although several examples herein relate to multimedia content presented via a large display device, it is to be understood that the present subject matter is not intended to be limited to particular types of content or particular mode or manner of presentation. For example, other content presentation systems may provide 3-D content (with or without audio). Furthermore, the display need not be large or public. For instance, a user may view a composite content presentation at a friend's home or other private setting at a small screen (e.g. television, computer screen) and extract partial content using embodiments of the present subject matter.
Returning to exemplary application server 12, the wireless content brokerage agent 14 provided via server 12 communicates with one or more mobile users to ascertain each user's media extraction requirements and arranges for multimedia flow from the appropriate content service provider or providers, such as content service provider 18. Namely, wireless content brokerage agents such as 14 can obtain content directly from content service providers, such as 18, and provide the content in a suitable form to mobile terminals, such as terminal 32. Accordingly, no rights management or other transactional details need to be handled directly by the user at mobile 32 for a particular content extraction session. Additionally, no interaction between the user and display device is required. Thus, relatively “dumb” large display devices can be used. In other embodiments the extraction experience can be enhanced through support of some interactivity/data transfer at the large display device, but this is not required.
Additionally, the “home” wireless content brokerage agent (14 in this example) is responsible for maintaining a content service provider database 16 that references major contents service providers known to supply multimedia content to public display devices. Database 16 can be used to determine when a mirror application server should be utilized for best service quality.
For instance, content service providers may service different geographic regions and may even be dispersed across continents. Thus, one or more mirror content brokerage services can be provided so that it is not necessary for content to be routed over excessive distances. Instead, local content from local content service providers can be routed through local mirror wireless service provider application servers. In this example, application server 12 a and content brokerage agent 14 a comprise a “mirror” service/agent supporting a different area than server 12 and agent 14. For example, when a user of mobile terminal 32 is far from his home network, such as on another continent, content may be routed through server 12 a rather than through home server 12.
Generally, the user can associate with a given wireless service provider and obtain a subscription to the partial content extraction service. The partial content extraction service, for example, may be provided by the user's communications carrier (e.g. cell phone company) or may be a separate service provided by one or more third parties. In any event, the wireless service provider affiliates with content providers such as content service provider 18 in order to obtain sufficient rights to retrieve and forward selected content to mobile device 32. For example, the wireless service provider may proactively or on a case-by-case basis obtain subscriptions to content service providers based on the location of mobile device 32. Additionally or alternatively, content brokerage agent 14 may engage in other rights clearance activities other than obtaining subscriptions.
FIG. 2 provides a high-level conceptual overview of some aspects of the present subject matter by illustrating exemplary steps in a process 50 for providing partial content provisioning via a wireless multimedia content brokerage service. Additionally, the exemplary steps of FIG. 2 are cross-referenced by letters to exemplary communications shown in FIG. 1 and identified by capital letters A through E.
At step 52, the home wireless service provider maintains information on subscribing mobile users, content service providers, and wireless service provider mirror servers. For instance, the information can be arranged and/or accessed by algorithms, processes, or applications that are configured to determine the optimal component combinations for serving users based on location. As shown at (A) in FIG. 1, server 12 is in communication with terminal 32 to determine the location of terminal 32. Location may be tracked in any suitable manner, such as by geographic coordinates (e.g., GPS) or network location (e.g. cell ID). Additionally, home wireless content brokerage agent 14 receives a request from the user of terminal 32 identifying a composite multimedia presentation comprising content which the user of terminal 32 wishes to have forwarded/routed to terminal 32.
At 54, based on the geographic (or other) location of the mobile user, the home wireless content brokerage agent 14 assigns an appropriate mirror site to service the mobile user. This is shown at (B) in FIG. 1, which represents one or more data transfers between server 12 and server 12 a which serve to alert mirror WCBA 14 a that content extraction is to be handled by wireless content brokerage agent 14 a. For example, the user of mobile terminal 32 may be physically closer to server 12 a rather than home server 12. As another example, such decisions may not depend on the relative location of the mobile terminal relative to the server, but instead may depend on the relative location of the server to the content provider. Of course, other network factors may be considered in addition to or instead of location.
At step 56, the assigned WCBA establishes a suitable connection with a content service provider. For example, data provided by home server 12 may indicate that content from content service provider 18 is to be forwarded to device 32. Accordingly, mirror WCBA 14 a may establish a SIP/SDP/RTP multimedia session with content service provider 18 and obtain extractable multimedia content component streams. This is shown at (C) in FIG. 1. Briefly, (C′) in FIG. 1 shows the connection that would be made between content service provider 18 and home server 12 if, for example, terminal 32 were to be served via home server 12/home WCBA 14.
As will be discussed in further detail below, the wireless multimedia content brokerage service can interface with mobile terminal 32 to receive selection data from a user. The selection data can identify one or more of a plurality of multimedia streams displayed in a composite multimedia presentation which are of interest to the user. For example, the content brokerage agent 14 a can generate a graphical user interface that enables the mobile terminal user to navigate through a representation of a large display to indicate one or more streams of interest. If home agent 14 were handing the entire session, then home agent 14 would generate the graphical user interface.
As shown at 58, based on the selection data provided by the mobile user, the wireless content brokerage agent sends the selected stream or streams to the mobile terminal. In FIG. 1, this is shown at (D). If home server 12/home agent 14 were serving terminal 32, then the content would flow over the same path as (A), although it will be understood that the multimedia flow can be entirely separate from the initial request.
In step 60 shown in FIG. 2, the mobile user selected multimedia content component streams continue to flow to the mobile terminal via one or more SIP/SDP/RTP multimedia sessions established between the content service provider and content brokerage agent, and between the content brokerage agent and the terminal. The streams can continue until any suitable end event, such as termination command by the user of terminal 32, the end of the multimedia content stream, or other considerations.
FIG. 3 is a block diagram showing a closer view of an exemplary application server 12. Also, in this example, application server 12 further comprises content service provider database 16. Specifically, database 16 comprises table 40 that comprises a listing of content service providers, mirror sites, and other applicable information by geographic location. Table 40, and any other databases or datasets discussed herein, can be provided by any number or type of databases in any suitable logical or physical format.
As was noted earlier, wireless content brokerage agent 14 accesses database 16 in order to determine optimal handling of partial content extraction and forwarding. Also, in this example, content brokerage agent comprises a service manager component 34 which handles initialization of content extraction sessions and a content manager component 36 which handles accessing and buffering content, generating selection interfaces, receiving selection data, and buffering and forwarding content to users. Thus, content manager component 36 may be used to handle sessions initiated by service manager component 34 and to handle incoming sessions where application server 12 and agent 14 act as a mirror for other servers/agents.
For instance, in this example, service manager 34 accesses database 16 and, as needed, handles contacting and interacting with mirror service providers and/or content providers. For instance, by referencing home subscriber service 24, service manager 34 may determine the location of mobile users and thereby make effective use of CSP database 16. In embodiments which do not utilize IMS, another suitable source of information as to the location of mobile users can be used rather than HSS 24.
Several other details illustrated in FIG. 3 relate to when content brokerage server 12 is handling media extraction and forwarding to mobile devices without use of a mirror server. For instance, a content manager 36 may utilize one or more buffers 38 a, 38 b, 38 c, and 38 d to buffer incoming content during the interval between a forwarding request and the actual provision of multimedia content to a mobile device. For example, one buffer may be used for each of a plurality of media streams that comprise a composite multimedia presentation of multimedia content. Although four buffers are shown in this example, it will be understood that an application server may have access to more or fewer buffers in order to adequately service a desired number of mobile users. Furthermore, in some embodiments, buffer(s) used for a particular multimedia content stream may be used to provide data for multiple users. The particular portion of content extracted from the buffer may differ between users in such cases. Any suitable type of hardware and/or software-based buffering schemes can be used. Still further, in other embodiments, no buffering is performed, and content manager 36 provides a pass-through functionality (although some buffering may be incidental to the pass-through functionality).
In this example, service manager 34 can access a dynamic table of available content streams 19 to determine particular media stream addresses to access. For example, as will be discussed below, a composite multimedia presentation may comprise media from several different feeds. When a user identifies a particular display, several or all of the streams comprising the composite multimedia presentation can be accessed via their respective network addresses and can be buffered in a respective buffer. The user can then be prompted to select one or more streams of Interest. Once the stream(s) of interest are identified, the buffered content can be forwarded to the user.
FIG. 4 provides a more detailed view of an exemplary communications system 100 comprising a wireless multimedia content brokerage service with support for partial content extraction. This example also depicts an exemplary user 101 associated with mobile device 132, with user 101 coming within perceptible range of a public fixed display device 102. Although the term “public” is used, the particular conditions required to view display device (or lack of such conditions) can vary. For example, a “public” display can comprise any display that can be viewed by one or more users, and may vary in size. Furthermore, the “display device” can comprise not only the screen, projection, and/or other equipment used to render a perceptible image, but additional components used to receive signals, such as one or more computing devices such as a set-top box (whether a separate component or integrated with other components) and the like. Furthermore, the “display” can include ancillary components not related to visual aspects of the presentation, such as speakers for audio content.
As shown in the inset, public display device 102 provides a composite multimedia presentation of several different multimedia real-time content streams. Namely, in this example, the display comprises a newscaster 103, graphical weather forecast 104, news clip 105, scrolling stock ticker 106, and scrolling news ticker 107. User 101 may wish to view some components on mobile device 132, but it may not be feasible for all components to be displayed on the screen of mobile device 132. For instance, the screen may be too small to show all components, or the bandwidth requirements for viewing all streams may be too excessive. Thus, in accordance with the present subject matter, user 101 can request for partial content extraction of the content displayed at device 102.
The remaining components illustrated in FIG. 4 are generally analogous to components with similar numbers shown in FIGS. 2-3. For instance, home application server 112 comprises home content brokerage agent 114 with access to database 116 in the same manner as home server 12 comprises home content brokerage agent 14 with access to database 16. Accordingly, mirror server 112 a, mirror content brokerage agent 114 a, home subscriber server (HSS) 124, IMS core network 122, content service provider 118, multimedia content source 120, multimedia content component table 119, and are not discussed in further detail. IMS call support components are generally illustrated at 126 and may comprise, for instance, P-CSCF, I-CSCF, and S-CSCF.
Exemplary operation of a wireless multimedia content brokerage system such as the one shown in network 100 will now be discussed in conjunction with FIGS. 5 and 6, which each illustrate steps in exemplary processes for operating such a service. Additionally, in a later example, reference will be made to communications occurring between components shown in FIG. 4 and labeled 201 through 222.
FIG. 5 shows an exemplary process 70 comprising steps related to service management aspects of a wireless content brokerage agent. Step 72 represents an initial state, where a wireless content brokerage agent has access to a database of content service providers in geographic (or other) locations which the content brokerage agent commits to provide content extraction and forwarding services. Each home content brokerage agent also has access to a list of mirror service sites located in the committed geographic locations. Although several examples herein relate to content brokerage services supporting mirroring, in other embodiments, all requests can be handled by the home agent. Accordingly, mirroring-related functionality could be omitted.
Step 74 represents an initial setup step between a wireless device user and the content brokerage agent, wherein the user obtains a subscription from the wireless service provider for selective content extraction services. As was noted above, this service may be provided as a feature in a calling plan or other arrangement between a wireless service provider and a user, or may be provided as a third party service.
The home content brokerage agent updates the mobile user's profile in the home subscription database identifying the wireless service provider as the mobile user's home provider. In embodiments in which the content brokerage service is implemented as part of an IMS core network, such as network 122, such a profile update is necessary for authorizing an S-CSCF component of the core network to establish a SIP/SDP/RTP session between the content brokerage agent and the mobile terminal.
Step 76 represents service management activities that may be performed at some point after a user has subscribed or otherwise obtained the services of the wireless multimedia content brokerage system. For instance, a user may set up the content forwarding service sometime prior to encountering content, or may be prompted to subscribe to the content forwarding service at the time the user encounters content. At step 76 a mobile user, such as user 101 in FIG. 4, comes into the vicinity of fixed display device 102 and logs onto the user's home content brokerage service by contacting a brokerage agent to launch the content extraction service. For example, the home brokerage agent can verify authentication for the content extraction service by checking the home subscriber database.
At step 78, the home content brokerage agent obtains information regarding the mobile user's current geographic or other location. This information may be obtained, for example, from the home subscriber service so database in implementations in a system supporting IMS functionality. Based on identification data provided by the user, the brokerage agent can determine the geographic or other location of the content provider for the display device of interest. As shown at 80, the home content brokerage agent uses its content service provider database 116 to determine which mirror content brokerage agent (if any) would be best suited for servicing the mobile user for the particular content extraction service. As shown at 82, if a home content brokerage agent is suitable for providing the content extraction service, process 70 skips to step 86. However, if the home content brokerage agent determines that another agent would be more appropriate, then as shown at 84, the home agent transfers the mobile user's web session to an appropriate mirror content brokerage agent. For instance, as was noted earlier, a user outside the geographic region served by the home content brokerage agent may be better served by a local brokerage agent with a closer or more robust connection to corresponding local content service providers.
As shown at 86, the home content brokerage agent which is handling the mobile user session returns a web page (or other suitable interface) to the user that can be used to send a request to the appropriate content brokerage agent to launch the content extraction service. The content brokerage agent which receives the request can then provide a suitable representation of the fixed display multimedia content for further selection by the user. As shown at 88, the mobile user provides data indicating a launch, such as pressing a content extraction service launch button, selecting a launch command using an interface on the phone, or in any other suitable manner. At this point, a content management session begins between the assigned content brokerage agent and the mobile terminal. If no mirror agent is used, then the content management session is also handled by the home content brokerage agent.
FIG. 6 illustrates steps in an exemplary content management session 150 between a wireless content brokerage agent and a mobile terminal. Step 152 represents an initial state wherein a user request for launching a multimedia content extraction session has arrived at an assigned content brokerage agent. The agent has access to a dynamic multimedia component table showing which multimedia content components of a particular display of interest are extractable in real time. For example, in some instances, a public display device may comprise a composite media display that includes elements which are not extractable. The component table may include a place holder or other indication so that the content brokerage agent can inform the mobile user of which content streams are available.
At 154, the content brokerage agent obtains a subscription as a user of the target content service provider. For instance, the content service provider may also use the home subscription server database of the IMS network to manage authorization for obtaining content. In such embodiments, the content service provider can update a user profile corresponding to the content brokerage agent to ensure authorization to the IMS components when required. At 156, the content brokerage agent accesses the multimedia component table for the identified content service provider to determine the number and characteristics of communication sessions which are needed in order to obtain content comprising the composite multimedia presentation. For example, the content brokerage agent may determine which particular SIP/SDP/RTP sessions are required to access the data comprising the streams of interest. At 158, the content brokerage agent establishes the required connections, such as an SIP/SDP/RTP multimedia session for each component stream of the content display.
At 160, the content brokerage agent extracts a thumbnail image of each multimedia stream incoming from the content service provider. At 162, the thumbnail images are inserted into a web page. This web page can be returned to the mobile device as part of a graphical user interface for the mobile user. For instance, the mobile user can navigate through a replica of the composite multimedia presentation in order to provide selection data to the content brokerage agent. For example, the images may be placed into the webpage that is returned to the user in response to launching the service as noted at step 88 in FIG. 5. Of course, the graphical user interface need not necessarily comprise a web page, and other data formats/protocols could be used to provide the graphical user interface.
At 164, the content brokerage agent receives the user's selection of multimedia components for extraction. At 166, the content brokerage agent establishes an SIP/SDP/RTP multimedia streaming session with the mobile terminal and sends the requested mobile streams to the terminal.
In some embodiments, during the time between initial identification of the display and the time at which the content brokerage agent begins streaming to the mobile device, the content brokerage agent may buffer incoming content streams. In such embodiments, the streaming sessions to the user terminal may begin at the earliest point in the buffer so that the recipient can avoid missing any portions of the content of interest. In other embodiments, the multimedia content may be mirrored at the device in real time or near real time, with or without buffering at the content brokerage agent. For instance, in some embodiments, the brokerage agent acts as a pass-through only (although some incidental ‘buffering’ may occur during the pass-through operations).
In this example, at 168 the content brokerage agent terminates the SIP/SDP/RTP multimedia sessions of component streams that are not selected by the mobile user. However, depending upon how the system is optimized and otherwise configured, then buffering may not be discontinued. For instance, if an agent is providing the same content to multiple users, the data may be maintained in a shared buffer which is continually updated until no more users are accessing the content. At 170, the selected component streams continue to play back in real time at the mobile terminal. The component streams may continue until the end of the particular multimedia content in the streams and/or another termination event, such as termination of forwarding by the user.
Another example of content and service management steps and data transfers which can occur in a system that includes a content brokerage service will now be discussed in conjunction with FIG. 4. The following so example explores additional detail while following a flow path similar to the previous example discussed above. As shown at 200 in FIG. 4, a content service provider, such as content service provider 118, obtains multimedia content 120 which is sent to a public fixed display device 102. Multimedia content 120 may be obtained from any suitable sources, including stored data, live feeds, broadcast sources, and the like.
As shown in the inset of FIG. 4, public fixed display device provides a multimedia display comprising a plurality of multimedia streams. Each one of the streams 103-107 can comprise real time video content with or without accompanying audio. Additionally, as shown in FIG. 4 at 201, the content service provider 118 updates multimedia component table 119 to identify the plurality of multimedia streams associated with display device 102. For example, the data could be in the form of an XML file that would be configured for a content brokerage agent to sort via a style sheet associated with the XML file. The XML file may comprise characteristics identifying each partial content stream in a manner such that content brokerage agents can establish appropriate SIP/SDP/RTP sessions with the content service provider if required. In some embodiments, the XML file may contain the coordinates of the partial content on the display screen so that the content brokerage agent can provide data to mobile users based on the special arrangement of content on the public display.
As shown at 202, the home wireless service provider 112 obtains a subscription to content service provider 118. For example, this subscription may be obtained in response to determining that user 101 is in a geographic or other location served by content service provider 118 on large display devices. If service provider 112 already has an adequate subscription, then no subscription is needed. As shown at 203, the content service provider updates one or more home subscription server database profiles to indicate that the wireless service provider and its brokerage agents (including the home and mirror content brokerage agents 114 and 114A) as authorized user of its multimedia content. As shown at 204, the home content brokerage 114 maintains a table or other so suitable data mapping content service providers to suitable mirror content brokerage agents. At 205, mobile user 101 becomes a subscriber of the selective content extraction service provided by the wireless multimedia content brokerage service. Content brokerage agent 114 updates the profile of user 101 in home subscription server database 124.
As shown at 207, user 101 encounters a composite multimedia presentation comprising a plurality of multimedia streams 103-107 provided via a public fixed display device 102. The display may include one or more public service identifiers indicating the source of the content. Additionally, the display itself may include one or more indications of its SIP address or other identifier(s). Although not required for the present subject matter, in some embodiments, the display includes communication functionality, such as Bluetooth or Wi-Fi connectivity for automatically providing its SIP address and/or content identifiers to interested users.
As shown at 208, the mobile user launches a browser or other thin client application on terminal 132 and logs onto home service provider 112 to begin the multimedia content extraction service. The home content brokerage agent 114 authenticates user 101 by referencing subscriber database 124 as shown at 209.
Home content brokerage agent 114 returns a mobile web page or other suitable user interface data through which user 101 can use terminal 132 to identify the content of interest as shown at 210. For example, the user may be provided with a mobile web page for entering a public service identifier of the content service provider and/or the SIP address of the display device. If the display supports local communication, such data may be obtained from the display. However, it is emphasized that the display does not need to have any such data transfer functionality, provided some sort of indication of the display identifier(s) is provided (e.g. a sign or panel). As shown at 211, the data identifying the display device is sent to the home content brokerage agent. In some embodiments, no explicit identification of the display is needed if the user can identify the content provider from available information (e.g. a program title, channel identifier, or the like).
As shown at 212, the home content brokerage agent determines the mobile user's current geographic or other location from home subscriber database 124. Also, as shown at 213, based on content provider identification data (and/or display identification data) and the location of user 101/terminal. 132, the home content brokerage agent 114 identifies an appropriate mirror content brokerage agent (114A in this example) suitable for serving terminal 132. As shown at 214, home content brokerage agent 114 informs the mirror content brokerage agent 114A regarding the current extraction request. For example, 214 may represent transfer of session data to agent 114A. As shown at 215, the home content brokerage agent also updates user 101 profile with service authorization for the mirror agent 114A. At 216, home content brokerage agent 114 returns a webpage or other suitable interface data which allows user 101 to launch the content extraction service. In some embodiments, agent 114 may hand off the entire session to agent 114A, making agent 114A responsible for generating the launch webpage.
As shown at 217, the mobile user sends a request to launch the component extraction service to the suitable content brokerage agent. In this example, the launch request is sent to mirror content brokerage agent 114A, although if the home agent 114 was handling this particular session, the request would be sent to the home agent. Mirror content brokerage agent 114 obtains multimedia component streams corresponding to those shown on display 102 by establishing SIP/SDP/RTP multimedia sessions with content service provider 118 as shown at 218. Next, as shown at 219, mirror content brokerage agent 114A provides terminal 132 with data so that terminal 132 can render an interface, such as a mobile terminal webpage, comprising thumbnail image representations of the multimedia component streams. The thumbnail images may be static in some embodiments, or may be updated at a reduced frame rate.
Although in the example above the content brokerage agent provided thumbnail representations of the content streams, in other embodiments, content service provider 118 may dynamically generate thumbnail representations of its partial content streams and send the representations to content brokerage agents, such as part of or along with the XML or other files identifying the content streams.
As shown at 220, user 101 provides input to terminal 132 and terminal 132 sends selection data to content brokerage agent 114A, such as via a HTTP request. In response, as shown at 221, mirror content brokerage agent 114A provides the selected multimedia component streams by establishing one or more SIP/SDP/RTP multimedia sessions with terminal 132. Mirror content brokerage agent 114A then terminates the unused SIP/SDP/RTP session with content service provider 118 as shown at 222. User 101 can then view the requested stream(s) at terminal 132 until the end of the stream(s) or until another termination event occurs.
Several examples discussed above depict content provisioning in the context of a communication system configured in accordance with IMS standards and principles. One of skill in the art will appreciate that the present subject matter does not rely on IMS and is not limited to IMS-compliant systems. For example, requests for content, responses to requests, and the content itself could be provided via other network types, such as broadband internet. Correspondingly, call routing, session requests, and the like need not be IMS-compliant. Subscriber databases and information may be maintained by a wireless service provider in any suitable fashion, and not only using the HSS server.
The material particularly shown and described above is not meant to be limiting, but instead serves to show and teach various exemplary implementations of the present subject matter. As set forth in the attached claims, the scope of the present invention includes both combinations and sub-combinations of various features discussed herein, along with such variations and modifications as would occur to a person of skill in the art.

Claims (17)

What is claimed:
1. A multimedia content brokerage computing device comprising:
memory; and
circuitry associated with the memory, the circuitry configured to:
receive a request from a mobile device to launch an extraction service when the mobile device comes into vicinity of a device capable of receiving multimedia content component streams;
determine a location of the mobile device;
assign a server to provide content to the mobile device based on the location of the mobile device;
establish a connection with a content provider;
obtain a plurality of identifiers for the multimedia content component streams;
provide the plurality of identifiers to the mobile device;
receive data from the mobile device identifying one multimedia content component stream of the multimedia content component streams for extraction;
obtain the one multimedia content component stream from the content provider; and
provide the one multimedia content component stream associated with selection data to the mobile device.
2. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to buffer at least one of the multimedia content component streams and to discontinue buffering accessed data comprising at least one stream that is not identified in the selection data.
3. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to:
interface with the content provider and, in response to the selection data provided by the mobile device, transmit data identifying at least one change in the device capable of receiving multimedia content component streams.
4. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to:
determine whether one or more subscriptions are needed to obtain the multimedia component streams and, if so, obtain the needed subscription or subscriptions.
5. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to:
after establishing a connection with the content provider, interface with the content provider and obtain at least one structured data file identifying a network address for each of the multimedia content component streams.
6. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to:
obtain a structured data file comprising data identifying a spatial arrangement of a media presentation displayed on the device capable of receiving multimedia content component streams; and
generate the user interface based on the structured data file.
7. The device set forth in claim 1, wherein the multimedia content brokerage computing device is further configured to:
access presentation identification data and identify at least one content provider as part of a partial content service session; and
based on the location of the mobile device and an identity of the content provider, determine whether to transfer the partial content service session to a mirror brokerage computing device.
8. The device set forth in claim 1 wherein the mirror brokerage computing device is configured to access the selection data, access data for the multimedia content component streams, buffer the data, and transmit the buffered data to the mobile device in response to a transfer of the partial content extraction session.
9. A method of providing partial content extraction, the method comprising:
receiving a request from a mobile device to launch an extraction service when the mobile device comes into vicinity of a device capable of receiving multimedia content component streams;
determining a location of the mobile device;
assigning a server to provide content to the mobile device based on the location of the mobile device;
establishing a connection with a content provider;
obtaining a plurality of identifiers for the multimedia content component streams; and
providing the plurality of identifiers to the mobile device;
receiving data from the mobile device identifying one multimedia content component stream of the multimedia content component streams for extraction;
obtaining the one multimedia content component stream from the content provider; and
providing the one multimedia content component stream associated with selection data to the mobile device.
10. The method set forth in claim 9, further comprising buffering at least one of the multimedia content component streams and, after receiving the selection data, discontinuing buffering at least one stream that is not identified in the selection data.
11. The method set forth in claim 9, further comprising:
interfacing with the content provider and, in response to the selection data provided by the mobile device, transmitting data identifying at least one change in the device capable of receiving multimedia content component streams.
12. The method set forth in claim 9, wherein the user interface data defines a layout of a graphical user interface, the graphical user interface comprising respective portions corresponding to the one multimedia content component stream.
13. The method set forth in claim 9, further comprising:
determining whether one or more subscriptions are needed to obtain the multimedia component streams and, if so, obtaining the needed subscription or subscriptions.
14. The method set forth in claim 9, further comprising:
after establishing a connection with the content provider, interfacing with the content provider and obtaining at least one structured data file identifying a network address for each of the multimedia component content streams.
15. The method set forth in claim 14, further comprising:
obtaining a structured data file comprising data identifying a spatial arrangement of a media presentation displayed on the device capable of receiving multimedia content component streams; and
generating the user selection interface based on the structured data file.
16. The method set forth in claim 14, further comprising:
accessing access presentation identification data;
identifying at least one content provider for a partial content service session; and
based on the location of the mobile device and an identity of the content provider, determining whether to transfer the partial content service session to a mirror brokerage computing device.
17. A multimedia content brokerage computing device comprising:
memory; and
circuitry associated with the memory, the circuitry configured to:
receive a request from a mobile device to launch an extraction service when the mobile device comes into vicinity of a device capable of providing multimedia content component streams;
determine a location of the mobile device;
assign a server to provide content to the mobile device based on the location of the mobile device;
establish a connection with a content provider;
obtain a plurality of identifiers for the multimedia content component streams;
provide the plurality of identifiers to the mobile device in a web page;
receive data from the mobile device identifying one multimedia content component stream of the multimedia content component streams for extraction;
obtain the one multimedia content component stream from the content provider; and
provide the one multimedia content component stream associated with selection data to the mobile device.
US14/245,040 2007-10-25 2014-04-04 Wireless multimedia content brokerage service for real time selective content provisioning Expired - Fee Related US9270717B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/245,040 US9270717B1 (en) 2007-10-25 2014-04-04 Wireless multimedia content brokerage service for real time selective content provisioning

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/924,210 US8261307B1 (en) 2007-10-25 2007-10-25 Wireless multimedia content brokerage service for real time selective content provisioning
US13/601,172 US8695044B1 (en) 2007-10-25 2012-08-31 Wireless multimedia content brokerage service for real time selective content provisioning
US14/245,040 US9270717B1 (en) 2007-10-25 2014-04-04 Wireless multimedia content brokerage service for real time selective content provisioning

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/601,172 Continuation US8695044B1 (en) 2007-10-25 2012-08-31 Wireless multimedia content brokerage service for real time selective content provisioning

Publications (1)

Publication Number Publication Date
US9270717B1 true US9270717B1 (en) 2016-02-23

Family

ID=46726650

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/924,210 Expired - Fee Related US8261307B1 (en) 2007-10-25 2007-10-25 Wireless multimedia content brokerage service for real time selective content provisioning
US13/601,172 Expired - Fee Related US8695044B1 (en) 2007-10-25 2012-08-31 Wireless multimedia content brokerage service for real time selective content provisioning
US14/245,040 Expired - Fee Related US9270717B1 (en) 2007-10-25 2014-04-04 Wireless multimedia content brokerage service for real time selective content provisioning

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US11/924,210 Expired - Fee Related US8261307B1 (en) 2007-10-25 2007-10-25 Wireless multimedia content brokerage service for real time selective content provisioning
US13/601,172 Expired - Fee Related US8695044B1 (en) 2007-10-25 2012-08-31 Wireless multimedia content brokerage service for real time selective content provisioning

Country Status (1)

Country Link
US (3) US8261307B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10453065B2 (en) * 2016-02-12 2019-10-22 Visa International Service Association Method and system for determining terminal location

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2634336A1 (en) * 2007-06-13 2008-12-13 Black Coral Inc. Method for determining relative ranking data in a broker mediated geospatial information service environment
US8261307B1 (en) * 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US9699242B2 (en) * 2007-12-07 2017-07-04 Dan Atsmon Multimedia file upload
US8152642B2 (en) * 2008-03-12 2012-04-10 Echostar Technologies L.L.C. Apparatus and methods for authenticating a user of an entertainment device using a mobile communication device
US8875026B2 (en) 2008-05-01 2014-10-28 International Business Machines Corporation Directed communication in a virtual environment
US20100239222A1 (en) * 2009-03-20 2010-09-23 International Business Machines Corporation Digital video recorder broadcast overlays
CA2824723A1 (en) * 2009-09-26 2011-03-31 Disternet Technology Inc. System and method for micro-cloud computing
US10048921B2 (en) * 2010-03-02 2018-08-14 Qualcomm Incorporated Controlling a multimedia device in remote display mode
US10462651B1 (en) * 2010-05-18 2019-10-29 Electric Mirror, Llc Apparatuses and methods for streaming audio and video
US8555332B2 (en) 2010-08-20 2013-10-08 At&T Intellectual Property I, L.P. System for establishing communications with a mobile device server
US8695054B2 (en) * 2010-09-29 2014-04-08 Verizon Patent And Licensing Inc. Ingesting heterogeneous video content to provide a unified video provisioning service
US8516039B2 (en) * 2010-10-01 2013-08-20 At&T Intellectual Property I, L.P. Apparatus and method for managing mobile device servers
US8504449B2 (en) 2010-10-01 2013-08-06 At&T Intellectual Property I, L.P. Apparatus and method for managing software applications of a mobile device server
US8989055B2 (en) 2011-07-17 2015-03-24 At&T Intellectual Property I, L.P. Processing messages with a device server operating in a telephone
US9066123B2 (en) 2010-11-30 2015-06-23 At&T Intellectual Property I, L.P. System for monetizing resources accessible to a mobile device server
US9256859B2 (en) 2011-07-26 2016-02-09 Salesforce.Com, Inc. Systems and methods for fragmenting newsfeed objects
US9973470B2 (en) * 2011-09-23 2018-05-15 Tara Chand Singhal Systems and methods for faster download of digital content in mobile wireless devices
RU2642813C2 (en) 2013-06-05 2018-01-26 Томсон Лайсенсинг Method and device of distributing content for viewing on multiple screens
CN105144721A (en) * 2013-06-05 2015-12-09 汤姆逊许可公司 Method and apparatus for content distribution for multiscreen viewing
EP3005717B1 (en) 2013-06-05 2020-05-27 InterDigital CE Patent Holdings Method and apparatus for content distribution for multiscreen viewing
EP2830275A1 (en) * 2013-07-23 2015-01-28 Thomson Licensing Method of identification of multimedia flows and corresponding apparatus
US9696414B2 (en) * 2014-05-15 2017-07-04 Sony Corporation Proximity detection of candidate companion display device in same room as primary display using sonic signaling
US10070291B2 (en) 2014-05-19 2018-09-04 Sony Corporation Proximity detection of candidate companion display device in same room as primary display using low energy bluetooth
US9894414B2 (en) * 2014-09-30 2018-02-13 Rovi Guides, Inc. Methods and systems for presenting content to a user based on the movement of the user
US10749900B2 (en) 2018-09-28 2020-08-18 The Mitre Corporation Deploying session initiation protocol application network security

Citations (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5736982A (en) 1994-08-03 1998-04-07 Nippon Telegraph And Telephone Corporation Virtual space apparatus with avatars and speech
US20010021920A1 (en) 2000-03-10 2001-09-13 Fumiko Ikeda Method of giving gifts via online network
WO2002021831A2 (en) 2000-09-08 2002-03-14 Kargo, Inc. Video interaction
US20020085031A1 (en) 2000-12-14 2002-07-04 Conrado Claudine Viegas Method and system for providing a user profile
US6421781B1 (en) 1998-04-30 2002-07-16 Openwave Systems Inc. Method and apparatus for maintaining security in a push server
US20030204846A1 (en) 2002-04-29 2003-10-30 Breen George Edward Accessing television services
US20030233469A1 (en) 2002-06-12 2003-12-18 Knowlson Kenneth L. Content server
WO2004036902A1 (en) 2002-10-15 2004-04-29 Infocast Systems Oy Method and system for supporting user interaction in broadcasting
US20040122907A1 (en) 2002-12-20 2004-06-24 Wu Chou Secure interaction between a mobile client device and an enterprise application in a communication system
US20040125136A1 (en) 2002-12-30 2004-07-01 Jukka Wallenius Provision of services through a display system
US20040199665A1 (en) 2001-07-12 2004-10-07 Omar Salim H. System and method for pushing data from an information source to a mobile communication device including transcoding of the data
US20050010637A1 (en) 2003-06-19 2005-01-13 Accenture Global Services Gmbh Intelligent collaborative media
US20050015725A1 (en) 2000-04-28 2005-01-20 Sony Corporation Information processing apparatus and method, and storage medium
US20050132420A1 (en) 2003-12-11 2005-06-16 Quadrock Communications, Inc System and method for interaction with television content
KR20050079852A (en) 2004-02-07 2005-08-11 엘지전자 주식회사 Avata service method and apparatus for mobile telecommunication terminal equipment
US20050198353A1 (en) 2004-03-05 2005-09-08 Robert Zmrzli Method and apparatus for providing dynamic network content to target devices
US20060059509A1 (en) 2004-09-13 2006-03-16 Huang Jau H System and method for embedding commercial information in a video bitstream
WO2006036207A1 (en) 2004-09-28 2006-04-06 Sony Ericsson Mobile Communications Ab A system and method of streaming audio from a common video device
US20060195515A1 (en) 2005-02-28 2006-08-31 Yahoo! Inc. System and method for rating media
US7107549B2 (en) 2001-05-11 2006-09-12 3Dna Corp. Method and system for creating and distributing collaborative multi-user three-dimensional websites for a computer system (3D Net Architecture)
US20070094691A1 (en) 2005-10-24 2007-04-26 Gazdzinski Robert F Method and apparatus for on-demand content transmission and control over networks
US20070106526A1 (en) 2005-07-18 2007-05-10 Jung Edward K Supervisory authority in virtual world environment
US20070287498A1 (en) 2004-07-16 2007-12-13 Tiehong Wang Method and apparatus for multimedia communications with different user terminals
US20080009268A1 (en) 2005-09-14 2008-01-10 Jorey Ramer Authorized mobile content search results
US7386799B1 (en) 2002-11-21 2008-06-10 Forterra Systems, Inc. Cinematic techniques in avatar-centric communication during a multi-user online simulation
US20080201638A1 (en) 2007-02-15 2008-08-21 Yahoo! Inc. Context avatar
US20080222295A1 (en) 2006-11-02 2008-09-11 Addnclick, Inc. Using internet content as a means to establish live social networks by linking internet users to each other who are simultaneously engaged in the same and/or similar content
US20090031006A1 (en) 2000-06-07 2009-01-29 Johnson William J System and method for alerting a first mobile data processing system nearby a second mobile data processing system
US7840903B1 (en) 2007-02-26 2010-11-23 Qurio Holdings, Inc. Group content representations
US7849420B1 (en) 2007-02-26 2010-12-07 Qurio Holdings, Inc. Interactive content representations enabling content sharing
US8261307B1 (en) 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US8400961B1 (en) 2007-08-27 2013-03-19 Qurio Holdings, Inc. Wireless multimedia brokerage service for real time content provisioning

Family Cites Families (116)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7859551B2 (en) 1993-10-15 2010-12-28 Bulman Richard L Object customization and presentation system
US5794210A (en) 1995-12-11 1998-08-11 Cybergold, Inc. Attention brokerage
US5923330A (en) 1996-08-12 1999-07-13 Ncr Corporation System and method for navigation and interaction in structured information spaces
US5956737A (en) 1996-09-09 1999-09-21 Design Intelligence, Inc. Design engine for fitting content to a medium
US5974398A (en) 1997-04-11 1999-10-26 At&T Corp. Method and apparatus enabling valuation of user access of advertising carried by interactive information and entertainment services
US6256043B1 (en) 1997-09-26 2001-07-03 Lucent Technologies Inc. Three dimensional virtual reality enhancement techniques
DE69828278T2 (en) 1997-10-30 2005-12-08 Ntt Docomo, Inc. PACKET COMMUNICATION NETWORK
US6466213B2 (en) 1998-02-13 2002-10-15 Xerox Corporation Method and apparatus for creating personal autonomous avatars
US6396509B1 (en) 1998-02-21 2002-05-28 Koninklijke Philips Electronics N.V. Attention-based interaction in a virtual environment
US6349301B1 (en) 1998-02-24 2002-02-19 Microsoft Corporation Virtual environment bystander updating in client server architecture
AU3639699A (en) 1998-04-13 1999-11-01 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US7073129B1 (en) 1998-12-18 2006-07-04 Tangis Corporation Automated selection of appropriate information based on a computer user's context
EP1194872A1 (en) 1999-06-11 2002-04-10 CCI Europe A/S (Stibo A/S) A content management computer system for managing publishing content objects
US6772195B1 (en) 1999-10-29 2004-08-03 Electronic Arts, Inc. Chat clusters for a virtual world application
US6629136B1 (en) 1999-11-15 2003-09-30 @ Security Broadband Corp. System and method for providing geographically-related content over a network
US6651086B1 (en) 2000-02-22 2003-11-18 Yahoo! Inc. Systems and methods for matching participants to a conversation
US6948131B1 (en) 2000-03-08 2005-09-20 Vidiator Enterprises Inc. Communication system and method including rich media tools
US6672961B1 (en) 2000-03-16 2004-01-06 Sony Computer Entertainment America Inc. Computer system and method of displaying images
US6854012B1 (en) 2000-03-16 2005-02-08 Sony Computer Entertainment America Inc. Data transmission protocol and visual display for a networked computer system
AU2001253161A1 (en) 2000-04-04 2001-10-15 Stick Networks, Inc. Method and apparatus for scheduling presentation of digital content on a personal communication device
JP4325075B2 (en) 2000-04-21 2009-09-02 ソニー株式会社 Data object management device
US7194524B2 (en) 2000-05-16 2007-03-20 Fujitsu Limited Information processing system, information disclosing server, and portal server
US6545682B1 (en) 2000-05-24 2003-04-08 There, Inc. Method and apparatus for creating and customizing avatars using genetic paradigm
US6453294B1 (en) 2000-05-31 2002-09-17 International Business Machines Corporation Dynamic destination-determined multimedia avatars for interactive on-line communications
US6556217B1 (en) 2000-06-01 2003-04-29 Nokia Corporation System and method for content adaptation and pagination based on terminal capabilities
US6704024B2 (en) 2000-08-07 2004-03-09 Zframe, Inc. Visual content browsing using rasterized representations
US7248677B2 (en) 2000-08-22 2007-07-24 Symbian Software Ltd. Method of and apparatus for communicating user related information using a wireless information device
US7689510B2 (en) 2000-09-07 2010-03-30 Sonic Solutions Methods and system for use in network management of content
US7036082B1 (en) 2000-09-21 2006-04-25 Nortel Networks Limited Controlling communications through a virtual reality environment
US7788323B2 (en) 2000-09-21 2010-08-31 International Business Machines Corporation Method and apparatus for sharing information in a virtual environment
US7168051B2 (en) 2000-10-10 2007-01-23 Addnclick, Inc. System and method to configure and provide a network-enabled three-dimensional computing environment
US6507727B1 (en) 2000-10-13 2003-01-14 Robert F. Henrick Purchase and delivery of digital content using multiple devices and data networks
US6910186B2 (en) 2000-12-08 2005-06-21 Kyunam Kim Graphic chatting with organizational avatars
US20020151327A1 (en) 2000-12-22 2002-10-17 David Levitt Program selector and guide system and method
US7483958B1 (en) 2001-03-26 2009-01-27 Microsoft Corporation Methods and apparatuses for sharing media content, libraries and playlists
US7272636B2 (en) 2001-04-24 2007-09-18 Sun Microsystems, Inc. Peer group name server
US7667705B2 (en) 2001-05-15 2010-02-23 Nintendo Of America Inc. System and method for controlling animation by tagging objects within a game environment
US6795972B2 (en) 2001-06-29 2004-09-21 Scientific-Atlanta, Inc. Subscriber television system user interface with a virtual reality media space
AU2002355530A1 (en) 2001-08-03 2003-02-24 John Allen Ananian Personalized interactive digital catalog profiling
US20030041101A1 (en) 2001-08-24 2003-02-27 Hansche Brian A. Presence watcher proxy
US7216002B1 (en) 2001-10-22 2007-05-08 Gateway Inc. System and method for group content selection
DE60123851T2 (en) 2001-11-23 2007-09-06 Nokia Corp. FERNSEHPLAUDERZIMMER
US20030154212A1 (en) 2002-01-28 2003-08-14 International Business Machines Corporation Method and apparatus for determining attributes among objects
US20030174178A1 (en) 2002-01-31 2003-09-18 Hodges Matthew Erwin System for presenting differentiated content in virtual reality environments
US7220910B2 (en) 2002-03-21 2007-05-22 Microsoft Corporation Methods and systems for per persona processing media content-associated metadata
US8516114B2 (en) 2002-03-29 2013-08-20 International Business Machines Corporation Method and apparatus for content pre-fetching and preparation
GB2388235B (en) 2002-05-04 2005-09-14 Ncr Int Inc Self-service terminal
AU2003247593A1 (en) 2002-06-18 2003-12-31 Wireless Ink, Llc Method, apparatus and system for management of information content for enhanced accessibility over wireless communication networks
US7034678B2 (en) 2002-07-02 2006-04-25 Tri-Sentinel, Inc. First responder communications system
US20040073924A1 (en) 2002-09-30 2004-04-15 Ramesh Pendakur Broadcast scheduling and content selection based upon aggregated user profile information
KR20050061548A (en) 2002-10-21 2005-06-22 코닌클리케 필립스 일렉트로닉스 엔.브이. Method of and system for presenting media content to a user or group of users
US7496647B2 (en) 2002-12-11 2009-02-24 Broadcom Corporation Personal inter-home media exchange network
US7522675B2 (en) 2002-12-30 2009-04-21 Motorola, Inc. Digital content preview generation and distribution among peer devices
US20040179037A1 (en) 2003-03-03 2004-09-16 Blattner Patrick D. Using avatars to communicate context out-of-band
US20070168863A1 (en) 2003-03-03 2007-07-19 Aol Llc Interacting avatars in an instant messaging communication session
US20070113181A1 (en) 2003-03-03 2007-05-17 Blattner Patrick D Using avatars to communicate real-time information
KR100412075B1 (en) 2003-03-07 2003-12-18 Moo Sung Ko Service method for transmitting mobile terminal origination message for free or at discount
US20040189701A1 (en) 2003-03-25 2004-09-30 Badt Sig Harold System and method for facilitating interaction between an individual present at a physical location and a telecommuter
US7536386B2 (en) 2003-03-27 2009-05-19 Microsoft Corporation System and method for sharing items in a computer system
JP2004348647A (en) 2003-05-26 2004-12-09 Hitachi Ltd Human communication system
US20050143174A1 (en) 2003-08-19 2005-06-30 Goldman Daniel P. Systems and methods for data mining via an on-line, interactive game
US20050049886A1 (en) 2003-08-28 2005-03-03 Sbc Knowledge Ventures, L.P. System and method for managing digital rights and content assets
US8554611B2 (en) 2003-09-11 2013-10-08 Catalina Marketing Corporation Method and system for electronic delivery of incentive information based on user proximity
KR100834747B1 (en) 2003-09-17 2008-06-05 삼성전자주식회사 Method And Apparatus For Providing Digital Television Viewer With Friendly User Interface Using Avatar
US20040107283A1 (en) 2003-10-06 2004-06-03 Trilibis Inc. System and method for the aggregation and matching of personal information
ES2231035B1 (en) 2003-10-30 2006-07-01 Frontera Azul Systems, S.L. COMMUNICATION SYSTEM AND PROCEDURE BASED ON VIRTUAL REALITY.
US7496184B2 (en) 2003-11-07 2009-02-24 Telarus, Inc. System and method to determine and deliver quotes for distance-sensitive communication links from multiple service providers
US8057307B2 (en) 2004-04-08 2011-11-15 International Business Machines Corporation Handling of players and objects in massive multi-player on-line games
US7849135B2 (en) 2004-04-09 2010-12-07 At&T Mobility Ii Llc Sharing content on mobile devices
US7176956B2 (en) 2004-05-26 2007-02-13 Motorola, Inc. Video enhancement of an avatar
AU2005258080A1 (en) 2004-06-18 2006-01-05 Pictothink Corporation Network content organization tool
JP3987512B2 (en) 2004-07-15 2007-10-10 株式会社東芝 Message delivery method, computer and program
US8943537B2 (en) 2004-07-21 2015-01-27 Cox Communications, Inc. Method and system for presenting personalized television program recommendation to viewers
WO2006025255A1 (en) 2004-08-30 2006-03-09 Matsushita Electric Industrial Co., Ltd. Client terminal for executing multiplayer application, group forming method, and group forming program
US20060053194A1 (en) 2004-09-03 2006-03-09 Schneider Ronald E Systems and methods for collaboration
US8285785B2 (en) 2004-11-19 2012-10-09 Nokia Corporation Method, apparatus and computer program product providing graphical user interface that facilitates management of multiple simultaneous communication sessions
US7695369B2 (en) 2004-11-22 2010-04-13 Planetwide Games, Inc. Systems and methods for accessing online content during online gaming
US7376645B2 (en) 2004-11-29 2008-05-20 The Intellection Group, Inc. Multimodal natural language query system and architecture for processing voice and proximity-based queries
FI20041638A0 (en) 2004-12-21 2004-12-21 Nokia Corp Content Sharing in a Communication System
US8583139B2 (en) 2004-12-31 2013-11-12 Nokia Corporation Context diary application for a mobile terminal
US20060184579A1 (en) 2005-01-05 2006-08-17 Michael Mills Framework for providing ancillary content in a television environment
US8230456B2 (en) 2005-01-05 2012-07-24 Yahoo! Inc. Framework for delivering a plurality of content and providing for interaction with the same in a television environment
US8060829B2 (en) 2005-04-15 2011-11-15 The Invention Science Fund I, Llc Participation profiles of virtual world players
US7620902B2 (en) 2005-04-20 2009-11-17 Microsoft Corporation Collaboration spaces
US20060242234A1 (en) 2005-04-21 2006-10-26 Microsoft Corporation Dynamic group formation for social interaction
US7614016B2 (en) 2005-04-21 2009-11-03 Microsoft Corporation Multiple roots in navigation pane
EP1897045A2 (en) 2005-04-26 2008-03-12 Governing Dynamics Inc. A method of digital good placement in a dynamic, real time environment
US20060259359A1 (en) 2005-05-16 2006-11-16 Gogel Edward D Method of monetizing networks
US20060282391A1 (en) 2005-06-08 2006-12-14 General Instrument Corporation Method and apparatus for transferring protected content between digital rights management systems
US7396281B2 (en) 2005-06-24 2008-07-08 Disney Enterprises, Inc. Participant interaction with entertainment in real and virtual environments
US20070011617A1 (en) 2005-07-06 2007-01-11 Mitsunori Akagawa Three-dimensional graphical user interface
US8543095B2 (en) 2005-07-08 2013-09-24 At&T Mobility Ii Llc Multimedia services include method, system and apparatus operable in a different data processing network, and sync other commonly owned apparatus
US20070082738A1 (en) 2005-10-06 2007-04-12 Game Driven Corporation Self-organizing turn base games and social activities on a computer network
US20070099560A1 (en) 2005-11-02 2007-05-03 Sony Ericsson Mobile Communications Ab Mobile device control of mobile television broadcast signals to alternate destinations
KR100782825B1 (en) 2005-12-01 2007-12-06 삼성전자주식회사 Method and apparatus for providing selection information of audio content, and recording medium storing program for performing the method
WO2007076459A2 (en) 2005-12-21 2007-07-05 Digimarc Corporation Rules driven pan id metadata routing system and network
US20070162863A1 (en) 2006-01-06 2007-07-12 Buhrke Eric R Three dimensional virtual pointer apparatus and method
US20070184855A1 (en) 2006-02-03 2007-08-09 Research In Motion Limited Visual representation of contact location
EP1984898A4 (en) 2006-02-09 2010-05-05 Nms Comm Corp Smooth morphing between personal video calling avatars
US8103590B2 (en) 2006-02-17 2012-01-24 Yahoo! Inc. Method and system for managing multiple catalogs of files on a network
US8141114B2 (en) 2006-02-28 2012-03-20 Microsoft Corporation Content ratings and recommendations
US7593354B2 (en) 2006-03-22 2009-09-22 Musigy Usa, Inc. Method and system for low latency high quality music conferencing
US20070288470A1 (en) 2006-06-08 2007-12-13 Hannu Kauniskangas Selection of media for public rendering via user devices
US7627536B2 (en) 2006-06-13 2009-12-01 Microsoft Corporation Dynamic interaction menus from natural language representations
US8145532B2 (en) 2006-06-27 2012-03-27 Microsoft Corporation Connecting devices to a media sharing service
US20080052242A1 (en) 2006-08-23 2008-02-28 Gofigure! Llc Systems and methods for exchanging graphics between communication devices
US8677243B2 (en) 2006-09-01 2014-03-18 Nokia Corporation Media recommendation system and method
US20080091521A1 (en) 2006-10-17 2008-04-17 Yahoo! Inc. Supplemental display matching using syndication information
US7783641B2 (en) 2006-10-26 2010-08-24 Microsoft Corporation Taxonometric personal digital media organization
US8332327B2 (en) 2006-10-31 2012-12-11 Core Wireless Licensing S.A.R.L. Legal text distribution and processing in mobile broadcasting
US20080221892A1 (en) 2007-03-06 2008-09-11 Paco Xander Nathan Systems and methods for an autonomous avatar driver
US20080257134A1 (en) 2007-04-18 2008-10-23 3B Music, Llc Method And Apparatus For Generating And Updating A Pre-Categorized Song Database From Which Consumers May Select And Then Download Desired Playlists
US20080300898A1 (en) 2007-05-30 2008-12-04 Belkacem Bacha Document processing services
US20080297515A1 (en) 2007-05-30 2008-12-04 Motorola, Inc. Method and apparatus for determining the appearance of a character display by an electronic device
US20090037822A1 (en) 2007-07-31 2009-02-05 Qurio Holdings, Inc. Context-aware shared content representations
US20090119614A1 (en) 2007-11-07 2009-05-07 Nokia Corporation Method, Apparatus and Computer Program Product for Heirarchical Navigation with Respect to Content Items of a Media Collection

Patent Citations (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5736982A (en) 1994-08-03 1998-04-07 Nippon Telegraph And Telephone Corporation Virtual space apparatus with avatars and speech
US6742127B2 (en) 1998-04-30 2004-05-25 Openwave Systems Inc. Method and apparatus for maintaining security in a push server
US6421781B1 (en) 1998-04-30 2002-07-16 Openwave Systems Inc. Method and apparatus for maintaining security in a push server
US20010021920A1 (en) 2000-03-10 2001-09-13 Fumiko Ikeda Method of giving gifts via online network
US20050015725A1 (en) 2000-04-28 2005-01-20 Sony Corporation Information processing apparatus and method, and storage medium
US20100131584A1 (en) 2000-06-07 2010-05-27 Johnson William J Mobile data processing system moving interest radius
US20090031006A1 (en) 2000-06-07 2009-01-29 Johnson William J System and method for alerting a first mobile data processing system nearby a second mobile data processing system
WO2002021831A2 (en) 2000-09-08 2002-03-14 Kargo, Inc. Video interaction
US20020085031A1 (en) 2000-12-14 2002-07-04 Conrado Claudine Viegas Method and system for providing a user profile
US7107549B2 (en) 2001-05-11 2006-09-12 3Dna Corp. Method and system for creating and distributing collaborative multi-user three-dimensional websites for a computer system (3D Net Architecture)
US20040199665A1 (en) 2001-07-12 2004-10-07 Omar Salim H. System and method for pushing data from an information source to a mobile communication device including transcoding of the data
US20030204846A1 (en) 2002-04-29 2003-10-30 Breen George Edward Accessing television services
US20030233469A1 (en) 2002-06-12 2003-12-18 Knowlson Kenneth L. Content server
WO2004036902A1 (en) 2002-10-15 2004-04-29 Infocast Systems Oy Method and system for supporting user interaction in broadcasting
US7386799B1 (en) 2002-11-21 2008-06-10 Forterra Systems, Inc. Cinematic techniques in avatar-centric communication during a multi-user online simulation
US20040122907A1 (en) 2002-12-20 2004-06-24 Wu Chou Secure interaction between a mobile client device and an enterprise application in a communication system
US20040125136A1 (en) 2002-12-30 2004-07-01 Jukka Wallenius Provision of services through a display system
US20050010637A1 (en) 2003-06-19 2005-01-13 Accenture Global Services Gmbh Intelligent collaborative media
US20050132420A1 (en) 2003-12-11 2005-06-16 Quadrock Communications, Inc System and method for interaction with television content
KR20050079852A (en) 2004-02-07 2005-08-11 엘지전자 주식회사 Avata service method and apparatus for mobile telecommunication terminal equipment
US20050198353A1 (en) 2004-03-05 2005-09-08 Robert Zmrzli Method and apparatus for providing dynamic network content to target devices
US20070287498A1 (en) 2004-07-16 2007-12-13 Tiehong Wang Method and apparatus for multimedia communications with different user terminals
US20060059509A1 (en) 2004-09-13 2006-03-16 Huang Jau H System and method for embedding commercial information in a video bitstream
WO2006036207A1 (en) 2004-09-28 2006-04-06 Sony Ericsson Mobile Communications Ab A system and method of streaming audio from a common video device
US20060195515A1 (en) 2005-02-28 2006-08-31 Yahoo! Inc. System and method for rating media
US20070106526A1 (en) 2005-07-18 2007-05-10 Jung Edward K Supervisory authority in virtual world environment
US20080009268A1 (en) 2005-09-14 2008-01-10 Jorey Ramer Authorized mobile content search results
US20070094691A1 (en) 2005-10-24 2007-04-26 Gazdzinski Robert F Method and apparatus for on-demand content transmission and control over networks
US20080222295A1 (en) 2006-11-02 2008-09-11 Addnclick, Inc. Using internet content as a means to establish live social networks by linking internet users to each other who are simultaneously engaged in the same and/or similar content
US20080201638A1 (en) 2007-02-15 2008-08-21 Yahoo! Inc. Context avatar
US7840903B1 (en) 2007-02-26 2010-11-23 Qurio Holdings, Inc. Group content representations
US7849420B1 (en) 2007-02-26 2010-12-07 Qurio Holdings, Inc. Interactive content representations enabling content sharing
US8400961B1 (en) 2007-08-27 2013-03-19 Qurio Holdings, Inc. Wireless multimedia brokerage service for real time content provisioning
US8261307B1 (en) 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning

Non-Patent Citations (12)

* Cited by examiner, † Cited by third party
Title
Advisory Action for U.S. Appl. No. 11/924,210, mailed Feb. 16, 2011, 3 pages.
Applicant-Initiated Interview Summary for U.S. Appl. No. 11/924,210, mailed Sep. 8, 2011, 3 pages.
Examiner Interview Summary for U.S. Appl. No. 11/924,210, mailed Octcober 25, 2010, 3 pages.
Final Office Action for U.S. Appl. No. 11/924,210, mailed Dec. 6, 2010, 9 pages.
Non-Final Office Action for U.S. Appl. No. 11/924,210, mailed Aug. 20, 2010, 8 pages.
Non-Final Office Action for U.S. Appl. No. 11/924,210, mailed Jun. 16, 2011, 10 pages.
Non-Final Office Action for U.S. Appl. No. 13/601,172, mailed Jun. 19, 2013, 5 pages.
Notice of Allowance for U.S. Appl. No. 11/924,210, mailed May 15, 2012, 9 pages.
Notice of Allowance for U.S. Appl. No. 11/924,210, mailed Nov. 21, 2011, 8 pages.
Notice of Allowance for U.S. Appl. No. 13/601,172, mailed Nov. 26, 2013, 10 pages.
Reexamination Decision for Chinese Patent Application No. 200880101285.0, issued Aug. 18, 2014, 24 pages (with English translation).
Supplemental Notice of Allowability for U.S. Appl. No. 13/601,172, mailed Dec. 18, 2013, 6 pages.

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10453065B2 (en) * 2016-02-12 2019-10-22 Visa International Service Association Method and system for determining terminal location
US11810115B2 (en) 2016-02-12 2023-11-07 Visa International Service Association Method and system for determining terminal locations

Also Published As

Publication number Publication date
US8261307B1 (en) 2012-09-04
US8695044B1 (en) 2014-04-08

Similar Documents

Publication Publication Date Title
US9270717B1 (en) Wireless multimedia content brokerage service for real time selective content provisioning
US11647092B2 (en) Apparatus and method for sharing information through presence service in a communication network
US8400961B1 (en) Wireless multimedia brokerage service for real time content provisioning
US10791163B2 (en) Communication apparatus, method, and system for using multimedia service
US20090316688A1 (en) Method for controlling advanced multimedia features and supplemtary services in sip-based phones and a system employing thereof
AU2012240570B2 (en) Visual telephony apparatus, system and method
US20130282820A1 (en) Method and System for an Optimized Multimedia Communications System
JP4848727B2 (en) Video distribution system, video distribution method, and video synchronization sharing apparatus
US9009593B2 (en) Apparatus and method for providing set top box assistance
US8644486B2 (en) Method and system to proxy phone directories
US9001980B2 (en) Data communication
EP2326086A1 (en) Method and system for interactive communications between an end-user terminal and a remote server or terminal

Legal Events

Date Code Title Description
STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20200223