WO2012073175A1 - Process for selective and personalized transmission of data to a mobile device and client/server system capable of implementing the process - Google Patents

Process for selective and personalized transmission of data to a mobile device and client/server system capable of implementing the process Download PDF

Info

Publication number
WO2012073175A1
WO2012073175A1 PCT/IB2011/055325 IB2011055325W WO2012073175A1 WO 2012073175 A1 WO2012073175 A1 WO 2012073175A1 IB 2011055325 W IB2011055325 W IB 2011055325W WO 2012073175 A1 WO2012073175 A1 WO 2012073175A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
mobile device
data
service providers
client
Prior art date
Application number
PCT/IB2011/055325
Other languages
French (fr)
Inventor
Patrizio Bof
Original Assignee
Infinite S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Infinite S.R.L. filed Critical Infinite S.R.L.
Publication of WO2012073175A1 publication Critical patent/WO2012073175A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems

Definitions

  • the present invention refers to a process for selective and personalized transmission of data to a mobile device; the invention also comprises an exemplifying embodiment of a client/server system that implements said process, wherein the client consists of a mobile device.
  • the categories of mobile devices referred to herein include, for example, Personal Digital Assistants (PDA), Smartphones, PC Tablets, etc.
  • PDA Personal Digital Assistants
  • the invention is also applicable to other systems, such as PCs, Kiosks, TV or other systems with which a user may interact and enjoy the information and/or services thereof.
  • PCs Personal Digital Assistants
  • Kiosks Portable Networks
  • TV Portable Video Players
  • Every mobile device belonging to one of these categories is characterized by a diversity of hardware and software components, platforms and user interfaces, so that in effect it can be considered as a small wireless computer.
  • what all mobile devices have in common is the possibility of employing a wide range of wireless communication interfaces that make it possible to have Internet access.
  • the various wireless communication technologies that mobile devices can use are complementary to each other. These include short-range broadband technologies, as well as wide-range medium-band or short-band technologies.
  • the latter include those technologies that are typical in radiotelephone communication systems, such as for example GSM, D-AMPS, GPRS, UMTS 3G, etc., which, as is well known, can also offer particular services.
  • GSM Global System for Mobile communications
  • D-AMPS D-AMPS
  • GPRS GPRS
  • UMTS 3G etc.
  • the GSM mobile telephone system offers a short message transmission service, the SMS.
  • SMS short message transmission service
  • the SMS service is also available on other networks, such as for example, the UMTS mobile telephony network or a fixed telephony network.
  • a main objective of the present invention is therefore to devise a process for the selective and personalized transmission of data from a server to a client device (for example a mobile device), as well as to realize a client/server system capable of implementing said process, wherein, in the exemplifying embodiment hereof, the client consists of a mobile device.
  • one purpose of the present invention is to enable a user to automatically receive text, or voice and/or video contents, selected according to the preferences previously set (implicitly or explicitly) by the same user, on the user's own mobile device, such as a smartphone.
  • Another purpose is to devise a process and a system provided with self- learning capabilities so as to enable the automatic and continuous updating of the selection criteria for the data to send, according to the user's choices.
  • automatic and continuous updating will be provided.
  • One not least important purpose is to devise a process for the selective and personalized transmission and display of data from a server to a mobile device, as well as to provide a client/server system capable of implementing said process, that attain the above-mentioned objective and purposes at competitive costs and that can be achieved with the usual well-known systems, machines and equipment.
  • FIG. 1 is a block diagram illustrating the general architecture of a client/server system according to the present invention
  • FIG. 2 is a block diagram of a client/server system according to the present invention with the capability of voice presentation of the transmitted data;
  • FIG. 3 is a graphic illustration of a mobile device, or client, of a system according to the present invention.
  • FIG. 4 is a block diagram of one part of the process according to the present invention.
  • FIG. 5 is a graphic illustration of the functionalities of a mobile device, or client, of a system according to the present invention.
  • the user is not requested to write keyword to search in a text field, as is the case instead in traditional applications based on search engines.
  • the user interacts with the client by means of web surfing menus built according to a graph of services dynamically generated on the server side, based on the previous interactions and on the user profile, in addition, naturally, to the objective of the search desired by the user.
  • the system under discussion does not have the purpose of searching for specific information or web pages indexed by search engines, but rather the purpose of searching for information of general nature (including, but not only, weather forecasts, information similar to that given by a "yellow pages" service, with the help of GPS sensors, aphorisms, news, etc.) or the provision of services.
  • the invention subject matter hereof therefore makes it possible to realize general systems that are oriented toward services and not merely toward searching for data.
  • reference numeral 1 indicates a client/server system comprising a client part consisting of a mobile device 2, such as a user's smartphone, and a server part 3 that operates on a JAVA platform and is capable of selecting and transmitting data and information, in text or voice and/or video message form, to the mobile device 2.
  • the mobile device 2 includes:
  • the second client module 5 to access the various functionalities of the mobile device 2, including the display of menus, maps, etc., through the use of libraries internal to the operating system resident in the mobile device 2;
  • the second client module 5 is defined as "Telephone API Connector";
  • a third client module 6 adapted to process the interaction and messaging between the mobile device 2 and the server 3 in the client/server direction, defined as "Message and Interaction Manager"; the requests to the server 3 are sent by HTTP protocol and the server 3 responds by generating a message in XML format.
  • the third client module 6 is capable of analyzing the XML message and of translating it, using the rules defined within the client, into a set of operations to execute, a menu to display or, more generally, a telephone or software functionality, pertinent to the logics under discussion in the disclosure.
  • TTS Textt-To-Speech
  • the server part 3, hereafter referred to simply as server 3, processes the requests from a plurality of mobile devices 2 and selectively transmits data and information to every individual mobile device 2 according to the specific user profile defined through a statistical model, resident in the server 3, that is capable of associating the user's preferences and manners of utilizing the individual mobile device 2 with a group of categories that substantially represent the user's habits.
  • the server 3 acquires and combines the data and information to send to the individual mobile device 2 through the connection to a plurality of remote service providers 11 , consisting of a plurality of servers external to the system, and to its internal database 18 which, for each mobile device 2, stores and categorizes the data already supplied.
  • the server 3 utilizes connectors based on different protocols to enable the querying of service providers 11 provided with different protocols.
  • the data are not provided to the user by means of web pages (as is done with the output typical of common search engines) but are represented by means of a dynamically generated graph, within which the user can surf, refining the output of his/her search through the addition of parameters (that are collected in a context) or by actions that cause a drill-down, through menu-based surfings, which too are dynamically generated according to said graph, as exemplified in figure 3.
  • the server 3 includes:
  • a first server module 12 defined as "Multi-Client Requests Manager", adapted to process the requests coming from the mobile devices 2; each single mobile device 2, and the profile associated with it, is identified through an authentication key supplied by the server 3 to the user upon login.
  • the authentication process by means of a key is a well-known process in the computer field and is clearly a prerequisite to identify the client device and therefore the user using it, in order to enable him or her to acquire the personalized contents. The authentication process is thus necessary to enable the server to identify the user profile.
  • the first server module 12 interacts substantially with the third client module 6 of the mobile device 2 to interpret and process the request coming from the mobile device 2, transmitted from the third client module 6 through HTTP protocol, and to respond, preferably in an XML message format;
  • the choice of the XML format has been determined by the prevalence of this format in the data transfer field, but it should be understood only as referring to the embodiment of the exemplifying system of the present invention.
  • the invention itself is not based on the fact that the client/server messages are encoded in XML; they could in fact be encoded in any other format, depending on the desired embodiment, as for example JSON, YAML, simple text structured in custom mode, or other serialization mechanisms;
  • a second server module 13 defined as "Connection Types Manager", for supporting the various types of connections with the remote service providers 11 , such as for example the HTTP(S), file systems, database, SOAP, TCPMP protocols;
  • Statistical Profile Adapter whose task is to provide a statistical analysis model for processing the user's habits starting from a static framework that describes the existing interrelations between all the remote service providers 11 with which the server 3 is connected; thus initially a static framework is defined, based on a description, preferably in XML format for the same reasons given above, in which are listed a series of "categories” grouped according to a principle of similarity between the services offered.
  • the fourth server module 15 receives the input variables from the mobile device 2, the state variables from the users database in communication with the server 3, and the access to the connection to the service providers 11 through the connection platform; the different data acquired are aggregated together in an organized manner so as to transmit to the mobile device 2 a series of actions to perform or of information to display.
  • the fourth server module 4 can be made up of multiple modules of the same type;
  • a fifth server module 16 called "Html Parsing Automata" for translating the HTML format used by some service providers 11 into a group of objects that can represent the results of the query and transmitting them to the mobile device 2 in a written message or audio-video format;
  • XML Parser for converting and storing the documents in XML format in XML DOM (Document Object Module) objects that can be processed by a JavaScript application; for example, it is possible to use the Dom4J library (www.dom4i.org) for converting the XML documents and the XStream library (http://xstream.codehaus.org) to store the objects in XML format.
  • This module is present in the exemplifying implementation of the system; however, it depends on the effective serialization technologies used, according to the embodiment, and on the basis of industrial standards that are considered to have a better applicability at the time of their implementation (be they XML, JASON, YAML or other serialization technologies). In other embodiments of the invention, this module will therefore have a different technical materialization, while still maintaining the "serialization/deserialization" spirit.
  • the system operating procedure is as follows: after the user has received the authentication codes for the user's own mobile device 2 following a request sent to the server 3, the third server module 14 "Statistical Profile Adapter" starts to define a static framework of the user's habits, consisting of the definition of the "categories” and of the association with each category of the pertinent services supplied by the external service providers 11 , as will be better explained later.
  • the server 3 processes the request through the first server module 12 "Multi- Client Request Manager", which authenticates the mobile device 2 and, if the authentication is positive, implements the search engines 19, 20, connected respectively to the external service providers 11 , through the second server module 13 and the fourth server module 15, and to the database 18 connected to the server 3, to acquire the data requested, based on the categories activated and the data supplied by the primary and secondary service providers (in cascade, which increment the information supplied by the primary providers), there is a delineation of the graph of dynamic contents, which is subsequently supplied to the client in serialized format (for example XML, as in the exemplified implementation).
  • serialized format for example XML, as in the exemplified implementation
  • the data provided can be associated to presentation phrases, in text or digital voice- video (spoken) form, if a client/server system with TTS functionality is provided, and transmitted to the mobile device 2.
  • the data that the server provides to the client are in the form of text structured as XML document.
  • XML document contains substantially three elements: a framework that models a menu of possible successive navigations (that the client submits to the user), a phrase of written text, which is shown on a display and a text phrase that is used to generate speech.
  • the client invokes the TTS service (either through a local TTS engine on board the device, or remotely on the same server or on another server, depending on the embodiments); the client then obtains an audio file (encoded in a suitable manner as Wave, Mp3 or other, depending on the implementation), that includes moreover a phonetic timeline, that is, a sequence of the phonemes generated by the TTS in the course of production of speech.
  • a phonetic timeline that is, a sequence of the phonemes generated by the TTS in the course of production of speech.
  • the specifications of the data framework used to represent the phonetic timeline depend on the TTS engine used; however, the concept is of a general nature.
  • the phonetic timeline is then used to generate a video, which in effect can be a stream video (made by means of rendering engines based on technologies such as OpenGL or similar) or based on sprites.
  • a video which in effect can be a stream video (made by means of rendering engines based on technologies such as OpenGL or similar) or based on sprites.
  • the phonemes are used for the final purpose of moving the assistant's lips to match the spoken words.
  • Such audio-visual content is then available to the end user, who also has the possibility of making subsequent menu navigations (which reflect on surfing the dynamic contents graph).
  • the XML messages (taking as example the implementation under discussion) containing the menus and the actions possible on the client side, are not semantically interpretable by any client capable of reading an XML file (as for example a web browser), as they do not represent HTML pages, nor is their meaning self-contained.
  • the messages include, in fact, actions that the same client can interpret semantically, optionally also on the basis of the context in which the request takes place.
  • semantic actions that the client could effect in some implementations: "call the following telephone number "open the following web site "open a geolocalized map etc.
  • the actions available to the client can vary, depending on the embodiments. In any case, they can be an integral part of the embodiment of the client itself.
  • the data relative to the user's profile and preferences, to the requests sent and to the replies provided are processed by the third server module 14 and stored in the database 18 to represent the user's habits; in this manner, the system launches a self-learning process based on artificial intelligence techniques which, with the passage of time and the increasing quantity of stored data, draws an increasingly accurate user profile that is differentiated according to the specific user. In this manner, the system can automatically and selectively provide the user, depending on the stored profile, the information of interest to the user, as exemplified in figure 5. This process is disclosed in detail in the following section.
  • the user is provided with a root menu, with pre-established and definable macro-contents in every specific embodiment of this system.
  • Such menu can be explicit (therefore directly viewable) or implicit (its items can be called up, for example, by means of vocal interactions or by other methods, depending on the implementation).
  • a request is sent to the server 3, involving a navigation in the tree defined by the dynamic contents graph. This process is reiterated by means of successive navigations in the graph nodes, until particular nodes are arrived at, where a request for information made to an external database (primary data source) is generated.
  • an external database primary data source
  • This request to a data source can be provided with some additional parameters, which can be obtained automatically without the explicit intervention of the user (for example, but not limited to GPS information, local date and time of the device, present displacement speed, etc.), or by requesting that the user explicitly optimizes the dynamic fields, depending on the request in progress or according to the embodiment.
  • data sources could be: feed RSS, service API, other types of WebService (for example, list services similar to the yellow pages, or social networks like Linkedin, Facebook, Twitter), search or meta-search engines (such as for example Google, Yahoo, Bing, Wolfram Alpha and others), or any other databank that may be accessible, or publicly, or by means of signed agreements.
  • WebService for example, list services similar to the yellow pages, or social networks like Linkedin, Facebook, Twitter
  • search or meta-search engines such as for example Google, Yahoo, Bing, Wolfram Alpha and others
  • any other databank that may be accessible, or publicly, or by means of signed agreements.
  • Every data source depending on the types of data provided, is associated with one or more pre-established categories.
  • additional data sources are queried in succession, with the purpose of enriching the information obtained.
  • the user could request that the application read his/her appointments for the day.
  • the basic data are read by the client, who can access the local agenda of the device; such data are then sent to the server as a part of the request, and the server analyzes them and can extract information such as: location of the appointments, type (meeting, working lunch, dinner, ...), time, other people taking part, particular key words, depending on the type of application or other factors.
  • data sources can be queried (for example services of "yellow pages" type) to find parking places in the vicinity of the meeting venues, or restaurants, or to check weather forecasts, with the effect of expanding the information without the express request from the buyer. This is one example of the process intended with the previously expressed phrase "in an automatic and selective manner".
  • a weighted network is used, it also being based on a graph, not to be confused with the graph of the dynamic contents supplied to the user, which will be now described.
  • a request coming from a client device (be it implicit or explicit and provided with the input parameters, where necessary) is made to correspond to a graph-based network input node.
  • the input nodes of this network model the user's intention of making use of a particular service (that is, of using a certain type of information, perform a particular action, etc., depending on the embodiments).
  • the nodes internal to the network model the affinity between the intention of the user and the services that can be provided by the embodiment (which are the output nodes).
  • the nodes internal to the graph are activated by means of an algorithm based on forward propagation.
  • the arcs that connect the various nodes of the graph are weighted and have a role in the activation of the nodes of the subsequent levels (according to feed-forward logics and the connections of the arcs).
  • the intermediate nodes end up by activating the output nodes, which, as has been mentioned, model the services that can be provided, which on the basis of the logic just now outlined, are coherent with the intention of the user and his/her past history.
  • the activated output nodes are subsequently sorted according to their activation value and the first N nodes (parametrical value depending on the embodiments) are selected for the purpose of determining the effective services or data source to be queried.
  • the topological structure of the graph is static and, depending on the embodiments, is modelled on the basis of the available services.
  • the structure can subsequently be modified so as to make it possible to add or remove services, or output nodes.
  • the weights of each arc, which represent the user profile, are dynamically updated according to the navigation choices as the user makes them through the use of the application. Greater details on this aspect will be provided later.
  • the concept of user “profile” differs substantially from the commonly general concept of profile represented with pairs (key, value).
  • the model discussed in the present invention does not explicitly define which properties or data are to be memorized.
  • the user profile is modelled by means of a topologically structured network such as a graph, to the arcs of which are associated weights (that are specific for each user).
  • weights dynamically updated, are based on the user's preferences, the history of previous interactions, the frequencies of use and any other factors that are desirably modelled in the graph according to the specific embodiments.
  • weights dynamically updated, are based on the user's preferences, the history of previous interactions, the frequencies of use and any other factors that are desirably modelled in the graph according to the specific embodiments.
  • the graph resembles a neural network, it is not based on the fundamental concepts of the neural networks, such as artificial "neurons", back-propagation or training through training sets.
  • the dynamic weight updating process is carried out in the following manner.
  • the weights belonging to the arcs outgoing from it are incremented (in the embodiments, such increment can be a fixed value or an adaptive value).
  • the weights of the arcs outgoing from the input nodes are normalized, ensuring that their sum is equal to the value of one.
  • the weights belonging to other arcs could also be updated in a similar manner or allowed to maintain their own value.
  • the client/server system has the TTS capability, the user can automatically receive the messages in digital audio-video form through a personal digital assistant.

Abstract

The present invention refers to a process for the selective and personalized transmission of data to a mobile device (2) from a server (3) connected with a plurality of external service providers (11) and with an internal database (18) thereof, which includes the following steps: defining and connecting a user profile static framework to the mobile device (2) by defining a plurality of profile categories and associating said plurality of categories to corresponding services categories supplied by said service providers (11); authenticating said mobile device (2) with said server (3) and sending a data request to the server (3) from the mobile device (2); if the authentication is positive, identifying said mobile device (2) and the corresponding user profile static framework associated with the mobile device (2); processing the request according to said static framework and connecting the server (3) to said service providers (11) and to said database (18) to acquire said data through first and second search engines (19, 20) included in said server (3) and connected respectively to said service providers (11) and to said database (18); converting the acquired data into text or digital audio-video format and transmitting said data to the mobile device (2); storing said query and said data in said database (18) to update said user profile.

Description

"PROCESS FOR SELECTIVE AND PERSONALIZED TRANSMISSION OF DATA TO A MOBILE DEVICE AND CLIENT/SERVER SYSTEM CAPABLE
OF IMPLEMENTING THE PROCESS"
DESCRIPTION
TECHNICAL FIELD OF INVENTION
The present invention refers to a process for selective and personalized transmission of data to a mobile device; the invention also comprises an exemplifying embodiment of a client/server system that implements said process, wherein the client consists of a mobile device.
BACKGROUND OF THE INVENTION
The technological evolution that accompanied the development of mobile devices in recent years has made it possible to increase their processing and storage capacity, as well as the number of their on-board peripherals, thus increasingly enhancing their performance capabilities. Consequently, mobile devices have enjoyed a rapid expansion in the business world leading to a greater productivity, as well as at the personal level for leisure-time applications.
The categories of mobile devices referred to herein include, for example, Personal Digital Assistants (PDA), Smartphones, PC Tablets, etc. However, the invention is also applicable to other systems, such as PCs, Kiosks, TV or other systems with which a user may interact and enjoy the information and/or services thereof. For the disclosure that follows, reference is made to the exemplifying implementation, and consequently to the mobile clients, without however limiting the applicability of the invention to them.
Every mobile device belonging to one of these categories is characterized by a diversity of hardware and software components, platforms and user interfaces, so that in effect it can be considered as a small wireless computer. In particular, what all mobile devices have in common is the possibility of employing a wide range of wireless communication interfaces that make it possible to have Internet access. The various wireless communication technologies that mobile devices can use are complementary to each other. These include short-range broadband technologies, as well as wide-range medium-band or short-band technologies.
The latter include those technologies that are typical in radiotelephone communication systems, such as for example GSM, D-AMPS, GPRS, UMTS 3G, etc., which, as is well known, can also offer particular services. For example, the GSM mobile telephone system offers a short message transmission service, the SMS. Now, however, the SMS service is also available on other networks, such as for example, the UMTS mobile telephony network or a fixed telephony network.
A new technology of presentation of information by means of a personal digital assistant has also been recently developed, in which the information is supplied to the user in a voice and/or video message format. US Patent Application 2009/044112 provides an example of this technology, currently used for presenting video/voice messages on personal computer by transmission on the network, via modem and Wi-Fi.
It would be desirable to be able to use said information transmission and presentation technology by personal digital assistant on mobile devices of compact size, such as for example cell phones or smartphones, adding to the possibility of message reception in text, or voice and/or video form, the functionality of selectively transmitting and supplying to the user personalized useful data and information based on the user's own preferences and on the self-learning capability of the client-server system.
SUMMARY OF THE INVENTION
A main objective of the present invention is therefore to devise a process for the selective and personalized transmission of data from a server to a client device (for example a mobile device), as well as to realize a client/server system capable of implementing said process, wherein, in the exemplifying embodiment hereof, the client consists of a mobile device.
In the scope of the above objective, one purpose of the present invention is to enable a user to automatically receive text, or voice and/or video contents, selected according to the preferences previously set (implicitly or explicitly) by the same user, on the user's own mobile device, such as a smartphone.
Another purpose is to devise a process and a system provided with self- learning capabilities so as to enable the automatic and continuous updating of the selection criteria for the data to send, according to the user's choices. In the description given hereunder a definition of the meaning of the terms "automatic" and "continuative" will be provided.
One not least important purpose is to devise a process for the selective and personalized transmission and display of data from a server to a mobile device, as well as to provide a client/server system capable of implementing said process, that attain the above-mentioned objective and purposes at competitive costs and that can be achieved with the usual well-known systems, machines and equipment.
The above objective, purposes and advantages, as well as others that will become more evident in the following description, are achieved by a process for the selective and personalized transmission and display of data from a server to a mobile device as defined in claim 1 and from a client/server system as defined in claim 4.
BRIEF DESCRIPTION OF THE FIGURES
Further characteristics of the invention will be better illustrated in the description of a particular, but not exclusive, embodiment illustrated by way of non-limiting example in the enclosed drawings, wherein:
- figure 1 is a block diagram illustrating the general architecture of a client/server system according to the present invention;
- figure 2 is a block diagram of a client/server system according to the present invention with the capability of voice presentation of the transmitted data;
- figure 3 is a graphic illustration of a mobile device, or client, of a system according to the present invention;
- figure 4 is a block diagram of one part of the process according to the present invention;
- figure 5 is a graphic illustration of the functionalities of a mobile device, or client, of a system according to the present invention.
DETAILED DESCRIPTION OF THE INVENTION
By way of introduction, it is pointed out that in the system of the invention hereof, the user is not requested to write keyword to search in a text field, as is the case instead in traditional applications based on search engines. The user interacts with the client by means of web surfing menus built according to a graph of services dynamically generated on the server side, based on the previous interactions and on the user profile, in addition, naturally, to the objective of the search desired by the user.
In fact, the system under discussion does not have the purpose of searching for specific information or web pages indexed by search engines, but rather the purpose of searching for information of general nature (including, but not only, weather forecasts, information similar to that given by a "yellow pages" service, with the help of GPS sensors, aphorisms, news, etc.) or the provision of services. The invention subject matter hereof therefore makes it possible to realize general systems that are oriented toward services and not merely toward searching for data. We may take as an example the fact of reading appointments, that a user memorizes in his/her smartphone, and of augmenting them with additional information, such as for example weather forecasts, traffic information or other information, without the user having expressly requested it, but relying on the fact that the user is generally interested in information of that type.
With reference to the above-mentioned figures, reference numeral 1 indicates a client/server system comprising a client part consisting of a mobile device 2, such as a user's smartphone, and a server part 3 that operates on a JAVA platform and is capable of selecting and transmitting data and information, in text or voice and/or video message form, to the mobile device 2. The mobile device 2 includes:
- a first client module 4 for connection to a local database resident in the mobile device 2, defined as "Local DB Connector";
- a second client module 5 to access the various functionalities of the mobile device 2, including the display of menus, maps, etc., through the use of libraries internal to the operating system resident in the mobile device 2; the second client module 5 is defined as "Telephone API Connector";
- a third client module 6 adapted to process the interaction and messaging between the mobile device 2 and the server 3 in the client/server direction, defined as "Message and Interaction Manager"; the requests to the server 3 are sent by HTTP protocol and the server 3 responds by generating a message in XML format. The third client module 6 is capable of analyzing the XML message and of translating it, using the rules defined within the client, into a set of operations to execute, a menu to display or, more generally, a telephone or software functionality, pertinent to the logics under discussion in the disclosure. Advantageously, it is also possible to provide a fourth client module 7, defined as "Rendering On Board Engine", and a fifth client module 8 defined as "Text-To-Speech (TTS) Connector", cooperating with each other and in connection with a TTS (Text-To-Speech Server), indicated in figure 2 with reference numeral 9 and being part of the server 3; the interaction between the fourth client module 7, the fifth client module 8 and the TTS server 9 makes it possible to convert the data acquired from the TTS server 9 through TTS engines resident in the TTS server itself or remote, collectively indicated with reference numeral 10, into a speech message (TTS) through the creation of a WAVE file, and to generate a sequence of images displayable on the mobile device 2, synchronized with the speech message, for the purpose of giving the user the information in digital audio-video format by means of a personal digital assistant. A detailed description of the architecture of the TTS system and of the process of converting the data into digital audio-video format through a digital assistant is provided by US Patent Application 2009/044112, which is intended as integrally included herein for reference.
The server part 3, hereafter referred to simply as server 3, processes the requests from a plurality of mobile devices 2 and selectively transmits data and information to every individual mobile device 2 according to the specific user profile defined through a statistical model, resident in the server 3, that is capable of associating the user's preferences and manners of utilizing the individual mobile device 2 with a group of categories that substantially represent the user's habits.
The server 3 acquires and combines the data and information to send to the individual mobile device 2 through the connection to a plurality of remote service providers 11 , consisting of a plurality of servers external to the system, and to its internal database 18 which, for each mobile device 2, stores and categorizes the data already supplied. The server 3 utilizes connectors based on different protocols to enable the querying of service providers 11 provided with different protocols.
As specified above, the data are not provided to the user by means of web pages (as is done with the output typical of common search engines) but are represented by means of a dynamically generated graph, within which the user can surf, refining the output of his/her search through the addition of parameters (that are collected in a context) or by actions that cause a drill-down, through menu-based surfings, which too are dynamically generated according to said graph, as exemplified in figure 3.
A fact worth mentioning is that the existing data and information (coming from independent and diverse data sources) are aggregated and presented to the user through a dynamic contents graph, navigable and without interruptions, which in addition to the same contents depends also on the profile and history of the user. Said contents graph is thus tailored to the user and evolves dynamically. Additional details in this regard will be provided herein later.
The possibility available to the user of carrying out selections through drill- downs or of specifying additional parameters for the requests in progress, that are accomplished by means of primary and secondary data sources, makes it possible to automatically enrich the information accessible to the user and also makes it possible to have a process and experience of use of the data that is both progressive (that is, based on the navigations by the user on a graph of personalized dynamic contents) and automatic (the aggregation of data coming from diverse data sources takes place transparently on the server side and without interruptions from the point of view of the user), in a selective manner, that is, on the basis of the previous interactions of the user with the system, his or her profile, and the intention of obtaining a given service.
The server 3 includes:
- a first server module 12, defined as "Multi-Client Requests Manager", adapted to process the requests coming from the mobile devices 2; each single mobile device 2, and the profile associated with it, is identified through an authentication key supplied by the server 3 to the user upon login. The authentication process by means of a key is a well-known process in the computer field and is clearly a prerequisite to identify the client device and therefore the user using it, in order to enable him or her to acquire the personalized contents. The authentication process is thus necessary to enable the server to identify the user profile. In normal operation, the first server module 12 interacts substantially with the third client module 6 of the mobile device 2 to interpret and process the request coming from the mobile device 2, transmitted from the third client module 6 through HTTP protocol, and to respond, preferably in an XML message format; the choice of the XML format has been determined by the prevalence of this format in the data transfer field, but it should be understood only as referring to the embodiment of the exemplifying system of the present invention. The invention itself is not based on the fact that the client/server messages are encoded in XML; they could in fact be encoded in any other format, depending on the desired embodiment, as for example JSON, YAML, simple text structured in custom mode, or other serialization mechanisms;
- a second server module 13, defined as "Connection Types Manager", for supporting the various types of connections with the remote service providers 11 , such as for example the HTTP(S), file systems, database, SOAP, TCPMP protocols;
- a third server module 14, called "Statistical Profile Adapter", whose task is to provide a statistical analysis model for processing the user's habits starting from a static framework that describes the existing interrelations between all the remote service providers 11 with which the server 3 is connected; thus initially a static framework is defined, based on a description, preferably in XML format for the same reasons given above, in which are listed a series of "categories" grouped according to a principle of similarity between the services offered. Subsequently, with each "category" is associated a list of services to establish the mutual interrelations between said services; naturally, the same service can be associated with different categories, such that, for example, the "meteo" service can be associated with both the "TRAVELS" category and the "EVENTS" category. Below is shown, by way of example, an abstract of the file associating the services to the categories:
Figure imgf000009_0001
a fourth server module 15, called "Stateful Connectors", that enables the server 3 to connect to the remote service providers 11 to acquire the information requested and to process the replies; the "stateful" connection makes it possible to store the data already previously supplied by the user and utilizes the connection platform together with some state variables that represent the latest user state situation. The fourth server module 15 receives the input variables from the mobile device 2, the state variables from the users database in communication with the server 3, and the access to the connection to the service providers 11 through the connection platform; the different data acquired are aggregated together in an organized manner so as to transmit to the mobile device 2 a series of actions to perform or of information to display. The fourth server module 4 can be made up of multiple modules of the same type;
- a fifth server module 16 called "Html Parsing Automata" for translating the HTML format used by some service providers 11 into a group of objects that can represent the results of the query and transmitting them to the mobile device 2 in a written message or audio-video format;
- a sixth server module 17 called "XML Parser" for converting and storing the documents in XML format in XML DOM (Document Object Module) objects that can be processed by a JavaScript application; for example, it is possible to use the Dom4J library (www.dom4i.org) for converting the XML documents and the XStream library (http://xstream.codehaus.org) to store the objects in XML format. This module is present in the exemplifying implementation of the system; however, it depends on the effective serialization technologies used, according to the embodiment, and on the basis of industrial standards that are considered to have a better applicability at the time of their implementation (be they XML, JASON, YAML or other serialization technologies). In other embodiments of the invention, this module will therefore have a different technical materialization, while still maintaining the "serialization/deserialization" spirit.
It should be noted that the particular subdivision into modules is given by way of example, based on the exemplifying embodiment of the present invention. Modularization is an established practice in data processing, and thus subsequent embodiments could encompass different structures. Clearly, what is highlighted here are the actions performed by the individual modules, which together comprise the embodiment of the invention, without going into details on the choice of modularization (which depends, among other things, also on the data processing paradigm used in the embodiment). The reference to the specific modules serves mainly to contextualize the various actions that contribute to the exemplifying embodiment of the invention under discussion, in order to add greater clarity to the disclosure, which however maintains a general nature.
The system operating procedure is as follows: after the user has received the authentication codes for the user's own mobile device 2 following a request sent to the server 3, the third server module 14 "Statistical Profile Adapter" starts to define a static framework of the user's habits, consisting of the definition of the "categories" and of the association with each category of the pertinent services supplied by the external service providers 11 , as will be better explained later. With each successive request sent by the user to the server 3 through a menu displayable on the mobile device 2, as exemplified in figure 3, the server 3 processes the request through the first server module 12 "Multi- Client Request Manager", which authenticates the mobile device 2 and, if the authentication is positive, implements the search engines 19, 20, connected respectively to the external service providers 11 , through the second server module 13 and the fourth server module 15, and to the database 18 connected to the server 3, to acquire the data requested, based on the categories activated and the data supplied by the primary and secondary service providers (in cascade, which increment the information supplied by the primary providers), there is a delineation of the graph of dynamic contents, which is subsequently supplied to the client in serialized format (for example XML, as in the exemplified implementation).
Depending on the context, the present request and the categories, the data provided can be associated to presentation phrases, in text or digital voice- video (spoken) form, if a client/server system with TTS functionality is provided, and transmitted to the mobile device 2.
In the embodiment provided by way of example, the data that the server provides to the client are in the form of text structured as XML document. Such XML document contains substantially three elements: a framework that models a menu of possible successive navigations (that the client submits to the user), a phrase of written text, which is shown on a display and a text phrase that is used to generate speech. If the TTS module is available, the client invokes the TTS service (either through a local TTS engine on board the device, or remotely on the same server or on another server, depending on the embodiments); the client then obtains an audio file (encoded in a suitable manner as Wave, Mp3 or other, depending on the implementation), that includes moreover a phonetic timeline, that is, a sequence of the phonemes generated by the TTS in the course of production of speech. The specifications of the data framework used to represent the phonetic timeline depend on the TTS engine used; however, the concept is of a general nature.
The phonetic timeline is then used to generate a video, which in effect can be a stream video (made by means of rendering engines based on technologies such as OpenGL or similar) or based on sprites. Depending on the implementations, in both cases, the phonemes are used for the final purpose of moving the assistant's lips to match the spoken words. Such audio-visual content is then available to the end user, who also has the possibility of making subsequent menu navigations (which reflect on surfing the dynamic contents graph).
It should be noted that the XML messages (taking as example the implementation under discussion) containing the menus and the actions possible on the client side, are not semantically interpretable by any client capable of reading an XML file (as for example a web browser), as they do not represent HTML pages, nor is their meaning self-contained. The messages include, in fact, actions that the same client can interpret semantically, optionally also on the basis of the context in which the request takes place. To improve the comprehension of the terms "interpret semantically", some examples are offered now of semantic actions that the client could effect in some implementations: "call the following telephone number "open the following web site "open a geolocalized map etc. Clearly, the actions available to the client can vary, depending on the embodiments. In any case, they can be an integral part of the embodiment of the client itself.
At the same time, the data relative to the user's profile and preferences, to the requests sent and to the replies provided are processed by the third server module 14 and stored in the database 18 to represent the user's habits; in this manner, the system launches a self-learning process based on artificial intelligence techniques which, with the passage of time and the increasing quantity of stored data, draws an increasingly accurate user profile that is differentiated according to the specific user. In this manner, the system can automatically and selectively provide the user, depending on the stored profile, the information of interest to the user, as exemplified in figure 5. This process is disclosed in detail in the following section.
PROCESS OF ACQUISITION OF INFORMATION AND INTERACTION
In a first instance of interaction, the user is provided with a root menu, with pre-established and definable macro-contents in every specific embodiment of this system. Such menu can be explicit (therefore directly viewable) or implicit (its items can be called up, for example, by means of vocal interactions or by other methods, depending on the implementation).
With the user selecting a menu item, be it implicit or explicit, a request is sent to the server 3, involving a navigation in the tree defined by the dynamic contents graph. This process is reiterated by means of successive navigations in the graph nodes, until particular nodes are arrived at, where a request for information made to an external database (primary data source) is generated.
This request to a data source can be provided with some additional parameters, which can be obtained automatically without the explicit intervention of the user (for example, but not limited to GPS information, local date and time of the device, present displacement speed, etc.), or by requesting that the user explicitly optimizes the dynamic fields, depending on the request in progress or according to the embodiment.
Once the necessary data are acquired (be it explicitly or implicitly, in the suitable manner), a request is made to the data source. By way of example, some examples of data sources could be: feed RSS, service API, other types of WebService (for example, list services similar to the yellow pages, or social networks like Linkedin, Facebook, Twitter), search or meta-search engines (such as for example Google, Yahoo, Bing, Wolfram Alpha and others), or any other databank that may be accessible, or publicly, or by means of signed agreements.
Every data source, depending on the types of data provided, is associated with one or more pre-established categories. Depending on the user profile and on the data source in the query phase, additional data sources are queried in succession, with the purpose of enriching the information obtained.
One example is useful. In the case of a smartphone, the user could request that the application read his/her appointments for the day. The basic data are read by the client, who can access the local agenda of the device; such data are then sent to the server as a part of the request, and the server analyzes them and can extract information such as: location of the appointments, type (meeting, working lunch, dinner, ...), time, other people taking part, particular key words, depending on the type of application or other factors. Depending on the information acquired and on the embodiment of the application, data sources can be queried (for example services of "yellow pages" type) to find parking places in the vicinity of the meeting venues, or restaurants, or to check weather forecasts, with the effect of expanding the information without the express request from the buyer. This is one example of the process intended with the previously expressed phrase "in an automatic and selective manner".
For what concerns the association of the services with the categories and the maintenance of the information that models the user profile, as already mentioned, a weighted network is used, it also being based on a graph, not to be confused with the graph of the dynamic contents supplied to the user, which will be now described.
A request coming from a client device (be it implicit or explicit and provided with the input parameters, where necessary) is made to correspond to a graph-based network input node. The input nodes of this network model the user's intention of making use of a particular service (that is, of using a certain type of information, perform a particular action, etc., depending on the embodiments). The nodes internal to the network model the affinity between the intention of the user and the services that can be provided by the embodiment (which are the output nodes). The nodes internal to the graph are activated by means of an algorithm based on forward propagation. The arcs that connect the various nodes of the graph are weighted and have a role in the activation of the nodes of the subsequent levels (according to feed-forward logics and the connections of the arcs). Through further passages of feed-forward activation, the intermediate nodes end up by activating the output nodes, which, as has been mentioned, model the services that can be provided, which on the basis of the logic just now outlined, are coherent with the intention of the user and his/her past history.
The activated output nodes are subsequently sorted according to their activation value and the first N nodes (parametrical value depending on the embodiments) are selected for the purpose of determining the effective services or data source to be queried.
The topological structure of the graph is static and, depending on the embodiments, is modelled on the basis of the available services. The structure can subsequently be modified so as to make it possible to add or remove services, or output nodes. The weights of each arc, which represent the user profile, are dynamically updated according to the navigation choices as the user makes them through the use of the application. Greater details on this aspect will be provided later.
It should be noted that the concept of user "profile" differs substantially from the commonly general concept of profile represented with pairs (key, value). In fact, the model discussed in the present invention does not explicitly define which properties or data are to be memorized. The user profile is modelled by means of a topologically structured network such as a graph, to the arcs of which are associated weights (that are specific for each user). Such weights, dynamically updated, are based on the user's preferences, the history of previous interactions, the frequencies of use and any other factors that are desirably modelled in the graph according to the specific embodiments. It should also be noted, that although such graph resembles a neural network, it is not based on the fundamental concepts of the neural networks, such as artificial "neurons", back-propagation or training through training sets.
The dynamic weight updating process is carried out in the following manner. Upon the selection of an input node, the weights belonging to the arcs outgoing from it are incremented (in the embodiments, such increment can be a fixed value or an adaptive value). Following the incremental step, the weights of the arcs outgoing from the input nodes are normalized, ensuring that their sum is equal to the value of one. In the specific embodiments, the weights belonging to other arcs could also be updated in a similar manner or allowed to maintain their own value.
From what is stated above, it is thus evident how the present invention achieves the purposes and advantages initially aimed at: in fact, a process and a client/server system has been devised for the selective and personalized transmission of data from a server to a mobile device, capable of memorizing the different user profiles and of automatically transmitting to the various mobile devices 2 selected and personalized information based on the stored user profile.
In particular, also evident are the self-learning capabilities of the system that allow the automatic and continuous updating of the selection criteria of the data and information to transmit according to user choices.
In addition, if the client/server system according to the present invention has the TTS capability, the user can automatically receive the messages in digital audio-video form through a personal digital assistant.
Naturally, the present invention is susceptible of numerous applications, modifications or variants without thereby departing from the scope of protection as defined in claim 1.
Moreover, the materials and equipment used to achieve the present invention, as well as the shapes and dimensions of the individual components, can be the most appropriate according to the specific requirements.

Claims

1. Process for selective and personalised transmission of data to a mobile device (2) from a server (3) connected with a plurality of external service providers (11) and with an internal database (18) thereof characterised in that it comprises the following steps:
- defining and associating a user profile static framework to said mobile device (2) by defining a plurality of profile categories and associating said plurality of categories to corresponding service categories provided by said service providers (11);
- authenticating said mobile device (2) at said server (3) and sending a data query to said server (3) from said mobile device (2);
- identifying said mobile device (2) and the corresponding user profile static framework associated to said mobile device (2) if said authentication is positive;
- processing said query according to said static framework and connecting said server (3) to said service providers (11) and to said database (18) to acquire said data through first and second search engines (19, 20) included in said server (3) and connected to said service providers (11) and to said database (18) respectively;
- converting the acquired data into text or digital audio-video format and transmitting said data to said mobile device (2);
- storing said query and said data in said database (18) to update said user profile.
2. Process according to claim 1 , wherein the data of each subsequent query and the data acquired from said service providers (11) and transmitted as a response to each subsequent query are stored in said database (18) and processed according to a statistical analysis to update and outline said user profile with increasing accuracy.
3. Process according to claim 2, wherein acquisition from said service providers (11) and transmission of said data to said mobile device (2) progressively occurs automatically and selectively according to the user profile and the data stored in said database (18).
4. Client/server system capable of implementing the process according to claim 1 , wherein the client is represented by said mobile device (2).
5. Mobile device part of a system according to claim 4, characterised in that it comprises a client module (6) capable of interacting with said server (3) to convert the messages coming from said server (3) into a set of operations or instructions to be executed.
6. Server part of the system according to claim 4, characterised in that it comprises:
- a first server module (12) adapted to manage incoming queries coming from every single mobile device (2) of a plurality of mobile devices and identify each single mobile device (2) and the profile associated thereto through an authentication key provided by said server (3), said first server module (12) being adapted to interact with said client module (6) of said mobile device (2) to decode and manage the incoming query transmitted from said client module (6) through the http protocol and provide a response in form of an XML message;
- a second server module (13) capable of supporting a plurality of types of connections on said service providers (11).
- a third server module (14) capable of providing a statistical analysis model for processing user profiles starting from a static framework predetermined according to said service providers (11) with which said server (3) is connected;
- a fourth server module (15) for establishing a stateful connection between said server (3) and said service providers (11), acquiring the requested data, aggregating and organising said data for transmission to said mobile device (2).
7. Server according to claim 6, comprising a fifth server module (16) adapted to convert the format of the data acquired from one or more of said service providers (11) into a group of objects capable of representing said data and transmitting said group of objects to said mobile device (2) in form of a text message or a digital audio-video message.
88. Server according to claim 7, comprising a sixth server module (17) for converting and storing XML documents into XML DOM objects which can be processed by a JavaScript application.
PCT/IB2011/055325 2010-11-29 2011-11-28 Process for selective and personalized transmission of data to a mobile device and client/server system capable of implementing the process WO2012073175A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT000067A ITPN20100067A1 (en) 2010-11-29 2010-11-29 PROCEDURE FOR SELECTIVE AND CUSTOMIZED DATA TRANSMISSION TO A MOBILE DEVICE AND CLIENT / SERVER SYSTEM THAT IMPLEMENTS THE PROCEDURE
ITPN2010A000067 2010-11-29

Publications (1)

Publication Number Publication Date
WO2012073175A1 true WO2012073175A1 (en) 2012-06-07

Family

ID=43742947

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2011/055325 WO2012073175A1 (en) 2010-11-29 2011-11-28 Process for selective and personalized transmission of data to a mobile device and client/server system capable of implementing the process

Country Status (2)

Country Link
IT (1) ITPN20100067A1 (en)
WO (1) WO2012073175A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2711836A1 (en) 2012-09-25 2014-03-26 RIMES Technologies Limited Data distribution system
ITUB20160771A1 (en) * 2016-02-16 2017-08-16 Doxee S P A SYSTEM AND METHOD FOR THE GENERATION OF CUSTOMIZED DIGITAL AUDIOVISUAL CONTENTS WITH VOCAL SYNTHESIS.
EP3208799A1 (en) * 2016-02-16 2017-08-23 DOXEE S.p.A. System and method for the generation of digital audiovisual contents customised with speech synthesis
CN107330452A (en) * 2017-06-16 2017-11-07 悦享趋势科技(北京)有限责任公司 Clustering method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030214775A1 (en) * 2002-05-15 2003-11-20 Fujitsu Limited Portal site server system, portal site method and computer-readable storage medium
US20080214157A1 (en) * 2005-09-14 2008-09-04 Jorey Ramer Categorization of a Mobile User Profile Based on Browse Behavior
US20090044112A1 (en) 2007-08-09 2009-02-12 H-Care Srl Animated Digital Assistant
US20100250578A1 (en) * 2009-03-31 2010-09-30 Yahoo! Inc. System and method for conducting a profile based search

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030214775A1 (en) * 2002-05-15 2003-11-20 Fujitsu Limited Portal site server system, portal site method and computer-readable storage medium
US20080214157A1 (en) * 2005-09-14 2008-09-04 Jorey Ramer Categorization of a Mobile User Profile Based on Browse Behavior
US20090044112A1 (en) 2007-08-09 2009-02-12 H-Care Srl Animated Digital Assistant
US20100250578A1 (en) * 2009-03-31 2010-09-30 Yahoo! Inc. System and method for conducting a profile based search

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2711836A1 (en) 2012-09-25 2014-03-26 RIMES Technologies Limited Data distribution system
WO2014049327A1 (en) 2012-09-25 2014-04-03 Rimes Technologies Limited Data distribution system
ITUB20160771A1 (en) * 2016-02-16 2017-08-16 Doxee S P A SYSTEM AND METHOD FOR THE GENERATION OF CUSTOMIZED DIGITAL AUDIOVISUAL CONTENTS WITH VOCAL SYNTHESIS.
EP3208799A1 (en) * 2016-02-16 2017-08-23 DOXEE S.p.A. System and method for the generation of digital audiovisual contents customised with speech synthesis
CN107330452A (en) * 2017-06-16 2017-11-07 悦享趋势科技(北京)有限责任公司 Clustering method and device

Also Published As

Publication number Publication date
ITPN20100067A1 (en) 2012-05-30

Similar Documents

Publication Publication Date Title
US11863646B2 (en) Proactive environment-based chat information system
US10573309B2 (en) Generating dialog recommendations for chat information systems based on user interaction and environmental data
US8271107B2 (en) Controlling audio operation for data management and data rendering
US8073700B2 (en) Retrieval and presentation of network service results for mobile device using a multimodal browser
US8370451B2 (en) System and method of providing a context-aware personalized blogging agent
US7958131B2 (en) Method for data management and data rendering for disparate data types
US20070165538A1 (en) Schedule-based connectivity management
US20070061711A1 (en) Management and rendering of RSS content
US20070100628A1 (en) Dynamic prosody adjustment for voice-rendering synthesized data
EP3236371A1 (en) Method and apparatus for context-indexed network resources
US20070168194A1 (en) Scheduling audio modalities for data management and data rendering
JP2021515256A (en) Data transfer within a secure processing environment
US20200258523A1 (en) Activation of remote devices in a networked system
US20210050008A1 (en) Platform selection for performing requested actions in audio-based computing environments
US20230169990A1 (en) Emotionally-aware voice response generation method and apparatus
US20230352017A1 (en) Platform selection for performing requested actions in audio-based computing environments
US8706909B1 (en) Systems and methods for semantic URL handling
WO2012073175A1 (en) Process for selective and personalized transmission of data to a mobile device and client/server system capable of implementing the process
JP2022172090A (en) Coordination of overlapping processing of audio queries
CN102804177A (en) Method, apparatus and computer program product for providing an adaptive context model framework
CN100390797C (en) Method for searching word and term relative content trough internet
Smirnov et al. Location-based on-board system for e-tourism: Implementation for Ford SYNC
KR20240023435A (en) Virtual remote control from the first device to control the second device (EG TV)
Rocha et al. Standard-based publish-subscribe service enabler for social applications and augmented reality services

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11810653

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11810653

Country of ref document: EP

Kind code of ref document: A1