US20150019665A1 - Linking context-based information to text messages - Google Patents

Linking context-based information to text messages Download PDF

Info

Publication number
US20150019665A1
US20150019665A1 US14/499,350 US201414499350A US2015019665A1 US 20150019665 A1 US20150019665 A1 US 20150019665A1 US 201414499350 A US201414499350 A US 201414499350A US 2015019665 A1 US2015019665 A1 US 2015019665A1
Authority
US
United States
Prior art keywords
users
text message
module
client device
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/499,350
Inventor
Jonathon Chad Linner
Juho-Pekka Iimari Virolainen
Robert James John Lawson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IDT MESSAGING LLC
Original Assignee
IDT MESSAGING LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IDT MESSAGING LLC filed Critical IDT MESSAGING LLC
Priority to US14/499,350 priority Critical patent/US20150019665A1/en
Publication of US20150019665A1 publication Critical patent/US20150019665A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/043Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • G06F40/117Tagging; Marking up; Designating a block; Setting of attributes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/279Recognition of textual entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12Messaging; Mailboxes; Announcements
    • H04W4/14Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]

Definitions

  • the disclosure generally relates to the field of text-based communication, and more particularly to dynamically linking content to text-based personal communications.
  • Text messaging has become an extremely popular method of communication due to its affordability and ease of use. On any given day, people all over the world exchange billions of text messages regarding a diverse range of topics. People may use text messages to make arrangements for group meals or activities, to solicit opinions about potential purchases at a retail establishment, or simply to exchange short pleasantries with friends.
  • text messaging systems are also rigid and non-interactive. Many messaging services only allow users to exchange short text strings, while some services also allow users to attach small multimedia items, such as images, to their messages. Regardless, text-based communication remains a relatively outdated and feature-poor service when compared to other interactive web-based features that are readily available on smartphones, computers, and other devices that people typically use to exchange messages.
  • Embodiments relate to providing information associated with a text message that is transmitted via a network using a push technology to establish or continue a conversation between a plurality of users.
  • One or more character strings associated with information likely to be inquired by at least one of the plurality of users within the context of the conversation are identified within the text message, and the information corresponding to each character string is generated.
  • the identified character strings are processed so that the character strings can be displayed in a manner distinguishable from other text in the text message.
  • the information corresponding to the selected character strings is displayed to the user.
  • the information corresponding to each character string in the text message is generated by analyzing the text message together with at least one additional text message that is part of the same conversation. In another embodiment, the information is generated by analyzing a user profile associated with at least one of the plurality of users in the conversation.
  • character strings are identified in the text message by executing at least one targeting rule.
  • Targeting rules contain a primary condition that specifies one or more character strings, at least one secondary condition, and a function to be executed at the client device. If one of the specified character strings is present in the text message and the text message satisfies the secondary conditions, then the specified character string that is present in the text message is identified. If a user selects the identified character string, then the client device executes the specified function.
  • FIG. 1 is a network diagram illustrating a system environment suitable for linking content to text messages, according to one embodiment.
  • FIG. 2A is a block diagram illustrating the linked content management module of FIG. 1 , according to one embodiment.
  • FIG. 2B is a block diagram illustrating a detailed view of the message analysis and targeting module of FIG. 2A , according to one embodiment.
  • FIG. 3 is a block diagram illustrating an example data structure for implementing a targeting rule, according to one embodiment.
  • FIGS. 4A and 4B are screenshots that illustrate an example of how linked content may be added to text messages, according to one embodiment.
  • FIG. 5 is an interaction diagram illustrating a process for using the processing server of FIG. 1 to add linked content to a text message, according to one embodiment.
  • FIG. 6A is a block diagram illustrating the messaging module of FIG. 1 , according to an alternative embodiment.
  • FIG. 6B is a block diagram illustrating a detailed view of the client-side analysis and targeting module, according to the embodiment of FIG. 6A .
  • FIG. 7 is an interaction diagram illustrating a process for using a client device to add linked content to a text message, according to the embodiment of FIG. 6A .
  • Embodiments relate to adding linked content to certain words or phrases in text messages in a conversation between two or more users.
  • a text message is analyzed to generate a linked message including selected words or phrases in the text message linked with content relevant to the context of the text message based on various information associated with the conversation.
  • the user selects one of the links after being presented with the linked message, the user is presented with the content linked to the selected link.
  • the linked content is useful to the users because it provides a convenient way for the users to access additional information via a simple interaction with their client devices.
  • the linked content is also valuable to advertisers because highly targeted advertisements may be added to the linked content and delivered to users.
  • a text message is any text-based personal communication between two or more users communicated by various communication protocols.
  • text messages are typically interpreted as messages sent over the Short Messaging System (SMS) or the Multimedia Messaging Service (MMS)
  • SMS Short Messaging System
  • MMS Multimedia Messaging Service
  • a text message as used herein may refer to any text-based communication sent over a cellular network, over the internet, or over any other networking technology.
  • SMS and MMS messages may also be sent over instant messenger (IM), social networking systems (e.g., Facebook), other chat messaging protocols, Internet Protocol (IP) messaging systems, the Rich Communication Suite (RCS), email, or other messaging services.
  • IM instant messenger
  • social networking systems e.g., Facebook
  • IP Internet Protocol
  • RCS Rich Communication Suite
  • a text message may also be generated based on a message in some other medium or format (e.g., a visual voicemail message that is transcribed from an audio message).
  • a multimedia item e.g., an image or video
  • text messages are typically push-based communications that are intended for reception by a targeted user or a targeted group of users. In other words, the delivery of a text message to its intended recipient is typically initiated by a text messaging server, not by the intended recipient.
  • a text messaging system can also be implemented with pull technology by configuring client devices to frequently request new messages from a messaging server.
  • text-based content that is requested by a user or does not represent a personal communication is not a text message for the purposes of the description presented herein.
  • a conversation is a series of related text messages that are exchanged between a group of users.
  • the new message is sent to the other users in the group. For example, if a first user adds a new text message to a conversation between a group of three users, then the new text message is sent to the second user and the third user.
  • a text message conversation may simulate a real-life conversation because users communicate to the group at large and not to a specific person or a subset of the people in the group.
  • FIG. 1 is a network diagram illustrating a system environment 100 suitable for adding linked content to text-based communications, according to one embodiment.
  • the system environment 100 may include, among other components, a client device 102 , a processing server 120 , a third party server 130 , and a network 132 .
  • the system environment 100 may include other components not illustrated in FIG. 1 such as security servers (to enhance security of the environment 100 ) and cache servers (to enhance response performance of the environment 100 ).
  • the client device 102 may be any electronic device containing the components described above.
  • the device 102 may be a smartphone, a personal digital assistant (PDA), a tablet computer, a laptop computer, a desktop computer, a game console, and a telematics unit in a vehicle.
  • PDA personal digital assistant
  • the system 100 may include multiple client devices 102 simultaneously exchanging data with the processing server 120 , one or more third-party servers 130 , or with each other.
  • the client device 102 may contain, among other components, a processor 104 , memory 106 , a display 108 , user input devices 110 , a networking module 112 , a location module 114 , a user profile module 116 , and a messaging module 118 .
  • the processor 104 is a hardware device capable of executing machine-readable instructions.
  • the memory 106 is a non-transitory computer-readable storage medium that can store data and machine-readable instructions for the processor 104 . Although pictured as single modules, the processor 104 and memory 106 may include multiple components.
  • the processor 104 may include a separate central processing unit (CPU) and a dedicated graphics processor (GPU), while the memory 106 may contain a combination of volatile memory (e.g., RAM) and non-volatile memory (e.g., flash memory, hard disk, etc.).
  • volatile memory e.g., RAM
  • non-volatile memory e.g., flash memory, hard disk, etc.
  • the display 108 is an electronic component that displays information to a user.
  • the display 108 may be, for example, a LCD screen, an electrophoretic ink (E Ink) display, or a heads-up display (HUD).
  • the user input devices 110 allow a user to provide user input to the client device 102 .
  • the user input devices 110 may include, for example, a keyboard, mouse, other external buttons, an accelerometer, a microphone, or a camera.
  • a single device, such as a touchscreen may act as a display 108 and a user input device 110 .
  • the networking module 112 exchanges data with other devices connected to the network 132 .
  • the networking module 112 may support any number of wired or wireless connection technologies, such as Ethernet, 802.11, GSM (Global System for Mobile Communications), 3G, 4G, or CDMA (Code Division Multiple Access).
  • the location module 114 uses various methods to determine the geographical location of the client device 102 .
  • the location module 114 communicates with a global navigation satellite system (GNSS) such as the Global Positioning System (GPS) to determine a precise latitude and longitude for the client device 102 .
  • GNSS global navigation satellite system
  • GPS Global Positioning System
  • the location module 114 may also analyze the Internet Protocol address (IP address) of the client device 102 or use information associated with a connected cellular tower or wireless access point to determine location information.
  • IP address Internet Protocol address
  • the user profile module 116 collects and stores information about the user of the client device 102 .
  • the user profile module 116 may collect information already present on the client device 102 , such as the language setting and operating system of the device 102 or the user's contact information and place of residence (e.g., from an address book application) to add to a profile of the user.
  • the user profile module 116 sends the collected information to the processing server 120 to be aggregated with information from other sources, such as information from other client devices belonging to the user or information from the user's accounts on social networking systems using a network 132 .
  • the user profile module 116 may store the information locally (i.e., on the memory 106 ) without sending it over the network 132 to any other device.
  • the messaging module 118 processes text messages that are sent and received by the client device 102 .
  • the messaging module 118 can include support for a number of different messaging protocols and technologies, including traditional text messaging technologies such as SMS (Short Message Service), IP messaging, instant messaging protocols, or email.
  • the messaging module 118 may also be compatible with other types of messaging services, such as a “visual voicemail” service that uses speech recognition algorithms to transcribe audio messages into text messages.
  • the messaging module 118 sends newly-received text messages to processing server 120 and receives link data from the processing server 120 indicating which words and phrases within the message are to be turned into links. After receiving the link data, the messaging module 118 displays the text message with the links included.
  • the messaging module 118 may optionally receive the linked content corresponding to each link at the same time as the link data. In this case, the messaging module 118 may also display visual representations (e.g., icons) next to certain links to indicate that the corresponding linked content contains a certain type of result.
  • the messaging module 118 may display the corresponding link with a dollar sign ($) icon to indicate to the user that selecting the link may result in a discount on a product.
  • the messaging module 118 may alternatively retrieve the linked content corresponding to a link from the processing server 120 after detecting that the user has selected the link.
  • the messaging module 118 may also display a visual representation or a separate character string independently of the original text of the message (e.g., at the end of a message) and have the added item function as a separate link. This function may be useful when the linked content is selected based on information from multiple sources (e.g., user profile data and multiple conversation messages) and cannot easily be associated with a single character string.
  • all or part of the link data and the corresponding linked content is generated in the messaging module 118 on the client device 102 instead of on the processing server 120 , and this embodiment is described in detail with reference to FIG. 6A , FIG. 6B , and FIG. 7 .
  • the processing server contains 120 a processor 122 , memory 124 , a networking module 126 , and a linked content management module 128 .
  • the operation of the processor 122 , memory 124 , and networking module 126 is similar to the operation of the corresponding devices 104 , 106 , 112 on the client device 102 so a detailed explanation of these components 122 , 124 , 126 is omitted for the sake of brevity.
  • the processing server 120 is likely to have a more powerful processor 122 and a larger memory 124 capacity than the client device 102 .
  • the linked content management module 128 receives, maintains, and stores information used to analyze text messages and add relevant linked content. A detailed description of the linked content management module 128 is provided with reference to FIG. 2A .
  • the third-party server 130 is any server that operates independently of the processing server 120 .
  • the third-party server 130 may be a social networking system (e.g., Facebook, Foursquare, Meetup, etc.) that provides additional user profile information that the linked content management module 128 may use to customize the linked content provided to a user.
  • the third party server 130 may also be a website that provides some of the linked content that the linked content management module 128 adds to messages. For example, if the linked content management module 128 may receive data from third-party servers 130 that provide information about news, weather, shopping and dining establishments, or local events. Although only a single third-party server 130 is shown, there may be multiple third-party servers 130 simultaneously providing different types of data to the processing server 120 and multiple client devices 102 .
  • FIG. 2A is a block diagram illustrating the linked content management module 128 of FIG. 1 , according to one embodiment.
  • the linked content management module 128 may contain, among other components, a user profile manager 202 , a user profile store 204 , a data analysis module 206 , an analysis database 208 , a targeting rule database 210 , a pre-screening module 212 , a device-rule association table 214 , and a message analysis and targeting module 216 .
  • the user profile manager 202 collects user information from different sources and compiles the information into a profile for each user of the system 100 .
  • the user profiles are saved in the user profile store 204 , and the analysis and targeting module 216 may use information in the user profile 204 to select linked content when processing new text messages.
  • the user profile manager 202 may collect user information from a plurality of client devices 102 belonging to or operated by the same user, from the user's accounts on different third-party social networking systems (e.g., Facebook, Foursquare, Meetup), or from any other entity that may contain information associated with the user.
  • third-party social networking systems e.g., Facebook, Foursquare, Meetup
  • the collected user information may include, for example, demographic information (e.g., birthday, age, gender, race), location information (e.g., home town, city of residence, past travel activity), dining and entertainment preferences (e.g., favorite types of food, favorite movie genres), preferred recreational activities (e.g., rock climbing, running, computer games, gambling), information related to a user's wireless bill or data usage, applications that a user has downloaded to his or her client devices 102 , or any other information that may allow the linked content management module 128 to provide users with relevant linked content.
  • the collected user information may be based on any combination of user-provided data and historical data.
  • a user's dining preferences may be based on the user's self-described preferences on a profile page of a social networking system and on the user's use of a “check-in” function to announce the user's presence at a particular dining establishment on the social networking system.
  • the user can opt out of allowing the user profile manager 202 collect some or all of the information mentioned above.
  • the user profile manager 202 may be configured to obtain a user's permission (e.g., a username and password) before gaining access to the user's accounts on third-party social networking services.
  • the user profile manager 202 may provide an interface that allows the user to select which types of information may be collected. For example, the user may indicate that the user profile manager 202 may collect the user's demographic information but not the user's dining preferences.
  • the data analysis module 206 receives and analyzes data related to user interactions with previously-added linked content. For example, the data analysis module 206 may receive a notification when a user selects a link that was generated, or when a user selects an item of linked content. The data analysis module 206 can generate aggregate data based on the notifications from multiple users of the system 100 and store the data in the analysis database 208 . The aggregate data can include, for example, the frequency with which users select a certain link or item of linked content, or the total number of times a link or an item of linked content is selected. The data analysis module 206 may also generate aggregate data based on changes in user activity over certain time frames (e.g., how selection frequency for a link varies over a 24-hour period).
  • the components of the analysis and targeting module 216 can subsequently use the data in the analysis database 208 to refine the algorithms that the module 216 uses to generate links and linked content for new text messages.
  • the data in the analysis database 208 can also be used to determine how frequently a certain advertisement was selected by users, and this data can then be used to measure the effectiveness of an advertising campaign and determine how much money the advertiser should pay for the campaign.
  • the targeting rule database 210 stores targeting rules that are used to deliver targeted linked content based on a series of predefined conditions.
  • a targeting rule could be configured to display an advertisement for Bob's Burger Bar (in addition to other relevant results) when a user sends a message including the word ‘burger’ while located within 2 miles of the physical address of Bob's Burger Bar.
  • FIG. 3 A detailed explanation of the contents and functionality of targeting rules is provided with reference to FIG. 3 .
  • the pre-screening module 212 associates targeting rules with individual client devices 102 based on one or more pre-screening criteria that are selected from the conditions in the targeting rule.
  • Pre-screening criteria are conditions that are based on information associated with a user or a client device 102 that is less likely to change over time. For example, conditions based on a user's race, gender, age, language (i.e., the language of the client device 102 ), device platform, or hometown may be selected as pre-screening criteria.
  • the pre-screening module 212 determines whether the client device 102 and the corresponding user profile satisfy the pre-screening criteria.
  • the pre-screening module 212 saves an association between the client device 102 and the targeting rule in the device-rule association table 214 .
  • the stored association causes the analysis and targeting module 216 to execute the targeting rule when the client device 102 sends a new message.
  • Pre-screening and associating the targeting rules in this manner beneficially allows for faster performance when adding linked content to a new message because the targeting and analysis module 216 does not spend time executing irrelevant targeting rules with conditions that the message and the corresponding user are unlikely to satisfy.
  • the analysis and targeting module 216 receives new text messages and analyzes various aspects of the text messages.
  • the module 216 uses the analysis to turn certain words and phrases in the text messages into links and to add linked content to those words and phrases.
  • a detailed description of the analysis and targeting module 216 is presented below in conjunction with FIG. 2B .
  • FIG. 2B is a block diagram illustrating a detailed view of the analysis and targeting module 216 of FIG. 2A , according to one embodiment.
  • the module 216 may contain, among other components, a series of analysis modules 252 through 266 , a link generation module 268 , and a linked content module 270 .
  • the phrasing analysis module 252 analyzes the context of individual words in a text message to determine the meaning of the words. For example, if a user includes the string “root beer” in a message, the phrasing analysis module 252 would analyze the message and determine that the words “root” and “beer” are part of a single phrase. As a result, instead of generating separate links for “root” (which may lead to results for gardening stores) and “beer” (which would likely result in listings for nearby bars), the phrasing analysis module 252 would instruct the link generation module 268 to turn the string “root beer” into a single link that provides results that are likely to be more relevant to the user.
  • the conversation analysis module 254 analyzes the content of previous text messages in a conversation to find contextual information that may be used to refine the linked content that is provided for new messages in the conversation. For example, the phrasing analysis module 252 might not be able to determine that the word “rabbit” in the message “How about some rabbit?” is meant to have a different meaning than the word “rabbit” in the message “How about a rabbit?” However, the conversation analysis module 254 may analyze the previous messages in each conversation and determine that the conversation containing the first message was a discussion of dinner plans, whereas the conversation containing the second message was a discussion related to adopting a pet.
  • the linked content module 270 may add a link to a list of local restaurants that serve rabbit stew in the first message and add a link to a list of local animal shelters and pet stores in the second message.
  • the conversational context of a message may be analyzed to link relevant information to words or phrases.
  • displaying results for rabbit stew may be an extremely upsetting and traumatizing experience for a user who wishes to adopt a pet rabbit and may discourage the user from selecting links in future text messages.
  • the temporal analysis module 256 analyses the timestamps on the text messages in a conversation to determine a temporal context for the conversation. For example, if two users exchange a series of messages in the morning and mention the word “lunch,” then the users are more likely to be making lunch plans. Meanwhile, if a conversation that occurs in the afternoon contains the word “lunch,” then the conversation may be a discussion between two people about what they ate for lunch earlier in the day. The temporal analysis module 256 may also work in conjunction with the conversation analysis module 254 to determine a timeframe for a proposed activity.
  • the conversation analysis module 254 may be combined with the timestamp data for the message to filter out results for dining establishments that will not be open during lunch hours on the day the message was sent.
  • the temporal analysis module 256 may also use timestamps to evaluate the relevance of older messages. For example, if a conversation consists of five three-month-old messages and twelve messages that were exchanged within the past two hours, then the temporal analysis module 256 may determine that the first five messages are less relevant and instruct the other analysis modules to place less weight on the content of the older messages. The temporal analysis module 256 may also work in conjunction with the conversation analysis module 254 to determine the relevance of older messages. For example, if the conversation analysis module 254 determines that the five older messages are somehow related to the twelve newer messages, then the older messages may be given the same weight as the newer messages.
  • the location analysis module 258 uses geographical data for a client device 102 to determine information about a user's location. In one embodiment, the location analysis module 258 simply receives location data (e.g., latitude and longitude coordinates) from the location module 114 of the client device 102 . In another embodiment, the location analysis module 258 may work in conjunction with the location module 114 to generate geographical data for the client device 102 . For example, the location analysis module 258 may receive the IP address of the client device 102 from the location module 114 and use IP geolocation techniques to find the location for the client device 102 .
  • location data e.g., latitude and longitude coordinates
  • the location analysis module 258 can transform the geographical location data into a point of interest (e.g., the address corresponding to the latitude and longitude coordinates of the client device 102 ).
  • the location analysis module 258 may also classify the point of interest (e.g., whether the address is a shopping mall, a restaurant, a park, a residence, etc.), which allows the linked content module 270 to select linked content that has a meaningful relationship to a user's surroundings.
  • the linked content module 270 may link the word “sweater” to an advertisement from a store in the same shopping mall that is having sale on sweaters.
  • the location analysis module 258 can also determine whether the client device 102 is inside a region defined by a “geofence,” which is a polygonal region whose vertices are defined by at least three sets of latitude/longitude coordinates. This function could be used, for example, to determine whether the user is in close proximity to a location of interest, such as a concert. This function could also be used in lieu of performing a point of interest analysis to determine whether the user is present in a large location, such as a particular park or stadium.
  • the location analysis module 258 can also use geographical location data for multiple users in a conversation to find a common region that is accessible to the multiple users. For example, if a first user located in a first city is making plans to go shopping with a second user located in a second city, then the location analysis module 258 may define a common region between the two cites and instruct the linked content module 270 to place more weight on shopping malls inside the common region. The creation of a common region allows the linked content module 270 to select location-based results that are convenient for both users in the conversation.
  • the location analysis module 258 may also operate in conjunction with the conversation analysis module 254 to infer the location of a user or the desired location of a proposed social event. For example, if a user sends a message that says, “Let's have drinks in Palo Alto tonight,” then the location analysis module 258 may skip any data-based location analysis and simply instruct the linked content module 270 to select results in Palo Alto. The location analysis module 258 may also use data-based location analysis in addition to information inferred from conversation messages.
  • the location analysis module 258 may still determine the locations of the users in the conversation and define a common region as described above, but the module 258 may also shift the common region so that the region is closer to Palo Alto.
  • the results generated by the location analysis module 258 may change based on the current location of the users, especially if no location can be inferred from the conversation messages. For example, suppose a user is commuting to work in the morning and sends a message that says “Let's have drinks tonight” to two other users and the link generation module 268 turns the word “drinks” into a link. If all three users are in a first city during the day, then the location analysis module 258 would instruct the linked content module 270 to provide results for bars and nightclubs in the first city if one of the users selects the link during the day.
  • the location analysis module 258 would instruct the linked content module 270 to provide results in the second city when one of the users selects the link.
  • a link generated for the same message may yield different linked content depending on the instantaneous location of the users in the conversation.
  • the results from the point of interest, “geofence,” and common region analysis techniques described above may also vary when the location of one or more users changes.
  • the group dynamics analysis module 260 analyzes user profiles of a group of people in a conversation to find characteristics that are common to the group. For example, if a group of high school students exchange a series of text messages to discuss weekend activities, then the group dynamics analysis module 260 would examine the user profile of each student to determine whether the students share any common interests. For example, the group dynamics analysis module 260 may determine that each of the students enjoy skateboarding and basketball, and the linked content module 270 can use this analysis to link a word in one of the conversation messages to a list of nearby skate parks and basketball courts. Thus, the group dynamics analysis module 260 allows the linked content module 270 to provide relevant linked content in a conversation even if the conversation only contains superficial messages such as “Hey! What should we do this weekend?” and “No idea. I'm fine with anything.” that provide little useable information regarding the group's preferences.
  • the group dynamics analysis module 260 may also take into account the number of people who are participating in a conversation. For example, if a group of six people are exchanging text messages to make plans for a group dinner, then the group dynamics analysis module 260 may instruct the linked content module 270 to filter out restaurants that do not have seating for groups of six or more people. The group dynamics module 260 may also work in conjunction with the conversation analysis module 254 to more accurately predict the number of people who will participate in an event.
  • the conversation analysis module 254 may inform the group dynamics analysis module 260 that the first user will not participate in the event, but three additional people will be participating.
  • the group dynamics analysis module 260 may subsequently ignore the profile information of the first user when determining the common dining preferences of the group and search for dining establishments with seating for groups of eight people rather than six people.
  • the weather analysis module 262 receives and analyzes weather data associated with the locations of users in a conversation to help generate links and refine the linked content that is selected. For example, if a group of users is planning an activity and the weather data indicates that a rainstorm is coming, then the weather analysis module 262 may instruct the linked content module 270 to give more weight to indoor activities (e.g., an arcade).
  • the weather analysis module 262 may also provide weather information to the linked content module 270 if the phrasing analysis module 252 or the conversation analysis module 254 detects a message in which a user expresses a desire to see a weather forecast. For example, if a user sends a message to ask another user, “Have you checked the weather yet?” then the weather analysis module 262 may provide a local weather forecast for the linked content module 270 to add to the message.
  • the image analysis module 264 uses pattern recognition, optical character recognition (OCR), or other image analysis methods to analyze pictures attached to text messages. For example, suppose a user sends a message consisting of the text “What do you think of these?” and a picture of a pair of jeans. Although the text may not contain enough useful information for the phrasing analysis module 252 and the conversation analysis module 256 to interpret, the image analysis module 264 may be able to recognize that the picture contains a pair of jeans and instruct the linked content module 270 to provide the user with linked content related to apparel and shopping (e.g., a coupon to purchase jeans at a discounted price at a nearby shopping center).
  • OCR optical character recognition
  • the global context analysis module 266 analyzes a wide range of data to find relationships between conversation messages and real-world events.
  • the module 266 may receive and analyze data from a number of different third-party services such as social networking systems, news feeds, weblogs, and other sources to find trending topics that have caught the attention of a large group of people.
  • the module 266 may also perform frequency analysis on text messages received by the analysis and targeting module 214 to detect sudden increases in the popularity of certain terms. For example, if a well-known actor is arrested for committing a serious crime, then there would likely be a sudden increase the number of times the actor's name is mentioned on social networks, news articles, weblogs, and text messages.
  • the global content analysis module 266 would determine that the actor was recently involved in some sort of significant event and inform the linked content module 270 .
  • the linked content module 270 may link the actor's name to news articles about the actor instead of to local theaters that are screening the actor's most recent movie.
  • the global context analysis module 266 may also operate in conjunction with the location analysis module 258 to add linked content related to events or information near the user's current location.
  • the module 266 may be configured to analyze data related to local traffic conditions, delays at nearby airports, train schedules, or nearby events, such as concerts and sporting events. If the module 266 determines that a message is related to any of this local information, it can forward the appropriate data to the linked content module 270 to be displayed to the user.
  • the link generation module 268 receives text messages from client devices 102 and determines which words and phrases in the text messages will be turned into links.
  • the link generation module 268 may select words and phrases based on analysis performed by any of the analysis modules 252 through 266 .
  • the global content analysis module 266 may instruct the link generation module 268 to turn all instances of the well-known actor's name into a link after detecting that the actor has been involved in a significant event that is receiving a large amount of publicity.
  • the link generation module 268 may add a link to be displayed independently of the original text of the message. As described above with reference to the messaging module 118 of FIG. 1 , this function is useful if the current text message does not contain any character strings that can easily be associated with linked content relevant to the conversation.
  • the added link may be a visual representation (e.g., an icon) or an additional character string; in the example presented with reference to the group dynamics module 260 , the linked content module 268 may add skateboard and basketball icons (or an additional character string that reads “nearby skate parks and basketball courts”) to the end of a conversation message and have the added items function as links.
  • the link generation module 268 may also add links to a text message by executing the targeting rules associated with the client device 102 that was used to send the message. In this case, the link generation module 268 accesses the device-rule association table 214 to determine which targeting rules are associated with the client device 102 . After determining the targeting rules to be executed, the module 268 retrieves the targeting rules from the targeting rule database 210 and executes the rules on the message. A detailed description of the contents of a targeting rule and the process of executing a target rule is provided in conjunction with FIG. 3 and FIG. 5 .
  • the link generation module 268 may be configured to stop adding links after meeting certain threshold.
  • the module 268 may be configured to add a maximum of five links to every ten messages in a conversation.
  • the link threshold may alternatively be defined at the message level.
  • the module 268 may be configured to add a maximum of two links to a single text message in a conversation.
  • the link generation module 268 may also limit the number of added links by maintaining a fixed separation between consecutive links in a message or conversation.
  • the module 268 may be configured to separate consecutive links by at least four words.
  • the module 268 may also be configured to maintain an average number of links per word (e.g., one link for every six words).
  • the linked content module 270 selects the linked content that will be displayed when the user selects the links. In one embodiment, the linked content module 270 chooses the linked content as soon as the link generation module 268 selects the words and phrases that are to be turned into links. Configuring the linked content module 270 to select the linked content immediately after the link generation module 268 chooses the links beneficially increases the speed with which the linked content can be displayed after a user selects the corresponding link. In addition, selecting the linked content before a link is selected enables the messaging module 118 to display indicator icons or other visual representations next to the links, as described with reference to FIG. 1 .
  • the linked content module 270 may select the linked content corresponding to a link responsive to receiving a notification from the client device 102 indicating that the user has selected the link. This beneficially prevents the linked content module 270 from searching for linked content corresponding to links that are not selected, thus reducing the computing load on the processor 122 and increasing the performance and responsiveness of the processing server 120 .
  • the linked content module 270 may select linked content based on the results of any of the analysis modules 252 through 266 .
  • the linked content module 270 may combine the results from multiple analysis modules 252 through 266 when selecting linked content. For example, if the group dynamics analysis module 260 determines that all three people in a conversation enjoy Indian food, the conversation analysis module 254 and temporal analysis module 256 determine that the three people wish to eat lunch at noon, and the location analysis module 258 can generate a common region that is accessible to the three people, then the linked content module 270 would retrieve a list of Indian restaurants that are located in the common region and will be open at noon. In addition, the linked content module 270 may select content based on any targeting rules whose conditions have been satisfied.
  • the selected linked content may be any content that is relevant to the conversation and the linked word.
  • Linked content may include, for example, search engine results, news articles, listings for local restaurants, shopping malls, or movie theaters, reviews of movies, weather conditions or forecasts, images, or maps.
  • the linked content module 270 may also include paid advertisements as part of the selected linked content.
  • Any of the analysis modules 252 through 266 may also use data from the analysis database 208 to refine the results that the modules 252 through 256 provide to the link generation module 268 and the linked content module 270 . For example, if data in the analysis database 208 indicates that people are more likely to go to a fast food establishment for lunch than for dinner, then the temporal analysis module 256 may instruct the linked content module 270 to give more weight to fast food restaurants when providing linked content to users who are making lunch plans.
  • analysis and targeting module 216 may use other analysis methods either in addition to or in place of the methods described herein to refine the linked content that is provided to users.
  • functionality of any of the analysis modules 252 through 266 described herein may be combined or divided into additional or different modules.
  • a single text analysis module may be configured to perform the functions of the phrasing analysis module 252 and the conversation analysis module 254 .
  • the analysis and targeting module 214 may also be configured to provide results for queries that users submit directly to the processing server 120 .
  • an additional module on the client device 102 may present the user with a user interface that allows the user to input key words and, optionally, input the names of other users.
  • the ability to directly submit queries to the processing server 120 beneficially allows users to access the targeted search functions of the analysis and targeting module 214 without exchanging any text messages. For example, suppose a user wishes to make lunch plans with two co-workers who are working in nearby cubicles. Instead of sending a text message to the two co-workers, the user may submit a query with the keywords “restaurant lunch today” and the names of two other users.
  • the analysis and targeting module 214 After receiving the query, the analysis and targeting module 214 would provide the user with a list of nearby restaurants that are open for lunch and match the overlapping dining preferences of the three users. Once the user chooses a restaurant from the list, the user may simply inform the two co-workers by walking over to their respective cubicles.
  • a user may also request linked content for a word or phrase in a message that was not turned into a link. For example, suppose a user receives the message “Let's go for a bike ride through Shoreline Park” and the link generation module 268 turned “Shoreline Park” into a link but did not turn “bike” into a link. If the user wishes to view linked content associated with the word “bike” (e.g., to view a list of local bike shops), then the user may select the word “bike” and have the analysis and targeting module 214 generate the results.
  • the ability to request linked content for a word is implemented by simply performing a query using relevant words in the message as key words.
  • the linked content module 270 may provide the user with multiple categories of linked content if the analysis and targeting module 214 is unable to determine a single meaning for a link. For example, suppose a user receives the same message as in the previous example, except the phrasing analysis module 252 turns the phrase “bike ride through Shoreline Park” into a single link. In this case, the linked content module 270 may provide the user with a list of local bike shops, weather information for the area, and a map with directions to Shoreline Park. To avoid overwhelming the user with a large amount of information, the client device 102 may be configured to display the information in three separate pages or tabs.
  • a user may opt out of providing some or all of the information that is used by the analysis and targeting module 214 .
  • a user may configure his or her client device 102 so that the device 102 does not send any geographical location data to the location analysis module 258 .
  • a user may also prevent the user profile manager 202 from collecting certain information about the user, such as the user's demographic information or dining preferences. Although providing less user information may cause the analysis and targeting module 216 to generate less relevant results, it beneficially allows users to preserve their privacy and maintain control of their personal information.
  • FIG. 3 is a block diagram illustrating an example data structure for implementing a targeting rule 300 , according to one embodiment.
  • the targeting rule 300 contains a primary condition 302 , one or more secondary conditions 304 , and a function 306 .
  • the targeting rule 300 may optionally specify a priority value 308 , a display method 310 , and a selection method 312 .
  • the purpose of a targeting rule 300 is to add the predetermined function 306 to any message that satisfies the conditions 302 , 304 .
  • the link generation module 268 analyzes the primary condition 302 . If the primary condition 302 is satisfied, then the link generation module 268 proceeds to analyze the secondary conditions 304 .
  • the primary condition 302 is typically based on a set of character strings (e.g., words or phrases); if at least one character string in the set is present in a text message, then the primary condition 302 is satisfied. For example, if the targeting rule 300 is meant to promote a Ford dealership in San Jose, then the primary condition 302 may instruct the link generation module 268 to determine whether a character string from the set consisting of “Ford,” “Mercury,” “new car,” and “test drive” is present.
  • the primary condition 302 may also be based on results from any of the analysis modules 252 through 266 .
  • the primary condition may be based on the context of the conversation as determined by the conversation analysis module 254 .
  • the primary condition 302 may be satisfied when the conversation analysis module 254 determines that the conversation is about dinner.
  • the primary condition 302 may also specify a set of generic food-related character strings (“food,” “meet,” “eat,” etc) that the link generation module 268 may turn into links when used in a conversation related to dinner plans.
  • the secondary conditions 304 are additional conditions that are to be satisfied before the function 306 is added to the text message. Secondary conditions 304 may be used to add precise targeting criteria to increase the probability that the function 306 will be displayed to a suitable group of users.
  • the targeting rule 300 for promoting the Ford dealership in San Jose may contain a secondary condition 304 that requires a client device 102 to be located within the city of San Jose. If the dealership is having a sale on pickup trucks, further secondary conditions 304 may be created so that the function 306 is only added to a text message if the user is a 25-to-34-year-old male.
  • any of the secondary conditions 304 may also be based on results from the analysis modules 252 through 266 .
  • a secondary condition 304 may be satisfied when a client device is inside a region defined by a “geofence,” as described with reference to the location analysis module 258 .
  • a different secondary condition 304 may configured so that it is satisfied when the group dynamics analysis module 260 determines that every user in a group of at least five users enjoys Indian food.
  • the ability to use results from the analysis modules 252 through 266 beneficially allows for the creation of precise targeting rules 300 that are displayed to users who meet a strict set of conditions.
  • the function 306 of the targeting rule 300 defines an action that occurs on the client device 102 after a user selects a link that was generated based on the targeting rule 300 .
  • the function 306 can define any action that the client device 102 is capable of performing.
  • the function 306 can prompt an action of displaying any sort of information (e.g., a list of places, an advertisement, a map, weather conditions, etc), playing a video or audio file, launching a different application on the client device 102 , or sending a text message.
  • the function 306 can also specify an action that is specific to the type of client device 102 (e.g., trigger a phone call).
  • the function 306 is typically presented as part of other results that the linked content module 270 selected for the link. For example, if the function 306 of a targeting rule 300 is to place a call to a local Indian restaurant, then an option to call the restaurant may be displayed together with information for other nearby Indian restaurants that were selected by the linked content module 270 . Presenting the function 306 together with other linked content beneficially allows users to see a more diverse range of information.
  • a targeting rule 300 may also be configured so that its function 306 is the only option that appears after selecting a link. This is a reasonable option for brand names and trademarked terms.
  • a targeting rule 300 for the fast food chain MCDONALDS may be configured to generate a link for the character string “Mcdonalds” and exclusively display nearby MCDONALDS locations when a user selects the link.
  • the targeting rule 300 may optionally contain a display method 308 and a selection method 310 . If the primary and secondary conditions 302 , 304 are satisfied and the targeting rule 300 results in the creation of a link, then the display method 308 and selection method 310 determine how the user interacts with the link.
  • the display method 308 determines how the messaging module 118 displays the link to the user.
  • the display method 308 may specify that the linked character string be formatted differently (e.g., underlined, displayed in a different font, highlighted, etc.) or specify that an icon be placed next to the link.
  • the display method 308 may also include a non-visual signal either in addition to or in place of a change in formatting.
  • the display method 308 could activate a vibration device in the client device 102 or cause the client device 102 to play a sound effect.
  • the ability to define a display method 308 beneficially allows the creator of the targeting rule 300 to make a link stand out from the rest of the message.
  • an advertiser that wishes to invoke a preexisting brand association may create a targeting rule 300 that causes one of their trademarks to be displayed in the same color and font as their logo (e.g., the string “STARBUCKS” may be displayed in white text and green highlighting to match the colors of the company's logo).
  • a targeting rule 300 that causes one of their trademarks to be displayed in the same color and font as their logo (e.g., the string “STARBUCKS” may be displayed in white text and green highlighting to match the colors of the company's logo).
  • the selection method 310 determines how the user selects the link. For example, the selection method 310 may specify that the user can select the link by clicking, tapping on, or rolling over the link, or by performing a predefined mouse or touchscreen gesture. The selection method 310 may also use other input methods, such as having the user shake the client device 102 in a manner that can be detected by an accelerometer in the device 102 , give the client device 102 a voice command via a microphone, or press an dedicated external button on the device 102 .
  • the messaging module 118 may use a set of predefined default settings to display the link and allow the user to select the link. Since a customized display method 308 and selection method 310 can be used to demonstrate a single entity's ownership of a particular word or phrase, it is common for a targeting rule 300 to omit the display method 308 and selection method 310 if the set of character strings defined in the primary condition 302 contains generic terms that are likely to yield other results in addition to the specified function 306 .
  • the targeting rule 300 for the Ford dealership in San Jose might omit the display method 308 and selection method 310 because the linked content module 270 is likely to retrieve and display results for additional car dealerships if the strings “new car” or “test drive” are turned into links and selected by the user.
  • the targeting rule 300 may also contain a priority value 312 that defines a priority for the rule 300 . If multiple targeting rules 300 are associated with a client device 102 , then the priority value 312 determines the order in which the link generation module 268 executes the rules 300 . As described above with reference to FIG. 2B , the link generation module 268 may impose a limit on the number of links that can be added to a single conversation or message. Thus, an advertiser that is using a targeting rule 300 to deliver an advertisement may pay an additional advertising fee for a higher priority value.
  • the link generation module 268 may automatically give the rule 300 a lower priority than the rules that do have priority levels. Alternatively, the link generation module 268 may automatically give the rule 300 a higher priority (e.g., rules without priority values may be reserved for especially important content) or assign an arbitrary priority value to the rule 100 . Meanwhile, if none of the rules 300 associated with a client device 102 have priority values, then the link generation module 268 may simple execute the rules 300 in an arbitrary order.
  • the analysis and targeting module 214 uses two distinct but related methods for adding links and corresponding linked content to text messages.
  • the analysis modules 252 through 266 , the link generation module 268 , and the linked content module 270 operate together to analyze conversation messages and automatically generate links and linked content for the messages.
  • the link generation module 268 and the linked content module 270 generate links and linked content by executing predefined targeting rules, and the targeting rules may be based on results from the analysis modules 252 through 266 .
  • the first method i.e., automatic generation
  • the second method i.e., executing targeting rules
  • may be performed with fewer computing resources i.e., a faster response time
  • advertisers and other content providers with a straightforward way of targeting their content to users.
  • FIGS. 4A and 4B are screenshots that illustrate some examples of how linked content may be added to text-based personal communications, according to one embodiment.
  • a first user is shown exchanging messages with a second user (John) early in the morning, and the two users make plans to go to a café together later in the morning.
  • the message is sent to the analysis and targeting module 214 , which performs multiple types of analysis on each message and on the conversation as a whole.
  • the first user mentions that “it's a nice sunny day.”
  • the phrasing analysis module 252 determines that the term “sunny day” 406 is a single phrase and that the presence of the term in the message indicates that the first user may be interested in viewing current weather conditions.
  • the module 252 instructs the link generation module 268 to turn the entire term 406 (e.g., “sunny day”) into a link, and the weather analysis module 262 retrieves the current weather conditions for the first user's location so that it can be displayed if the user selects the “sunny day” link 406 .
  • the conversation analysis module 254 detects that the two users are planning a social activity and works with the temporal analysis module 256 to predict a timeframe for the proposed activity. Based on the timestamps 404 of the messages and the word “morning” 402 in the first message, the modules 254 , 256 may predict that the two users plan to make their trip sometime between 8:20 AM and noon. As a result, the modules 254 , 256 instruct the linked content module 270 to filter out results for establishments that will be not open during those hours. The conversation analysis module 254 also detects the word “outside” 408 in the third message. Although the word 408 is not significant enough to be turned into a link, the conversation analysis module 254 determines that the two users would prefer to engage in an activity outdoors.
  • the analysis and targeting module 214 has received enough information to determine that the two users wish to visit a café with outdoor seating later in the morning.
  • the link generation module 268 turns the word “café” 410 in the fourth message into a second link.
  • the location analysis module 258 receives geographical location data from the two users' client devices 102 and generates a common region that is accessible to both users.
  • the linked content module 270 subsequently generates a list of cafés that satisfy the conditions determined by the analysis and targeting module 214 and are located inside the common region.
  • FIG. 4B is a screenshot 420 of the list of cafés that is displayed to the user after the user selects the “café” link 410 in the previous screenshot 400 .
  • results 424 through 432 that were retrieved by the linked content module 270 based on the results of the analysis modules 252 through 266 .
  • STARBUCKS pays to have their closest location placed at the top of the list 422 , and a star 422 A indicates that the first result was added as a paid advertisement.
  • the addition of the advertisement may be the result of a targeting rule 300 that was executed by the link generation module 268 and the linked content module 270 .
  • the linked content module 270 may have found the STARBUCKS location while searching for the other cafés, and STARBUCKS may have simply paid an extra fee to have their locations shifted to the top whenever they show up in a list.
  • the ability to add targeted content to text messages is extremely valuable to advertisers because the users who view the advertisements are much more likely to partake in whatever is being advertised.
  • FIG. 5 is an interaction diagram illustrating a process for using the processing server 120 of FIG. 1 to add linked content to a text message, according to one embodiment.
  • the processing server 120 generates 502 one or more targeting rules.
  • targeting rules can used to add linked content to text messages that meet a set of predefined conditions.
  • targeting rules are particularly useful to advertisers because the targeting rules give advertisers a way of displaying advertisements to extremely specific and narrowly-defined groups of users who are especially likely to be interested in the content of the advertisement.
  • an advertiser may work with an administrator of the processing server 120 to generate 502 a targeting rule to distribute an advertisement.
  • the processing server 120 may provide advertisers with a computer tool that the advertisers can use to generate targeting rules and transfer the rules to the processing server.
  • the processing server 120 may also generate 502 targeting rules that are used to distribute non-advertising content.
  • the rules are stored in the targeting rule database 210 and the pre-screening module 212 pre-screens each rule to determine 504 a list of eligible client devices 102 that are likely to satisfy the conditions defined in the rule.
  • the pre-screening module 212 operates by determining whether a client device 102 and its corresponding user profile matches matching one or more pre-screening criteria (which are selected from the conditions 302 , 304 of the rule). The pre-screening module 212 then proceeds to associate 506 the targeting rule with the eligible client devices 102 and stores the associations in the device-rule association table 214 .
  • the client device 102 receives 508 a text message and sends 510 the message to the processing server for analysis.
  • the client device 102 may also send 510 related data (e.g., the current location data of the device 102 ) along with the message.
  • the analysis and targeting module 214 analyzes 512 the message using a wide range of techniques to add one or more links to the message. As described with reference to FIG. 2B and FIG. 3 , the analysis and targeting module 214 may automatically add a link based on results from one or more of the analysis modules 252 through 266 , or the module 214 may add a link after executing a targeting rule 300 and determining that the conditions of the rule 302 , 304 have been satisfied.
  • the message may also originate from a non-text-based message.
  • a third-party voice mailbox system may receive an audio message for the user and use voice recognition algorithms to generate a text message corresponding to the audio message.
  • the resulting text message may be sent 510 directly to the processing server 120 , or it may first be sent to the client device 102 and relayed to the processing server 120 .
  • the processing server 120 may also include one or more modules for processing audio messages, text messages, or other types of messages, and these messages may be received directly at the processing server 120 to eliminate the need to send 510 the message from the client device 102 to the server 120 . In either case, the processing server 120 analyzes 512 and adds links to the text message in the manner described above.
  • the processing server 120 sends 514 the message back to the client device 102 , and the messaging module 118 displays 516 the message with the links.
  • the linked content module 270 may optionally select the linked content corresponding to each link and send 514 the linked content along with the message. If the client device 102 receives 518 a link selection from the user, then the messaging module 118 displays 520 the linked content corresponding to the selected link. As described above with reference to the messaging module 118 of FIG. 1 , the linked content may have been sent along with the message.
  • the client device 120 may also retrieve 520 A the linked content from the processing server 102 after the user selects the link.
  • the linked content module 270 may use results from the analysis modules 252 through 266 to generate a series of instructions that the client device 102 can use to retrieve the linked content from a third party and associate the instructions with the corresponding link.
  • the linked content module 270 may generate instructions for the client device 102 to use a local search service (e.g., YELP) to find a café that is located near the two users, has outdoor seating, and is open between 8:20 AM and noon on the day the messages were sent, and associate the instructions with the link for the word “café” 410 in the fourth message.
  • the instructions are sent 514 along with the message, and the client device 102 retrieves 520 B the linked content from a third-party server 130 after receiving 518 a user's selection of the link 410 .
  • the client device 102 also sends 522 data about the user's selections back to the processing server 102 , and the data analysis module 206 analyzes 524 the data and stores the data in the analysis database 208 .
  • the data in the analysis database 208 can subsequently used to refine the linked content that is provided to other users. For example, if users repeatedly select the fourth choice (Alana's Café) 428 in the example linked content 420 shown in FIG. 4B , then Alana's Café may be shown as the second choice to future users who are looking for a café in the same area.
  • the client device 102 may also send selection data in response to receiving 518 a link selection.
  • the data generated by the analysis 524 can also be used to enhance the advertising capabilities of the system 100 .
  • an advertiser may specify that an advertisement be displayed to a predefined number of unique users, be displayed with a particular frequency (e.g., 100 times per day), or define a length of time that should elapse between consecutive displays of the advertisement. It is also possible to monitor users' reactions to the advertisement.
  • the analysis of the selection data 524 may determine how frequently users select the advertisement, how long users spend viewing the advertisement, or how many users interact with the advertisement in a certain way (e.g., select a link within the advertisement to visit a web page, make a defined transaction, etc). Since the data analysis module 206 can reliably keep track of any of these parameters, these parameters may be used as a basis for calculating advertising fees.
  • FIG. 6A is a block diagram illustrating the messaging module 116 of FIG. 1 , in accordance with an alternative embodiment.
  • the client device 102 does not send messages to the processing server 120 for analysis. Instead, the messaging module 116 on the client device 102 contains additional components for analyzing messages and adding relevant linked content to the messages.
  • the message processing engine 602 performs the functions associated with exchanging and displaying text messages. As described with reference to FIG. 1 , this includes sending and receiving text messages over a variety of protocols and displaying the messages in conjunction with the corresponding links and linked content.
  • the message store 604 stores text messages that the message processing engine 602 previously sent or received. Storing messages locally allows the client-side analysis and targeting module 608 to perform conversation analysis and temporal analysis.
  • the targeting rule store 606 stores targeting rules that the pre-screening module 212 associates with the client device 102 . It is beneficial to maintain a local copy of the targeting rules because the message analysis is performed locally.
  • the client-side analysis and targeting module 608 performs message functions that are analogous to the analysis and targeting module 216 of the embodiment described with reference to FIG. 2 . However, some components of the client-side analysis and targeting module 608 operate differently because the client device 102 does not have access to as much information as the processing server 120 . A description of these differences and of the general operation of the client-side analysis and targeting module 608 is presented below with reference to FIG. 6B .
  • FIG. 6B is a block diagram illustrating a detailed view of the client-side analysis and targeting module 608 , according to the alternative embodiment of FIG. 6A .
  • the client-side analysis and targeting module 608 might have limited access to the data that is maintained in the linked content management module 128 (e.g., the data in the user profile store 204 and the analysis database 208 ). In some circumstances, the client-side analysis and targeting module 608 might be completely unable to access this data (e.g., if the client device 102 is unable to communicate with the processing server 120 or if the processing server malfunctions 120 ).
  • the client-side analysis and targeting module 608 may not be able to directly access information on other client devices 102 , either due to privacy restrictions on the other client devices 102 or due to unreliable connections over the network 132 .
  • some of the analysis modules 652 through 666 in the client-side analysis and targeting module 608 may be reconfigured to be make more effective use of data that is stored locally on the client device 102 and less dependent on data that is stored remotely.
  • these modules 652 , 654 , 656 may simply retrieve any relevant messages from the message store 604 and perform substantially the same analysis as the analogous modules 252 , 254 , 256 described with reference to the embodiment of FIG. 2B .
  • the location analysis module 658 receives geographical location data from the location module 114 and can perform a point-of-interest analysis or determine whether the client device 102 is inside a “geofence.” However, the location analysis module 658 may not be able to retrieve location data for other users in a conversation (e.g., the other users might configure their client devices 102 so that the location module 114 does not send location data to other client devices). If location data is not available for other users, then location analysis module 658 is not able to generate a common region that can be used to select location based results that are convenient to multiple users in a conversation.
  • the group dynamics analysis module 660 relies on being able to access and analyze user profiles of multiple people in a conversation. If the module 660 is not able to access the user profile store 204 in the processing server 120 (or if the present embodiment of the processing server 120 does not include a user profile store 204 ), then the module 660 retrieves information from the user profile modules 116 of other client devices 102 that are part of the conversation. However, users may also have the option of restricting or denying access to the user profile module 116 on their client devices 102 .
  • the module 660 may simply analyze the user profile module 116 of the client device 102 on which it resides and perform its analysis based solely on a single user's preferences.
  • the weather analysis module 662 and the image analysis module 664 perform substantially the same analysis as the analogous modules 262 , 264 described with reference to FIG. 2B .
  • the weather analysis module 662 may be limited to retrieving and analyzing weather data corresponding to the location of the client device 102 on which it resides.
  • the image analysis module 664 may be constrained by the weaker computing capabilities of the client device 102 and may not be able to perform an equally thorough analysis as the image analysis module 264 of the embodiment of FIG. 2B .
  • the link generation module 668 and linked content module 670 may be configured to rely more heavily on executing targeting rules rather than automatically generating links based on the results of the analysis modules 652 through 666 . This may be done, for example, by configuring the link generation module 668 to execute the rules in the targeting rule store 606 before using the results of the analysis modules 652 through 666 to automatically generate any links. If the execution of the targeting rules generates enough links to exceed the link threshold for the message or for the conversation, then the process of automatically generating links may be skipped.
  • the link generation module 668 executes a targeting rule 300 by determining whether the conditions 302 , 304 defined in the targeting rule 300 are satisfied, and any of the conditions may be based on a result from one of the analysis modules 652 through 666 . If the conditions 302 , 304 are satisfied, then the link generation module 668 turns the appropriate word or phrase in the message into a link, and the linked content module 270 associates the function 306 of the targeting rule 300 with the link.
  • the link generation module 268 starts by analyzing the secondary conditions 304 of each targeting rule to determine what information will be used in the conditions. Next, the link generation module 268 collects the information from the various analysis modules 652 through 666 or from other components of the client device 102 or the system 100 and temporarily stores the information in the memory 106 of the client device 102 . For example, suppose the targeting rule store 606 contains a first targeting rule specifying that the user must be inside the city of San Jose and be male, and a second targeting rule specifying that the user must be in San Jose and that a message must be sent between 7 AM and 10 AM.
  • the link generation module 268 When the user sends or receives a message, the link generation module 268 would use the location analysis module 658 to determine whether the user is in San Jose, use the temporal analysis module to determine the time of day that the user's message was sent, and access the user profile module 116 to determine whether the user is male. After the information is collected and stored in the memory 106 , the link generation module 668 can rapidly check the primary and secondary conditions 302 , 304 with reduced lag. In addition, the link generation module 268 does not retrieve information that is not used in any of the conditions (e.g., the user's age, current weather conditions, or group dynamics).
  • the link generation module 268 does not retrieve information that is not used in any of the conditions (e.g., the user's age, current weather conditions, or group dynamics).
  • This process of collecting relevant information before executing multiple rules at once prevents the link generation module 668 from retrieving unneeded information or retrieving the same information twice (e.g., the user's location information was only collected once even though it is used in both rules), which beneficially allows the rules to be executed faster and with fewer computing resources. While this process of evaluating multiple rules at once may also be performed on the processing server 120 in the embodiment described with reference to FIG. 2B , it is especially beneficial when performed on a client device 102 because many types of client devices 102 (e.g., smartphones, tablet computers, or other portable electronics) have limited power, memory 106 , and processing resources 104 .
  • client devices 102 e.g., smartphones, tablet computers, or other portable electronics
  • FIG. 7 is an interaction diagram illustrating a process for using the client device 102 to add linked content to a text-based personal communication, according to the alternative embodiment of FIG. 6A . Similar to the diagram in FIG. 5 , the process begins when the processing server 120 generates 702 targeting rules and pre-screens the rules based on pre-screening criteria to determine 704 a list of eligible client devices 102 that are likely to satisfy the conditions defined in the rule.
  • the processing server may generate 702 additional targeting rules to add links that would normally be generated automatically.
  • one targeting rule could specify that any word from the set consisting of “today,” “cloudy,” “sunny,” “rain,” and “weather” be turned into a link for displaying current weather conditions. While the conversation analysis module 654 and the weather analysis module 662 would normally work in conjunction to automatically identify these words and link one of them to current weather conditions, executing the targeting rule would yield roughly the same result. In addition, executing the targeting rule may use fewer computing resources than analyzing the context of the conversation to determine whether a user has expressed a desire to see weather information.
  • the processing server 120 loads 706 each targeting rule onto the corresponding client devices 102 .
  • each client device 102 receives a set of pre-screened targeting rules with conditions that the client device and the corresponding user profile are likely to satisfy.
  • the messaging module 118 stores 708 the rules in the targeting rule store 606 .
  • the client device receives 710 a message and the client-side analysis and targeting module 608 analyses 712 the message to turn some of the words and phrases in the message into links.
  • the client-side analysis and targeting module 608 may be configured to analyze 712 the message by executing the targeting rules before attempting to automatically generate any links. Alternatively, the module 608 may rely exclusively on the targeting rules to analyze 712 the message and skip the process of automatically generating links altogether.
  • the module 608 may access 712 A a third party server 130 (e.g., to retrieve weather conditions or associate the geographical location data with a point of interest) or retrieve 712 B data from the processing server 120 (e.g., user profile data) when analyzing the message.
  • a third party server 130 e.g., to retrieve weather conditions or associate the geographical location data with a point of interest
  • retrieve 712 B data from the processing server 120 e.g., user profile data
  • the message processing engine 602 displays the message to the user and the client device 102 may receive 716 an input from the user indicating that the user wishes to select one of the links. In response to receiving 716 the link selection, the message processing engine 602 displays 718 the linked content corresponding to the user. If the link was generated by a targeting rule, then the client device may simply perform the function 306 that was defined in the targeting rule. If the link was generated automatically, then any of the display methods described with reference to the embodiment of FIG. 5 may be used. In both cases, the client device may once again retrieve 718 A information from a third-party server or access 718 B the processing server to display the linked content.
  • the client device 120 also sends 720 selection data back to the processing server 120 for analysis 722 and storage.
  • the data may subsequently be used to define more effective targeting rules, calculate fees for advertisements, or for other purposes.
  • performing the message analysis functions of the system 100 on the client device 102 may result in less dynamic and relevant linked content.
  • performing message analysis on the client device 102 beneficially reduces the time associated with analyzing the message because there is no need to send the message to the processing server 120 and wait for the message to be sent back to the client device 102 .
  • the embodiment described with reference to FIGS. 2A through 5 contains features to preserve users' privacy, users may find that a system that does not send data to a remote server for analysis allows for even greater privacy of their personal information.
  • the analysis functions of the system 100 are divided between the client device 102 and the processing server 120 .
  • the analysis and targeting module 214 on the linked content management module 128 may be configured to perform analysis that relies more heavily on resources that are available on the processing server 120 .
  • the group dynamics analysis module 260 , and the global context module 266 may be implemented on the processing server.
  • the client-side analysis and targeting module 608 may perform analysis that relies on information that is readily available on the client device 102 (e.g., the user's location) or analysis that involves any personal information that a user does not wish to send to a remote server.
  • the disclosed embodiments beneficially allow for the addition of highly precise and targeted linked content to text messages.
  • targeted internet advertisements that are shown on computers
  • the widespread popularity of text messages allows linked content to be delivered to users while the users are in a wide range of real world situations, and the range of analysis methods that are used to characterize each text message allows for the selection of linked content that is relevant to users. This greatly enhances the interactivity of text messages and provides users with information that they are likely to find valuable.
  • Modules may constitute either software modules (e.g., code embodied on a machine-readable medium or in a transmission signal) or hardware modules.
  • a hardware module is tangible unit capable of performing certain operations and may be configured or arranged in a certain manner.
  • one or more computer systems e.g., a standalone, client or server computer system
  • one or more hardware modules of a computer system e.g., a processor or a group of processors
  • software e.g., an application or application portion
  • a hardware module may be implemented mechanically or electronically.
  • a hardware module may comprise dedicated circuitry or logic that is permanently configured (e.g., as a special-purpose processor, such as a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations.
  • a hardware module may also comprise programmable logic or circuitry (e.g., as encompassed within a general-purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
  • processors may be temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions.
  • the modules referred to herein may, in some example embodiments, comprise processor-implemented modules.
  • the one or more processors may also operate to support performance of the relevant operations in a “cloud computing” environment or as a “software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application program interfaces (APIs).)
  • SaaS software as a service
  • the performance of certain operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines.
  • the one or more processors or processor-implemented modules may be located in a single geographic location (e.g., within a home environment, an office environment, or a server farm). In other example embodiments, the one or more processors or processor-implemented modules may be distributed across a number of geographic locations.
  • any reference to “one embodiment” or “an embodiment” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment.
  • the appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
  • Coupled and “connected” along with their derivatives.
  • some embodiments may be described using the term “coupled” to indicate that two or more elements are in direct physical or electrical contact.
  • the term “coupled,” however, may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other.
  • the embodiments are not limited in this context.
  • the terms “comprises,” “comprising,” “includes,” “including,” “has,” “having” or any other variation thereof, are intended to cover a non-exclusive inclusion.
  • a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
  • “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).

Abstract

A system and a method are disclosed for adding linked content to text messages. Messages are analyzed to determine the context and meaning of a conversation between users, and linked content relevant to the conversation is selected and associated with certain words or phrases in the messages. This process for enhancing text messages beneficially provides users with additional information related to the meaning of their conversation, and also provides advertisers with a valuable new way of delivering highly relevant advertisements to a precise group of users.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 13/418,286, filed Mar. 12, 2012, which claims the benefit of U.S. Provisional Application No. 61/453,028, filed Mar. 15, 2011, which are incorporated by reference in their entirety.
  • BACKGROUND
  • 1. Field of Art
  • The disclosure generally relates to the field of text-based communication, and more particularly to dynamically linking content to text-based personal communications.
  • 2. Description of the Related Art
  • Text messaging has become an extremely popular method of communication due to its affordability and ease of use. On any given day, people all over the world exchange billions of text messages regarding a diverse range of topics. People may use text messages to make arrangements for group meals or activities, to solicit opinions about potential purchases at a retail establishment, or simply to exchange short pleasantries with friends.
  • However, despite their tremendous popularity and convenience, current text messaging systems are also rigid and non-interactive. Many messaging services only allow users to exchange short text strings, while some services also allow users to attach small multimedia items, such as images, to their messages. Regardless, text-based communication remains a relatively outdated and feature-poor service when compared to other interactive web-based features that are readily available on smartphones, computers, and other devices that people typically use to exchange messages.
  • SUMMARY
  • Embodiments relate to providing information associated with a text message that is transmitted via a network using a push technology to establish or continue a conversation between a plurality of users. One or more character strings associated with information likely to be inquired by at least one of the plurality of users within the context of the conversation are identified within the text message, and the information corresponding to each character string is generated. The identified character strings are processed so that the character strings can be displayed in a manner distinguishable from other text in the text message. When a user selects one of the character strings, the information corresponding to the selected character strings is displayed to the user.
  • In one embodiment, the information corresponding to each character string in the text message is generated by analyzing the text message together with at least one additional text message that is part of the same conversation. In another embodiment, the information is generated by analyzing a user profile associated with at least one of the plurality of users in the conversation.
  • In still another embodiment, character strings are identified in the text message by executing at least one targeting rule. Targeting rules contain a primary condition that specifies one or more character strings, at least one secondary condition, and a function to be executed at the client device. If one of the specified character strings is present in the text message and the text message satisfies the secondary conditions, then the specified character string that is present in the text message is identified. If a user selects the identified character string, then the client device executes the specified function.
  • BRIEF DESCRIPTION OF DRAWINGS
  • The disclosed embodiments have other advantages and features which will be more readily apparent from the detailed description, the appended claims, and the accompanying figures (or drawings). A brief introduction of the figures is below.
  • FIG. 1 is a network diagram illustrating a system environment suitable for linking content to text messages, according to one embodiment.
  • FIG. 2A is a block diagram illustrating the linked content management module of FIG. 1, according to one embodiment.
  • FIG. 2B is a block diagram illustrating a detailed view of the message analysis and targeting module of FIG. 2A, according to one embodiment.
  • FIG. 3 is a block diagram illustrating an example data structure for implementing a targeting rule, according to one embodiment.
  • FIGS. 4A and 4B are screenshots that illustrate an example of how linked content may be added to text messages, according to one embodiment.
  • FIG. 5 is an interaction diagram illustrating a process for using the processing server of FIG. 1 to add linked content to a text message, according to one embodiment.
  • FIG. 6A is a block diagram illustrating the messaging module of FIG. 1, according to an alternative embodiment.
  • FIG. 6B is a block diagram illustrating a detailed view of the client-side analysis and targeting module, according to the embodiment of FIG. 6A.
  • FIG. 7 is an interaction diagram illustrating a process for using a client device to add linked content to a text message, according to the embodiment of FIG. 6A.
  • DETAILED DESCRIPTION
  • The Figures (FIGS.) and the following description relate to preferred embodiments by way of illustration only. It should be noted that from the following discussion, alternative embodiments of the structures and methods disclosed herein will be readily recognized as viable alternatives that may be employed without departing from the principles of what is claimed.
  • Reference will now be made in detail to several embodiments, examples of which are illustrated in the accompanying figures. It is noted that wherever practicable similar or like reference numbers may be used in the figures and may indicate similar or like functionality. The figures depict embodiments of the disclosed system (or method) for purposes of illustration only. One skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.
  • Embodiments relate to adding linked content to certain words or phrases in text messages in a conversation between two or more users. A text message is analyzed to generate a linked message including selected words or phrases in the text message linked with content relevant to the context of the text message based on various information associated with the conversation. When a user selects one of the links after being presented with the linked message, the user is presented with the content linked to the selected link. The linked content is useful to the users because it provides a convenient way for the users to access additional information via a simple interaction with their client devices. The linked content is also valuable to advertisers because highly targeted advertisements may be added to the linked content and delivered to users.
  • As used herein, a text message is any text-based personal communication between two or more users communicated by various communication protocols. Although text messages are typically interpreted as messages sent over the Short Messaging System (SMS) or the Multimedia Messaging Service (MMS), a text message as used herein may refer to any text-based communication sent over a cellular network, over the internet, or over any other networking technology. In addition to SMS and MMS messages, text messages may also be sent over instant messenger (IM), social networking systems (e.g., Facebook), other chat messaging protocols, Internet Protocol (IP) messaging systems, the Rich Communication Suite (RCS), email, or other messaging services. A text message may also be generated based on a message in some other medium or format (e.g., a visual voicemail message that is transcribed from an audio message). In some cases, a multimedia item (e.g., an image or video) may be attached to a text message. In addition, text messages are typically push-based communications that are intended for reception by a targeted user or a targeted group of users. In other words, the delivery of a text message to its intended recipient is typically initiated by a text messaging server, not by the intended recipient. A text messaging system can also be implemented with pull technology by configuring client devices to frequently request new messages from a messaging server. However, text-based content that is requested by a user or does not represent a personal communication (e.g., a web page) is not a text message for the purposes of the description presented herein.
  • A conversation, as used herein, is a series of related text messages that are exchanged between a group of users. When one of the users adds a new text message to a conversation, the new message is sent to the other users in the group. For example, if a first user adds a new text message to a conversation between a group of three users, then the new text message is sent to the second user and the third user. Thus, a text message conversation may simulate a real-life conversation because users communicate to the group at large and not to a specific person or a subset of the people in the group.
  • Overview of System Architecture
  • FIG. 1 is a network diagram illustrating a system environment 100 suitable for adding linked content to text-based communications, according to one embodiment. The system environment 100 may include, among other components, a client device 102, a processing server 120, a third party server 130, and a network 132. The system environment 100 may include other components not illustrated in FIG. 1 such as security servers (to enhance security of the environment 100) and cache servers (to enhance response performance of the environment 100).
  • The client device 102 may be any electronic device containing the components described above. For example, the device 102 may be a smartphone, a personal digital assistant (PDA), a tablet computer, a laptop computer, a desktop computer, a game console, and a telematics unit in a vehicle. Although only one client device 102 is shown for the sake of brevity, the system 100 may include multiple client devices 102 simultaneously exchanging data with the processing server 120, one or more third-party servers 130, or with each other.
  • The client device 102 may contain, among other components, a processor 104, memory 106, a display 108, user input devices 110, a networking module 112, a location module 114, a user profile module 116, and a messaging module 118. The processor 104 is a hardware device capable of executing machine-readable instructions. The memory 106 is a non-transitory computer-readable storage medium that can store data and machine-readable instructions for the processor 104. Although pictured as single modules, the processor 104 and memory 106 may include multiple components. For example, the processor 104 may include a separate central processing unit (CPU) and a dedicated graphics processor (GPU), while the memory 106 may contain a combination of volatile memory (e.g., RAM) and non-volatile memory (e.g., flash memory, hard disk, etc.).
  • The display 108 is an electronic component that displays information to a user. The display 108 may be, for example, a LCD screen, an electrophoretic ink (E Ink) display, or a heads-up display (HUD). The user input devices 110 allow a user to provide user input to the client device 102. The user input devices 110 may include, for example, a keyboard, mouse, other external buttons, an accelerometer, a microphone, or a camera. In one embodiment, a single device, such as a touchscreen, may act as a display 108 and a user input device 110.
  • The networking module 112 exchanges data with other devices connected to the network 132. The networking module 112 may support any number of wired or wireless connection technologies, such as Ethernet, 802.11, GSM (Global System for Mobile Communications), 3G, 4G, or CDMA (Code Division Multiple Access).
  • The location module 114 uses various methods to determine the geographical location of the client device 102. In one embodiment, the location module 114 communicates with a global navigation satellite system (GNSS) such as the Global Positioning System (GPS) to determine a precise latitude and longitude for the client device 102. The location module 114 may also analyze the Internet Protocol address (IP address) of the client device 102 or use information associated with a connected cellular tower or wireless access point to determine location information.
  • The user profile module 116 collects and stores information about the user of the client device 102. In particular, the user profile module 116 may collect information already present on the client device 102, such as the language setting and operating system of the device 102 or the user's contact information and place of residence (e.g., from an address book application) to add to a profile of the user. In one embodiment, the user profile module 116 sends the collected information to the processing server 120 to be aggregated with information from other sources, such as information from other client devices belonging to the user or information from the user's accounts on social networking systems using a network 132. In an alternative embodiment, the user profile module 116 may store the information locally (i.e., on the memory 106) without sending it over the network 132 to any other device.
  • The messaging module 118 processes text messages that are sent and received by the client device 102. The messaging module 118 can include support for a number of different messaging protocols and technologies, including traditional text messaging technologies such as SMS (Short Message Service), IP messaging, instant messaging protocols, or email. The messaging module 118 may also be compatible with other types of messaging services, such as a “visual voicemail” service that uses speech recognition algorithms to transcribe audio messages into text messages.
  • In the present embodiment, the messaging module 118 sends newly-received text messages to processing server 120 and receives link data from the processing server 120 indicating which words and phrases within the message are to be turned into links. After receiving the link data, the messaging module 118 displays the text message with the links included. The messaging module 118 may optionally receive the linked content corresponding to each link at the same time as the link data. In this case, the messaging module 118 may also display visual representations (e.g., icons) next to certain links to indicate that the corresponding linked content contains a certain type of result. For example, if one of the items of linked content is a coupon, then the messaging module 118 may display the corresponding link with a dollar sign ($) icon to indicate to the user that selecting the link may result in a discount on a product. The messaging module 118 may alternatively retrieve the linked content corresponding to a link from the processing server 120 after detecting that the user has selected the link.
  • The messaging module 118 may also display a visual representation or a separate character string independently of the original text of the message (e.g., at the end of a message) and have the added item function as a separate link. This function may be useful when the linked content is selected based on information from multiple sources (e.g., user profile data and multiple conversation messages) and cannot easily be associated with a single character string.
  • In an alternative embodiment, all or part of the link data and the corresponding linked content is generated in the messaging module 118 on the client device 102 instead of on the processing server 120, and this embodiment is described in detail with reference to FIG. 6A, FIG. 6B, and FIG. 7.
  • The processing server contains 120 a processor 122, memory 124, a networking module 126, and a linked content management module 128. The operation of the processor 122, memory 124, and networking module 126 is similar to the operation of the corresponding devices 104, 106, 112 on the client device 102 so a detailed explanation of these components 122, 124, 126 is omitted for the sake of brevity. However, it should be noted that the processing server 120 is likely to have a more powerful processor 122 and a larger memory 124 capacity than the client device 102.
  • The linked content management module 128 receives, maintains, and stores information used to analyze text messages and add relevant linked content. A detailed description of the linked content management module 128 is provided with reference to FIG. 2A.
  • The third-party server 130 is any server that operates independently of the processing server 120. For example, the third-party server 130 may be a social networking system (e.g., Facebook, Foursquare, Meetup, etc.) that provides additional user profile information that the linked content management module 128 may use to customize the linked content provided to a user. The third party server 130 may also be a website that provides some of the linked content that the linked content management module 128 adds to messages. For example, if the linked content management module 128 may receive data from third-party servers 130 that provide information about news, weather, shopping and dining establishments, or local events. Although only a single third-party server 130 is shown, there may be multiple third-party servers 130 simultaneously providing different types of data to the processing server 120 and multiple client devices 102.
  • FIG. 2A is a block diagram illustrating the linked content management module 128 of FIG. 1, according to one embodiment. The linked content management module 128 may contain, among other components, a user profile manager 202, a user profile store 204, a data analysis module 206, an analysis database 208, a targeting rule database 210, a pre-screening module 212, a device-rule association table 214, and a message analysis and targeting module 216.
  • The user profile manager 202 collects user information from different sources and compiles the information into a profile for each user of the system 100. The user profiles are saved in the user profile store 204, and the analysis and targeting module 216 may use information in the user profile 204 to select linked content when processing new text messages. As described with reference to the user profile module 118 of FIG. 1, the user profile manager 202 may collect user information from a plurality of client devices 102 belonging to or operated by the same user, from the user's accounts on different third-party social networking systems (e.g., Facebook, Foursquare, Meetup), or from any other entity that may contain information associated with the user.
  • The collected user information may include, for example, demographic information (e.g., birthday, age, gender, race), location information (e.g., home town, city of residence, past travel activity), dining and entertainment preferences (e.g., favorite types of food, favorite movie genres), preferred recreational activities (e.g., rock climbing, running, computer games, gambling), information related to a user's wireless bill or data usage, applications that a user has downloaded to his or her client devices 102, or any other information that may allow the linked content management module 128 to provide users with relevant linked content. The collected user information may be based on any combination of user-provided data and historical data. For example, a user's dining preferences may be based on the user's self-described preferences on a profile page of a social networking system and on the user's use of a “check-in” function to announce the user's presence at a particular dining establishment on the social networking system.
  • To preserve the user's privacy, the user can opt out of allowing the user profile manager 202 collect some or all of the information mentioned above. In one embodiment, the user profile manager 202 may be configured to obtain a user's permission (e.g., a username and password) before gaining access to the user's accounts on third-party social networking services. In another embodiment, the user profile manager 202 may provide an interface that allows the user to select which types of information may be collected. For example, the user may indicate that the user profile manager 202 may collect the user's demographic information but not the user's dining preferences.
  • The data analysis module 206 receives and analyzes data related to user interactions with previously-added linked content. For example, the data analysis module 206 may receive a notification when a user selects a link that was generated, or when a user selects an item of linked content. The data analysis module 206 can generate aggregate data based on the notifications from multiple users of the system 100 and store the data in the analysis database 208. The aggregate data can include, for example, the frequency with which users select a certain link or item of linked content, or the total number of times a link or an item of linked content is selected. The data analysis module 206 may also generate aggregate data based on changes in user activity over certain time frames (e.g., how selection frequency for a link varies over a 24-hour period). The components of the analysis and targeting module 216 can subsequently use the data in the analysis database 208 to refine the algorithms that the module 216 uses to generate links and linked content for new text messages. The data in the analysis database 208 can also be used to determine how frequently a certain advertisement was selected by users, and this data can then be used to measure the effectiveness of an advertising campaign and determine how much money the advertiser should pay for the campaign.
  • The targeting rule database 210 stores targeting rules that are used to deliver targeted linked content based on a series of predefined conditions. For example, a targeting rule could be configured to display an advertisement for Bob's Burger Bar (in addition to other relevant results) when a user sends a message including the word ‘burger’ while located within 2 miles of the physical address of Bob's Burger Bar. A detailed explanation of the contents and functionality of targeting rules is provided with reference to FIG. 3.
  • The pre-screening module 212 associates targeting rules with individual client devices 102 based on one or more pre-screening criteria that are selected from the conditions in the targeting rule. Pre-screening criteria are conditions that are based on information associated with a user or a client device 102 that is less likely to change over time. For example, conditions based on a user's race, gender, age, language (i.e., the language of the client device 102), device platform, or hometown may be selected as pre-screening criteria. To determine whether a targeting rule should be associated with a client device 102, the pre-screening module 212 determines whether the client device 102 and the corresponding user profile satisfy the pre-screening criteria. If the pre-screening criteria are satisfied, then the pre-screening module 212 saves an association between the client device 102 and the targeting rule in the device-rule association table 214. The stored association causes the analysis and targeting module 216 to execute the targeting rule when the client device 102 sends a new message. Pre-screening and associating the targeting rules in this manner beneficially allows for faster performance when adding linked content to a new message because the targeting and analysis module 216 does not spend time executing irrelevant targeting rules with conditions that the message and the corresponding user are unlikely to satisfy.
  • The analysis and targeting module 216 receives new text messages and analyzes various aspects of the text messages. The module 216 uses the analysis to turn certain words and phrases in the text messages into links and to add linked content to those words and phrases. A detailed description of the analysis and targeting module 216 is presented below in conjunction with FIG. 2B.
  • Analysis of Text Messages
  • FIG. 2B is a block diagram illustrating a detailed view of the analysis and targeting module 216 of FIG. 2A, according to one embodiment. The module 216 may contain, among other components, a series of analysis modules 252 through 266, a link generation module 268, and a linked content module 270.
  • The phrasing analysis module 252 analyzes the context of individual words in a text message to determine the meaning of the words. For example, if a user includes the string “root beer” in a message, the phrasing analysis module 252 would analyze the message and determine that the words “root” and “beer” are part of a single phrase. As a result, instead of generating separate links for “root” (which may lead to results for gardening stores) and “beer” (which would likely result in listings for nearby bars), the phrasing analysis module 252 would instruct the link generation module 268 to turn the string “root beer” into a single link that provides results that are likely to be more relevant to the user.
  • The conversation analysis module 254 analyzes the content of previous text messages in a conversation to find contextual information that may be used to refine the linked content that is provided for new messages in the conversation. For example, the phrasing analysis module 252 might not be able to determine that the word “rabbit” in the message “How about some rabbit?” is meant to have a different meaning than the word “rabbit” in the message “How about a rabbit?” However, the conversation analysis module 254 may analyze the previous messages in each conversation and determine that the conversation containing the first message was a discussion of dinner plans, whereas the conversation containing the second message was a discussion related to adopting a pet. In this case, the linked content module 270 may add a link to a list of local restaurants that serve rabbit stew in the first message and add a link to a list of local animal shelters and pet stores in the second message. As illustrated in this example, the conversational context of a message may be analyzed to link relevant information to words or phrases. Although mistakenly displaying results for animal shelters may simply be a minor annoyance for a user who wishes to enjoy rabbit stew with a group of friends, displaying results for rabbit stew may be an extremely upsetting and traumatizing experience for a user who wishes to adopt a pet rabbit and may discourage the user from selecting links in future text messages.
  • The temporal analysis module 256 analyses the timestamps on the text messages in a conversation to determine a temporal context for the conversation. For example, if two users exchange a series of messages in the morning and mention the word “lunch,” then the users are more likely to be making lunch plans. Meanwhile, if a conversation that occurs in the afternoon contains the word “lunch,” then the conversation may be a discussion between two people about what they ate for lunch earlier in the day. The temporal analysis module 256 may also work in conjunction with the conversation analysis module 254 to determine a timeframe for a proposed activity. For example, if the conversation analysis module 254 encounters a message such as “let's go to lunch later today,” then the phrase “later today” may be combined with the timestamp data for the message to filter out results for dining establishments that will not be open during lunch hours on the day the message was sent.
  • The temporal analysis module 256 may also use timestamps to evaluate the relevance of older messages. For example, if a conversation consists of five three-month-old messages and twelve messages that were exchanged within the past two hours, then the temporal analysis module 256 may determine that the first five messages are less relevant and instruct the other analysis modules to place less weight on the content of the older messages. The temporal analysis module 256 may also work in conjunction with the conversation analysis module 254 to determine the relevance of older messages. For example, if the conversation analysis module 254 determines that the five older messages are somehow related to the twelve newer messages, then the older messages may be given the same weight as the newer messages.
  • The location analysis module 258 uses geographical data for a client device 102 to determine information about a user's location. In one embodiment, the location analysis module 258 simply receives location data (e.g., latitude and longitude coordinates) from the location module 114 of the client device 102. In another embodiment, the location analysis module 258 may work in conjunction with the location module 114 to generate geographical data for the client device 102. For example, the location analysis module 258 may receive the IP address of the client device 102 from the location module 114 and use IP geolocation techniques to find the location for the client device 102.
  • After receiving or determining location data for the client device 102, the location analysis module 258 can transform the geographical location data into a point of interest (e.g., the address corresponding to the latitude and longitude coordinates of the client device 102). The location analysis module 258 may also classify the point of interest (e.g., whether the address is a shopping mall, a restaurant, a park, a residence, etc.), which allows the linked content module 270 to select linked content that has a meaningful relationship to a user's surroundings. For example, if a user sends a message containing the word “sweater” while in a shopping mall, the linked content module 270 may link the word “sweater” to an advertisement from a store in the same shopping mall that is having sale on sweaters. The location analysis module 258 can also determine whether the client device 102 is inside a region defined by a “geofence,” which is a polygonal region whose vertices are defined by at least three sets of latitude/longitude coordinates. This function could be used, for example, to determine whether the user is in close proximity to a location of interest, such as a concert. This function could also be used in lieu of performing a point of interest analysis to determine whether the user is present in a large location, such as a particular park or stadium.
  • The location analysis module 258 can also use geographical location data for multiple users in a conversation to find a common region that is accessible to the multiple users. For example, if a first user located in a first city is making plans to go shopping with a second user located in a second city, then the location analysis module 258 may define a common region between the two cites and instruct the linked content module 270 to place more weight on shopping malls inside the common region. The creation of a common region allows the linked content module 270 to select location-based results that are convenient for both users in the conversation.
  • In addition to using geographical data, the location analysis module 258 may also operate in conjunction with the conversation analysis module 254 to infer the location of a user or the desired location of a proposed social event. For example, if a user sends a message that says, “Let's have drinks in Palo Alto tonight,” then the location analysis module 258 may skip any data-based location analysis and simply instruct the linked content module 270 to select results in Palo Alto. The location analysis module 258 may also use data-based location analysis in addition to information inferred from conversation messages. For example, if the message says “Let's have drinks near Palo Alto tonight,” then the location analysis module 258 may still determine the locations of the users in the conversation and define a common region as described above, but the module 258 may also shift the common region so that the region is closer to Palo Alto.
  • The results generated by the location analysis module 258 may change based on the current location of the users, especially if no location can be inferred from the conversation messages. For example, suppose a user is commuting to work in the morning and sends a message that says “Let's have drinks tonight” to two other users and the link generation module 268 turns the word “drinks” into a link. If all three users are in a first city during the day, then the location analysis module 258 would instruct the linked content module 270 to provide results for bars and nightclubs in the first city if one of the users selects the link during the day. However, if the three users travel to a second city after work, then the location analysis module 258 would instruct the linked content module 270 to provide results in the second city when one of the users selects the link. Thus, a link generated for the same message may yield different linked content depending on the instantaneous location of the users in the conversation. Similarly, the results from the point of interest, “geofence,” and common region analysis techniques described above may also vary when the location of one or more users changes.
  • The group dynamics analysis module 260 analyzes user profiles of a group of people in a conversation to find characteristics that are common to the group. For example, if a group of high school students exchange a series of text messages to discuss weekend activities, then the group dynamics analysis module 260 would examine the user profile of each student to determine whether the students share any common interests. For example, the group dynamics analysis module 260 may determine that each of the students enjoy skateboarding and basketball, and the linked content module 270 can use this analysis to link a word in one of the conversation messages to a list of nearby skate parks and basketball courts. Thus, the group dynamics analysis module 260 allows the linked content module 270 to provide relevant linked content in a conversation even if the conversation only contains superficial messages such as “Hey! What should we do this weekend?” and “No idea. I'm fine with anything.” that provide little useable information regarding the group's preferences.
  • The group dynamics analysis module 260 may also take into account the number of people who are participating in a conversation. For example, if a group of six people are exchanging text messages to make plans for a group dinner, then the group dynamics analysis module 260 may instruct the linked content module 270 to filter out restaurants that do not have seating for groups of six or more people. The group dynamics module 260 may also work in conjunction with the conversation analysis module 254 to more accurately predict the number of people who will participate in an event. For example, if a first user of the group in the previous example sends a message to say “Sorry, I can't make it,” while a second user sends a message indicating that he intends to bring three friends with him, then the conversation analysis module 254 may inform the group dynamics analysis module 260 that the first user will not participate in the event, but three additional people will be participating. As a result, the group dynamics analysis module 260 may subsequently ignore the profile information of the first user when determining the common dining preferences of the group and search for dining establishments with seating for groups of eight people rather than six people.
  • The weather analysis module 262 receives and analyzes weather data associated with the locations of users in a conversation to help generate links and refine the linked content that is selected. For example, if a group of users is planning an activity and the weather data indicates that a rainstorm is coming, then the weather analysis module 262 may instruct the linked content module 270 to give more weight to indoor activities (e.g., an arcade). The weather analysis module 262 may also provide weather information to the linked content module 270 if the phrasing analysis module 252 or the conversation analysis module 254 detects a message in which a user expresses a desire to see a weather forecast. For example, if a user sends a message to ask another user, “Have you checked the weather yet?” then the weather analysis module 262 may provide a local weather forecast for the linked content module 270 to add to the message.
  • The image analysis module 264 uses pattern recognition, optical character recognition (OCR), or other image analysis methods to analyze pictures attached to text messages. For example, suppose a user sends a message consisting of the text “What do you think of these?” and a picture of a pair of jeans. Although the text may not contain enough useful information for the phrasing analysis module 252 and the conversation analysis module 256 to interpret, the image analysis module 264 may be able to recognize that the picture contains a pair of jeans and instruct the linked content module 270 to provide the user with linked content related to apparel and shopping (e.g., a coupon to purchase jeans at a discounted price at a nearby shopping center).
  • The global context analysis module 266 analyzes a wide range of data to find relationships between conversation messages and real-world events. The module 266 may receive and analyze data from a number of different third-party services such as social networking systems, news feeds, weblogs, and other sources to find trending topics that have caught the attention of a large group of people. The module 266 may also perform frequency analysis on text messages received by the analysis and targeting module 214 to detect sudden increases in the popularity of certain terms. For example, if a well-known actor is arrested for committing a serious crime, then there would likely be a sudden increase the number of times the actor's name is mentioned on social networks, news articles, weblogs, and text messages. In addition, the extra publicity for the actor is far more likely to be directed toward the crime than the actor's recent movies. The global content analysis module 266 would determine that the actor was recently involved in some sort of significant event and inform the linked content module 270. As a result, the linked content module 270 may link the actor's name to news articles about the actor instead of to local theaters that are screening the actor's most recent movie.
  • The global context analysis module 266 may also operate in conjunction with the location analysis module 258 to add linked content related to events or information near the user's current location. For example, the module 266 may be configured to analyze data related to local traffic conditions, delays at nearby airports, train schedules, or nearby events, such as concerts and sporting events. If the module 266 determines that a message is related to any of this local information, it can forward the appropriate data to the linked content module 270 to be displayed to the user.
  • The link generation module 268 receives text messages from client devices 102 and determines which words and phrases in the text messages will be turned into links. The link generation module 268 may select words and phrases based on analysis performed by any of the analysis modules 252 through 266. Continuing with the previous example, the global content analysis module 266 may instruct the link generation module 268 to turn all instances of the well-known actor's name into a link after detecting that the actor has been involved in a significant event that is receiving a large amount of publicity.
  • In addition, the link generation module 268 may add a link to be displayed independently of the original text of the message. As described above with reference to the messaging module 118 of FIG. 1, this function is useful if the current text message does not contain any character strings that can easily be associated with linked content relevant to the conversation. The added link may be a visual representation (e.g., an icon) or an additional character string; in the example presented with reference to the group dynamics module 260, the linked content module 268 may add skateboard and basketball icons (or an additional character string that reads “nearby skate parks and basketball courts”) to the end of a conversation message and have the added items function as links.
  • The link generation module 268 may also add links to a text message by executing the targeting rules associated with the client device 102 that was used to send the message. In this case, the link generation module 268 accesses the device-rule association table 214 to determine which targeting rules are associated with the client device 102. After determining the targeting rules to be executed, the module 268 retrieves the targeting rules from the targeting rule database 210 and executes the rules on the message. A detailed description of the contents of a targeting rule and the process of executing a target rule is provided in conjunction with FIG. 3 and FIG. 5.
  • To avoid overwhelming the user with a large number of links, the link generation module 268 may be configured to stop adding links after meeting certain threshold. For example, the module 268 may be configured to add a maximum of five links to every ten messages in a conversation. The link threshold may alternatively be defined at the message level. For example, the module 268 may be configured to add a maximum of two links to a single text message in a conversation. The link generation module 268 may also limit the number of added links by maintaining a fixed separation between consecutive links in a message or conversation. For example, the module 268 may be configured to separate consecutive links by at least four words. The module 268 may also be configured to maintain an average number of links per word (e.g., one link for every six words).
  • After the link generation module 268 turns certain words and phrases of a message into links, the linked content module 270 selects the linked content that will be displayed when the user selects the links. In one embodiment, the linked content module 270 chooses the linked content as soon as the link generation module 268 selects the words and phrases that are to be turned into links. Configuring the linked content module 270 to select the linked content immediately after the link generation module 268 chooses the links beneficially increases the speed with which the linked content can be displayed after a user selects the corresponding link. In addition, selecting the linked content before a link is selected enables the messaging module 118 to display indicator icons or other visual representations next to the links, as described with reference to FIG. 1. Alternatively, the linked content module 270 may select the linked content corresponding to a link responsive to receiving a notification from the client device 102 indicating that the user has selected the link. This beneficially prevents the linked content module 270 from searching for linked content corresponding to links that are not selected, thus reducing the computing load on the processor 122 and increasing the performance and responsiveness of the processing server 120.
  • The linked content module 270 may select linked content based on the results of any of the analysis modules 252 through 266. In addition, the linked content module 270 may combine the results from multiple analysis modules 252 through 266 when selecting linked content. For example, if the group dynamics analysis module 260 determines that all three people in a conversation enjoy Indian food, the conversation analysis module 254 and temporal analysis module 256 determine that the three people wish to eat lunch at noon, and the location analysis module 258 can generate a common region that is accessible to the three people, then the linked content module 270 would retrieve a list of Indian restaurants that are located in the common region and will be open at noon. In addition, the linked content module 270 may select content based on any targeting rules whose conditions have been satisfied.
  • The selected linked content may be any content that is relevant to the conversation and the linked word. Linked content may include, for example, search engine results, news articles, listings for local restaurants, shopping malls, or movie theaters, reviews of movies, weather conditions or forecasts, images, or maps. The linked content module 270 may also include paid advertisements as part of the selected linked content.
  • Any of the analysis modules 252 through 266 may also use data from the analysis database 208 to refine the results that the modules 252 through 256 provide to the link generation module 268 and the linked content module 270. For example, if data in the analysis database 208 indicates that people are more likely to go to a fast food establishment for lunch than for dinner, then the temporal analysis module 256 may instruct the linked content module 270 to give more weight to fast food restaurants when providing linked content to users who are making lunch plans.
  • The subject matter described with reference to the analysis modules 252 through 266 does not provide a comprehensive description of the functionality of the analysis and targeting module 216. In other embodiments, the analysis and targeting module 216 may use other analysis methods either in addition to or in place of the methods described herein to refine the linked content that is provided to users. In addition, the functionality of any of the analysis modules 252 through 266 described herein may be combined or divided into additional or different modules. For example, a single text analysis module may be configured to perform the functions of the phrasing analysis module 252 and the conversation analysis module 254.
  • In addition to analyzing messages that are exchanged between users, the analysis and targeting module 214 may also be configured to provide results for queries that users submit directly to the processing server 120. In one embodiment, an additional module on the client device 102 may present the user with a user interface that allows the user to input key words and, optionally, input the names of other users. The ability to directly submit queries to the processing server 120 beneficially allows users to access the targeted search functions of the analysis and targeting module 214 without exchanging any text messages. For example, suppose a user wishes to make lunch plans with two co-workers who are working in nearby cubicles. Instead of sending a text message to the two co-workers, the user may submit a query with the keywords “restaurant lunch today” and the names of two other users. After receiving the query, the analysis and targeting module 214 would provide the user with a list of nearby restaurants that are open for lunch and match the overlapping dining preferences of the three users. Once the user chooses a restaurant from the list, the user may simply inform the two co-workers by walking over to their respective cubicles.
  • A user may also request linked content for a word or phrase in a message that was not turned into a link. For example, suppose a user receives the message “Let's go for a bike ride through Shoreline Park” and the link generation module 268 turned “Shoreline Park” into a link but did not turn “bike” into a link. If the user wishes to view linked content associated with the word “bike” (e.g., to view a list of local bike shops), then the user may select the word “bike” and have the analysis and targeting module 214 generate the results. In one embodiment, the ability to request linked content for a word is implemented by simply performing a query using relevant words in the message as key words.
  • Alternatively, the linked content module 270 may provide the user with multiple categories of linked content if the analysis and targeting module 214 is unable to determine a single meaning for a link. For example, suppose a user receives the same message as in the previous example, except the phrasing analysis module 252 turns the phrase “bike ride through Shoreline Park” into a single link. In this case, the linked content module 270 may provide the user with a list of local bike shops, weather information for the area, and a map with directions to Shoreline Park. To avoid overwhelming the user with a large amount of information, the client device 102 may be configured to display the information in three separate pages or tabs.
  • In one embodiment, a user may opt out of providing some or all of the information that is used by the analysis and targeting module 214. For example, a user may configure his or her client device 102 so that the device 102 does not send any geographical location data to the location analysis module 258. As described above with reference to FIG. 2A, a user may also prevent the user profile manager 202 from collecting certain information about the user, such as the user's demographic information or dining preferences. Although providing less user information may cause the analysis and targeting module 216 to generate less relevant results, it beneficially allows users to preserve their privacy and maintain control of their personal information.
  • FIG. 3 is a block diagram illustrating an example data structure for implementing a targeting rule 300, according to one embodiment. The targeting rule 300 contains a primary condition 302, one or more secondary conditions 304, and a function 306. In addition, the targeting rule 300 may optionally specify a priority value 308, a display method 310, and a selection method 312. As a whole, the purpose of a targeting rule 300 is to add the predetermined function 306 to any message that satisfies the conditions 302, 304.
  • When executing a targeting rule 300, the link generation module 268 analyzes the primary condition 302. If the primary condition 302 is satisfied, then the link generation module 268 proceeds to analyze the secondary conditions 304. The primary condition 302 is typically based on a set of character strings (e.g., words or phrases); if at least one character string in the set is present in a text message, then the primary condition 302 is satisfied. For example, if the targeting rule 300 is meant to promote a Ford dealership in San Jose, then the primary condition 302 may instruct the link generation module 268 to determine whether a character string from the set consisting of “Ford,” “Mercury,” “new car,” and “test drive” is present.
  • The primary condition 302 may also be based on results from any of the analysis modules 252 through 266. In particular, the primary condition may be based on the context of the conversation as determined by the conversation analysis module 254. For example, if the targeting rule 300 is meant to display a coupon for a restaurant, the primary condition 302 may be satisfied when the conversation analysis module 254 determines that the conversation is about dinner. In this case, the primary condition 302 may also specify a set of generic food-related character strings (“food,” “meet,” “eat,” etc) that the link generation module 268 may turn into links when used in a conversation related to dinner plans.
  • The secondary conditions 304 are additional conditions that are to be satisfied before the function 306 is added to the text message. Secondary conditions 304 may be used to add precise targeting criteria to increase the probability that the function 306 will be displayed to a suitable group of users. To continue with the previous example, the targeting rule 300 for promoting the Ford dealership in San Jose may contain a secondary condition 304 that requires a client device 102 to be located within the city of San Jose. If the dealership is having a sale on pickup trucks, further secondary conditions 304 may be created so that the function 306 is only added to a text message if the user is a 25-to-34-year-old male.
  • Any of the secondary conditions 304 may also be based on results from the analysis modules 252 through 266. For example, a secondary condition 304 may be satisfied when a client device is inside a region defined by a “geofence,” as described with reference to the location analysis module 258. A different secondary condition 304 may configured so that it is satisfied when the group dynamics analysis module 260 determines that every user in a group of at least five users enjoys Indian food. The ability to use results from the analysis modules 252 through 266 beneficially allows for the creation of precise targeting rules 300 that are displayed to users who meet a strict set of conditions.
  • The function 306 of the targeting rule 300 defines an action that occurs on the client device 102 after a user selects a link that was generated based on the targeting rule 300. The function 306 can define any action that the client device 102 is capable of performing. For example, the function 306 can prompt an action of displaying any sort of information (e.g., a list of places, an advertisement, a map, weather conditions, etc), playing a video or audio file, launching a different application on the client device 102, or sending a text message. If one of the secondary conditions 304 limits the rule 300 to a certain type of client device 102 (e.g., mobile phones), then the function 306 can also specify an action that is specific to the type of client device 102 (e.g., trigger a phone call).
  • The function 306 is typically presented as part of other results that the linked content module 270 selected for the link. For example, if the function 306 of a targeting rule 300 is to place a call to a local Indian restaurant, then an option to call the restaurant may be displayed together with information for other nearby Indian restaurants that were selected by the linked content module 270. Presenting the function 306 together with other linked content beneficially allows users to see a more diverse range of information. However, a targeting rule 300 may also be configured so that its function 306 is the only option that appears after selecting a link. This is a reasonable option for brand names and trademarked terms. For example, a targeting rule 300 for the fast food chain MCDONALDS may be configured to generate a link for the character string “Mcdonalds” and exclusively display nearby MCDONALDS locations when a user selects the link.
  • The targeting rule 300 may optionally contain a display method 308 and a selection method 310. If the primary and secondary conditions 302, 304 are satisfied and the targeting rule 300 results in the creation of a link, then the display method 308 and selection method 310 determine how the user interacts with the link.
  • The display method 308 determines how the messaging module 118 displays the link to the user. The display method 308 may specify that the linked character string be formatted differently (e.g., underlined, displayed in a different font, highlighted, etc.) or specify that an icon be placed next to the link. The display method 308 may also include a non-visual signal either in addition to or in place of a change in formatting. For example, the display method 308 could activate a vibration device in the client device 102 or cause the client device 102 to play a sound effect. The ability to define a display method 308 beneficially allows the creator of the targeting rule 300 to make a link stand out from the rest of the message. For example, an advertiser that wishes to invoke a preexisting brand association may create a targeting rule 300 that causes one of their trademarks to be displayed in the same color and font as their logo (e.g., the string “STARBUCKS” may be displayed in white text and green highlighting to match the colors of the company's logo).
  • The selection method 310 determines how the user selects the link. For example, the selection method 310 may specify that the user can select the link by clicking, tapping on, or rolling over the link, or by performing a predefined mouse or touchscreen gesture. The selection method 310 may also use other input methods, such as having the user shake the client device 102 in a manner that can be detected by an accelerometer in the device 102, give the client device 102 a voice command via a microphone, or press an dedicated external button on the device 102.
  • If the targeting rule 300 does not contain a display method 308 or selection method 310, then the messaging module 118 may use a set of predefined default settings to display the link and allow the user to select the link. Since a customized display method 308 and selection method 310 can be used to demonstrate a single entity's ownership of a particular word or phrase, it is common for a targeting rule 300 to omit the display method 308 and selection method 310 if the set of character strings defined in the primary condition 302 contains generic terms that are likely to yield other results in addition to the specified function 306. For example, the targeting rule 300 for the Ford dealership in San Jose might omit the display method 308 and selection method 310 because the linked content module 270 is likely to retrieve and display results for additional car dealerships if the strings “new car” or “test drive” are turned into links and selected by the user.
  • The targeting rule 300 may also contain a priority value 312 that defines a priority for the rule 300. If multiple targeting rules 300 are associated with a client device 102, then the priority value 312 determines the order in which the link generation module 268 executes the rules 300. As described above with reference to FIG. 2B, the link generation module 268 may impose a limit on the number of links that can be added to a single conversation or message. Thus, an advertiser that is using a targeting rule 300 to deliver an advertisement may pay an additional advertising fee for a higher priority value.
  • If one of the rules 300 associated with a client device 102 does not have a priority value 312, then the link generation module 268 may automatically give the rule 300 a lower priority than the rules that do have priority levels. Alternatively, the link generation module 268 may automatically give the rule 300 a higher priority (e.g., rules without priority values may be reserved for especially important content) or assign an arbitrary priority value to the rule 100. Meanwhile, if none of the rules 300 associated with a client device 102 have priority values, then the link generation module 268 may simple execute the rules 300 in an arbitrary order.
  • At a high level, the analysis and targeting module 214 uses two distinct but related methods for adding links and corresponding linked content to text messages. In the first method, the analysis modules 252 through 266, the link generation module 268, and the linked content module 270 operate together to analyze conversation messages and automatically generate links and linked content for the messages. In the second method, the link generation module 268 and the linked content module 270 generate links and linked content by executing predefined targeting rules, and the targeting rules may be based on results from the analysis modules 252 through 266.
  • The first method (i.e., automatic generation) is beneficially able to provide linked content that is more dynamic, relevant, and up-to-date. In particular, it may be difficult to implement the functionality of analysis modules that are based on actively changing external data (e.g., the global content analysis module 266) as targeting rules 300. Meanwhile, the second method (i.e., executing targeting rules) may be performed with fewer computing resources (i.e., a faster response time) and provides advertisers and other content providers with a straightforward way of targeting their content to users. Given that both methods come with specific benefits and drawbacks, it is typically beneficial to configure the analysis and targeting module 214 to use both methods together.
  • Examples of Linked Content
  • FIGS. 4A and 4B are screenshots that illustrate some examples of how linked content may be added to text-based personal communications, according to one embodiment. In the screenshot 400 of FIG. 4A, a first user is shown exchanging messages with a second user (John) early in the morning, and the two users make plans to go to a café together later in the morning. After each message is received at one of the two users' client devices 102, the message is sent to the analysis and targeting module 214, which performs multiple types of analysis on each message and on the conversation as a whole.
  • In the third message, the first user mentions that “it's a nice sunny day.” After receiving this message, the phrasing analysis module 252 determines that the term “sunny day” 406 is a single phrase and that the presence of the term in the message indicates that the first user may be interested in viewing current weather conditions. As a result, the module 252 instructs the link generation module 268 to turn the entire term 406 (e.g., “sunny day”) into a link, and the weather analysis module 262 retrieves the current weather conditions for the first user's location so that it can be displayed if the user selects the “sunny day” link 406.
  • As the two users exchange messages, the conversation analysis module 254 detects that the two users are planning a social activity and works with the temporal analysis module 256 to predict a timeframe for the proposed activity. Based on the timestamps 404 of the messages and the word “morning” 402 in the first message, the modules 254, 256 may predict that the two users plan to make their trip sometime between 8:20 AM and noon. As a result, the modules 254, 256 instruct the linked content module 270 to filter out results for establishments that will be not open during those hours. The conversation analysis module 254 also detects the word “outside” 408 in the third message. Although the word 408 is not significant enough to be turned into a link, the conversation analysis module 254 determines that the two users would prefer to engage in an activity outdoors.
  • After the fourth message, the analysis and targeting module 214 has received enough information to determine that the two users wish to visit a café with outdoor seating later in the morning. As a result, the link generation module 268 turns the word “café” 410 in the fourth message into a second link. Meanwhile, the location analysis module 258 receives geographical location data from the two users' client devices 102 and generates a common region that is accessible to both users. The linked content module 270 subsequently generates a list of cafés that satisfy the conditions determined by the analysis and targeting module 214 and are located inside the common region.
  • FIG. 4B is a screenshot 420 of the list of cafés that is displayed to the user after the user selects the “café” link 410 in the previous screenshot 400. In addition to the results 424 through 432 that were retrieved by the linked content module 270 based on the results of the analysis modules 252 through 266, there may also be additional results from advertisers. In the example shown, STARBUCKS pays to have their closest location placed at the top of the list 422, and a star 422A indicates that the first result was added as a paid advertisement.
  • The addition of the advertisement may be the result of a targeting rule 300 that was executed by the link generation module 268 and the linked content module 270. Alternatively, the linked content module 270 may have found the STARBUCKS location while searching for the other cafés, and STARBUCKS may have simply paid an extra fee to have their locations shifted to the top whenever they show up in a list. The ability to add targeted content to text messages is extremely valuable to advertisers because the users who view the advertisements are much more likely to partake in whatever is being advertised.
  • Adding Linked Content to Text Messages
  • FIG. 5 is an interaction diagram illustrating a process for using the processing server 120 of FIG. 1 to add linked content to a text message, according to one embodiment. The processing server 120 generates 502 one or more targeting rules. As described with reference to FIG. 2A and FIG. 3, targeting rules can used to add linked content to text messages that meet a set of predefined conditions. As described above with reference to FIG. 3, targeting rules are particularly useful to advertisers because the targeting rules give advertisers a way of displaying advertisements to extremely specific and narrowly-defined groups of users who are especially likely to be interested in the content of the advertisement. Thus, an advertiser may work with an administrator of the processing server 120 to generate 502 a targeting rule to distribute an advertisement. Alternatively, the processing server 120 may provide advertisers with a computer tool that the advertisers can use to generate targeting rules and transfer the rules to the processing server. In addition, the processing server 120 may also generate 502 targeting rules that are used to distribute non-advertising content.
  • After the processing server 120 generates 502 or receives one or more targeting rules, the rules are stored in the targeting rule database 210 and the pre-screening module 212 pre-screens each rule to determine 504 a list of eligible client devices 102 that are likely to satisfy the conditions defined in the rule. As described with reference to FIG. 2A, the pre-screening module 212 operates by determining whether a client device 102 and its corresponding user profile matches matching one or more pre-screening criteria (which are selected from the conditions 302, 304 of the rule). The pre-screening module 212 then proceeds to associate 506 the targeting rule with the eligible client devices 102 and stores the associations in the device-rule association table 214.
  • Meanwhile, the client device 102 receives 508 a text message and sends 510 the message to the processing server for analysis. The client device 102 may also send 510 related data (e.g., the current location data of the device 102) along with the message. After receiving the message, the analysis and targeting module 214 analyzes 512 the message using a wide range of techniques to add one or more links to the message. As described with reference to FIG. 2B and FIG. 3, the analysis and targeting module 214 may automatically add a link based on results from one or more of the analysis modules 252 through 266, or the module 214 may add a link after executing a targeting rule 300 and determining that the conditions of the rule 302, 304 have been satisfied.
  • The message may also originate from a non-text-based message. For example, a third-party voice mailbox system may receive an audio message for the user and use voice recognition algorithms to generate a text message corresponding to the audio message. The resulting text message may be sent 510 directly to the processing server 120, or it may first be sent to the client device 102 and relayed to the processing server 120. Alternatively, the processing server 120 may also include one or more modules for processing audio messages, text messages, or other types of messages, and these messages may be received directly at the processing server 120 to eliminate the need to send 510 the message from the client device 102 to the server 120. In either case, the processing server 120 analyzes 512 and adds links to the text message in the manner described above.
  • After the links are links added to the message, the processing server 120 sends 514 the message back to the client device 102, and the messaging module 118 displays 516 the message with the links. The linked content module 270 may optionally select the linked content corresponding to each link and send 514 the linked content along with the message. If the client device 102 receives 518 a link selection from the user, then the messaging module 118 displays 520 the linked content corresponding to the selected link. As described above with reference to the messaging module 118 of FIG. 1, the linked content may have been sent along with the message. The client device 120 may also retrieve 520A the linked content from the processing server 102 after the user selects the link.
  • Alternatively, the linked content module 270 may use results from the analysis modules 252 through 266 to generate a series of instructions that the client device 102 can use to retrieve the linked content from a third party and associate the instructions with the corresponding link. For the example conversation shown in the screenshot 400 of FIG. 4A, the linked content module 270 may generate instructions for the client device 102 to use a local search service (e.g., YELP) to find a café that is located near the two users, has outdoor seating, and is open between 8:20 AM and noon on the day the messages were sent, and associate the instructions with the link for the word “café” 410 in the fourth message. In this case, the instructions are sent 514 along with the message, and the client device 102 retrieves 520B the linked content from a third-party server 130 after receiving 518 a user's selection of the link 410.
  • The client device 102 also sends 522 data about the user's selections back to the processing server 102, and the data analysis module 206 analyzes 524 the data and stores the data in the analysis database 208. The data in the analysis database 208 can subsequently used to refine the linked content that is provided to other users. For example, if users repeatedly select the fourth choice (Alana's Café) 428 in the example linked content 420 shown in FIG. 4B, then Alana's Café may be shown as the second choice to future users who are looking for a café in the same area. Although the process of sending 522 the selection data is shown as occurring after the client device 102 displays 520 the linked content, the client device 102 may also send selection data in response to receiving 518 a link selection.
  • The data generated by the analysis 524 can also be used to enhance the advertising capabilities of the system 100. For example, an advertiser may specify that an advertisement be displayed to a predefined number of unique users, be displayed with a particular frequency (e.g., 100 times per day), or define a length of time that should elapse between consecutive displays of the advertisement. It is also possible to monitor users' reactions to the advertisement. The analysis of the selection data 524 may determine how frequently users select the advertisement, how long users spend viewing the advertisement, or how many users interact with the advertisement in a certain way (e.g., select a link within the advertisement to visit a web page, make a defined transaction, etc). Since the data analysis module 206 can reliably keep track of any of these parameters, these parameters may be used as a basis for calculating advertising fees.
  • Alliterative Embodiment Client-Side Message Analysis
  • FIG. 6A is a block diagram illustrating the messaging module 116 of FIG. 1, in accordance with an alternative embodiment. In this embodiment, the client device 102 does not send messages to the processing server 120 for analysis. Instead, the messaging module 116 on the client device 102 contains additional components for analyzing messages and adding relevant linked content to the messages.
  • The message processing engine 602 performs the functions associated with exchanging and displaying text messages. As described with reference to FIG. 1, this includes sending and receiving text messages over a variety of protocols and displaying the messages in conjunction with the corresponding links and linked content. The message store 604 stores text messages that the message processing engine 602 previously sent or received. Storing messages locally allows the client-side analysis and targeting module 608 to perform conversation analysis and temporal analysis. The targeting rule store 606 stores targeting rules that the pre-screening module 212 associates with the client device 102. It is beneficial to maintain a local copy of the targeting rules because the message analysis is performed locally.
  • The client-side analysis and targeting module 608 performs message functions that are analogous to the analysis and targeting module 216 of the embodiment described with reference to FIG. 2. However, some components of the client-side analysis and targeting module 608 operate differently because the client device 102 does not have access to as much information as the processing server 120. A description of these differences and of the general operation of the client-side analysis and targeting module 608 is presented below with reference to FIG. 6B.
  • FIG. 6B is a block diagram illustrating a detailed view of the client-side analysis and targeting module 608, according to the alternative embodiment of FIG. 6A. Since client devices 102 normally interact with the processing server 120 via a remote connection over the network 132, the client-side analysis and targeting module 608 might have limited access to the data that is maintained in the linked content management module 128 (e.g., the data in the user profile store 204 and the analysis database 208). In some circumstances, the client-side analysis and targeting module 608 might be completely unable to access this data (e.g., if the client device 102 is unable to communicate with the processing server 120 or if the processing server malfunctions 120). In addition, the client-side analysis and targeting module 608 may not be able to directly access information on other client devices 102, either due to privacy restrictions on the other client devices 102 or due to unreliable connections over the network 132. Thus, some of the analysis modules 652 through 666 in the client-side analysis and targeting module 608 may be reconfigured to be make more effective use of data that is stored locally on the client device 102 and less dependent on data that is stored remotely.
  • Since the phrasing analysis module 652, conversation analysis module 654, and temporal analysis module 656 perform analysis that is primarily based on the content of the text messages, these modules 652, 654, 656 may simply retrieve any relevant messages from the message store 604 and perform substantially the same analysis as the analogous modules 252, 254, 256 described with reference to the embodiment of FIG. 2B.
  • The location analysis module 658 receives geographical location data from the location module 114 and can perform a point-of-interest analysis or determine whether the client device 102 is inside a “geofence.” However, the location analysis module 658 may not be able to retrieve location data for other users in a conversation (e.g., the other users might configure their client devices 102 so that the location module 114 does not send location data to other client devices). If location data is not available for other users, then location analysis module 658 is not able to generate a common region that can be used to select location based results that are convenient to multiple users in a conversation.
  • The group dynamics analysis module 660 relies on being able to access and analyze user profiles of multiple people in a conversation. If the module 660 is not able to access the user profile store 204 in the processing server 120 (or if the present embodiment of the processing server 120 does not include a user profile store 204), then the module 660 retrieves information from the user profile modules 116 of other client devices 102 that are part of the conversation. However, users may also have the option of restricting or denying access to the user profile module 116 on their client devices 102. If the group dynamics analysis module 660 is unable to gain access to both the user profile store 204 and the user profile modules 116 of other client devices 102, then the module 660 may simply analyze the user profile module 116 of the client device 102 on which it resides and perform its analysis based solely on a single user's preferences.
  • Similar to the phrasing analysis module 652, the conversation analysis module 654, and the temporal analysis module 656, the weather analysis module 662 and the image analysis module 664 perform substantially the same analysis as the analogous modules 262, 264 described with reference to FIG. 2B. However, if location data for other client devices 102 in the conversation is not accessible, the weather analysis module 662 may be limited to retrieving and analyzing weather data corresponding to the location of the client device 102 on which it resides. Meanwhile, the image analysis module 664 may be constrained by the weaker computing capabilities of the client device 102 and may not be able to perform an equally thorough analysis as the image analysis module 264 of the embodiment of FIG. 2B.
  • Although it would be possible to implement the global context analysis module 666 on a client device 102, it would be impractical on most client devices 102 because the device would have to receive a large amount of data from third party servers 130 and perform processor- and memory-intensive data analysis. Thus, it may be preferable to simply omit the global context analysis module 666 in most embodiments.
  • In contrast to the corresponding modules 268, 270 in FIG. 2B, the link generation module 668 and linked content module 670 may be configured to rely more heavily on executing targeting rules rather than automatically generating links based on the results of the analysis modules 652 through 666. This may be done, for example, by configuring the link generation module 668 to execute the rules in the targeting rule store 606 before using the results of the analysis modules 652 through 666 to automatically generate any links. If the execution of the targeting rules generates enough links to exceed the link threshold for the message or for the conversation, then the process of automatically generating links may be skipped.
  • As described above with reference to FIG. 2B and FIG. 3, the link generation module 668 executes a targeting rule 300 by determining whether the conditions 302, 304 defined in the targeting rule 300 are satisfied, and any of the conditions may be based on a result from one of the analysis modules 652 through 666. If the conditions 302, 304 are satisfied, then the link generation module 668 turns the appropriate word or phrase in the message into a link, and the linked content module 270 associates the function 306 of the targeting rule 300 with the link.
  • If multiple targeting rules are to be executed at once, the link generation module 268 starts by analyzing the secondary conditions 304 of each targeting rule to determine what information will be used in the conditions. Next, the link generation module 268 collects the information from the various analysis modules 652 through 666 or from other components of the client device 102 or the system 100 and temporarily stores the information in the memory 106 of the client device 102. For example, suppose the targeting rule store 606 contains a first targeting rule specifying that the user must be inside the city of San Jose and be male, and a second targeting rule specifying that the user must be in San Jose and that a message must be sent between 7 AM and 10 AM. When the user sends or receives a message, the link generation module 268 would use the location analysis module 658 to determine whether the user is in San Jose, use the temporal analysis module to determine the time of day that the user's message was sent, and access the user profile module 116 to determine whether the user is male. After the information is collected and stored in the memory 106, the link generation module 668 can rapidly check the primary and secondary conditions 302, 304 with reduced lag. In addition, the link generation module 268 does not retrieve information that is not used in any of the conditions (e.g., the user's age, current weather conditions, or group dynamics).
  • This process of collecting relevant information before executing multiple rules at once prevents the link generation module 668 from retrieving unneeded information or retrieving the same information twice (e.g., the user's location information was only collected once even though it is used in both rules), which beneficially allows the rules to be executed faster and with fewer computing resources. While this process of evaluating multiple rules at once may also be performed on the processing server 120 in the embodiment described with reference to FIG. 2B, it is especially beneficial when performed on a client device 102 because many types of client devices 102 (e.g., smartphones, tablet computers, or other portable electronics) have limited power, memory 106, and processing resources 104.
  • FIG. 7 is an interaction diagram illustrating a process for using the client device 102 to add linked content to a text-based personal communication, according to the alternative embodiment of FIG. 6A. Similar to the diagram in FIG. 5, the process begins when the processing server 120 generates 702 targeting rules and pre-screens the rules based on pre-screening criteria to determine 704 a list of eligible client devices 102 that are likely to satisfy the conditions defined in the rule.
  • Since the client-side analysis and targeting module 608 may be configured to rely more heavily on targeting rules, the processing server may generate 702 additional targeting rules to add links that would normally be generated automatically. For example, one targeting rule could specify that any word from the set consisting of “today,” “cloudy,” “sunny,” “rain,” and “weather” be turned into a link for displaying current weather conditions. While the conversation analysis module 654 and the weather analysis module 662 would normally work in conjunction to automatically identify these words and link one of them to current weather conditions, executing the targeting rule would yield roughly the same result. In addition, executing the targeting rule may use fewer computing resources than analyzing the context of the conversation to determine whether a user has expressed a desire to see weather information.
  • After determining 704 the eligible client devices 102 for each targeting rule, the processing server 120 loads 706 each targeting rule onto the corresponding client devices 102. As a result, each client device 102 receives a set of pre-screened targeting rules with conditions that the client device and the corresponding user profile are likely to satisfy. Upon receiving the rules, the messaging module 118 stores 708 the rules in the targeting rule store 606.
  • At some point after storing 708 the targeting rules, the client device receives 710 a message and the client-side analysis and targeting module 608 analyses 712 the message to turn some of the words and phrases in the message into links. As described with reference to FIG. 6B, the client-side analysis and targeting module 608 may be configured to analyze 712 the message by executing the targeting rules before attempting to automatically generate any links. Alternatively, the module 608 may rely exclusively on the targeting rules to analyze 712 the message and skip the process of automatically generating links altogether. In either case, the module 608 may access 712A a third party server 130 (e.g., to retrieve weather conditions or associate the geographical location data with a point of interest) or retrieve 712B data from the processing server 120 (e.g., user profile data) when analyzing the message.
  • After analyzing 712 the message, the message processing engine 602 displays the message to the user and the client device 102 may receive 716 an input from the user indicating that the user wishes to select one of the links. In response to receiving 716 the link selection, the message processing engine 602 displays 718 the linked content corresponding to the user. If the link was generated by a targeting rule, then the client device may simply perform the function 306 that was defined in the targeting rule. If the link was generated automatically, then any of the display methods described with reference to the embodiment of FIG. 5 may be used. In both cases, the client device may once again retrieve 718A information from a third-party server or access 718B the processing server to display the linked content.
  • Similar to the embodiment described with reference to FIG. 5, the client device 120 also sends 720 selection data back to the processing server 120 for analysis 722 and storage. The data may subsequently be used to define more effective targeting rules, calculate fees for advertisements, or for other purposes.
  • In general, performing the message analysis functions of the system 100 on the client device 102 may result in less dynamic and relevant linked content. However, performing message analysis on the client device 102 beneficially reduces the time associated with analyzing the message because there is no need to send the message to the processing server 120 and wait for the message to be sent back to the client device 102. In addition, although the embodiment described with reference to FIGS. 2A through 5 contains features to preserve users' privacy, users may find that a system that does not send data to a remote server for analysis allows for even greater privacy of their personal information.
  • In still another embodiment, the analysis functions of the system 100 are divided between the client device 102 and the processing server 120. In this embodiment, the analysis and targeting module 214 on the linked content management module 128 may be configured to perform analysis that relies more heavily on resources that are available on the processing server 120. For example, the group dynamics analysis module 260, and the global context module 266 may be implemented on the processing server. Meanwhile, the client-side analysis and targeting module 608 may perform analysis that relies on information that is readily available on the client device 102 (e.g., the user's location) or analysis that involves any personal information that a user does not wish to send to a remote server.
  • Additional Configuration Considerations
  • The disclosed embodiments beneficially allow for the addition of highly precise and targeted linked content to text messages. In contrast to targeted internet advertisements that are shown on computers, the widespread popularity of text messages allows linked content to be delivered to users while the users are in a wide range of real world situations, and the range of analysis methods that are used to characterize each text message allows for the selection of linked content that is relevant to users. This greatly enhances the interactivity of text messages and provides users with information that they are likely to find valuable.
  • Throughout this specification, plural instances may implement components, operations, or structures described as a single instance. Although individual operations of one or more methods are illustrated and described as separate operations, one or more of the individual operations may be performed concurrently, and nothing requires that the operations be performed in the order illustrated. Structures and functionality presented as separate components in example configurations may be implemented as a combined structure or component. Similarly, structures and functionality presented as a single component may be implemented as separate components. These and other variations, modifications, additions, and improvements fall within the scope of the subject matter herein.
  • Certain embodiments are described herein as including logic or a number of components, modules, or mechanisms. Modules may constitute either software modules (e.g., code embodied on a machine-readable medium or in a transmission signal) or hardware modules. A hardware module is tangible unit capable of performing certain operations and may be configured or arranged in a certain manner. In example embodiments, one or more computer systems (e.g., a standalone, client or server computer system) or one or more hardware modules of a computer system (e.g., a processor or a group of processors) may be configured by software (e.g., an application or application portion) as a hardware module that operates to perform certain operations as described herein.
  • In various embodiments, a hardware module may be implemented mechanically or electronically. For example, a hardware module may comprise dedicated circuitry or logic that is permanently configured (e.g., as a special-purpose processor, such as a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations. A hardware module may also comprise programmable logic or circuitry (e.g., as encompassed within a general-purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
  • The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions. The modules referred to herein may, in some example embodiments, comprise processor-implemented modules.
  • The one or more processors may also operate to support performance of the relevant operations in a “cloud computing” environment or as a “software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application program interfaces (APIs).)
  • The performance of certain operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the one or more processors or processor-implemented modules may be located in a single geographic location (e.g., within a home environment, an office environment, or a server farm). In other example embodiments, the one or more processors or processor-implemented modules may be distributed across a number of geographic locations.
  • Some portions of this specification are presented in terms of algorithms or symbolic representations of operations on data stored as bits or binary digital signals within a machine memory (e.g., a computer memory). These algorithms or symbolic representations are examples of techniques used by those of ordinary skill in the data processing arts to convey the substance of their work to others skilled in the art. As used herein, an “algorithm” is a self-consistent sequence of operations or similar processing leading to a desired result. In this context, algorithms and operations involve physical manipulation of physical quantities. Typically, but not necessarily, such quantities may take the form of electrical, magnetic, or optical signals capable of being stored, accessed, transferred, combined, compared, or otherwise manipulated by a machine. It is convenient at times, principally for reasons of common usage, to refer to such signals using words such as “data,” “content,” “bits,” “values,” “elements,” “symbols,” “characters,” “terms,” “numbers,” “numerals,” or the like. These words, however, are merely convenient labels and are to be associated with appropriate physical quantities.
  • Unless specifically stated otherwise, discussions herein using words such as “processing,” “computing,” “calculating,” “determining,” “presenting,” “displaying,” or the like may refer to actions or processes of a machine (e.g., a computer) that manipulates or transforms data represented as physical (e.g., electronic, magnetic, or optical) quantities within one or more memories (e.g., volatile memory, non-volatile memory, or a combination thereof), registers, or other machine components that receive, store, transmit, or display information.
  • As used herein any reference to “one embodiment” or “an embodiment” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
  • Some embodiments may be described using the expression “coupled” and “connected” along with their derivatives. For example, some embodiments may be described using the term “coupled” to indicate that two or more elements are in direct physical or electrical contact. The term “coupled,” however, may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other. The embodiments are not limited in this context.
  • As used herein, the terms “comprises,” “comprising,” “includes,” “including,” “has,” “having” or any other variation thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Further, unless expressly stated to the contrary, “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
  • In addition, use of the “a” or “an” are employed to describe elements and components of the embodiments herein. This is done merely for convenience and to give a general sense of the invention. This description should be read to include one or at least one and the singular also includes the plural unless it is obvious that it is meant otherwise.
  • Upon reading this disclosure, those of skill in the art will appreciate still additional alternative structural and functional designs for a system and a process for adding linked content to text-based communications through the disclosed principles herein. Thus, while particular embodiments and applications have been illustrated and described, it is to be understood that the disclosed embodiments are not limited to the precise construction and components disclosed herein. Various modifications, changes and variations, which will be apparent to those skilled in the art, may be made in the arrangement, operation and details of the method and apparatus disclosed herein without departing from the spirit and scope defined in the appended claims.

Claims (21)

What is claimed is:
1. A method for providing information associated with a text message, comprising:
receiving a text message, the text message for transmittal from a remote device to a client device via a network using a push technology to establish or continue a conversation between a plurality of users;
identifying at least one character string within the text message, each of the identified character strings associated with information likely to be inquired by at least one of the plurality of users within a context of the conversation;
generating, for each of the identified character strings, the information likely to be inquired by the at least one of the plurality of users;
processing the identified character strings for displaying at the client device, the identified character strings displayed in a manner distinguishable from other text in the text message; and
processing a content item for execution at the client device, the content item corresponding to one of the identified character strings, and the content item representing at least part of the information likely to be inquired by the at least one of the plurality of users.
2. The method of claim 1, wherein the text message is received from the client device.
3. The method of claim 1, further comprising receiving at least one additional text message in the conversation between the plurality of users.
4. The method of claim 3, wherein generating the information likely to be inquired by the at least one of the plurality of users comprises analyzing the text message together with the at least one additional text message.
5. The method of claim 1, wherein generating the information likely to be inquired by the at least one of the plurality of users comprises analyzing user profiles associated with one or more of the plurality of users.
6. The method of claim 1, wherein processing the identified character strings comprises sending the identified character strings to the client device for displaying at the client device.
7. The method of claim 1, wherein processing a content item comprises sending the content item to the client device for execution at the client device.
8. The method of claim 1, further comprising generating at least one targeting rule, each targeting rule containing:
a primary condition for identifying one or more character strings in the text message based on matching to a set of predefined character strings;
at least one secondary condition, each secondary condition for identifying a characteristic related to the text message; and
a function to be executed at the client device.
9. The method of claim 8, wherein identifying at least one character string within the text message comprises:
determining whether one of the predefined character strings appears in the text message;
responsive to determining that one of the predefined character strings appears in the text message, determining whether the characteristics identified by the least one secondary condition are present; and
responsive to determining that characteristics are present, identifying the predefined character string that appears in the text message.
10. The method of claim 8, wherein the content item for execution at the client device is the function contained in the targeting rule.
11. A system for providing information associated with a text message, comprising:
an analysis and targeting module coupled to a networking module, the analysis and targeting module configured to:
receive a text message from the networking module, the text message for transmittal from a remote device to a client device via a network using a push technology to establish or continue a conversation between a plurality of users;
identify at least one character string within the text message, each of the identified character strings associated with information likely to be inquired by at least one of the plurality of users within a context of the conversation; and
generate, for each of the identified character strings, the information likely to be inquired by the at least one of the plurality of users; and
the networking module, configured to:
receive the text message via the network;
send the identified character strings via the network to the client device for displaying at the client device, the identified character strings displayed in a manner distinguishable from other text in the text message; and
send a content item via the network to the client device for execution at the client device, the content item corresponding to one of the identified character strings, and the content item representing at least part of the information likely to be inquired by the at least one of the plurality of users.
12. The system of claim 11, wherein the networking module is further configured to receive at least one additional text message in the conversation between the plurality of users.
13. The system of claim 12, wherein the analysis and targeting module generates the information likely to inquired by the at least one of the plurality of users by analyzing the text message together with the at least one additional text message.
14. The system of claim 11, further comprising a user profile store configured to store a plurality of user profiles, each user profile associated with one of the plurality of users, wherein the analysis and targeting module generates the information likely to inquired by the at least one of the plurality of users by analyzing the user profiles associated with one or more of the plurality of users.
15. The system of claim 11, further comprising a targeting rule store containing a plurality of targeting rules, each targeting rule containing:
a primary condition for identifying one or more character strings in the text message based on matching to a set of predefined character strings;
at least one secondary condition, each secondary condition for identifying a characteristic related to the text message; and
a function to be executed at the client device.
16. The system of claim 15, wherein the analysis and targeting module is configured to identify at least one character string within the text message by:
determining whether one of the predefined character strings appears in the text message;
responsive to determining that one of the predefined character strings appears in the text message, determining whether the characteristics identified by the least one secondary condition are present; and
responsive to determining that characteristics are present, identifying the predefined character string that appears in the text message.
17. The system of claim 15, wherein the content item for execution at the client device is the function contained in the targeting rule.
18. A computer readable medium configured to store instructions, the instructions when executed by a processor cause the processor to:
receive a text message, the text message for transmittal from a remote device to a client device via a network using a push technology to establish or continue a conversation between a plurality of users;
identify at least one character string within the text message, each of the identified character strings associated with information likely to be inquired by at least one of the plurality of users within a context of the conversation;
generate, for each of the identified character strings, the information likely to be inquired by the at least one of the plurality of users;
process the identified character strings for displaying at the client device, the identified character strings displayed in a manner distinguishable from other text in the text message; and
process a content item for execution at the client device, the content item corresponding to one of the identified character strings, and the content item representing at least part of the information likely to be inquired by the at least one of the plurality of users.
19. The computer readable medium of claim 18, further comprising instructions that cause the processor to receive at least one additional text message in the conversation between the plurality of users;
20. The computer readable medium of claim 19, wherein generating the information likely to be inquired by the at least one of the plurality of users comprises analyzing the text message together with the at least one additional text message to determine the information likely to be inquired by the at least one of the plurality of users.
21. The computer readable medium of claim 18, wherein generating the information likely to be inquired by the at least one of the plurality of users comprises analyzing user profiles associated with one or more of the plurality of users to determine the information likely to be inquired by the at least one of the plurality of users.
US14/499,350 2011-03-15 2014-09-29 Linking context-based information to text messages Abandoned US20150019665A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/499,350 US20150019665A1 (en) 2011-03-15 2014-09-29 Linking context-based information to text messages

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161453028P 2011-03-15 2011-03-15
US13/418,286 US8849931B2 (en) 2011-03-15 2012-03-12 Linking context-based information to text messages
US14/499,350 US20150019665A1 (en) 2011-03-15 2014-09-29 Linking context-based information to text messages

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/418,286 Continuation US8849931B2 (en) 2011-03-15 2012-03-12 Linking context-based information to text messages

Publications (1)

Publication Number Publication Date
US20150019665A1 true US20150019665A1 (en) 2015-01-15

Family

ID=46829354

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/418,286 Expired - Fee Related US8849931B2 (en) 2011-03-15 2012-03-12 Linking context-based information to text messages
US14/499,350 Abandoned US20150019665A1 (en) 2011-03-15 2014-09-29 Linking context-based information to text messages

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/418,286 Expired - Fee Related US8849931B2 (en) 2011-03-15 2012-03-12 Linking context-based information to text messages

Country Status (3)

Country Link
US (2) US8849931B2 (en)
EP (1) EP2687028A4 (en)
WO (1) WO2012125653A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181221A1 (en) * 2012-12-21 2014-06-26 Longsand Limited Analyzing a message using location-based processing
US20140337438A1 (en) * 2013-05-09 2014-11-13 Ebay Inc. System and method for suggesting a phrase based on a context
WO2017090916A1 (en) * 2015-11-25 2017-06-01 Samsung Electronics Co., Ltd. Managing display of information on multiple devices based on context for a user task
WO2018119428A1 (en) * 2016-12-23 2018-06-28 Mutare, Inc. Unanswered-call handling and routing
US20180217864A1 (en) * 2017-02-02 2018-08-02 Samsung Electronics Co., Ltd Method and apparatus for managing content across applications
US10516636B2 (en) 2014-01-01 2019-12-24 SlamAd.com, Inc. Real-time messaging platform with enhanced privacy
US10846465B2 (en) 2016-06-30 2020-11-24 Microsoft Technology Licensing, Llc Integrating an application for surfacing data on an email message pane
US11256752B2 (en) * 2018-05-02 2022-02-22 Samsung Electronics Co., Ltd. Contextual recommendation
US11586683B2 (en) * 2015-02-03 2023-02-21 Line Corporation Methods, systems and recording mediums for managing conversation contents in messenger
US20230259957A1 (en) * 2022-02-11 2023-08-17 Target Brands, Inc. Guest messaging platform

Families Citing this family (432)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8554868B2 (en) 2007-01-05 2013-10-08 Yahoo! Inc. Simultaneous sharing communication interface
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
WO2013008238A1 (en) 2011-07-12 2013-01-17 Mobli Technologies 2010 Ltd. Methods and systems of providing visual content editing functions
US8799269B2 (en) 2012-01-03 2014-08-05 International Business Machines Corporation Optimizing map/reduce searches by using synthetic events
US11734712B2 (en) 2012-02-24 2023-08-22 Foursquare Labs, Inc. Attributing in-store visits to media consumption based on data collected from user devices
US8972357B2 (en) 2012-02-24 2015-03-03 Placed, Inc. System and method for data collection to validate location data
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US20150200895A1 (en) * 2012-04-10 2015-07-16 Google Inc. Marking outgoing communications for follow-up
US9685160B2 (en) * 2012-04-16 2017-06-20 Htc Corporation Method for offering suggestion during conversation, electronic device using the same, and non-transitory storage medium
US10155168B2 (en) 2012-05-08 2018-12-18 Snap Inc. System and method for adaptable avatars
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US10657768B2 (en) 2012-06-22 2020-05-19 Zonal Systems, Llc System and method for placing virtual geographic zone markers
US10360760B2 (en) 2012-06-22 2019-07-23 Zonal Systems, Llc System and method for placing virtual geographic zone markers
US9317996B2 (en) 2012-06-22 2016-04-19 II Robert L. Pierce Method for authenticating a wager using a system and method for interacting with virtual geographic zones
US8898165B2 (en) 2012-07-02 2014-11-25 International Business Machines Corporation Identification of null sets in a context-based electronic document search
US9460200B2 (en) 2012-07-02 2016-10-04 International Business Machines Corporation Activity recommendation based on a context-based electronic files search
US8903813B2 (en) 2012-07-02 2014-12-02 International Business Machines Corporation Context-based electronic document search using a synthetic event
US9412136B2 (en) * 2012-07-09 2016-08-09 Facebook, Inc. Creation of real-time conversations based on social location information
US8577671B1 (en) 2012-07-20 2013-11-05 Veveo, Inc. Method of and system for using conversation state information in a conversational interaction system
US9465833B2 (en) 2012-07-31 2016-10-11 Veveo, Inc. Disambiguating user intent in conversational interaction system for large corpus information retrieval
US9262499B2 (en) 2012-08-08 2016-02-16 International Business Machines Corporation Context-based graphical database
CN104704797B (en) 2012-08-10 2018-08-10 纽昂斯通讯公司 Virtual protocol communication for electronic equipment
US9473582B1 (en) 2012-08-11 2016-10-18 Federico Fraccaroli Method, system, and apparatus for providing a mediated sensory experience to users positioned in a shared location
US11184448B2 (en) 2012-08-11 2021-11-23 Federico Fraccaroli Method, system and apparatus for interacting with a digital work
US10419556B2 (en) 2012-08-11 2019-09-17 Federico Fraccaroli Method, system and apparatus for interacting with a digital work that is performed in a predetermined location
US20150206349A1 (en) 2012-08-22 2015-07-23 Goldrun Corporation Augmented reality virtual content platform apparatuses, methods and systems
US8676857B1 (en) * 2012-08-23 2014-03-18 International Business Machines Corporation Context-based search for a data store related to a graph node
BR112015003030B1 (en) * 2012-08-24 2022-03-08 Samsung Electronics Co., Ltd METHOD TO RECOMMEND A FRIEND, IN A FIRST TERMINAL, FIRST TERMINAL TO RECOMMEND A FRIEND
US8959119B2 (en) 2012-08-27 2015-02-17 International Business Machines Corporation Context-based graph-relational intersect derived database
US9959548B2 (en) 2012-08-31 2018-05-01 Sprinklr, Inc. Method and system for generating social signal vocabularies
US10003560B1 (en) * 2012-08-31 2018-06-19 Sprinklr, Inc. Method and system for correlating social media conversations
US9251530B1 (en) 2012-08-31 2016-02-02 Sprinklr, Inc. Apparatus and method for model-based social analytics
US9288123B1 (en) 2012-08-31 2016-03-15 Sprinklr, Inc. Method and system for temporal correlation of social signals
US9641556B1 (en) 2012-08-31 2017-05-02 Sprinklr, Inc. Apparatus and method for identifying constituents in a social network
US9548998B1 (en) * 2012-09-07 2017-01-17 Mindmeld, Inc. Asynchronous communication system architecture
US8620958B1 (en) 2012-09-11 2013-12-31 International Business Machines Corporation Dimensionally constrained synthetic context objects database
US9619580B2 (en) 2012-09-11 2017-04-11 International Business Machines Corporation Generation of synthetic context objects
US9251237B2 (en) 2012-09-11 2016-02-02 International Business Machines Corporation User-specific synthetic context object matching
US9223846B2 (en) 2012-09-18 2015-12-29 International Business Machines Corporation Context-based navigation through a database
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US8782777B2 (en) 2012-09-27 2014-07-15 International Business Machines Corporation Use of synthetic context-based objects to secure data stores
US9741138B2 (en) 2012-10-10 2017-08-22 International Business Machines Corporation Node cluster relationships in a graph database
US8775972B2 (en) 2012-11-08 2014-07-08 Snapchat, Inc. Apparatus and method for single action control of social network profile access
US8931109B2 (en) 2012-11-19 2015-01-06 International Business Machines Corporation Context-based security screening for accessing data
US9276802B2 (en) 2012-12-11 2016-03-01 Nuance Communications, Inc. Systems and methods for sharing information between virtual agents
US9262175B2 (en) 2012-12-11 2016-02-16 Nuance Communications, Inc. Systems and methods for storing record of virtual agent interaction
US9679300B2 (en) 2012-12-11 2017-06-13 Nuance Communications, Inc. Systems and methods for virtual agent recommendation for multiple persons
US9560089B2 (en) 2012-12-11 2017-01-31 Nuance Communications, Inc. Systems and methods for providing input to virtual agent
US20140164532A1 (en) * 2012-12-11 2014-06-12 Nuance Communications, Inc. Systems and methods for virtual agent participation in multiparty conversation
US9659298B2 (en) 2012-12-11 2017-05-23 Nuance Communications, Inc. Systems and methods for informing virtual agent recommendation
CN103874037A (en) * 2012-12-17 2014-06-18 中兴通讯股份有限公司 Multimedia message sending method and device
US8983981B2 (en) 2013-01-02 2015-03-17 International Business Machines Corporation Conformed dimensional and context-based data gravity wells
US9229932B2 (en) 2013-01-02 2016-01-05 International Business Machines Corporation Conformed dimensional data gravity wells
US8914413B2 (en) 2013-01-02 2014-12-16 International Business Machines Corporation Context-based data gravity wells
US9069752B2 (en) 2013-01-31 2015-06-30 International Business Machines Corporation Measuring and displaying facets in context-based conformed dimensional data gravity wells
US8856946B2 (en) 2013-01-31 2014-10-07 International Business Machines Corporation Security filter for context-based data gravity wells
US9053102B2 (en) 2013-01-31 2015-06-09 International Business Machines Corporation Generation of synthetic context frameworks for dimensionally constrained hierarchical synthetic context-based objects
EP2954514B1 (en) 2013-02-07 2021-03-31 Apple Inc. Voice trigger for a digital assistant
US9292506B2 (en) 2013-02-28 2016-03-22 International Business Machines Corporation Dynamic generation of demonstrative aids for a meeting
US9110722B2 (en) 2013-02-28 2015-08-18 International Business Machines Corporation Data processing work allocation
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US11151899B2 (en) * 2013-03-15 2021-10-19 Apple Inc. User training by intelligent digital assistant
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
US10152526B2 (en) 2013-04-11 2018-12-11 International Business Machines Corporation Generation of synthetic context objects using bounded context objects
US9195608B2 (en) 2013-05-17 2015-11-24 International Business Machines Corporation Stored data analysis
US9348794B2 (en) 2013-05-17 2016-05-24 International Business Machines Corporation Population of context-based data gravity wells
US9742713B2 (en) 2013-05-30 2017-08-22 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US10439972B1 (en) 2013-05-30 2019-10-08 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
US9705831B2 (en) 2013-05-30 2017-07-11 Snap Inc. Apparatus and method for maintaining a message thread with opt-in permanence for entries
WO2014196959A1 (en) * 2013-06-04 2014-12-11 Hewlett-Packard Development Company, L.P. Identifying relevant content for data gathered from real time communications
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
WO2014200728A1 (en) 2013-06-09 2014-12-18 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
US9491601B2 (en) * 2013-06-10 2016-11-08 Intel Corporation Dynamic visual profiles
US9282425B2 (en) 2013-06-27 2016-03-08 Google Inc. Triggering completion step suggestion for a task
US9483565B2 (en) 2013-06-27 2016-11-01 Google Inc. Associating a task with a user based on user selection of a query suggestion
US9378196B1 (en) 2013-06-27 2016-06-28 Google Inc. Associating information with a task based on a category of the task
US20150006290A1 (en) 2013-06-27 2015-01-01 Google Inc. Providing information to a user based on determined user activity
US20150033178A1 (en) * 2013-07-27 2015-01-29 Zeta Projects Swiss GmbH User Interface With Pictograms for Multimodal Communication Framework
CN103455620B (en) * 2013-09-12 2017-05-03 百度在线网络技术(北京)有限公司 Method and equipment for adding links in content
US9697240B2 (en) 2013-10-11 2017-07-04 International Business Machines Corporation Contextual state of changed data structures
EP2874419B1 (en) * 2013-10-18 2021-03-03 Samsung Electronics Co., Ltd Communication method for electronic device in wireless communication network and system therefor
WO2015065438A1 (en) * 2013-10-31 2015-05-07 Intel Corporation Contextual content translation system
US20150148005A1 (en) * 2013-11-25 2015-05-28 The Rubicon Project, Inc. Electronic device lock screen content distribution based on environmental context system and method
US9195734B2 (en) 2013-11-26 2015-11-24 Google Inc. Associating a task completion step of a task with a task template of a group of similar tasks
US9083770B1 (en) 2013-11-26 2015-07-14 Snapchat, Inc. Method and system for integrating real time communication features in applications
US9183039B2 (en) 2013-11-26 2015-11-10 Google Inc. Associating a task completion step of a task with a related task of the same group of similar tasks
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US9684627B1 (en) 2013-12-13 2017-06-20 Google Inc. Determining a likelihood of completion of a task
US10831348B1 (en) 2013-12-13 2020-11-10 Google Llc Ranking and selecting task components based on frequency of completions
US20170017501A1 (en) 2013-12-16 2017-01-19 Nuance Communications, Inc. Systems and methods for providing a virtual assistant
US10565268B2 (en) * 2013-12-19 2020-02-18 Adobe Inc. Interactive communication augmented with contextual information
CN103699643A (en) * 2013-12-25 2014-04-02 三星电子(中国)研发中心 Transaction recording implementation method and device in mobile terminal
US9552560B1 (en) 2013-12-31 2017-01-24 Google Inc. Facilitating communication between event attendees based on event starting time
US9571427B2 (en) 2013-12-31 2017-02-14 Google Inc. Determining strength of association between user contacts
US9548951B2 (en) 2013-12-31 2017-01-17 Google Inc. Providing additional information related to a vague term in a message
US9304974B1 (en) 2013-12-31 2016-04-05 Google Inc. Determining an effect on dissemination of information related to an event based on a dynamic confidence level associated with the event
US9342597B1 (en) 2013-12-31 2016-05-17 Google Inc. Associating an event attribute with a user based on a group of electronic messages associated with the user
US20180357303A1 (en) * 2013-12-31 2018-12-13 Google Inc. Determining feature scores for message features
US9766998B1 (en) 2013-12-31 2017-09-19 Google Inc. Determining a user habit
US10949448B1 (en) 2013-12-31 2021-03-16 Google Llc Determining additional features for a task entry based on a user habit
US9424247B1 (en) 2013-12-31 2016-08-23 Google Inc. Associating one or more terms in a message trail with a task entry
CA2863124A1 (en) 2014-01-03 2015-07-03 Investel Capital Corporation User content sharing system and method with automated external content integration
US9628950B1 (en) 2014-01-12 2017-04-18 Investment Asset Holdings Llc Location-based messaging
US20150201061A1 (en) * 2014-01-13 2015-07-16 Cisco Technology, Inc. Automatically providing phone numbers viewed on a display screen to a dialing interface of a phone device
US9606977B2 (en) 2014-01-22 2017-03-28 Google Inc. Identifying tasks in messages
US10333995B2 (en) 2014-01-23 2019-06-25 International Business Machines Corporation Providing of recommendations determined from a collaboration session system and method
US9436755B1 (en) 2014-01-26 2016-09-06 Google Inc. Determining and scoring task indications
US9497153B2 (en) 2014-01-30 2016-11-15 Google Inc. Associating a segment of an electronic message with one or more segment addressees
US10082926B1 (en) 2014-02-21 2018-09-25 Snap Inc. Apparatus and method for alternate channel communication initiated through a common message thread
US8909725B1 (en) 2014-03-07 2014-12-09 Snapchat, Inc. Content delivery network for ephemeral objects
US10476968B2 (en) * 2014-04-01 2019-11-12 Microsoft Technology Licensing, Llc Providing a shared user experience of facilitate communication
US9276886B1 (en) 2014-05-09 2016-03-01 Snapchat, Inc. Apparatus and method for dynamically configuring application component tiles
US9645703B2 (en) 2014-05-14 2017-05-09 International Business Machines Corporation Detection of communication topic change
WO2015178715A1 (en) * 2014-05-23 2015-11-26 Samsung Electronics Co., Ltd. System and method of providing voice-message call service
US9508360B2 (en) 2014-05-28 2016-11-29 International Business Machines Corporation Semantic-free text analysis for identifying traits
US9537811B2 (en) 2014-10-02 2017-01-03 Snap Inc. Ephemeral gallery of ephemeral messages
US9396354B1 (en) 2014-05-28 2016-07-19 Snapchat, Inc. Apparatus and method for automated privacy protection in distributed images
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9787822B1 (en) * 2014-06-02 2017-10-10 Amazon Technologies, Inc. Tracking text messages with reminders
US20150356101A1 (en) 2014-06-05 2015-12-10 Mobli Technologies 2010 Ltd. Automatic article enrichment by social media trends
US9113301B1 (en) 2014-06-13 2015-08-18 Snapchat, Inc. Geo-location based event gallery
US10031836B2 (en) * 2014-06-16 2018-07-24 Ca, Inc. Systems and methods for automatically generating message prototypes for accurate and efficient opaque service emulation
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9225897B1 (en) 2014-07-07 2015-12-29 Snapchat, Inc. Apparatus and method for supplying content aware photo filters
JP6418820B2 (en) * 2014-07-07 2018-11-07 キヤノン株式会社 Information processing apparatus, display control method, and computer program
US20160012401A1 (en) * 2014-07-08 2016-01-14 Navico Holding As Methods for Discovering and Purchasing Content for Marine Electronics Device
US20160021042A1 (en) * 2014-07-18 2016-01-21 Flips, LLC Video messaging
WO2016018039A1 (en) * 2014-07-31 2016-02-04 Samsung Electronics Co., Ltd. Apparatus and method for providing information
KR102370373B1 (en) * 2014-07-31 2022-03-04 삼성전자주식회사 Method for Providing Information and Device thereof
US10055717B1 (en) 2014-08-22 2018-08-21 Snap Inc. Message processor with application prompts
US9369852B2 (en) * 2014-09-08 2016-06-14 Toyota Motor Engineering & Manufacturing North America, Inc. Messaging for mobile devices using vehicle DCM
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10505875B1 (en) * 2014-09-15 2019-12-10 Amazon Technologies, Inc. Determining contextually relevant application templates associated with electronic message content
US10423983B2 (en) 2014-09-16 2019-09-24 Snap Inc. Determining targeting information based on a predictive targeting model
US10824654B2 (en) 2014-09-18 2020-11-03 Snap Inc. Geolocation-based pictographs
US11216869B2 (en) 2014-09-23 2022-01-04 Snap Inc. User interface to augment an image using geolocation
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10284508B1 (en) 2014-10-02 2019-05-07 Snap Inc. Ephemeral gallery of ephemeral messages with opt-in permanence
US20160112359A1 (en) * 2014-10-16 2016-04-21 International Business Machines Corporation Group message contextual delivery
US9015285B1 (en) 2014-11-12 2015-04-21 Snapchat, Inc. User interface for accessing media at a geographic location
US11902232B1 (en) * 2014-11-18 2024-02-13 Amazon Technologies, Inc. Email conversation linking
US10044662B1 (en) 2014-11-18 2018-08-07 Amazon Technologies, Inc. Email conversation linking
US11093125B1 (en) 2014-12-09 2021-08-17 Amazon Technologies, Inc. Email conversation linking
US9385983B1 (en) 2014-12-19 2016-07-05 Snapchat, Inc. Gallery of messages from individuals with a shared interest
US9854219B2 (en) 2014-12-19 2017-12-26 Snap Inc. Gallery of videos set to an audio time line
US10311916B2 (en) 2014-12-19 2019-06-04 Snap Inc. Gallery of videos set to an audio time line
US9852136B2 (en) 2014-12-23 2017-12-26 Rovi Guides, Inc. Systems and methods for determining whether a negation statement applies to a current or past query
US9754355B2 (en) 2015-01-09 2017-09-05 Snap Inc. Object recognition based photo filters
US11388226B1 (en) 2015-01-13 2022-07-12 Snap Inc. Guided personal identity based actions
US10133705B1 (en) 2015-01-19 2018-11-20 Snap Inc. Multichannel system
US9521515B2 (en) 2015-01-26 2016-12-13 Mobli Technologies 2010 Ltd. Content request by location
US9722965B2 (en) 2015-01-29 2017-08-01 International Business Machines Corporation Smartphone indicator for conversation nonproductivity
US20160224538A1 (en) * 2015-01-30 2016-08-04 First Advantage Litigation Consulting Dba Consilio Systems and methods for electronic document review
US9854049B2 (en) 2015-01-30 2017-12-26 Rovi Guides, Inc. Systems and methods for resolving ambiguous terms in social chatter based on a user profile
US10515344B1 (en) 2015-02-10 2019-12-24 Open Invention Network Llc Location awareness assistant that activates a business-oriented operation system or a personal-oriented operation system based on conditions
US10284537B2 (en) 2015-02-11 2019-05-07 Google Llc Methods, systems, and media for presenting information related to an event based on metadata
US11048855B2 (en) 2015-02-11 2021-06-29 Google Llc Methods, systems, and media for modifying the presentation of contextually relevant documents in browser windows of a browsing application
US9769564B2 (en) 2015-02-11 2017-09-19 Google Inc. Methods, systems, and media for ambient background noise modification based on mood and/or behavior information
US10223459B2 (en) 2015-02-11 2019-03-05 Google Llc Methods, systems, and media for personalizing computerized services based on mood and/or behavior information from multiple data sources
US11392580B2 (en) 2015-02-11 2022-07-19 Google Llc Methods, systems, and media for recommending computerized services based on an animate object in the user's environment
EP3262537A4 (en) * 2015-02-27 2018-07-11 Keypoint Technologies India Pvt. Ltd. Contextual discovery
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US10223397B1 (en) 2015-03-13 2019-03-05 Snap Inc. Social graph based co-location of network users
CN107637099B (en) 2015-03-18 2020-10-16 斯纳普公司 Geo-fence authentication provisioning
US9692967B1 (en) 2015-03-23 2017-06-27 Snap Inc. Systems and methods for reducing boot time and power consumption in camera systems
US9431003B1 (en) 2015-03-27 2016-08-30 International Business Machines Corporation Imbuing artificial intelligence systems with idiomatic traits
US10965622B2 (en) * 2015-04-16 2021-03-30 Samsung Electronics Co., Ltd. Method and apparatus for recommending reply message
US10296949B2 (en) * 2015-04-21 2019-05-21 Facebook, Inc. Messenger application plug-in for providing tailored advertisements within a conversation thread
US9881094B2 (en) 2015-05-05 2018-01-30 Snap Inc. Systems and methods for automated local story generation and curation
US10135949B1 (en) 2015-05-05 2018-11-20 Snap Inc. Systems and methods for story and sub-story navigation
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10033677B2 (en) 2015-06-11 2018-07-24 International Business Machines Corporation Tracking conversation threads among electronic communications
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
KR101593883B1 (en) * 2015-07-07 2016-02-18 박성호 Server which providing contents with advertisement, method for the same and electric device readable recording medium having program for method of displaying advertisement in contents
US10993069B2 (en) 2015-07-16 2021-04-27 Snap Inc. Dynamically adaptive media content delivery
US10817898B2 (en) 2015-08-13 2020-10-27 Placed, Llc Determining exposures to content presented by physical objects
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US10178527B2 (en) 2015-10-22 2019-01-08 Google Llc Personalized entity repository
US9652896B1 (en) 2015-10-30 2017-05-16 Snap Inc. Image based tracking in augmented reality systems
WO2017075515A1 (en) 2015-10-30 2017-05-04 Loji, Llc Interactive icons with embedded functionality used in text messages
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
CN108351890B (en) * 2015-11-24 2022-04-12 三星电子株式会社 Electronic device and operation method thereof
US10474321B2 (en) 2015-11-30 2019-11-12 Snap Inc. Network resource location linking and visual content sharing
US9984499B1 (en) 2015-11-30 2018-05-29 Snap Inc. Image and point cloud based tracking and in augmented reality systems
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10354425B2 (en) 2015-12-18 2019-07-16 Snap Inc. Method and system for providing context relevant media augmentation
EP3395019B1 (en) * 2015-12-21 2022-03-30 Google LLC Automatic suggestions and other content for messaging applications
US10530723B2 (en) 2015-12-21 2020-01-07 Google Llc Automatic suggestions for message exchange threads
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US20170193087A1 (en) * 2015-12-31 2017-07-06 Quixey, Inc. Real-Time Markup of User Text with Deep Links
US20170220573A1 (en) 2016-01-05 2017-08-03 William McMichael Systems and methods of performing searches within a text input application
US20170214651A1 (en) 2016-01-05 2017-07-27 William McMichael Systems and methods of transmitting and displaying private message data via a text input application
US9762521B2 (en) * 2016-01-15 2017-09-12 International Business Machines Corporation Semantic analysis and delivery of alternative content
WO2017132087A1 (en) 2016-01-25 2017-08-03 nToggle, Inc. Platform for programmatic advertising
US9980165B2 (en) 2016-02-10 2018-05-22 Airwatch Llc Visual privacy systems for enterprise mobility management
US10285001B2 (en) 2016-02-26 2019-05-07 Snap Inc. Generation, curation, and presentation of media collections
US10679389B2 (en) 2016-02-26 2020-06-09 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US11023514B2 (en) 2016-02-26 2021-06-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US10339365B2 (en) 2016-03-31 2019-07-02 Snap Inc. Automated avatar generation
US11900418B2 (en) 2016-04-04 2024-02-13 Snap Inc. Mutable geo-fencing system
US10958614B2 (en) * 2016-05-26 2021-03-23 International Business Machines Corporation Co-references for messages to avoid confusion in social networking systems
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10739972B2 (en) * 2016-06-10 2020-08-11 Apple Inc. Device, method, and graphical user interface for managing electronic communications
EP3255540A1 (en) * 2016-06-11 2017-12-13 Apple Inc. Intelligent task discovery
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
CN106021600B (en) * 2016-06-12 2018-03-09 腾讯科技(深圳)有限公司 Information cuing method and device
US11044393B1 (en) 2016-06-20 2021-06-22 Pipbin, Inc. System for curation and display of location-dependent augmented reality content in an augmented estate system
US11201981B1 (en) 2016-06-20 2021-12-14 Pipbin, Inc. System for notification of user accessibility of curated location-dependent content in an augmented estate
KR101844467B1 (en) * 2016-06-20 2018-04-03 주식회사 인포바인 Method and apparatus for providing information and function related to a message
US10805696B1 (en) 2016-06-20 2020-10-13 Pipbin, Inc. System for recording and targeting tagged content of user interest
US10638256B1 (en) 2016-06-20 2020-04-28 Pipbin, Inc. System for distribution and display of mobile targeted augmented reality content
US11876941B1 (en) 2016-06-20 2024-01-16 Pipbin, Inc. Clickable augmented reality content manager, system, and network
US11785161B1 (en) 2016-06-20 2023-10-10 Pipbin, Inc. System for user accessibility of tagged curated augmented reality content
US10334134B1 (en) 2016-06-20 2019-06-25 Maximillian John Suiter Augmented real estate with location and chattel tagging system and apparatus for virtual diary, scrapbooking, game play, messaging, canvasing, advertising and social interaction
US9681265B1 (en) 2016-06-28 2017-06-13 Snap Inc. System to track engagement of media items
US10430838B1 (en) 2016-06-28 2019-10-01 Snap Inc. Methods and systems for generation, curation, and presentation of media collections with automated advertising
US10733255B1 (en) 2016-06-30 2020-08-04 Snap Inc. Systems and methods for content navigation with automated curation
US10348662B2 (en) 2016-07-19 2019-07-09 Snap Inc. Generating customized electronic messaging graphics
US10104417B2 (en) 2016-07-26 2018-10-16 At&T Mobility Ii Llc Method and apparatus for sponsored messaging
US10264037B2 (en) 2016-07-31 2019-04-16 Microsoft Technology Licensing, Llc Classroom messaging
CN109804411B (en) 2016-08-30 2023-02-17 斯纳普公司 System and method for simultaneous localization and mapping
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10650621B1 (en) 2016-09-13 2020-05-12 Iocurrents, Inc. Interfacing with a vehicular controller area network
WO2018057541A1 (en) 2016-09-20 2018-03-29 Google Llc Suggested responses based on message stickers
DE112017003594T5 (en) 2016-09-20 2019-04-25 Google Llc Bot requesting permission to access data
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10432559B2 (en) 2016-10-24 2019-10-01 Snap Inc. Generating and displaying customized avatars in electronic messages
KR102163443B1 (en) 2016-11-07 2020-10-08 스냅 인코포레이티드 Selective identification and ordering of image modifiers
US10832000B2 (en) * 2016-11-14 2020-11-10 International Business Machines Corporation Identification of textual similarity with references
TWI647638B (en) * 2016-11-15 2019-01-11 財團法人工業技術研究院 Interactive recommendation system and method
US11550751B2 (en) * 2016-11-18 2023-01-10 Microsoft Technology Licensing, Llc Sequence expander for data entry/information retrieval
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10203855B2 (en) 2016-12-09 2019-02-12 Snap Inc. Customized user-controlled media overlays
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11616745B2 (en) 2017-01-09 2023-03-28 Snap Inc. Contextual generation and selection of customized media content
US10454857B1 (en) 2017-01-23 2019-10-22 Snap Inc. Customized digital avatar accessories
US10915911B2 (en) 2017-02-03 2021-02-09 Snap Inc. System to determine a price-schedule to distribute media content
US10319149B1 (en) 2017-02-17 2019-06-11 Snap Inc. Augmented reality anamorphosis system
US11250075B1 (en) 2017-02-17 2022-02-15 Snap Inc. Searching social media content
US10074381B1 (en) 2017-02-20 2018-09-11 Snap Inc. Augmented reality speech balloon system
US10565795B2 (en) 2017-03-06 2020-02-18 Snap Inc. Virtual vision system
US10523625B1 (en) 2017-03-09 2019-12-31 Snap Inc. Restricted group content collection
US11562035B2 (en) * 2017-03-16 2023-01-24 Driftwood Capital, Llc Enhancement of electronic communications and documents with links to contextually relevant information
US10582277B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10581782B2 (en) 2017-03-27 2020-03-03 Snap Inc. Generating a stitched data stream
US10643230B2 (en) 2017-04-10 2020-05-05 Wildfire Systems, Inc. Monetization system for images
US10733622B1 (en) 2017-04-10 2020-08-04 Wildfire Systems, Inc. Application user interface monetization system
US10540671B2 (en) 2017-04-10 2020-01-21 Wildfire Systems, Inc. Messaging gateway monetization system
US11170393B1 (en) 2017-04-11 2021-11-09 Snap Inc. System to calculate an engagement score of location based media content
US10387730B1 (en) 2017-04-20 2019-08-20 Snap Inc. Augmented reality typography personalization system
EP3667603A1 (en) 2017-04-27 2020-06-17 Snap Inc. Location privacy management on map-based social media platforms
US10212541B1 (en) 2017-04-27 2019-02-19 Snap Inc. Selective location-based identity communication
US11893647B2 (en) 2017-04-27 2024-02-06 Snap Inc. Location-based virtual avatars
US10467147B1 (en) 2017-04-28 2019-11-05 Snap Inc. Precaching unlockable data elements
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. User interface for correcting recognition errors
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
DK201770428A1 (en) 2017-05-12 2019-02-18 Apple Inc. Low-latency intelligent automated assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. Far-field extension for digital assistant services
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10860854B2 (en) 2017-05-16 2020-12-08 Google Llc Suggested actions for images
US10679192B2 (en) * 2017-05-25 2020-06-09 Microsoft Technology Licensing, Llc Assigning tasks and monitoring task performance based on context extracted from a shared contextual graph
CN107145800A (en) * 2017-05-31 2017-09-08 北京小米移动软件有限公司 Method for protecting privacy and device, terminal and storage medium
US10803120B1 (en) 2017-05-31 2020-10-13 Snap Inc. Geolocation based playlists
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10404636B2 (en) 2017-06-15 2019-09-03 Google Llc Embedded programs and interfaces for chat conversations
US10852945B2 (en) * 2017-08-03 2020-12-01 Facebook, Inc. Generating social media communications based on low-data messages
US10891947B1 (en) 2017-08-03 2021-01-12 Wells Fargo Bank, N.A. Adaptive conversation support bot
US10482504B2 (en) 2017-08-24 2019-11-19 William McMichael Systems and methods for analyzing input data and presenting information
US11475254B1 (en) 2017-09-08 2022-10-18 Snap Inc. Multimodal entity identification
US10740974B1 (en) 2017-09-15 2020-08-11 Snap Inc. Augmented reality system
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10499191B1 (en) 2017-10-09 2019-12-03 Snap Inc. Context sensitive presentation of content
US10573043B2 (en) 2017-10-30 2020-02-25 Snap Inc. Mobile-based cartographic control of display content
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US11265273B1 (en) 2017-12-01 2022-03-01 Snap, Inc. Dynamic media overlay with smart widget
US11017173B1 (en) 2017-12-22 2021-05-25 Snap Inc. Named entity recognition visual context and caption data
US10678818B2 (en) 2018-01-03 2020-06-09 Snap Inc. Tag distribution visualization system
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US11507614B1 (en) 2018-02-13 2022-11-22 Snap Inc. Icon based tagging
US10885136B1 (en) 2018-02-28 2021-01-05 Snap Inc. Audience filtering system
US10979752B1 (en) 2018-02-28 2021-04-13 Snap Inc. Generating media content items based on location information
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10327096B1 (en) 2018-03-06 2019-06-18 Snap Inc. Geo-fence selection system
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
EP3766028A1 (en) 2018-03-14 2021-01-20 Snap Inc. Generating collectible items based on location information
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11163941B1 (en) 2018-03-30 2021-11-02 Snap Inc. Annotating a collection of media content items
US10219111B1 (en) 2018-04-18 2019-02-26 Snap Inc. Visitation tracking system
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10547734B2 (en) * 2018-05-17 2020-01-28 International Business Machines Corporation Augmenting messages based on sender location
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US10896197B1 (en) 2018-05-22 2021-01-19 Snap Inc. Event detection system
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. Virtual assistant operation in multi-device environments
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US10762274B2 (en) * 2018-06-18 2020-09-01 International Business Machines Corporation Execution of an application using a specifically formatted input
US10839143B2 (en) * 2018-06-29 2020-11-17 Dropbox, Inc. Referential gestures within content items
WO2020014712A1 (en) 2018-07-13 2020-01-16 Pubwise, LLLP Digital advertising platform with demand path optimization
US10679393B2 (en) 2018-07-24 2020-06-09 Snap Inc. Conditional modification of augmented reality object
US10997760B2 (en) 2018-08-31 2021-05-04 Snap Inc. Augmented reality anthropomorphization system
US10742588B2 (en) 2018-09-25 2020-08-11 International Business Machines Corporation Representative media item selection for electronic posts
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US10698583B2 (en) 2018-09-28 2020-06-30 Snap Inc. Collaborative achievement interface
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US10778623B1 (en) 2018-10-31 2020-09-15 Snap Inc. Messaging and gaming applications communication platform
US11199957B1 (en) 2018-11-30 2021-12-14 Snap Inc. Generating customized avatars based on location information
US10939236B1 (en) 2018-11-30 2021-03-02 Snap Inc. Position service to determine relative position to map features
US11461369B2 (en) * 2018-12-10 2022-10-04 Sap Se Sensor-based detection of related devices
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11032670B1 (en) 2019-01-14 2021-06-08 Snap Inc. Destination sharing in location sharing system
US10939246B1 (en) 2019-01-16 2021-03-02 Snap Inc. Location-based context information sharing in a messaging system
US11294936B1 (en) 2019-01-30 2022-04-05 Snap Inc. Adaptive spatial density based clustering
US10936066B1 (en) 2019-02-13 2021-03-02 Snap Inc. Sleep detection in a location sharing system
US10838599B2 (en) 2019-02-25 2020-11-17 Snap Inc. Custom media overlay system
US10964082B2 (en) 2019-02-26 2021-03-30 Snap Inc. Avatar based on weather
US10852918B1 (en) 2019-03-08 2020-12-01 Snap Inc. Contextual information in chat
US11868414B1 (en) 2019-03-14 2024-01-09 Snap Inc. Graph-based prediction for contact suggestion in a location sharing system
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11852554B1 (en) 2019-03-21 2023-12-26 Snap Inc. Barometer calibration in a location sharing system
US11249614B2 (en) 2019-03-28 2022-02-15 Snap Inc. Generating personalized map interface with enhanced icons
US10810782B1 (en) 2019-04-01 2020-10-20 Snap Inc. Semantic texture mapping system
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US10582453B1 (en) 2019-05-30 2020-03-03 Snap Inc. Wearable device location systems architecture
US10560898B1 (en) 2019-05-30 2020-02-11 Snap Inc. Wearable device location systems
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. User activity shortcut suggestions
DK201970511A1 (en) 2019-05-31 2021-02-15 Apple Inc Voice identification in digital assistant systems
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11468890B2 (en) 2019-06-01 2022-10-11 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US10893385B1 (en) 2019-06-07 2021-01-12 Snap Inc. Detection of a physical collision between two client devices in a location sharing system
WO2020246020A1 (en) * 2019-06-07 2020-12-10 富士通株式会社 Information management program, information management method, and information management device
US11307747B2 (en) 2019-07-11 2022-04-19 Snap Inc. Edge gesture interface with smart interactions
JP7272893B2 (en) * 2019-07-26 2023-05-12 トヨタ自動車株式会社 Control device
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11821742B2 (en) 2019-09-26 2023-11-21 Snap Inc. Travel based notifications
US11218838B2 (en) 2019-10-31 2022-01-04 Snap Inc. Focused map-based context information surfacing
US11429618B2 (en) 2019-12-30 2022-08-30 Snap Inc. Surfacing augmented reality objects
US10880496B1 (en) 2019-12-30 2020-12-29 Snap Inc. Including video feed in message thread
US11128715B1 (en) 2019-12-30 2021-09-21 Snap Inc. Physical friend proximity in chat
US11343323B2 (en) 2019-12-31 2022-05-24 Snap Inc. Augmented reality objects registry
US11169658B2 (en) 2019-12-31 2021-11-09 Snap Inc. Combined map icon with action indicator
US11228551B1 (en) 2020-02-12 2022-01-18 Snap Inc. Multiple gateway message exchange
US11516167B2 (en) 2020-03-05 2022-11-29 Snap Inc. Storing data based on device location
US11619501B2 (en) 2020-03-11 2023-04-04 Snap Inc. Avatar based on trip
US11430091B2 (en) 2020-03-27 2022-08-30 Snap Inc. Location mapping for large scale augmented-reality
US10956743B1 (en) 2020-03-27 2021-03-23 Snap Inc. Shared augmented reality system
US11043220B1 (en) 2020-05-11 2021-06-22 Apple Inc. Digital assistant hardware abstraction
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11314776B2 (en) 2020-06-15 2022-04-26 Snap Inc. Location sharing using friend list versions
US11290851B2 (en) 2020-06-15 2022-03-29 Snap Inc. Location sharing using offline and online objects
US11503432B2 (en) 2020-06-15 2022-11-15 Snap Inc. Scalable real-time location sharing framework
US11483267B2 (en) 2020-06-15 2022-10-25 Snap Inc. Location sharing using different rate-limited links
US11308327B2 (en) 2020-06-29 2022-04-19 Snap Inc. Providing travel-based augmented reality content with a captured image
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones
US11349797B2 (en) 2020-08-31 2022-05-31 Snap Inc. Co-location connection service
US11606756B2 (en) 2021-03-29 2023-03-14 Snap Inc. Scheduling requests for location data
US11645324B2 (en) 2021-03-31 2023-05-09 Snap Inc. Location-based timeline media content system
US11829834B2 (en) 2021-10-29 2023-11-28 Snap Inc. Extended QR code

Citations (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020107882A1 (en) * 2000-12-12 2002-08-08 Gorelick Richard B. Automatically inserting relevant hyperlinks into a webpage
US20030187733A1 (en) * 2002-04-01 2003-10-02 Hertling William Edward Personalized messaging determined from detected content
US20040008828A1 (en) * 2002-07-09 2004-01-15 Scott Coles Dynamic information retrieval system utilizing voice recognition
US20040187082A1 (en) * 2003-03-20 2004-09-23 Hathaway Thomas W. User operable help information system
US20050289113A1 (en) * 2004-06-29 2005-12-29 Blake Bookstaff Method and system for automated intelligent electronic advertising
US20060013487A1 (en) * 2004-07-09 2006-01-19 Longe Michael R Disambiguating ambiguous characters
US20070088687A1 (en) * 2005-10-18 2007-04-19 Microsoft Corporation Searching based on messages
US20070265006A1 (en) * 2006-05-09 2007-11-15 James Edward Washok Interactive text messaging system for information distribution
US20070265990A1 (en) * 2006-05-10 2007-11-15 Miscrosoft Corporation Multi-party information analysis in a VoIP system
US20080040437A1 (en) * 2006-08-10 2008-02-14 Mayank Agarwal Mobile Social Networking Platform
US20080162439A1 (en) * 2002-04-05 2008-07-03 Jason Bosarge Method of enhancing email text with hyperlinked word pointing to targeted ad
US20080177721A1 (en) * 2007-01-22 2008-07-24 Samsung Electronics Co., Ltd. Keyword Manager
US20080243619A1 (en) * 2007-03-30 2008-10-02 Sharman Duane R Method and system for delivery of advertising content in short message service (SMS) messages
US20080244375A1 (en) * 2007-02-09 2008-10-02 Healthline Networks, Inc. Hyperlinking Text in Document Content Using Multiple Concept-Based Indexes Created Over a Structured Taxonomy
US20080275864A1 (en) * 2007-05-02 2008-11-06 Yahoo! Inc. Enabling clustered search processing via text messaging
US20090007148A1 (en) * 2007-06-28 2009-01-01 Microsoft Corporation Search tool that aggregates disparate tools unifying communication
US20090031323A1 (en) * 2007-07-26 2009-01-29 Affle Limited Communication system and method
US20090068991A1 (en) * 2007-09-05 2009-03-12 Janne Aaltonen Systems, methods, network elements and applications for modifying messages
US20090076917A1 (en) * 2007-08-22 2009-03-19 Victor Roditis Jablokov Facilitating presentation of ads relating to words of a message
US20090119368A1 (en) * 2007-11-02 2009-05-07 International Business Machines Corporation System and method for gathering conversation information
US20090235150A1 (en) * 2008-03-17 2009-09-17 Digitalsmiths Corporation Systems and methods for dynamically creating hyperlinks associated with relevant multimedia content
US20090292526A1 (en) * 2008-05-20 2009-11-26 Aol Llc Monitoring conversations to identify topics of interest
US20100041422A1 (en) * 2008-08-07 2010-02-18 Research In Motion Limited System and method for incorporating multimedia content into a message handled by a mobile device
US20100088322A1 (en) * 2005-10-21 2010-04-08 Aol Llc Real time query trends with multi-document summarization
US20100153106A1 (en) * 2008-12-15 2010-06-17 Verizon Data Services Llc Conversation mapping
US20100223279A1 (en) * 2009-02-27 2010-09-02 Research In Motion Limited System and method for linking ad tagged words
US20100246784A1 (en) * 2009-03-27 2010-09-30 Verizon Patent And Licensing Inc. Conversation support
US20110106892A1 (en) * 2009-11-02 2011-05-05 Marie-France Nelson System and method for extracting calendar events from free-form email
US20120109746A1 (en) * 2010-11-01 2012-05-03 Microsoft Corporation Trusted Online Advertising
US20120131024A1 (en) * 2009-07-30 2012-05-24 Soo Min Park Apparatus and method for providing contact information and portable terminal using same
US20120197937A1 (en) * 2011-01-27 2012-08-02 Kashinath Kakarla Method and system for providing detailed information in an interactive manner in a short message service (sms) environment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5873107A (en) * 1996-03-29 1999-02-16 Apple Computer, Inc. System for automatically retrieving information relevant to text being authored
US20050163379A1 (en) * 2004-01-28 2005-07-28 Logitech Europe S.A. Use of multimedia data for emoticons in instant messaging
US8134481B2 (en) 2006-08-11 2012-03-13 Honda Motor Co., Ltd. Method and system for receiving and sending navigational data via a wireless messaging service on a navigation system
EP2254063A3 (en) 2006-09-28 2011-04-27 SFGT Inc. Apparatuses, methods, and systems for code triggered information querying and serving
US20080268882A1 (en) 2007-04-30 2008-10-30 Palm, Inc. Short message service enhancement techniques for added communication options

Patent Citations (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020107882A1 (en) * 2000-12-12 2002-08-08 Gorelick Richard B. Automatically inserting relevant hyperlinks into a webpage
US20030187733A1 (en) * 2002-04-01 2003-10-02 Hertling William Edward Personalized messaging determined from detected content
US20080162439A1 (en) * 2002-04-05 2008-07-03 Jason Bosarge Method of enhancing email text with hyperlinked word pointing to targeted ad
US20040008828A1 (en) * 2002-07-09 2004-01-15 Scott Coles Dynamic information retrieval system utilizing voice recognition
US20040187082A1 (en) * 2003-03-20 2004-09-23 Hathaway Thomas W. User operable help information system
US20050289113A1 (en) * 2004-06-29 2005-12-29 Blake Bookstaff Method and system for automated intelligent electronic advertising
US20060013487A1 (en) * 2004-07-09 2006-01-19 Longe Michael R Disambiguating ambiguous characters
US20070088687A1 (en) * 2005-10-18 2007-04-19 Microsoft Corporation Searching based on messages
US20100088322A1 (en) * 2005-10-21 2010-04-08 Aol Llc Real time query trends with multi-document summarization
US20070265006A1 (en) * 2006-05-09 2007-11-15 James Edward Washok Interactive text messaging system for information distribution
US20070265990A1 (en) * 2006-05-10 2007-11-15 Miscrosoft Corporation Multi-party information analysis in a VoIP system
US20080040437A1 (en) * 2006-08-10 2008-02-14 Mayank Agarwal Mobile Social Networking Platform
US20080177721A1 (en) * 2007-01-22 2008-07-24 Samsung Electronics Co., Ltd. Keyword Manager
US20080244375A1 (en) * 2007-02-09 2008-10-02 Healthline Networks, Inc. Hyperlinking Text in Document Content Using Multiple Concept-Based Indexes Created Over a Structured Taxonomy
US20080243619A1 (en) * 2007-03-30 2008-10-02 Sharman Duane R Method and system for delivery of advertising content in short message service (SMS) messages
US20080275864A1 (en) * 2007-05-02 2008-11-06 Yahoo! Inc. Enabling clustered search processing via text messaging
US20090007148A1 (en) * 2007-06-28 2009-01-01 Microsoft Corporation Search tool that aggregates disparate tools unifying communication
US20090031323A1 (en) * 2007-07-26 2009-01-29 Affle Limited Communication system and method
US20090076917A1 (en) * 2007-08-22 2009-03-19 Victor Roditis Jablokov Facilitating presentation of ads relating to words of a message
US20090068991A1 (en) * 2007-09-05 2009-03-12 Janne Aaltonen Systems, methods, network elements and applications for modifying messages
US20090119368A1 (en) * 2007-11-02 2009-05-07 International Business Machines Corporation System and method for gathering conversation information
US20090235150A1 (en) * 2008-03-17 2009-09-17 Digitalsmiths Corporation Systems and methods for dynamically creating hyperlinks associated with relevant multimedia content
US20090292526A1 (en) * 2008-05-20 2009-11-26 Aol Llc Monitoring conversations to identify topics of interest
US20100041422A1 (en) * 2008-08-07 2010-02-18 Research In Motion Limited System and method for incorporating multimedia content into a message handled by a mobile device
US20100153106A1 (en) * 2008-12-15 2010-06-17 Verizon Data Services Llc Conversation mapping
US20100223279A1 (en) * 2009-02-27 2010-09-02 Research In Motion Limited System and method for linking ad tagged words
US20100246784A1 (en) * 2009-03-27 2010-09-30 Verizon Patent And Licensing Inc. Conversation support
US20120131024A1 (en) * 2009-07-30 2012-05-24 Soo Min Park Apparatus and method for providing contact information and portable terminal using same
US20110106892A1 (en) * 2009-11-02 2011-05-05 Marie-France Nelson System and method for extracting calendar events from free-form email
US20120109746A1 (en) * 2010-11-01 2012-05-03 Microsoft Corporation Trusted Online Advertising
US20120197937A1 (en) * 2011-01-27 2012-08-02 Kashinath Kakarla Method and system for providing detailed information in an interactive manner in a short message service (sms) environment

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181221A1 (en) * 2012-12-21 2014-06-26 Longsand Limited Analyzing a message using location-based processing
US10257137B2 (en) 2013-05-09 2019-04-09 Ebay Inc. System and method for suggesting a phrase based on a context
US20140337438A1 (en) * 2013-05-09 2014-11-13 Ebay Inc. System and method for suggesting a phrase based on a context
US20200244607A1 (en) * 2013-05-09 2020-07-30 Ebay Inc. System and method for suggesting a phrase based on a context
US9923849B2 (en) * 2013-05-09 2018-03-20 Ebay Inc. System and method for suggesting a phrase based on a context
US10659406B2 (en) * 2013-05-09 2020-05-19 Ebay Inc. System and method for suggesting a phrase based on a context
US20190199664A1 (en) * 2013-05-09 2019-06-27 Ebay Inc. System and method for suggesting a phrase based on a context
US10516636B2 (en) 2014-01-01 2019-12-24 SlamAd.com, Inc. Real-time messaging platform with enhanced privacy
US11509610B2 (en) 2014-01-01 2022-11-22 SlamAd.com, Inc. Real-time messaging platform with enhanced privacy
US10645041B2 (en) 2014-01-01 2020-05-05 SlamAd.com, Inc. Real-time messaging platform with enhanced privacy
US10873548B2 (en) 2014-01-01 2020-12-22 SlamAd.com, Inc. Real-time messaging platform with enhanced privacy
US11586683B2 (en) * 2015-02-03 2023-02-21 Line Corporation Methods, systems and recording mediums for managing conversation contents in messenger
WO2017090916A1 (en) * 2015-11-25 2017-06-01 Samsung Electronics Co., Ltd. Managing display of information on multiple devices based on context for a user task
US10846465B2 (en) 2016-06-30 2020-11-24 Microsoft Technology Licensing, Llc Integrating an application for surfacing data on an email message pane
WO2018119428A1 (en) * 2016-12-23 2018-06-28 Mutare, Inc. Unanswered-call handling and routing
US20180217864A1 (en) * 2017-02-02 2018-08-02 Samsung Electronics Co., Ltd Method and apparatus for managing content across applications
WO2018143723A1 (en) * 2017-02-02 2018-08-09 Samsung Electronics Co., Ltd. Method and apparatus for managing content across applications
US11630688B2 (en) * 2017-02-02 2023-04-18 Samsung Electronics Co., Ltd. Method and apparatus for managing content across applications
US11256752B2 (en) * 2018-05-02 2022-02-22 Samsung Electronics Co., Ltd. Contextual recommendation
US20230259957A1 (en) * 2022-02-11 2023-08-17 Target Brands, Inc. Guest messaging platform

Also Published As

Publication number Publication date
US20120239761A1 (en) 2012-09-20
EP2687028A4 (en) 2014-10-08
EP2687028A1 (en) 2014-01-22
US8849931B2 (en) 2014-09-30
WO2012125653A1 (en) 2012-09-20

Similar Documents

Publication Publication Date Title
US8849931B2 (en) Linking context-based information to text messages
US20210294825A1 (en) System and method for context enhanced mapping
US10949429B1 (en) Scoring authors of posts
US9026917B2 (en) System and method for context enhanced mapping within a user interface
US9574899B2 (en) Systems and method for determination and display of personalized distance
US8281027B2 (en) System and method for distributing media related to a location
US9356901B1 (en) Determining message prominence
US8370062B1 (en) Switching between location contexts
US8200247B1 (en) Confirming a venue of user location
US10209079B2 (en) Optimization of map views based on real-time data
US20130238727A1 (en) System and method for context enhanced messaging
US20120209839A1 (en) Providing applications with personalized and contextually relevant content
US20140222564A1 (en) Geo-located social connectivity relating to events and commerce
CN107851231A (en) Activity detection based on motility model
US20130290439A1 (en) Method and apparatus for notification and posting at social networks
CN105103105A (en) Social cover feed interface
JP2019016347A (en) User terminal providing retrieval service using emoticons, retrieval server, and operation method thereof
JP5996749B1 (en) Information providing apparatus, information providing program, and information providing method
US20130124973A1 (en) Automatic Diary for an Electronic Device
KR101767399B1 (en) Mobile advertising method
Yepez Diffusion of location based services and targeting US Hispanics: A case study

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION