US20060282530A1 - Methods and apparatus for end-user based service monitoring - Google Patents

Methods and apparatus for end-user based service monitoring Download PDF

Info

Publication number
US20060282530A1
US20060282530A1 US11/424,077 US42407706A US2006282530A1 US 20060282530 A1 US20060282530 A1 US 20060282530A1 US 42407706 A US42407706 A US 42407706A US 2006282530 A1 US2006282530 A1 US 2006282530A1
Authority
US
United States
Prior art keywords
requests
support
alarm
automated
topic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/424,077
Inventor
Stephen Klein
Adam Erlebacher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Colloquis Inc
Original Assignee
Colloquis Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Colloquis Inc filed Critical Colloquis Inc
Priority to US11/424,077 priority Critical patent/US20060282530A1/en
Assigned to COLLOQUIS, INC. reassignment COLLOQUIS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ERLEBACHER, ADAM, KLEIN, STEPHEN D
Publication of US20060282530A1 publication Critical patent/US20060282530A1/en
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC reassignment MICROSOFT TECHNOLOGY LICENSING, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MICROSOFT CORPORATION
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/54Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/53Network services using third party service providers

Definitions

  • service providers generally monitor the performance of the systems and services they provide to their customers.
  • the service provided is monitored for outages and other problems.
  • a phone company monitors the status of the central office system and their equipment.
  • the present invention provides methods and apparatus that use the amount and type of information accessed by users using an automated support system, as well as historical information about the levels of access to support information to automatically monitor the performance of service provided to end users. It does so by identifying changing trends in the topics requested by users from the customer support system.
  • the service provider monitors user interaction with an automated service agent to determine anomalous, e.g., spikes, in certain service areas.
  • a method comprises receiving user requests for support from an automated agent of an automated support system for a plurality of topics for at least one service, tracking the support requests for at least two of the plurality of topics, and determining trends in the tracked support requests to generate an alarm.
  • the method can further include one or more of following features: the received requests are processed by the automated agent, generating a baseline for topic support requests, the services include one or more of E-mail, Internet access, telephone, utilities, premise security, insurance coverage, banking, and investments, generating alarms by an alarm engine, identifying a party associated with the alarm and transmitting the alarm to the party, determining the trend includes determining a percentage increase above a predetermined threshold, receiving the requests as instant messages that initiate a conversation with an automated service agent, updating a distribution of the support request by topic, and comparing the distribution to a baseline distribution.
  • a system comprises an automated support system to receive user requests for support for a plurality of topics for at least one service, a monitoring module coupled to the automated support system to track the support requests and determine trends, and an alarm module to generate an alarm based upon the trends for the topic requests.
  • the system can further include one or more of the following features: the automated support system includes an automated agent to carry on a conversation with a user, the automated agent communicates with the user via instant messaging, the monitoring module generates a baseline for the support requests, the alarm module identifies a party to receive the alarm based upon the topic that generated the alarm.
  • FIG. 1 is a schematic block diagram of a system having user-based service monitoring in accordance with the present invention
  • FIG. 2 is a flow diagram showing an exemplary sequence of steps to implement user-based monitoring in accordance with the present invention
  • FIG. 3 is a graphical depiction of an exemplary report showing an alert condition
  • FIG. 4 is a block diagram of a system having an automated service agent to provide end-user based service monitoring.
  • FIG. 1 shows an exemplary system 10 including a service provider 12 that provides a service 14 to end users 16 with user-based service performance monitoring in accordance with exemplary embodiments of the invention.
  • the service 14 can be provided, for example, as phone service, utilities, e.g., electricity, gas, water etc., Internet access, alarm system, banking, insurance, investment, and the like.
  • the service 14 can be any service for which a user 16 may contact the service provider 12 to obtain some information on the service.
  • the service provider 12 provides end users with an automated support system 18 , which can locally or remotely located.
  • the automated support system 18 provides an automated interface for users 16 to contact the service provider 12 .
  • the automated support system 18 includes an automated agent to carry on a textual, or other type of, conversation with users to provide the desired assistance.
  • the automated agent can process user queries and interact using natural language processing.
  • the system 10 includes a monitoring module 20 to automatically monitor variations in user requests to the support system 18 . As described below, variations in user request levels for various topics can be used to identify possible disruptions by monitoring end user interaction with the automated support system.
  • a topic request storage database 21 can be used to store information on topic requests.
  • the system can further includes an alarm engine 22 to generate alarms from a set of rules 23 for transmission to a designated recipient 24 .
  • the alarm recipient 24 corresponds to the topic that generated the alarm, as described more fully below.
  • the user interacts with the automated support system 18 via a workstation 30 having a processor 32 and memory 34 on which an operating system 36 runs to support client applications, such as an Internet browser application 38 and/or an instant messaging application 40 , as well as other applications 42 .
  • client applications such as an Internet browser application 38 and/or an instant messaging application 40 , as well as other applications 42 .
  • FIG. 2 in conjunction with FIG. 1 , shows an exemplary sequence of steps to implement user-based monitoring in accordance with exemplary embodiments of the invention.
  • step 100 support requests are sent by the user and received by the automated support system.
  • step 102 the support requests are associated with a topic and stored.
  • various information for the support requests can be stored, such as rate (e.g., number of topic requests per unit time), length of time between topic requests, change from baseline, historical information, etc.
  • a topic distribution history includes the level of customer (user) inquiries for each topic that can be used to calculate averages and moving averages of queries to each topic, over a range of operator-determined time-period settings (i.e. hourly, daily, weekly, during specific ranges of minutes, hours, days, weeks. etc.). These average user query activity levels to each topic form a base line level.
  • the monitoring module outputs the current topic distribution level, such as for a display.
  • the alarm rules can be used to evaluate the current topic distribution and history to trigger alarms upon identification of predetermined criteria, such as statistically significant differences, particularly increases in user query activity level to specific topics in the current topic distribution in comparison to the baseline from the topic distribution history.
  • predetermined criteria such as statistically significant differences, particularly increases in user query activity level to specific topics in the current topic distribution in comparison to the baseline from the topic distribution history.
  • trends for particular topic requests are identified and alarms are generated after identifying a trend of a percentage increase above a predetermined threshold.
  • the level of statistical significance and threshold of acceptable ranges of variance can be defined by the rules, which can be provided by an operator managing the system, for example.
  • step 110 one or more alarms are generated and sent to a designated alarm recipient in step 112 .
  • the alarm recipient can be an employee or contractor of the service provider company responsible for system management or other designated individual or entity.
  • an alarm condition indicates that a specific support topic has been accessed by end users over the specified time period at a level that is above a predetermined threshold, indicating a likelihood that a component associated with the topic may have a failure, malfunction, communication issue, etc.
  • the alarms can be transmitted via any form of suitable electronic communication, including but not limited to electronic mail, telephone text messages, telephone voice messages, and paging system messages.
  • the automated support system can track user requests by topic in a variety of ways.
  • the automated support system tracks what are the most common topics requested by the end users and tracks what is the frequency of user inquiries to each topic.
  • a topic can be defined as a specific record in a knowledge base that is delivered to users' based on user queries; user queries may vary in their form, but generally seek resolution or response to the same “topic” area. For example, one user may ask “why can't I get my email?” and another might say “I'm having trouble retrieving email” but both result in a query to the same topic.
  • An Internet service provider deploys an automated service agent to enable its customers to engage in conversations with an automated customer support database.
  • the system constantly measures the level of customer inquiry to each topic stored in the automated service agent's knowledge database.
  • the typical level of inquiry to the topic titled “problems sending email” is, for example, 76 per hour during Monday to Friday 9:00 am to 5:00 pm Eastern Standard Time. On a Tuesday afternoon, between 2:15 pm and 2:30 pm EST the level of customer inquiries to this topic is 34 during the 15-minute period, implying a query-per-hour rate of 136 queries-per-hour to this topic, which is significantly higher than the average query-per-hour rate to this topic.
  • the system recognizes the statistically significant abnormal increase and sends an alert (or multiple alerts per the alert management settings determined by the system's operator) indicating to people responsible for managing the company's email systems that the customer support system has discovered a potential problem with the email sending system.
  • the alert system is managed by the system operator and individual topics can be assigned to send alerts to an individual assigned to the area of responsibility of that topic. So in the example cited above, an individual or group of individuals in the email management area of the ISP receive an alert about the mail sending problem users are experiencing. If the topic for which the alert is generated is related to a different system (i.e. video-on-demand problems) the topics related to the different system would be set to send alerts to the specific personnel responsible for the company's specific (i.e. video-on-demand services) systems.
  • the system includes a reporting apparatus, giving companies a system overview based on the customer usage patterns to their automated support system.
  • the reporting system graphically and numerically displays periods of high customer support inquiry rates to specific topics, revealing the period of time for which a specific system was not properly servicing customers, as evidenced by a heightened level of customer inquiries for the particular topic associated with the specific system.
  • peaks PK at various times can indicate a flood of customer topic requests/complaints in a particular area, here shown as not being able to send E-mails.
  • the series of peaks PK for the topic of ‘cannot send email’ define a trend that generates an alarm, which can be sent to the individual on call for E-mail issues. It appears that the situation was addressed as the peaks end at a short time after 6:00 am.
  • the reporting apparatus can be configured to display on-going levels of customer inquiries to specific topics to generate a picture of the ongoing levels of health of a company's various systems deployed to customers as evidenced by the relative levels of support problems generated by customers to each service or product offering.
  • Topic query rate during 10 am-11 am on average weekday are: (qph-Queries Per Hour) How Do I reset my password 162 I cannot send email 76 How do I speed up my downloads 12 How to pay my bills 39 My mailbox is full 43
  • Topic query rate during 10 am-11 am on sampled (today) date is: Qph variance How Do I reset my password 171 (+5.6%) I cannot send email 136 (+74%) How do I speed up my downloads 15 (+25%) How to pay my bills 39 (+0%) My mailbox is full 46 (+7%)
  • a statistical model of appropriate alarm events is established for each deployment, taking into consideration the degree of variance tempered with the statistical relevance. So in the above example, the large increase (+74%) in the level of query activity to the topic “I cannot send email” generates an alarm as it represents a significant (level of significance can be set by manager) and a stable sample (132/76 queries) being monitored. For example, a variance of over 50% results in the generation of an alarm. In one embodiment, the variance must be above the threshold for a given duration in order to generate the alarm.
  • alarm events are primarily shown and described in conjunction with user interaction via automated agents, it is understood that the invention is applicable to various systems and user interaction mechanisms, such as telephone call centers, menu-driven telephone messages, etc.
  • FIG. 4 shows an exemplary system 200 having an automated support system 202 that includes an automated service agent 204 to provide end-user based service monitoring.
  • a user 206 can interact with a client workstation 208 having an IM application 210 and a web browser application 212 in a manner well known to one of ordinary skill in the art.
  • An IM service 214 supports messaging over a network 216 , such as the Internet.
  • Various servers 218 a -N support web pages that can be accessed over the network 216 , which is well known to one of ordinary skill in the art.
  • the automated support system 202 includes a message processor 220 logged into the network 216 as a user of the instant messaging service 214 .
  • the user 206 is connected to the network 216 and the IM service provider 214 .
  • the IM application 222 between message processor 220 and the network is configured to enable access to the appropriate IM service provider(s).
  • the message processor 220 When the message processor 220 receives a request from the user 206 , the screen name of the user is stored and, in this embodiment, the request, is forwarded to a local or remotely located query response server 224 .
  • the query response server 224 includes a natural language interpreter or other intelligent system that is capable of responding to queries and other requests related to topics within at least a specified range of issues by generating an appropriate answer.
  • the answer generated by query response server 224 is returned to the message processor 220 where it is incorporated into an output message that is subsequently sent to the user through the IM network.
  • the output message can be forwarded to the user through any other designated means, including E-mail, fax, text messaging to wireless or hand-held devices, voice mail (via a text to speech output system), or any other type of messaging system specified by the user.
  • a user profile database 226 which contain various profiles associated which each user.
  • the profiles can be keyed to a user screen name in combination with the name of the instant messaging provider, for example “john@aol.”
  • the system 200 further includes a monitoring module 228 , which can be similar to the monitoring module 20 of FIG. 1 , an alarm engine 230 and rules 232 , which can be similar to the alarm engine 22 and rules 23 of FIG. 1 , and a topic request database 234 , which can be similar to the topic request storage module 21 of FIG. 1 .
  • the monitoring module 228 evaluates IM queries from users and associates the queries with a particular topic. Topic request information is stored in the database 234 . Upon detecting predetermined trends in the topic requests, the alarm engine 230 generates alarms based upon the rules 232 . For example, as described above, if the variance in topic requests increases more than a set amount above a baseline amount, an alarm is generated and transmitted to a designated recipient.

Abstract

Methods and apparatus to receive requests for support from an automated support system for a plurality of topics for at least one service, track the support requests for at least two of the plurality of topics, and determine trends in the tracked support requests to generate alarms. In one embodiment, the automated support system includes an automated agent.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • The present application claims in the benefit of U.S. Provisional Patent Application No. 60/690,240, filed on Jun. 14, 2005, which is incorporated herein by reference.
  • STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH
  • Not Applicable.
  • BACKGROUND OF THE INVENTION
  • As is known in the art, service providers generally monitor the performance of the systems and services they provide to their customers. In general, the service provided is monitored for outages and other problems. For example, a phone company monitors the status of the central office system and their equipment.
  • However, it may be difficult to monitor service performance from the end user perspective. For example, for an Internet Service Provider, it may be difficult to determine that end users are having significant E-mail difficulty. On site monitoring may indicate that all systems are functional even though end users are unable to use E-mail or other services.
  • SUMMARY OF THE INVENTION
  • The present invention provides methods and apparatus that use the amount and type of information accessed by users using an automated support system, as well as historical information about the levels of access to support information to automatically monitor the performance of service provided to end users. It does so by identifying changing trends in the topics requested by users from the customer support system. In one embodiment, the service provider monitors user interaction with an automated service agent to determine anomalous, e.g., spikes, in certain service areas.
  • In one aspect of the invention, a method comprises receiving user requests for support from an automated agent of an automated support system for a plurality of topics for at least one service, tracking the support requests for at least two of the plurality of topics, and determining trends in the tracked support requests to generate an alarm.
  • The method can further include one or more of following features: the received requests are processed by the automated agent, generating a baseline for topic support requests, the services include one or more of E-mail, Internet access, telephone, utilities, premise security, insurance coverage, banking, and investments, generating alarms by an alarm engine, identifying a party associated with the alarm and transmitting the alarm to the party, determining the trend includes determining a percentage increase above a predetermined threshold, receiving the requests as instant messages that initiate a conversation with an automated service agent, updating a distribution of the support request by topic, and comparing the distribution to a baseline distribution.
  • In another aspect of the invention, a system comprises an automated support system to receive user requests for support for a plurality of topics for at least one service, a monitoring module coupled to the automated support system to track the support requests and determine trends, and an alarm module to generate an alarm based upon the trends for the topic requests.
  • The system can further include one or more of the following features: the automated support system includes an automated agent to carry on a conversation with a user, the automated agent communicates with the user via instant messaging, the monitoring module generates a baseline for the support requests, the alarm module identifies a party to receive the alarm based upon the topic that generated the alarm.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention will be more fully understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
  • FIG. 1 is a schematic block diagram of a system having user-based service monitoring in accordance with the present invention;
  • FIG. 2 is a flow diagram showing an exemplary sequence of steps to implement user-based monitoring in accordance with the present invention;
  • FIG. 3 is a graphical depiction of an exemplary report showing an alert condition; and
  • FIG. 4 is a block diagram of a system having an automated service agent to provide end-user based service monitoring.
  • DETAILED DESCRIPTION OF THE INVENTION
  • FIG. 1 shows an exemplary system 10 including a service provider 12 that provides a service 14 to end users 16 with user-based service performance monitoring in accordance with exemplary embodiments of the invention. The service 14 can be provided, for example, as phone service, utilities, e.g., electricity, gas, water etc., Internet access, alarm system, banking, insurance, investment, and the like. In general, the service 14 can be any service for which a user 16 may contact the service provider 12 to obtain some information on the service.
  • In an exemplary embodiment, the service provider 12 provides end users with an automated support system 18, which can locally or remotely located. The automated support system 18 provides an automated interface for users 16 to contact the service provider 12.
  • In another embodiment, the automated support system 18 includes an automated agent to carry on a textual, or other type of, conversation with users to provide the desired assistance. As described more fully below, the automated agent can process user queries and interact using natural language processing.
  • The system 10 includes a monitoring module 20 to automatically monitor variations in user requests to the support system 18. As described below, variations in user request levels for various topics can be used to identify possible disruptions by monitoring end user interaction with the automated support system. A topic request storage database 21 can be used to store information on topic requests.
  • The system can further includes an alarm engine 22 to generate alarms from a set of rules 23 for transmission to a designated recipient 24. In one embodiment, the alarm recipient 24 corresponds to the topic that generated the alarm, as described more fully below.
  • In one embodiment, the user interacts with the automated support system 18 via a workstation 30 having a processor 32 and memory 34 on which an operating system 36 runs to support client applications, such as an Internet browser application 38 and/or an instant messaging application 40, as well as other applications 42.
  • FIG. 2, in conjunction with FIG. 1, shows an exemplary sequence of steps to implement user-based monitoring in accordance with exemplary embodiments of the invention. In step 100, support requests are sent by the user and received by the automated support system. In step 102, the support requests are associated with a topic and stored. In one embodiment, various information for the support requests can be stored, such as rate (e.g., number of topic requests per unit time), length of time between topic requests, change from baseline, historical information, etc.
  • In step 104, the monitoring module tabulates the topic requests and calculates how they are distributed for storage of topic distribution history information. In one embodiment, a topic distribution history includes the level of customer (user) inquiries for each topic that can be used to calculate averages and moving averages of queries to each topic, over a range of operator-determined time-period settings (i.e. hourly, daily, weekly, during specific ranges of minutes, hours, days, weeks. etc.). These average user query activity levels to each topic form a base line level. In optional step 106, the monitoring module outputs the current topic distribution level, such as for a display.
  • In step 108, the alarm rules can be used to evaluate the current topic distribution and history to trigger alarms upon identification of predetermined criteria, such as statistically significant differences, particularly increases in user query activity level to specific topics in the current topic distribution in comparison to the baseline from the topic distribution history. In one embodiment, trends for particular topic requests are identified and alarms are generated after identifying a trend of a percentage increase above a predetermined threshold. The level of statistical significance and threshold of acceptable ranges of variance can be defined by the rules, which can be provided by an operator managing the system, for example.
  • If an alarm condition has occurred as defined by the rules, in step 110 one or more alarms are generated and sent to a designated alarm recipient in step 112. The alarm recipient can be an employee or contractor of the service provider company responsible for system management or other designated individual or entity.
  • In one embodiment, an alarm condition indicates that a specific support topic has been accessed by end users over the specified time period at a level that is above a predetermined threshold, indicating a likelihood that a component associated with the topic may have a failure, malfunction, communication issue, etc.
  • In general, the alarms can be transmitted via any form of suitable electronic communication, including but not limited to electronic mail, telephone text messages, telephone voice messages, and paging system messages.
  • The automated support system can track user requests by topic in a variety of ways. In one embodiment, the automated support system tracks what are the most common topics requested by the end users and tracks what is the frequency of user inquiries to each topic. A topic can be defined as a specific record in a knowledge base that is delivered to users' based on user queries; user queries may vary in their form, but generally seek resolution or response to the same “topic” area. For example, one user may ask “why can't I get my email?” and another might say “I'm having trouble retrieving email” but both result in a query to the same topic.
  • EXAMPLE
  • An Internet service provider (ISP) deploys an automated service agent to enable its customers to engage in conversations with an automated customer support database. The system constantly measures the level of customer inquiry to each topic stored in the automated service agent's knowledge database. The typical level of inquiry to the topic titled “problems sending email” is, for example, 76 per hour during Monday to Friday 9:00 am to 5:00 pm Eastern Standard Time. On a Tuesday afternoon, between 2:15 pm and 2:30 pm EST the level of customer inquiries to this topic is 34 during the 15-minute period, implying a query-per-hour rate of 136 queries-per-hour to this topic, which is significantly higher than the average query-per-hour rate to this topic. In this case, at 2:30 pm EST on the Tuesday afternoon experiencing the increase in query activity to this topic, the system recognizes the statistically significant abnormal increase and sends an alert (or multiple alerts per the alert management settings determined by the system's operator) indicating to people responsible for managing the company's email systems that the customer support system has discovered a potential problem with the email sending system.
  • The alert system is managed by the system operator and individual topics can be assigned to send alerts to an individual assigned to the area of responsibility of that topic. So in the example cited above, an individual or group of individuals in the email management area of the ISP receive an alert about the mail sending problem users are experiencing. If the topic for which the alert is generated is related to a different system (i.e. video-on-demand problems) the topics related to the different system would be set to send alerts to the specific personnel responsible for the company's specific (i.e. video-on-demand services) systems.
  • In another embodiment of the invention shown in FIG. 3, the system includes a reporting apparatus, giving companies a system overview based on the customer usage patterns to their automated support system. The reporting system graphically and numerically displays periods of high customer support inquiry rates to specific topics, revealing the period of time for which a specific system was not properly servicing customers, as evidenced by a heightened level of customer inquiries for the particular topic associated with the specific system. As shown, peaks PK at various times can indicate a flood of customer topic requests/complaints in a particular area, here shown as not being able to send E-mails. As can be seen, the series of peaks PK for the topic of ‘cannot send email’ define a trend that generates an alarm, which can be sent to the individual on call for E-mail issues. It appears that the situation was addressed as the peaks end at a short time after 6:00 am.
  • In another embodiment, the reporting apparatus can be configured to display on-going levels of customer inquiries to specific topics to generate a picture of the ongoing levels of health of a company's various systems deployed to customers as evidenced by the relative levels of support problems generated by customers to each service or product offering.
  • EXAMPLE
  • Topic query rate during 10 am-11 am on average weekday are:
    (qph-Queries Per Hour)
    How Do I reset my password 162
    I cannot send email 76
    How do I speed up my downloads 12
    How to pay my bills 39
    My mailbox is full 43
  • Topic query rate during 10 am-11 am on sampled (today) date is:
    Qph variance
    How Do I reset my password 171 (+5.6%)
    I cannot send email 136 (+74%)
    How do I speed up my downloads 15 (+25%)
    How to pay my bills 39 (+0%)
    My mailbox is full 46 (+7%)
  • In one embodiment, a statistical model of appropriate alarm events is established for each deployment, taking into consideration the degree of variance tempered with the statistical relevance. So in the above example, the large increase (+74%) in the level of query activity to the topic “I cannot send email” generates an alarm as it represents a significant (level of significance can be set by manager) and a stable sample (132/76 queries) being monitored. For example, a variance of over 50% results in the generation of an alarm. In one embodiment, the variance must be above the threshold for a given duration in order to generate the alarm.
  • It is understood that a wide range of techniques for establishing threshold and criteria to identify alarm events will be readily apparent to one of ordinary skill in the art without departing from the present invention.
  • While the alarm events are primarily shown and described in conjunction with user interaction via automated agents, it is understood that the invention is applicable to various systems and user interaction mechanisms, such as telephone call centers, menu-driven telephone messages, etc.
  • FIG. 4 shows an exemplary system 200 having an automated support system 202 that includes an automated service agent 204 to provide end-user based service monitoring. A user 206 can interact with a client workstation 208 having an IM application 210 and a web browser application 212 in a manner well known to one of ordinary skill in the art. An IM service 214 supports messaging over a network 216, such as the Internet. Various servers 218 a-N support web pages that can be accessed over the network 216, which is well known to one of ordinary skill in the art.
  • To support IM capability, the automated support system 202 includes a message processor 220 logged into the network 216 as a user of the instant messaging service 214. The user 206 is connected to the network 216 and the IM service provider 214. The IM application 222 between message processor 220 and the network is configured to enable access to the appropriate IM service provider(s).
  • When the message processor 220 receives a request from the user 206, the screen name of the user is stored and, in this embodiment, the request, is forwarded to a local or remotely located query response server 224. In an exemplary embodiment, the query response server 224 includes a natural language interpreter or other intelligent system that is capable of responding to queries and other requests related to topics within at least a specified range of issues by generating an appropriate answer. The answer generated by query response server 224 is returned to the message processor 220 where it is incorporated into an output message that is subsequently sent to the user through the IM network. Alternatively, or in addition to, the output message can be forwarded to the user through any other designated means, including E-mail, fax, text messaging to wireless or hand-held devices, voice mail (via a text to speech output system), or any other type of messaging system specified by the user.
  • Various types of information received during the query response interaction can be stored for later use in a user profile database 226 which contain various profiles associated which each user. The profiles can be keyed to a user screen name in combination with the name of the instant messaging provider, for example “john@aol.”
  • The system 200 further includes a monitoring module 228, which can be similar to the monitoring module 20 of FIG. 1, an alarm engine 230 and rules 232, which can be similar to the alarm engine 22 and rules 23 of FIG. 1, and a topic request database 234, which can be similar to the topic request storage module 21 of FIG. 1.
  • The monitoring module 228 evaluates IM queries from users and associates the queries with a particular topic. Topic request information is stored in the database 234. Upon detecting predetermined trends in the topic requests, the alarm engine 230 generates alarms based upon the rules 232. For example, as described above, if the variance in topic requests increases more than a set amount above a baseline amount, an alarm is generated and transmitted to a designated recipient.
  • It will be understood by those of skill in the art that various changes and additions to the methods and systems described above can be made without departing from the spirit and scope of the invention.

Claims (20)

1. A method, comprising:
receiving user requests for support from an automated agent of an automated support system for a plurality of topics for at least one service;
tracking the support requests for at least two of the plurality of topics;
determining trends in the tracked support requests to generate an alarm.
2. The method according to claim 1, wherein the received requests are processed by the automated agent.
3. The method according to claim 1, further including generating a baseline for topic support requests.
4. The method according to claim 1, wherein services include one or more of E-mail, Internet access, telephone, utilities, premise security, insurance coverage, banking, and investments.
5. The method according to claim 1, further including generating alarms by an alarm engine.
6. The method according to claim 1, further including identifying a party associated with the alarm and transmitting the alarm to the party.
7. The method according to claim 1, wherein determining the trend includes determining a percentage increase above a predetermined threshold.
8. The method according to claim 1, further including receiving the requests as instant messages that initiate a conversation with an automated service agent.
9. The method according to claim 1, further including updating a distribution of the support request by topic.
10. The method according to claim 9, further including comparing the distribution to a baseline distribution.
11. A system, comprising:
an automated support system to receive user requests for support for a plurality of topics for at least one service;
a monitoring module coupled to the automated support system to track the support requests and determine trends; and
an alarm module to generate an alarm based upon the trends for the topic requests.
12. The system according to claim 11, wherein the automated support system includes an automated agent to carry on a conversation with a user.
13. The system according to claim 12, wherein the automated agent communicates with the user via instant messaging.
14. The system according to claim 11, wherein the monitoring module generates a baseline for the support requests.
15. The system according to claim 11, wherein the alarm module identifies a party to receive the alarm based upon the topic that generated the alarm.
16. An article, comprising:
a storage medium having stored thereon instructions that when executed by a machine result in the following:
receiving requests for support from an automated support system for a plurality of topics for at least one service;
tracking the support requests for at least two of the plurality of topics; and
determining trends in the tracked support requests to generate alarms.
17. The article according to claim 16, wherein the automated support system includes an automated agent to process the received requests.
18. The article according to claim 16, further including instructions for generating a baseline for topic support requests.
19. The article according to claim 16, further including instructions for identifying a party associated with the alarm and transmitting the alarm to the party.
20. The article according to claim 16, further including instructions for wherein determining the trend by determining a percentage increase above a predetermined threshold.
US11/424,077 2005-06-14 2006-06-14 Methods and apparatus for end-user based service monitoring Abandoned US20060282530A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/424,077 US20060282530A1 (en) 2005-06-14 2006-06-14 Methods and apparatus for end-user based service monitoring

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US69024005P 2005-06-14 2005-06-14
US11/424,077 US20060282530A1 (en) 2005-06-14 2006-06-14 Methods and apparatus for end-user based service monitoring

Publications (1)

Publication Number Publication Date
US20060282530A1 true US20060282530A1 (en) 2006-12-14

Family

ID=37525337

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/424,077 Abandoned US20060282530A1 (en) 2005-06-14 2006-06-14 Methods and apparatus for end-user based service monitoring

Country Status (1)

Country Link
US (1) US20060282530A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090077156A1 (en) * 2007-09-14 2009-03-19 Srinivas Raghav Kashyap Efficient constraint monitoring using adaptive thresholds
US20090132307A1 (en) * 2007-11-20 2009-05-21 Messer Martin Systems and methods for providing visibility in a technical support resolution process
US8108459B1 (en) * 2007-05-30 2012-01-31 Rocketon, Inc. Method and apparatus for distributing virtual goods over the internet
US8190733B1 (en) 2007-05-30 2012-05-29 Rocketon, Inc. Method and apparatus for virtual location-based services
US20140143026A1 (en) * 2012-11-21 2014-05-22 Verint Americas Inc. Use of Analytics Methods for Personalized Guidance

Citations (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5491791A (en) * 1995-01-13 1996-02-13 International Business Machines Corporation System and method for remote workstation monitoring within a distributed computing environment
US5794237A (en) * 1995-11-13 1998-08-11 International Business Machines Corporation System and method for improving problem source identification in computer systems employing relevance feedback and statistical source ranking
US6032184A (en) * 1995-12-29 2000-02-29 Mci Worldcom, Inc. Integrated interface for Web based customer care and trouble management
US6064304A (en) * 1995-03-29 2000-05-16 Cabletron Systems, Inc. Method and apparatus for policy-based alarm notification in a distributed network management environment
US6157618A (en) * 1999-01-26 2000-12-05 Microsoft Corporation Distributed internet user experience monitoring system
US6219648B1 (en) * 1997-03-31 2001-04-17 Sbc Technology Resources, Inc. Apparatus and method for monitoring progress of customer generated trouble tickets
US6236989B1 (en) * 1998-12-11 2001-05-22 International Business Machines Corporation Network-based help architecture
US6237114B1 (en) * 1998-05-13 2001-05-22 Sun Microsystems, Inc. System and method for evaluating monitored computer systems
US6327677B1 (en) * 1998-04-27 2001-12-04 Proactive Networks Method and apparatus for monitoring a network environment
US6353902B1 (en) * 1999-06-08 2002-03-05 Nortel Networks Limited Network fault prediction and proactive maintenance system
US6389426B1 (en) * 1999-02-09 2002-05-14 Worldcom, Inc. Central trouble ticket database and system and method for managing same to facilitate ticketing, trending, and tracking processes
US20020146668A1 (en) * 2001-04-05 2002-10-10 Burgin Daniel Keele System and method for automated end-user support
US20020145628A1 (en) * 2001-04-05 2002-10-10 Burgin Daniel Keele System and method for automated end-user support
US6470464B2 (en) * 1999-02-23 2002-10-22 International Business Machines Corporation System and method for predicting computer system performance and for making recommendations for improving its performance
US20020165892A1 (en) * 2001-05-03 2002-11-07 Doug Grumann Method and apparatus to extract the health of a service from a host machine
US20020183972A1 (en) * 2001-06-01 2002-12-05 Enck Brent A. Adaptive performance data measurement and collections
US20030005362A1 (en) * 2001-06-29 2003-01-02 Miller Jennifer J. System and method of automatic information collection and problem solution generation for computer storage devices
US20030023712A1 (en) * 2001-03-30 2003-01-30 Zhao Ling Z. Site monitor
US6516055B1 (en) * 1999-12-29 2003-02-04 Bellsouth Intellectual Property Corp. Interface for trouble report input system and trouble report resolution system
US20030065986A1 (en) * 2001-05-09 2003-04-03 Fraenkel Noam A. Root cause analysis of server system performance degradations
US6587847B1 (en) * 1999-08-24 2003-07-01 Stream International, Inc. Method and system for monitoring knowledge use
US6711615B2 (en) * 1998-11-09 2004-03-23 Sri International Network surveillance
US20040141508A1 (en) * 2002-08-16 2004-07-22 Nuasis Corporation Contact center architecture
US20040267750A1 (en) * 2003-06-30 2004-12-30 Aaron Jeffrey A. Automatically facilitated support for complex electronic services
US20050015667A1 (en) * 2003-06-30 2005-01-20 Aaron Jeffrey A. Automated diagnosis for electronic systems
US6859783B2 (en) * 1995-12-29 2005-02-22 Worldcom, Inc. Integrated interface for web based customer care and trouble management
US6985944B2 (en) * 2002-11-01 2006-01-10 Fidelia Technology, Inc. Distributing queries and combining query responses in a fault and performance monitoring system using distributed data gathering and storage
US7076695B2 (en) * 2001-07-20 2006-07-11 Opnet Technologies, Inc. System and methods for adaptive threshold determination for performance metrics
US7127456B1 (en) * 2002-12-05 2006-10-24 Ncr Corp. System and method for logging database queries
US20060265656A1 (en) * 2005-05-23 2006-11-23 Lambert Timothy M System and method for managing information handling system service communication
US20070038899A1 (en) * 2004-03-08 2007-02-15 O'brien Michael Method for managing faults in a computer system environment
US7257514B2 (en) * 2004-06-15 2007-08-14 Hewlett-Packard Development Company, L.P. Computer support service with solution function updates as a function of pre-delivery expert changes to automatically generated solutions
US7308482B2 (en) * 2002-02-12 2007-12-11 At&T Bls Intellectual Property, Inc. Methods and systems for communicating with service technicians in a telecommunications system
US20080027922A1 (en) * 2006-07-26 2008-01-31 Srinivasu Togari Automated support notification
US7340038B2 (en) * 2003-03-14 2008-03-04 At&T Bls Intellectual Property, Inc. Systems, methods and computer program products for automatically pushing a status change message as a result of repair services that are performed on a network
US7366731B2 (en) * 2003-12-12 2008-04-29 At&T Delaware Intellectual Property, Inc. Trouble ticket assignment

Patent Citations (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5491791A (en) * 1995-01-13 1996-02-13 International Business Machines Corporation System and method for remote workstation monitoring within a distributed computing environment
US6064304A (en) * 1995-03-29 2000-05-16 Cabletron Systems, Inc. Method and apparatus for policy-based alarm notification in a distributed network management environment
US5794237A (en) * 1995-11-13 1998-08-11 International Business Machines Corporation System and method for improving problem source identification in computer systems employing relevance feedback and statistical source ranking
US6859783B2 (en) * 1995-12-29 2005-02-22 Worldcom, Inc. Integrated interface for web based customer care and trouble management
US6032184A (en) * 1995-12-29 2000-02-29 Mci Worldcom, Inc. Integrated interface for Web based customer care and trouble management
US6219648B1 (en) * 1997-03-31 2001-04-17 Sbc Technology Resources, Inc. Apparatus and method for monitoring progress of customer generated trouble tickets
US6763333B2 (en) * 1997-03-31 2004-07-13 Sbc Technology Resources, Inc. Apparatus and method for monitoring progress of customer generated trouble tickets
US6327677B1 (en) * 1998-04-27 2001-12-04 Proactive Networks Method and apparatus for monitoring a network environment
US6237114B1 (en) * 1998-05-13 2001-05-22 Sun Microsystems, Inc. System and method for evaluating monitored computer systems
US6711615B2 (en) * 1998-11-09 2004-03-23 Sri International Network surveillance
US6236989B1 (en) * 1998-12-11 2001-05-22 International Business Machines Corporation Network-based help architecture
US6157618A (en) * 1999-01-26 2000-12-05 Microsoft Corporation Distributed internet user experience monitoring system
US6389426B1 (en) * 1999-02-09 2002-05-14 Worldcom, Inc. Central trouble ticket database and system and method for managing same to facilitate ticketing, trending, and tracking processes
US6470464B2 (en) * 1999-02-23 2002-10-22 International Business Machines Corporation System and method for predicting computer system performance and for making recommendations for improving its performance
US6353902B1 (en) * 1999-06-08 2002-03-05 Nortel Networks Limited Network fault prediction and proactive maintenance system
US6587847B1 (en) * 1999-08-24 2003-07-01 Stream International, Inc. Method and system for monitoring knowledge use
US6516055B1 (en) * 1999-12-29 2003-02-04 Bellsouth Intellectual Property Corp. Interface for trouble report input system and trouble report resolution system
US20030023712A1 (en) * 2001-03-30 2003-01-30 Zhao Ling Z. Site monitor
US20020146668A1 (en) * 2001-04-05 2002-10-10 Burgin Daniel Keele System and method for automated end-user support
US20020145628A1 (en) * 2001-04-05 2002-10-10 Burgin Daniel Keele System and method for automated end-user support
US20020165892A1 (en) * 2001-05-03 2002-11-07 Doug Grumann Method and apparatus to extract the health of a service from a host machine
US20030065986A1 (en) * 2001-05-09 2003-04-03 Fraenkel Noam A. Root cause analysis of server system performance degradations
US20020183972A1 (en) * 2001-06-01 2002-12-05 Enck Brent A. Adaptive performance data measurement and collections
US20030005362A1 (en) * 2001-06-29 2003-01-02 Miller Jennifer J. System and method of automatic information collection and problem solution generation for computer storage devices
US7076695B2 (en) * 2001-07-20 2006-07-11 Opnet Technologies, Inc. System and methods for adaptive threshold determination for performance metrics
US7308482B2 (en) * 2002-02-12 2007-12-11 At&T Bls Intellectual Property, Inc. Methods and systems for communicating with service technicians in a telecommunications system
US7382773B2 (en) * 2002-08-16 2008-06-03 Intervoice, Inc. Contact center with normalized multiple protocol architecture
US20040141508A1 (en) * 2002-08-16 2004-07-22 Nuasis Corporation Contact center architecture
US6985944B2 (en) * 2002-11-01 2006-01-10 Fidelia Technology, Inc. Distributing queries and combining query responses in a fault and performance monitoring system using distributed data gathering and storage
US7127456B1 (en) * 2002-12-05 2006-10-24 Ncr Corp. System and method for logging database queries
US7340038B2 (en) * 2003-03-14 2008-03-04 At&T Bls Intellectual Property, Inc. Systems, methods and computer program products for automatically pushing a status change message as a result of repair services that are performed on a network
US7324986B2 (en) * 2003-06-30 2008-01-29 At&T Delaware Intellectual Property, Inc. Automatically facilitated support for complex electronic services
US20050015667A1 (en) * 2003-06-30 2005-01-20 Aaron Jeffrey A. Automated diagnosis for electronic systems
US20040267750A1 (en) * 2003-06-30 2004-12-30 Aaron Jeffrey A. Automatically facilitated support for complex electronic services
US7409593B2 (en) * 2003-06-30 2008-08-05 At&T Delaware Intellectual Property, Inc. Automated diagnosis for computer networks
US7366731B2 (en) * 2003-12-12 2008-04-29 At&T Delaware Intellectual Property, Inc. Trouble ticket assignment
US20070038899A1 (en) * 2004-03-08 2007-02-15 O'brien Michael Method for managing faults in a computer system environment
US7257514B2 (en) * 2004-06-15 2007-08-14 Hewlett-Packard Development Company, L.P. Computer support service with solution function updates as a function of pre-delivery expert changes to automatically generated solutions
US20060265656A1 (en) * 2005-05-23 2006-11-23 Lambert Timothy M System and method for managing information handling system service communication
US20080027922A1 (en) * 2006-07-26 2008-01-31 Srinivasu Togari Automated support notification

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8510413B1 (en) 2007-05-30 2013-08-13 Hyperlayers, Inc. Method and apparatus for promoting desired on-line activities using on-line games
US8108459B1 (en) * 2007-05-30 2012-01-31 Rocketon, Inc. Method and apparatus for distributing virtual goods over the internet
US9240014B1 (en) 2007-05-30 2016-01-19 Lavamind Llc Method and apparatus for promotion of users in rules-based virtual worlds
US8788961B1 (en) 2007-05-30 2014-07-22 Hyperlayers, Inc. Method and apparatus for motivating interactions between users in virtual worlds
US8190733B1 (en) 2007-05-30 2012-05-29 Rocketon, Inc. Method and apparatus for virtual location-based services
US8239487B1 (en) 2007-05-30 2012-08-07 Rocketon, Inc. Method and apparatus for promoting desired on-line activities using on-line games
US8443039B2 (en) * 2007-05-30 2013-05-14 Hyperlayers, Inc. Method and apparatus for distributing virtual goods over the internet
US8490007B1 (en) 2007-05-30 2013-07-16 Hyperlayers, Inc. Method and apparatus for motivating interactions between users in virtual worlds
US9238174B2 (en) 2007-05-30 2016-01-19 Lavamind Llc Method and apparatus for virtual location-based services
US9137273B2 (en) 2007-05-30 2015-09-15 Lavamind Llc Method and apparatus for distributing virtual goods over the internet
US20120131086A1 (en) * 2007-05-30 2012-05-24 Steven Samuel Hoffman Method and Apparatus for Distributing Virtual Goods Over the Internet
US9028324B1 (en) 2007-05-30 2015-05-12 Lavamind Llc Method and apparatus for promoting desired on-line activities using on-line games
US20090077156A1 (en) * 2007-09-14 2009-03-19 Srinivas Raghav Kashyap Efficient constraint monitoring using adaptive thresholds
US20090132307A1 (en) * 2007-11-20 2009-05-21 Messer Martin Systems and methods for providing visibility in a technical support resolution process
US10282701B2 (en) * 2007-11-20 2019-05-07 Red Hat, Inc. Web-based technical issue assignments based on technical support groups having handled a highest number of technical requests
US11687866B2 (en) 2012-11-21 2023-06-27 Verint Americas Inc. Use of analytics methods for personalized guidance
US20140143026A1 (en) * 2012-11-21 2014-05-22 Verint Americas Inc. Use of Analytics Methods for Personalized Guidance
US10740712B2 (en) * 2012-11-21 2020-08-11 Verint Americas Inc. Use of analytics methods for personalized guidance

Similar Documents

Publication Publication Date Title
US8125328B2 (en) System and method for providing managed remote monitoring services
US9231837B2 (en) Methods and apparatus for collecting, analyzing, and presenting data in a communication network
US7197131B2 (en) Web-based network monitoring tool
CN1942007B (en) Telephony extension attack detection, recording, and intelligent prevention
CN100388693C (en) Method and system for monitoring service quality according to service level protocol
US9041544B2 (en) Power outage detection
US20080037761A1 (en) Remotely Monitoring Call Center Statistics
US7978605B2 (en) Methods and apparatus for directory enabled network services
US8145954B2 (en) System and method for generating a chronic circuit report for use in proactive maintenance of a communication network
US8223954B2 (en) System and method for automating customer relations in a communications environment
US20060126801A1 (en) Trouble ticket monitoring system having internet enabled and web-based graphical user interface to trouble ticket workload management systems
JP2001057555A (en) Network fault detection method and device
US20060282530A1 (en) Methods and apparatus for end-user based service monitoring
CN107947998B (en) Real-time monitoring system based on application system
US20080222286A1 (en) Computer Usage Monitoring
US20200280501A1 (en) Automation of customer support sorting process
CN101854647A (en) Method for remotely monitoring and managing mobile agent server (MAS) through short message interface
CN101621816A (en) System and method for monitoring background server of mobile terminal
US20100074417A1 (en) Systems and methods for monitoring voice service feature failures in a telecommunication network
US20060269050A1 (en) Adaptive fraud management systems and methods for telecommunications
US7120633B1 (en) Method and system for automated handling of alarms from a fault management system for a telecommunications network
US8976785B2 (en) System and method for voice redundancy service
JP2000354035A (en) Centralized non-infiltration monitoring system and method for distributed independent data network
EP1622310A2 (en) Administration system for network management systems
WO2001027787A1 (en) Event monitoring and closed-loop response system

Legal Events

Date Code Title Description
AS Assignment

Owner name: COLLOQUIS, INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KLEIN, STEPHEN D;ERLEBACHER, ADAM;REEL/FRAME:018143/0693;SIGNING DATES FROM 20060705 TO 20060816

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034766/0509

Effective date: 20141014