US6393387B1 - System and method for model mining complex information technology systems - Google Patents
System and method for model mining complex information technology systems Download PDFInfo
- Publication number
- US6393387B1 US6393387B1 US09/036,394 US3639498A US6393387B1 US 6393387 B1 US6393387 B1 US 6393387B1 US 3639498 A US3639498 A US 3639498A US 6393387 B1 US6393387 B1 US 6393387B1
- Authority
- US
- United States
- Prior art keywords
- model
- performance data
- performance
- adaptive
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3495—Performance evaluation by tracing or monitoring for systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3447—Performance evaluation by modeling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/81—Threshold
Definitions
- the present invention relates to complex information technology systems (IT) and, in particular, to a system and method for discovering relations between components in a complex IT system, and more particularly, to techniques for iteratively determining IT system component associations.
- IT information technology systems
- IT information technology
- interconnected systems such as the one shown in FIG. 1
- system performance begins to lag or becomes inconsistent, even becoming chaotic in nature.
- the addition or removal of one component, even seemingly minor, could have dramatic consequences on the performance of the whole system.
- Even an upgrade on one component could adversely affect a distant, seemingly unrelated component.
- the system and method of the present invention is directed to techniques to better predict the behavior of complex IT systems, offering system administrators the opportunity to identify problem areas such as performance bottlenecks and to correct them prior to a system or component failure.
- data mining is an analysis of data in a database using tools which determine trends or patterns of event occurrences without knowledge of the meaning of the analyzed data. Such analysis may reveal strategic information that is hidden in vast amounts of data stored in a database.
- data mining is used when the quantity of information being analyzed is very large, when variables of interest are influenced by complicated relations to other variables, when the importance of the variable varies with its own value, or when the importance of variables vary with respect to time. In situations such as these, traditional statistical analysis techniques or common database management systems may fail or become unduly cumbersome.
- Such data mining techniques are being increasingly utilized in a number of fields, including banking, marketing, biomedical applications and a number of other industries.
- Insurance companies and banks have used data mining for risk analysis, for example, using data mining methods in investigating its own claims databases for relations between client characteristics and corresponding claims.
- Insurance companies have obvious interest in the characteristics of their policy holders, particularly those exhibiting risky or otherwise inappropriate activities or behaviors adverse to the companies' interests, and with such analyses, are able to determine risk-profiles and adjust premiums commensurate with the determined risk.
- Data mining has also found great success in direct marketing strategies. Direct marketing firms are able to determine relationships between personal attributes, such as age, gender, locality, income, and the likelihood that a person will respond to, for instance, a particular direct mailing. These relationships may then be used to direct mailing towards persons with the greatest probability of responding, thus enhancing the companies' prospects and potential profits.
- the company mails X number of direct marketing sales proposals. Out of these mailing, a percentage Y reply.
- Data mining techniques are then applied to a database containing biographical information on all persons to whom mailings were directed. Relational factors between those that did and did not respond may be determined. The result is a subgroup of the original database with mailing targets that have demonstrated a greater probability of responding.
- This subgroup could be, for example, middle-aged, dual-income families with one child. Future mailings could be directed towards families fitting this biographical data. Responses from these familial groups could then be further data mined in relation to the original group to refine the analysis. A process such as this could be repeated indefinitely, where changes in behaviors of targeted groups would be recovered over time through increased amounts of data that is analyzed and with repeated analysis. In this sense, the data mining analysis ‘learns’ from each repeated result. In this example, data mining is used to predict the behavior of customers based on historical analysis of their behavior.
- data mining may also be employed in predicting the behavior of the components of a complex information technology (IT) system. Similar approaches with appropriate modifications can be used to determine how interconnected components influence each other and for uncovering complex relations that exist throughout the IT system.
- IT information technology
- multiple applications will be operated within a common IT infrastructure, such as the one shown in FIG. 1 . Often, these applications will utilize some of the same resources. It is obvious that sharing of IT infrastructure resources among different applications may cause unexpected interactions or system behavior and often such unexpected interactions, being non-synergist are undesirable in nature.
- An example would be multiple business applications sharing a router within an IT system. As illustrated, a particular application, e.g., an E-mail service, burdens a router in such a way that other applications do not function well. In this example, it is reasonable to expect numerous applications to, at times, share usage of the router. Traditional systems management techniques may prove difficult in determining which specific application is causing loss of system performance. This example explains why the need to find hidden relationships among IT system components and applications running in such environments exist. By way of solving the problem in the previous example, it may be necessary to reroute E-mail traffic through another router to obtain adequate performance for the other applications.
- FIG. 2 Shown in FIG. 2 is a traditional IT systems management model, generally designated by the reference numeral 200 .
- system administrators 210 having knowledge of the IT infrastructure, such as the one shown in FIG. 1 hereinafter and generally designated herein by reference numeral 220 , which they are managing.
- the knowledge of the infrastructure 220 is scattered among the various personnel comprising the system administrator group 210 .
- the total of this knowledge is limited to the sum of the individual administrators' knowledge, where invariably there is a great deal of redundancy of knowledge. This redundancy may be considered an inefficiency of the overall knowledge base.
- system monitoring When system monitoring is included in the aforementioned traditional management system, this monitoring is usually limited to real time data, such as the current system load and the like. An administrator may observe such reporting of real time data, and if system loads or events being monitored are noticed to be consistent with loads that the administrator recognizes to be associated with impending system malfunction or loss of performance, that administrator may redirect part of the load through alternative subsystems of the IT infrastructure.
- Such real time data reporting may be used in coordination with a system model of the IT system, of which data is being collected and reported.
- the model usually includes a computer algorithm that utilizes code governing the relations among various system devices.
- a problem with such models is that the relations used in modeling the system account only for expected interactions among components and subsystems.
- the model is, therefore, merely an idealized model of the actual system. Hidden or unexpected relations that exist between components would not be accounted for.
- the model must be manually altered to include new relations in the model algorithm to account for the changes made.
- An expert system is a form of artificial intelligence in which a computer program containing a database, frequently referred to as a knowledge base, and a number of algorithms used to extrapolate facts from the programmed knowledge and new data that is input into the system.
- the knowledge base is a compilation of human expertise used to aid in solving problems, e.g., in medical diagnosis.
- the utility of the expert system is, however, limited to the quality of the data and algorithms that are input into the system by the human expert.
- expert systems are developed so that knowledge may be accumulated from a person or persons skilled in a specific area of technology and stored in an easily retrievable media. This way, persons less skilled than the experts, whose knowledge was accumulated within the expert system, have access to such expert information. In this manner, a company may save human and financial resources by having less skilled personnel access such expert systems instead of requiring the expert to handle all of such situations requiring a certain level of knowledge.
- Utilization of such expert systems allows less skilled persons to also analyze IT systems behavior. These systems may be used to aid in troubleshooting faults in an IT system or they may be used to assist in predicting such faults with the assistance of system performance monitors, i.e., a person with access to an expert system applied to a particular IT system may, through appropriate monitors, study system load parameters or the like and through the use of the expert system, make estimates of potential faults due to system bottlenecks or the like.
- the present invention is a further progression towards the realization of a fully automated IT management system.
- the idea of such techniques may be applied to complex IT system models in determining causal relations between IT system components.
- the system and method of the present invention when implemented determine how the interlinked components influence each other in terms of performance, potentially uncovering unexpected relations among different components of an IT system and automatically creating or updating causal association models of such systems. This is accomplished through the use of association rule induction methods in conjunction with other data mining techniques applied on historical data sets of system state data.
- Another desirable feature of an IT system is to reduce the amount of human intervention required for the system to adapt to dynamic system changes. This is preferably accomplished through automation.
- system and method of the present invention analyze system performances with Boolean attributes, i.e., true or false.
- the present invention is directed to a system and method for automatically creating causal association models of complex information technology (IT) systems by use of association rule induction methods, preferably in conjunction with other data mining techniques.
- System state information is periodically recorded by system monitors placed throughout the IT system. This state information is then stored in a database with the system model.
- a model of the IT system environment is developed in terms of system components and relations between them. This model may be defined with any level of detail and does not necessarily have to be complete or consistent.
- Thresholds are defined in terms of monitoring events. These thresholds are used to convert the monitored state information from its monitored numeric format to Boolean values. Target components are then selected and an association rules algorithm searches for associations with other components based on the Boolean values obtained from comparisons between monitored state information and associated thresholds. The probability of causal relation between components are indicated by sets of association rules. Causal relations implied by the model may then be confirmed or refuted. Causal relations discovered that are not implied by the model may indicate the model is incomplete. In this manner, the causal relations of the model may be refined to more accurately model the system environment.
- FIG. 1 is an exemplary network system upon which the system and method of the present invention may be employed;
- FIG. 2 is a block diagram of a traditional IT systems management method
- FIG. 3 is a block diagram of a system and method for adaptive system management in accordance with the present invention.
- FIG. 4 is a schematic diagram illustrating causal modeling between two simple elements within an IT system.
- FIG. 3 shows a model of an adaptive system management scenario in accordance with the system and method of the present invention.
- the application of data mining for causal relations of system components on an information technology (IT) system is illustrated in FIG. 3, in which the IT system 100 / 305 is connected to at least one monitor 310 that monitors the performance of the IT system 305 .
- the monitor 310 is connected to a historical database 315 , which is used to store various performance measurements on the IT system 100 .
- the historical database 315 is connected to a number of learning algorithms 320 .
- These learning algorithms uses association rule induction methods well known to those skilled in the data mining community to create causal association models of the IT system.
- Elements or events relating to the IT system or infrastructure 305 are monitored throughout the system by appropriate monitoring schemes housed within the monitors 310 .
- Data from the aforementioned monitoring is forwarded by the monitors 310 and input into the historical database 315 .
- the data within the historical database 315 including the newly updated information on the IT system 305 performance is then subjected to an association rules algorithm of the learning algorithms 320 .
- the association rules algorithm 320 may confirm or refute associations in the existing IT system model, or, it may recover associations which are not considered in the model.
- the learning algorithms 320 then update an adaptive model of the IT infrastructure, designated by the reference numeral 325 by adding, removing, or altering existing modeled associations.
- the management environment stores all collected information and uses various learning techniques to learn about the IT system 305 being managed. It should be understood that the aforementioned ‘learning’ algorithms are well-known to those skilled in the art. These learning techniques enable the management environment to better adapt itself to the IT infrastructure 305 being managed. Further information will then be collected and stored so that the learning process continues. In fact, the entire monitoring, learning, and adapting process provided by the system and method of the present invention is continuous and iterative.
- thresholds for various system performances. These thresholds are required since, when monitoring and recording system state data, numerical data is recovered. This numerical data is ill suited for typical association rules algorithms that are to be utilized in the present invention. By defining thresholds for each specific set of monitored data, the numerical nature of the monitored data is converted to a Boolean value by simple comparison between the monitored data and its corresponding threshold.
- Database 105 also denoted herein by the reference identifier A, is resident on a server 110 such that numerous and diverse users may query the database 105 .
- a login may conventionally be performed through another database, in this example database 115 , also referred to herein as database B. Therefore, for a system user, such as at a remote computer 140 , to remotely query database A, login is executed through database B, which upon a successful login grants a user rights to query database A.
- a threshold may be established by knowledgeable management personnel, designated in FIG. 2 by the reference numeral 230 . Typically, such a threshold would be formed with knowledge of the server performances on which databases A and B reside and a general knowledge of data traffic through these servers.
- such a query may be executed from computer 140 or another computer 145 . Therefore, an obvious effect of such a query would be on the performance of a hub element 135 .
- a number of elements may often exist that could unknowingly effect system performance, such as the database query of the ongoing discussion, a network printer 165 , another printer 155 , a server 160 or any of a wide variety of system hardware resources or software applications running on system 100 .
- a further discussion of potential deleterious effects within a network, such as shown in FIG. 1, may be found in Applicants' aforementioned co-pending patent application.
- the startup time of database A is a reasonable measure of the performance of database A. Therefore, the targeted performance level of database A, or a performance threshold, could be constructed from the access times of databases A and B. Since access time has been assumed to be a good measure of performance of such an application, total access time for database A may include the access time of database B since effective execution of database A is prolonged by the execution of database B. For this case, the total access time, (AT) AB , for startup of database A may be found from the sum of the startup times of the individual databases, AT A and AT B , in other words,
- This threshold would indicate, in a Boolean format, that execution of database A in a time of less than or equal to 3 seconds is satisfactory and an execution time exceeding 3 seconds is unsatisfactory and may be recorded in a form similar to the following:
- the previous example utilizes a defined threshold, TH AB .
- some thresholds may not be defined but rather discovered.
- a threshold For an example of such a threshold, consider a monitor that collects (counts) the number of disk accesses to a specific hard drive. Often times, the total number of disk accesses may be of little or no value, i.e., resetting of the monitor counter may yield the monitored values useless. However, the average number of disk accesses per unit time may be very valuable.
- the numeric value of the cumulative disk accesses may be converted to a useful Boolean attribute in a manner similar to the previous example where the Boolean value would indicate a load above or below the component's average load. For the monitor of the current example, herein denoted monitor Y , the conversion to a Boolean value would be given according to the following logical expression:
- (Higher_than_average) Y is a Boolean value describing the load on component Y.
- a threshold as the average value of component Y, (Average_Monitor Y )
- monitored component state data may be converted to Boolean values by the use of either defined or discovered thresholds. In this way, every monitored component state is able to be described as either in a high or low state.
- thresholds may be static, i.e., TH AB , or dynamic, i.e., TH(Average_Monitor Y ).
- each monitor 310 may or may not have its own local memory. Typically, all monitored data would be directed to one central storage location. However, this is not a necessity. Such data could possibly be stored locally at a respective monitor 310 and then later sent to a central database where data mining applications may be used to analyze the data.
- Data monitors 310 may be placed throughout the IT infrastructure 305 at various components within the system. Monitoring activity may be directed to any number of components with, in general, the overall effectiveness of the present invention enhanced with a corresponding increase in the number of monitors 310 being utilized. These monitors 310 preferably perform their specific monitoring activity automatically and at specific time intervals.
- the type of data being monitored and stored in the historical database 315 may be generally described as state or usage information on a component level, i.e., a harddisk, database, or a network segment.
- a monitor 310 used to monitor and record historical data on a particular harddisk may record free capacity of the disk and whether the disk is being accessed or not. Similar data collected from monitoring a database may include the number of users accessing the database, query volume, and access time.
- a final input to be considered is the original system model.
- the model of the IT system 305 should be developed in terms of system components and relations between these components. A better understanding of development of such a model may be had with reference to FIG. 4 .
- This figure depicts a simplified example relationship between two common IT system components, a Mail Server 400 and File Server 410 , and respective clients 420 , 430 and 440 , attached thereto.
- the original model is derived from expected interactions among such components. From inspection of FIG. 4, the following relations would likely be expected and would therefore be included in the original system model:
- the algorithm searches for relations among system state data by techniques well known to those in the data mining community. These relations are then compared to expected relations as predicted by the current system model given identical system state input. In this manner, causal relationships in the model can be confirmed or refuted, allowing the model to be updated to more accurately model the real IT system.
- association rules algorithm may discover over some time that client mail at Mail Client 420 or another Mail Client 430 is not readable whenever the File Server 410 is down. This would indicate that the Mail Server 400 and File Server 410 are not independent elements. In this case, the following rules or their equivalent, would be generated from the association rules induction algorithm:
- the model would then be updated, either by an administrator or automatically, to reflect their newly discovered causal relations between the Mail Server 400 and File Server 410 services.
- causal relations among various components would not be so discrete but instead would be determined to have complex probability relations among one another. These types of relations are often expressed with relative ‘weights’ among each other. In such, the model may not be adapted by simply removing or adding causal relations.
- new information that is discovered may relate to thresholds existing between components. In the previous example, a threshold may be determined such that when the Mail Server 400 is serving X number of clients during a period of time, there is a probability Y of the File Server 410 failing. New information uncovered relating to the causal relation between the Mail Server 400 and File Servers 410 of the current example may simply be to adjust the threshold of the Mail Server 400 load, X, at which performance of the File Server 410 begins to become faulty.
- association rules algorithms work only with binary values. Of consequence is the necessity of converting monitored values into binary values. This is accomplished per the previously discussed thresholds and conversion techniques. These Boolean values are then used as descriptors for system component states to be input into the association rules algorithm. The Boolean values are simply used to describe the monitored state of components. It is these Boolean values that allow the use of such association rules algorithms.
- the association rules algorithm verifies or refutes causal association rules of the model, where such rules have the following general form:
- Monitor A (antecedent) ⁇ Monitor B (consequent)(confidence x%, support y%)
- the antecedent and consequent are simply characterizations describing the states of the respective monitors.
- the confidence is the probability that the consequent is true given that the antecedent is true.
- Support is the percentage of cases within the total data set for which the rule is found to be true.
- the input to the association rules algorithm consisted of the historical data set of historical system component state data, thresholds relating to component state data, and the system component relations that would currently reside in the system model.
- the administrator may select the Mail Server 400 as a target component to be analyzed by the system and method of the present invention.
- the historical database of system component state data and this data's associated thresholds would then be analyzed by techniques known to those skilled in the art, e.g., through analysis of decision nodes of decision trees as described in more detail in Applicants' copending patent application. Components with apparent interactions with the Mail Server 400 would be identified.
- the components thresholds are then used to convert the numerical state data to Boolean attributes describing such states.
- the system component state data, now described with discrete Boolean attributes, are then input into an association rules algorithm to search for causal relations on the target component, which is the Mail Server 400 in this example.
- the output of the process would be a new set of associations between the target component and other components.
- the output may be manifested in a number of ways.
- a initial set of association rules is generated. These rules are then compared to the association rules in the model. In this way, common algorithm coding techniques can render the output process substantially automatically.
- Results of the comparison between the discovered set of association rules and those rules in the model would have two possible outcomes: association rules discovered that are coincident with those rules in the model and association rules discovered that are not included in the model. Therefore causal relations not known or implied by the model would be determined in a new set of association rules output by the association rules algorithm, and, association rules discovered that were implied by the model would give further corroboration by the association rules algorithm output.
- possible association rules that may be discovered by the association rules algorithm include the following:
- the first two association rules output are noted to be coincident with those association rules of the model. However, the last two association rules are not included in the model.
- the system and method of the present invention may be realized in an automated fashion by having the newly discovered association rules automatically added to the model by means of appropriate coding techniques.
- an automated means may not be desirable.
- the newly discovered association rules that are not included in the model may be output to a system administrator to observe or verify before the model is altered.
Abstract
Description
Claims (55)
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/036,394 US6393387B1 (en) | 1998-03-06 | 1998-03-06 | System and method for model mining complex information technology systems |
PCT/US1999/004685 WO1999045467A1 (en) | 1998-03-06 | 1999-03-04 | System and method for model mining complex information technology systems |
AT99909786T ATE346339T1 (en) | 1998-03-06 | 1999-03-04 | SYSTEM AND METHOD FOR MODEL MINING OF COMPLEX INFORMATION TECHNOLOGY SYSTEMS |
DE69934102T DE69934102T2 (en) | 1998-03-06 | 1999-03-04 | SYSTEM AND METHOD FOR MODEL MINING OF COMPLEX INFORMATION TECHNOLOGY SYSTEMS |
AU28914/99A AU2891499A (en) | 1998-03-06 | 1999-03-04 | System and method for model mining complex information technology systems |
EP99909786A EP1062583B1 (en) | 1998-03-06 | 1999-03-04 | System and method for model mining complex information technology systems |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/036,394 US6393387B1 (en) | 1998-03-06 | 1998-03-06 | System and method for model mining complex information technology systems |
Publications (1)
Publication Number | Publication Date |
---|---|
US6393387B1 true US6393387B1 (en) | 2002-05-21 |
Family
ID=21888380
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/036,394 Expired - Lifetime US6393387B1 (en) | 1998-03-06 | 1998-03-06 | System and method for model mining complex information technology systems |
Country Status (6)
Country | Link |
---|---|
US (1) | US6393387B1 (en) |
EP (1) | EP1062583B1 (en) |
AT (1) | ATE346339T1 (en) |
AU (1) | AU2891499A (en) |
DE (1) | DE69934102T2 (en) |
WO (1) | WO1999045467A1 (en) |
Cited By (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020075307A1 (en) * | 2000-09-28 | 2002-06-20 | Vigilos, Inc. | System and method for dynamic interaction with remote devices |
US20020143934A1 (en) * | 2000-09-28 | 2002-10-03 | Barker Geoffrey T. | System and method for providing configurable security monitoring utilizing an integrated information system |
US20020143938A1 (en) * | 2000-09-28 | 2002-10-03 | Bruce Alexander | System and method for providing configurable security monitoring utilizing an integrated information system |
US20020161875A1 (en) * | 2001-04-30 | 2002-10-31 | Raymond Robert L. | Dynamic generation of context-sensitive data and instructions for troubleshooting problem events in information network systems |
US20020158899A1 (en) * | 2001-04-30 | 2002-10-31 | Robert Raymond | Portal system and method for managing resources in a networked computing environment |
US20030088456A1 (en) * | 2001-11-08 | 2003-05-08 | International Business Machines Corporation | Automated information technology management system |
US6591147B2 (en) * | 1998-09-07 | 2003-07-08 | Kabushiki Kaisha Toshiba | Adjustment control and adjustment control method |
US20030167335A1 (en) * | 2002-03-04 | 2003-09-04 | Vigilos, Inc. | System and method for network-based communication |
US20030206172A1 (en) * | 2002-03-05 | 2003-11-06 | Vigilos, Inc. | System and method for the asynchronous collection and management of video data |
US20040103181A1 (en) * | 2002-11-27 | 2004-05-27 | Chambliss David Darden | System and method for managing the performance of a computer system based on operational characteristics of the system components |
US20040117336A1 (en) * | 2002-12-17 | 2004-06-17 | Jayanta Basak | Interpretable unsupervised decision trees |
US20050102303A1 (en) * | 2003-11-12 | 2005-05-12 | International Business Machines Corporation | Computer-implemented method, system and program product for mapping a user data schema to a mining model schema |
US20050114360A1 (en) * | 2003-11-24 | 2005-05-26 | International Business Machines Corporation | Computerized data mining system, method and program product |
US20050114277A1 (en) * | 2003-11-21 | 2005-05-26 | International Business Machines Corporation | Method, system and program product for evaluating a data mining algorithm |
US20060047512A1 (en) * | 2004-08-27 | 2006-03-02 | Chao Yuan | System, device, and methods for updating system-monitoring models |
US20060112166A1 (en) * | 2004-11-19 | 2006-05-25 | Nancy Pettigrew | System and method for disaster recovery and management of an email system |
US7065524B1 (en) * | 2001-03-30 | 2006-06-20 | Pharsight Corporation | Identification and correction of confounders in a statistical analysis |
US20060190960A1 (en) * | 2005-02-14 | 2006-08-24 | Barker Geoffrey T | System and method for incorporating video analytics in a monitoring network |
US7107339B1 (en) * | 2001-04-07 | 2006-09-12 | Webmethods, Inc. | Predictive monitoring and problem identification in an information technology (IT) infrastructure |
US20060248033A1 (en) * | 2005-04-19 | 2006-11-02 | International Business Machines Corporation | Data mining within a message handling system |
US20070198493A1 (en) * | 2006-02-22 | 2007-08-23 | First American Real Estate Solutions, L.P. | System and method for monitoring events associated with a person or property |
US20080046402A1 (en) * | 2003-11-21 | 2008-02-21 | Russell Feng-Wei C | Computerized method, system and program product for generating a data mining model |
US20080104389A1 (en) * | 2006-10-31 | 2008-05-01 | Jon Duane Warden | Computer system model generation with tracking of actual computer system configuration |
US7383238B1 (en) | 2004-02-24 | 2008-06-03 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Inductive monitoring system constructed from nominal system data and its use in real-time system monitoring |
US20090177929A1 (en) * | 2007-11-21 | 2009-07-09 | Rachid Sijelmassi | Method and apparatus for adaptive declarative monitoring |
US20100004952A1 (en) * | 2008-07-01 | 2010-01-07 | First American Corelogic, Inc. | System and method for tracking, monitoring and reporting extinguishment of a title insurance policy |
US20100106629A1 (en) * | 2006-06-13 | 2010-04-29 | First American Real Estate Tax Service, Llc. | Automatic delinquency item processing with customization for lenders |
US7933989B1 (en) | 2002-01-25 | 2011-04-26 | Barker Geoffrey T | Predictive threat assessment |
US20110125621A1 (en) * | 1999-04-09 | 2011-05-26 | Richard Tad Lepman | Process for determining object level profitability |
US20110302301A1 (en) * | 2008-10-31 | 2011-12-08 | Hsbc Holdings Plc | Capacity control |
US20120173301A1 (en) * | 2011-01-04 | 2012-07-05 | International Business Machines Corporation | System and method for failure association analysis |
USRE43598E1 (en) | 2000-09-28 | 2012-08-21 | Vig Acquisitions Ltd., L.L.C. | Method and process for configuring a premises for monitoring |
US9299046B2 (en) | 2010-11-24 | 2016-03-29 | International Business Machines Corporation | Infrastructure asset management |
CN112740184A (en) * | 2018-09-27 | 2021-04-30 | 美国西门子医学诊断股份有限公司 | Method for deterministically reporting causes and effects in software systems |
US11314554B2 (en) * | 2016-11-28 | 2022-04-26 | Cloudamize, Inc. | System and method for grouping nodes by analyzing and associating nodes of a computer system by shared characteristics |
US20230079026A1 (en) * | 2020-02-05 | 2023-03-16 | Ebay Inc. | Selecting a Host Based on Quality of Stored Data |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8655623B2 (en) * | 2007-02-13 | 2014-02-18 | International Business Machines Corporation | Diagnostic system and method |
JP2015184818A (en) * | 2014-03-20 | 2015-10-22 | 株式会社東芝 | Server, model application propriety determination method and computer program |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4825195A (en) | 1986-05-07 | 1989-04-25 | Yves Berruyer | Method of monitoring to anticipate the triggering of an alarm |
US5461628A (en) | 1993-06-18 | 1995-10-24 | Nec Corporation | Network system capable of network elements with decreasing load of a monitoring device |
US5469463A (en) | 1988-03-30 | 1995-11-21 | Digital Equipment Corporation | Expert system for identifying likely failure points in a digital data processing system |
WO1996000419A1 (en) | 1994-06-23 | 1996-01-04 | Candle Distributed Solutions, Inc. | Data server with event driven sampling |
US5528516A (en) | 1994-05-25 | 1996-06-18 | System Management Arts, Inc. | Apparatus and method for event correlation and problem reporting |
US5568471A (en) | 1995-09-06 | 1996-10-22 | International Business Machines Corporation | System and method for a workstation monitoring and control of multiple networks having different protocols |
US5612949A (en) | 1994-06-13 | 1997-03-18 | Hewlett-Packard Company | Method and apparatus for determining network delays |
US5615341A (en) * | 1995-05-08 | 1997-03-25 | International Business Machines Corporation | System and method for mining generalized association rules in databases |
US5668944A (en) | 1994-09-06 | 1997-09-16 | International Business Machines Corporation | Method and system for providing performance diagnosis of a computer system |
US5704017A (en) * | 1996-02-16 | 1997-12-30 | Microsoft Corporation | Collaborative filtering utilizing a belief network |
US5715432A (en) | 1995-04-04 | 1998-02-03 | U S West Technologies, Inc. | Method and system for developing network analysis and modeling with graphical objects |
US5724573A (en) * | 1995-12-22 | 1998-03-03 | International Business Machines Corporation | Method and system for mining quantitative association rules in large relational tables |
US5748098A (en) * | 1993-02-23 | 1998-05-05 | British Telecommunications Public Limited Company | Event correlation |
US5802254A (en) * | 1995-07-21 | 1998-09-01 | Hitachi, Ltd. | Data analysis apparatus |
US5812997A (en) * | 1995-10-26 | 1998-09-22 | International Business Machines Incorporated | Method and apparatus for deriving an association rule between data |
US5832482A (en) * | 1997-02-20 | 1998-11-03 | International Business Machines Corporation | Method for mining causality rules with applications to electronic commerce |
US5847131A (en) | 1996-06-18 | 1998-12-08 | Basf Aktiengesellschaft | Preparation of N-substituted cyclic amines |
US5897627A (en) * | 1997-05-20 | 1999-04-27 | Motorola, Inc. | Method of determining statistically meaningful rules |
US6311175B1 (en) * | 1998-03-06 | 2001-10-30 | Perot Systems Corp. | System and method for generating performance models of complex information technology systems |
-
1998
- 1998-03-06 US US09/036,394 patent/US6393387B1/en not_active Expired - Lifetime
-
1999
- 1999-03-04 EP EP99909786A patent/EP1062583B1/en not_active Expired - Lifetime
- 1999-03-04 WO PCT/US1999/004685 patent/WO1999045467A1/en active IP Right Grant
- 1999-03-04 AT AT99909786T patent/ATE346339T1/en not_active IP Right Cessation
- 1999-03-04 DE DE69934102T patent/DE69934102T2/en not_active Expired - Lifetime
- 1999-03-04 AU AU28914/99A patent/AU2891499A/en not_active Abandoned
Patent Citations (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4825195A (en) | 1986-05-07 | 1989-04-25 | Yves Berruyer | Method of monitoring to anticipate the triggering of an alarm |
US5469463A (en) | 1988-03-30 | 1995-11-21 | Digital Equipment Corporation | Expert system for identifying likely failure points in a digital data processing system |
US5748098A (en) * | 1993-02-23 | 1998-05-05 | British Telecommunications Public Limited Company | Event correlation |
US5461628A (en) | 1993-06-18 | 1995-10-24 | Nec Corporation | Network system capable of network elements with decreasing load of a monitoring device |
US5661668A (en) * | 1994-05-25 | 1997-08-26 | System Management Arts, Inc. | Apparatus and method for analyzing and correlating events in a system using a causality matrix |
US5528516A (en) | 1994-05-25 | 1996-06-18 | System Management Arts, Inc. | Apparatus and method for event correlation and problem reporting |
US5612949A (en) | 1994-06-13 | 1997-03-18 | Hewlett-Packard Company | Method and apparatus for determining network delays |
WO1996000419A1 (en) | 1994-06-23 | 1996-01-04 | Candle Distributed Solutions, Inc. | Data server with event driven sampling |
US5668944A (en) | 1994-09-06 | 1997-09-16 | International Business Machines Corporation | Method and system for providing performance diagnosis of a computer system |
US5715432A (en) | 1995-04-04 | 1998-02-03 | U S West Technologies, Inc. | Method and system for developing network analysis and modeling with graphical objects |
US5615341A (en) * | 1995-05-08 | 1997-03-25 | International Business Machines Corporation | System and method for mining generalized association rules in databases |
US5802254A (en) * | 1995-07-21 | 1998-09-01 | Hitachi, Ltd. | Data analysis apparatus |
US5568471A (en) | 1995-09-06 | 1996-10-22 | International Business Machines Corporation | System and method for a workstation monitoring and control of multiple networks having different protocols |
US5812997A (en) * | 1995-10-26 | 1998-09-22 | International Business Machines Incorporated | Method and apparatus for deriving an association rule between data |
US5724573A (en) * | 1995-12-22 | 1998-03-03 | International Business Machines Corporation | Method and system for mining quantitative association rules in large relational tables |
US5704017A (en) * | 1996-02-16 | 1997-12-30 | Microsoft Corporation | Collaborative filtering utilizing a belief network |
US5847131A (en) | 1996-06-18 | 1998-12-08 | Basf Aktiengesellschaft | Preparation of N-substituted cyclic amines |
US5832482A (en) * | 1997-02-20 | 1998-11-03 | International Business Machines Corporation | Method for mining causality rules with applications to electronic commerce |
US5897627A (en) * | 1997-05-20 | 1999-04-27 | Motorola, Inc. | Method of determining statistically meaningful rules |
US6311175B1 (en) * | 1998-03-06 | 2001-10-30 | Perot Systems Corp. | System and method for generating performance models of complex information technology systems |
Non-Patent Citations (3)
Title |
---|
A.J. Knobbe. Data Mining for Adaptive System Management, Proceedings of the First International Conference on the Practical Application of Knowledge Discovery and Data Mining, PADD, 1997; Apr. 23-25, 1997, pp. 157-165, XP002105193. |
Raul Velez, Du Zhang and James Kho,by Raul Velez, Du Zhang and James Kho, An Intelligent Tool for Unix Performance Tuning, Proceedings of the 1993 IEEE International Conference on Tools with Artificial Intelligence, TAI, 1993; Boston MA.; Conf. No. 5, Nov. 8-11, pp. 118-122, XP000436431. |
Syllogic White Paper; Adaptive Systems Management, Version 2.1, Jan. 1998, pp. 1-14; Retrieved from Internet; Jun. 2, 1999; XP002105194. |
Cited By (70)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6591147B2 (en) * | 1998-09-07 | 2003-07-08 | Kabushiki Kaisha Toshiba | Adjustment control and adjustment control method |
US8612316B2 (en) * | 1999-04-09 | 2013-12-17 | Richard Tad Lepman | Process for determining object level profitability |
US20110125621A1 (en) * | 1999-04-09 | 2011-05-26 | Richard Tad Lepman | Process for determining object level profitability |
USRE45649E1 (en) | 2000-09-28 | 2015-08-11 | Vivint, Inc. | Method and process for configuring a premises for monitoring |
US20020143934A1 (en) * | 2000-09-28 | 2002-10-03 | Barker Geoffrey T. | System and method for providing configurable security monitoring utilizing an integrated information system |
US8392552B2 (en) | 2000-09-28 | 2013-03-05 | Vig Acquisitions Ltd., L.L.C. | System and method for providing configurable security monitoring utilizing an integrated information system |
US20020075307A1 (en) * | 2000-09-28 | 2002-06-20 | Vigilos, Inc. | System and method for dynamic interaction with remote devices |
US8700769B2 (en) | 2000-09-28 | 2014-04-15 | Vig Acquisitions Ltd., L.L.C. | System and method for providing configurable security monitoring utilizing an integrated information system |
USRE43598E1 (en) | 2000-09-28 | 2012-08-21 | Vig Acquisitions Ltd., L.L.C. | Method and process for configuring a premises for monitoring |
US20020143938A1 (en) * | 2000-09-28 | 2002-10-03 | Bruce Alexander | System and method for providing configurable security monitoring utilizing an integrated information system |
US7627665B2 (en) * | 2000-09-28 | 2009-12-01 | Barker Geoffrey T | System and method for providing configurable security monitoring utilizing an integrated information system |
US7065524B1 (en) * | 2001-03-30 | 2006-06-20 | Pharsight Corporation | Identification and correction of confounders in a statistical analysis |
US20070005761A1 (en) * | 2001-04-07 | 2007-01-04 | Webmethods, Inc. | Predictive monitoring and problem identification in an information technology (it) infrastructure |
US7107339B1 (en) * | 2001-04-07 | 2006-09-12 | Webmethods, Inc. | Predictive monitoring and problem identification in an information technology (IT) infrastructure |
US20020158899A1 (en) * | 2001-04-30 | 2002-10-31 | Robert Raymond | Portal system and method for managing resources in a networked computing environment |
US7010593B2 (en) * | 2001-04-30 | 2006-03-07 | Hewlett-Packard Development Company, L.P. | Dynamic generation of context-sensitive data and instructions for troubleshooting problem events in a computing environment |
US20020161875A1 (en) * | 2001-04-30 | 2002-10-31 | Raymond Robert L. | Dynamic generation of context-sensitive data and instructions for troubleshooting problem events in information network systems |
US7865380B2 (en) * | 2001-11-08 | 2011-01-04 | International Business Machines Corporation | Automated information technology management system |
US20030088456A1 (en) * | 2001-11-08 | 2003-05-08 | International Business Machines Corporation | Automated information technology management system |
US7933989B1 (en) | 2002-01-25 | 2011-04-26 | Barker Geoffrey T | Predictive threat assessment |
US20030167335A1 (en) * | 2002-03-04 | 2003-09-04 | Vigilos, Inc. | System and method for network-based communication |
US20030206172A1 (en) * | 2002-03-05 | 2003-11-06 | Vigilos, Inc. | System and method for the asynchronous collection and management of video data |
US20040103181A1 (en) * | 2002-11-27 | 2004-05-27 | Chambliss David Darden | System and method for managing the performance of a computer system based on operational characteristics of the system components |
US7457864B2 (en) | 2002-11-27 | 2008-11-25 | International Business Machines Corporation | System and method for managing the performance of a computer system based on operational characteristics of the system components |
US20040117336A1 (en) * | 2002-12-17 | 2004-06-17 | Jayanta Basak | Interpretable unsupervised decision trees |
US7542960B2 (en) * | 2002-12-17 | 2009-06-02 | International Business Machines Corporation | Interpretable unsupervised decision trees |
US20050102303A1 (en) * | 2003-11-12 | 2005-05-12 | International Business Machines Corporation | Computer-implemented method, system and program product for mapping a user data schema to a mining model schema |
US20050114277A1 (en) * | 2003-11-21 | 2005-05-26 | International Business Machines Corporation | Method, system and program product for evaluating a data mining algorithm |
US7349919B2 (en) | 2003-11-21 | 2008-03-25 | International Business Machines Corporation | Computerized method, system and program product for generating a data mining model |
US7734645B2 (en) | 2003-11-21 | 2010-06-08 | International Business Machines Corporation | Computerized method, system and program product for generating a data mining model |
US7743068B2 (en) | 2003-11-21 | 2010-06-22 | International Business Machines Corporation | Computerized method, system and program product for generating a data mining model |
US7739297B2 (en) | 2003-11-21 | 2010-06-15 | International Business Machines Corporation | Computerized method, system and program product for generating a data mining model |
US20080046402A1 (en) * | 2003-11-21 | 2008-02-21 | Russell Feng-Wei C | Computerized method, system and program product for generating a data mining model |
US20080046452A1 (en) * | 2003-11-21 | 2008-02-21 | Russell Feng-Wei C | Computerized method, system and program product for generating a data mining model |
US20080046426A1 (en) * | 2003-11-21 | 2008-02-21 | Russell Feng-Wei C | Computerized method, system and program product for generating a data mining model |
US20090144276A1 (en) * | 2003-11-24 | 2009-06-04 | Feng-Wei Chen Russell | Computerized data mining system and program product |
US20050114360A1 (en) * | 2003-11-24 | 2005-05-26 | International Business Machines Corporation | Computerized data mining system, method and program product |
US7523106B2 (en) | 2003-11-24 | 2009-04-21 | International Business Machines Coporation | Computerized data mining system, method and program product |
US7383238B1 (en) | 2004-02-24 | 2008-06-03 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Inductive monitoring system constructed from nominal system data and its use in real-time system monitoring |
US20060047512A1 (en) * | 2004-08-27 | 2006-03-02 | Chao Yuan | System, device, and methods for updating system-monitoring models |
US7457674B2 (en) | 2004-08-27 | 2008-11-25 | Siemens Corporate Research, Inc. | System, device, and methods for updating system-monitoring models |
US20060112166A1 (en) * | 2004-11-19 | 2006-05-25 | Nancy Pettigrew | System and method for disaster recovery and management of an email system |
US7353257B2 (en) * | 2004-11-19 | 2008-04-01 | Microsoft Corporation | System and method for disaster recovery and management of an email system |
US20060190960A1 (en) * | 2005-02-14 | 2006-08-24 | Barker Geoffrey T | System and method for incorporating video analytics in a monitoring network |
US20060248033A1 (en) * | 2005-04-19 | 2006-11-02 | International Business Machines Corporation | Data mining within a message handling system |
US7533095B2 (en) | 2005-04-19 | 2009-05-12 | International Business Machines Corporation | Data mining within a message handling system |
US20100223169A1 (en) * | 2006-02-22 | 2010-09-02 | First American Corelogic, Inc. | System and method for monitoring events associated with a person or property |
US7835986B2 (en) | 2006-02-22 | 2010-11-16 | Corelogic Information Solutions, Inc. | System and method for monitoring events associated with a person or property |
US20110035325A1 (en) * | 2006-02-22 | 2011-02-10 | Corelogic Information Solutions, Inc. | System and method for monitoring events associated with a person or property |
US7747521B2 (en) * | 2006-02-22 | 2010-06-29 | First American Corelogic, Inc. | System and method for monitoring events associated with a person or property |
US20070198493A1 (en) * | 2006-02-22 | 2007-08-23 | First American Real Estate Solutions, L.P. | System and method for monitoring events associated with a person or property |
US8224745B2 (en) | 2006-06-13 | 2012-07-17 | Corelogic Tax Services, Llc | Automatic delinquency item processing with customization for lenders |
US20100106629A1 (en) * | 2006-06-13 | 2010-04-29 | First American Real Estate Tax Service, Llc. | Automatic delinquency item processing with customization for lenders |
US7743244B2 (en) * | 2006-10-31 | 2010-06-22 | Hewlett-Packard Development Company, L.P. | Computer system model generation with tracking of actual computer system configuration |
US20080104389A1 (en) * | 2006-10-31 | 2008-05-01 | Jon Duane Warden | Computer system model generation with tracking of actual computer system configuration |
US20090177929A1 (en) * | 2007-11-21 | 2009-07-09 | Rachid Sijelmassi | Method and apparatus for adaptive declarative monitoring |
US8769346B2 (en) * | 2007-11-21 | 2014-07-01 | Ca, Inc. | Method and apparatus for adaptive declarative monitoring |
US20100004952A1 (en) * | 2008-07-01 | 2010-01-07 | First American Corelogic, Inc. | System and method for tracking, monitoring and reporting extinguishment of a title insurance policy |
US8548831B2 (en) * | 2008-07-01 | 2013-10-01 | Corelogic Solutions, Llc | System and method for tracking, monitoring and reporting extinguishment of a title insurance policy |
US20110282699A1 (en) * | 2008-07-01 | 2011-11-17 | Corelogic Information Solutions, Inc. | System and Method for Tracking, Monitoring and Reporting Extinguishment of a Title Insurance Policy |
US8015037B2 (en) | 2008-07-01 | 2011-09-06 | Corelogic Information Solutions, Inc. | System and method for tracking, monitoring and reporting extinguishment of a title insurance policy |
US20110302301A1 (en) * | 2008-10-31 | 2011-12-08 | Hsbc Holdings Plc | Capacity control |
US9176789B2 (en) * | 2008-10-31 | 2015-11-03 | Hsbc Group Management Services Limited | Capacity control |
US9299046B2 (en) | 2010-11-24 | 2016-03-29 | International Business Machines Corporation | Infrastructure asset management |
US9311615B2 (en) | 2010-11-24 | 2016-04-12 | International Business Machines Corporation | Infrastructure asset management |
US20120173301A1 (en) * | 2011-01-04 | 2012-07-05 | International Business Machines Corporation | System and method for failure association analysis |
US11314554B2 (en) * | 2016-11-28 | 2022-04-26 | Cloudamize, Inc. | System and method for grouping nodes by analyzing and associating nodes of a computer system by shared characteristics |
CN112740184A (en) * | 2018-09-27 | 2021-04-30 | 美国西门子医学诊断股份有限公司 | Method for deterministically reporting causes and effects in software systems |
CN112740184B (en) * | 2018-09-27 | 2023-12-22 | 美国西门子医学诊断股份有限公司 | Method for deterministically reporting causes and effects in a software system |
US20230079026A1 (en) * | 2020-02-05 | 2023-03-16 | Ebay Inc. | Selecting a Host Based on Quality of Stored Data |
Also Published As
Publication number | Publication date |
---|---|
DE69934102T2 (en) | 2007-04-19 |
EP1062583B1 (en) | 2006-11-22 |
DE69934102D1 (en) | 2007-01-04 |
ATE346339T1 (en) | 2006-12-15 |
AU2891499A (en) | 1999-09-20 |
WO1999045467A1 (en) | 1999-09-10 |
EP1062583A1 (en) | 2000-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6393387B1 (en) | System and method for model mining complex information technology systems | |
US6311175B1 (en) | System and method for generating performance models of complex information technology systems | |
KR100714157B1 (en) | Adaptive problem determination and recovery in a computer system | |
US7451210B2 (en) | Hybrid method for event prediction and system control | |
US6697791B2 (en) | System and method for systematic construction of correlation rules for event management | |
US7634563B2 (en) | System and method for correlating and diagnosing system component performance data | |
US20140180738A1 (en) | Machine learning for systems management | |
Jacob et al. | Exathlon: A benchmark for explainable anomaly detection over time series | |
US20140223555A1 (en) | Method and system for improving security threats detection in communication networks | |
WO2008098631A2 (en) | A diagnostic system and method | |
US11900248B2 (en) | Correlating data center resources in a multi-tenant execution environment using machine learning techniques | |
US20230102786A1 (en) | Ccontinuous knowledge graph generation using causal event graph feedback | |
US11892904B2 (en) | Directed incremental clustering of causally related events using multi-layered small world networks | |
Marcu et al. | Towards an optimized model of incident ticket correlation | |
JP5240709B2 (en) | Computer system, method and computer program for evaluating symptom | |
Song et al. | Hierarchical online problem classification for IT support services | |
Zeydan et al. | Cloud 2 HDD: large-scale HDD data analysis on cloud for cloud datacenters | |
Li et al. | An integrated data-driven framework for computing system management | |
Kakadia et al. | Machine learning approaches for network resiliency optimization for service provider networks | |
Chen et al. | BALANCE: Bayesian Linear Attribution for Root Cause Localization | |
Fernandes et al. | Impact of Non-Fitting Cases for Remaining Time Prediction in a Multi-Attribute Process-Aware Method. | |
TWI789003B (en) | Service anomaly detection and alerting method, apparatus using the same, storage media for storing the same, and computer software program for generating service anomaly alert | |
US20220027831A1 (en) | System and method for security analyst modeling and management | |
US20230281070A1 (en) | Methods and systems for identifying and resolving root causes of performance problems in data center object | |
Wee | Adaptive fault diagnosis and resolution system for enterprise data replication system using deep reinforcement learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: PEROT SYSTEMS CORP., TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ADRIAANS, PIETER WILLEM;KNOBBE, ARNO JAN;GATHIER, MARC;REEL/FRAME:009271/0992;SIGNING DATES FROM 19980311 TO 19980316 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS FIRST LIEN COLLATERAL AGENT, TEXAS Free format text: PATENT SECURITY AGREEMENT (NOTES);ASSIGNORS:APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;BOOMI, INC.;AND OTHERS;REEL/FRAME:031897/0348 Effective date: 20131029 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT (TERM LOAN);ASSIGNORS:DELL INC.;APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;AND OTHERS;REEL/FRAME:031899/0261 Effective date: 20131029 Owner name: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT, TEXAS Free format text: PATENT SECURITY AGREEMENT (ABL);ASSIGNORS:DELL INC.;APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;AND OTHERS;REEL/FRAME:031898/0001 Effective date: 20131029 Owner name: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT, TE Free format text: PATENT SECURITY AGREEMENT (ABL);ASSIGNORS:DELL INC.;APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;AND OTHERS;REEL/FRAME:031898/0001 Effective date: 20131029 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT (TERM LOAN);ASSIGNORS:DELL INC.;APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;AND OTHERS;REEL/FRAME:031899/0261 Effective date: 20131029 Owner name: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS FI Free format text: PATENT SECURITY AGREEMENT (NOTES);ASSIGNORS:APPASSURE SOFTWARE, INC.;ASAP SOFTWARE EXPRESS, INC.;BOOMI, INC.;AND OTHERS;REEL/FRAME:031897/0348 Effective date: 20131029 |
|
AS | Assignment |
Owner name: DELL SYSTEMS CORPORATION, TEXAS Free format text: CHANGE OF NAME;ASSIGNOR:PEROT SYSTEMS CORPORATION;REEL/FRAME:037198/0430 Effective date: 20150108 |
|
AS | Assignment |
Owner name: SECUREWORKS, INC., GEORGIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: DELL MARKETING L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: ASAP SOFTWARE EXPRESS, INC., ILLINOIS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: DELL SOFTWARE INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: DELL PRODUCTS L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: APPASSURE SOFTWARE, INC., VIRGINIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: CREDANT TECHNOLOGIES, INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: DELL INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: DELL USA L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: PEROT SYSTEMS CORPORATION, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: WYSE TECHNOLOGY L.L.C., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: COMPELLANT TECHNOLOGIES, INC., MINNESOTA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 Owner name: FORCE10 NETWORKS, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:040065/0216 Effective date: 20160907 |
|
AS | Assignment |
Owner name: PEROT SYSTEMS CORPORATION, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL MARKETING L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: CREDANT TECHNOLOGIES, INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: WYSE TECHNOLOGY L.L.C., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: COMPELLENT TECHNOLOGIES, INC., MINNESOTA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL PRODUCTS L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: APPASSURE SOFTWARE, INC., VIRGINIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: ASAP SOFTWARE EXPRESS, INC., ILLINOIS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: FORCE10 NETWORKS, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL USA L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL SOFTWARE INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: SECUREWORKS, INC., GEORGIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:040040/0001 Effective date: 20160907 Owner name: DELL PRODUCTS L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: DELL MARKETING L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: APPASSURE SOFTWARE, INC., VIRGINIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: SECUREWORKS, INC., GEORGIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: ASAP SOFTWARE EXPRESS, INC., ILLINOIS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: CREDANT TECHNOLOGIES, INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: DELL USA L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: DELL INC., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: FORCE10 NETWORKS, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: COMPELLENT TECHNOLOGIES, INC., MINNESOTA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: DELL SOFTWARE INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: WYSE TECHNOLOGY L.L.C., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 Owner name: PEROT SYSTEMS CORPORATION, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT;REEL/FRAME:040065/0618 Effective date: 20160907 |
|
AS | Assignment |
Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT, TEXAS Free format text: SECURITY AGREEMENT;ASSIGNORS:ASAP SOFTWARE EXPRESS, INC.;AVENTAIL LLC;CREDANT TECHNOLOGIES, INC.;AND OTHERS;REEL/FRAME:040136/0001 Effective date: 20160907 Owner name: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT, NORTH CAROLINA Free format text: SECURITY AGREEMENT;ASSIGNORS:ASAP SOFTWARE EXPRESS, INC.;AVENTAIL LLC;CREDANT TECHNOLOGIES, INC.;AND OTHERS;REEL/FRAME:040134/0001 Effective date: 20160907 Owner name: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLAT Free format text: SECURITY AGREEMENT;ASSIGNORS:ASAP SOFTWARE EXPRESS, INC.;AVENTAIL LLC;CREDANT TECHNOLOGIES, INC.;AND OTHERS;REEL/FRAME:040134/0001 Effective date: 20160907 Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., A Free format text: SECURITY AGREEMENT;ASSIGNORS:ASAP SOFTWARE EXPRESS, INC.;AVENTAIL LLC;CREDANT TECHNOLOGIES, INC.;AND OTHERS;REEL/FRAME:040136/0001 Effective date: 20160907 |
|
AS | Assignment |
Owner name: AVENTAIL LLC, CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN CERTAIN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:040564/0897 Effective date: 20161102 Owner name: DELL SYSTEMS CORPORATION, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:040564/0886 Effective date: 20161102 Owner name: DELL SOFTWARE INC., CALIFORNIA Free format text: RELEASE OF SECURITY INTEREST IN CERTAIN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:040564/0897 Effective date: 20161102 Owner name: DELL SOFTWARE INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:040564/0886 Effective date: 20161102 Owner name: DELL SYSTEMS CORPORATION, TEXAS Free format text: RELEASE OF SECURITY INTEREST IN CERTAIN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:040564/0897 Effective date: 20161102 Owner name: DELL PRODUCTS L.P., TEXAS Free format text: RELEASE OF SECURITY INTEREST IN CERTAIN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:040564/0897 Effective date: 20161102 Owner name: AVENTAIL LLC, CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:040564/0886 Effective date: 20161102 Owner name: DELL PRODUCTS, L.P., TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:040564/0886 Effective date: 20161102 |
|
AS | Assignment |
Owner name: NTT DATA SERVICES CORPORATION, TEXAS Free format text: CHANGE OF NAME;ASSIGNOR:DELL SYSTEMS CORPORATION;REEL/FRAME:042346/0831 Effective date: 20161102 |
|
AS | Assignment |
Owner name: SCALEIO LLC, MASSACHUSETTS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.), TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC), MASSACHUSETTS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.), TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL PRODUCTS L.P., TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL INTERNATIONAL L.L.C., TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL USA L.P., TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.), TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 Owner name: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.), TEXAS Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:061753/0001 Effective date: 20220329 |