CN103200046A - Method and system for monitoring network cell device performance - Google Patents
Method and system for monitoring network cell device performance Download PDFInfo
- Publication number
- CN103200046A CN103200046A CN2013101047960A CN201310104796A CN103200046A CN 103200046 A CN103200046 A CN 103200046A CN 2013101047960 A CN2013101047960 A CN 2013101047960A CN 201310104796 A CN201310104796 A CN 201310104796A CN 103200046 A CN103200046 A CN 103200046A
- Authority
- CN
- China
- Prior art keywords
- daily record
- record data
- network element
- element device
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method and a system for monitoring network cell device performance. The method comprises the steps: in a network cell device, a data format and a data transmission method which are used for performance monitoring are arranged in advance; performance information is collected, performance information is packaged to log data according to the data format arranged in advance and the log data are transmitted according to the data transmission method arranged in advance; the log data sent are received and the log data are clustered according to a performance information collecting cycle arranged in advance; and the clustered log data are combined according to a log data combination cycle arranged in advance and network cell performance analysis is performed according to the log data obtained by combination processing. The method and the system for monitoring the network cell device performance can improve reliability of a log data analysis result.
Description
Technical field
The present invention relates to the communication monitoring technology, relate in particular to a kind of method and system of monitoring network element device performance.
Background technology
Along with development of Communication Technique, the number of users of communication system service increases day by day, in order to improve the efficient of transfer of data in the communication system, promotes user's business experience, in communication system, each network element device is general to adopt concurrent data transfer mode to provide service to the user.Be example with the intelligent television system, because the extensive use of digital television techniques, number of users is numerous, causes the concurrent processing amount (performance) of each network element device in the intelligent television system to increase day by day.Thereby, experience in order to promote the user, to the also enhancing day by day of parallel processing performance demands of each network element device in the intelligent television system.
In order to ensure the parallel processing capability of intelligent television system, safeguard the normal operation of intelligent television system, need monitor the performance of each network element device in the intelligent television system, for example, load information, CPU usage etc., to guarantee to insert the user's data transmission rate, for example, need guarantee that network element device can provide concurrent transmission quantity more than the 10K/S to inserting the user.In the prior art, generally by the daily record watch-dog is set in the intelligent television system, the daily record watch-dog obtains the performance information of the network element device in the intelligent television system in real time, the performance information that obtains is sampled, and the performance information that sampling obtains write hard disk in the daily record data mode, carry out the network element performance evaluation according to daily record data; If results of performance analysis shows the concurrent speed of this network element and is lower than 10K/S, then the number of users that inserts is controlled, experience to ensure the digital television business that inserts the user.
By as seen above-mentioned, the method of existing monitoring network element device performance, by periodic sample mode acquisition performance information (daily record data) and analyze, the daily record data that causes analyzing can not be contained the source data of this network element device performance in the intelligent television system, makes for the analysis result reliability of the performance of network element device lower; Further, because this analysis result can not reflect the actual performance situation of network element device, if control according to this analysis result, it is relatively poor then to control effect.On the other hand, if the performance information to network element device does not carry out sample process, the daily record data that generates for this scale of the network element device of intelligent television system then, not only the memory space of daily record watch-dog is difficult to satisfy, and the daily record watch-dog is to the analysis of daily record data, the resource cost that desired data is handled is very big, and the daily record data analysis is difficult to realize.
In the prior art, although performance information is sampled and is analyzed, reduce daily record data amount and the backstage amount of calculation of transmission, but owing to can not keep containing the source data of network element device performance to the processing mode of performance information, therefore, prior art can't be monitored well to the network element device performance.In other words, exist in the prior art a kind of daily record data amount and backstage amount of calculation that can reduce transmission, and can contain the needs of technology of monitoring network element device performance of the source data of network element device performance simultaneously.
Summary of the invention
Embodiments of the invention provide a kind of method of monitoring network element device performance, improve the reliability of daily record data analysis result.
Embodiments of the invention also provide a kind of system of monitoring network element device performance, improve the reliability of daily record data analysis result.
For achieving the above object, the method for a kind of monitoring network element device performance that the embodiment of the invention provides in described network element device, sets in advance data format and data transfer mode for performance monitoring, and this method comprises:
Acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with performance information, according to the data transfer mode transmission daily record data that sets in advance;
Receive the daily record data that sends, the performance information collection period according to setting in advance carries out cluster to daily record data;
Merge the cycle according to the daily record data that sets in advance, the daily record data of cluster is merged, handle the daily record data that obtains according to merging, carry out the network element device performance evaluation.
Wherein, described data format comprises: information such as network element device identification code, function numbering, behavior sign, data time point and additional data;
Described data transfer mode is the User Datagram Protoco (UDP) transmission.
Wherein, described behavior is designated triggering behavior sign, continues behavior sign or misdeed sign.
Wherein, describedly daily record data carried out cluster comprise:
A11 in the performance information collection period that sets in advance, resolves the daily record data that receives, and obtains the network element device information of identification code, network element device number information, function number information and the behavior identification information that comprise in the daily record data;
A12 judges and resolves whether the behavior identification information that obtains is to continue the behavior identification information, if, execution in step A13, otherwise, execution in step A15;
A13 continues behavior and begins corresponding data time dot information in the log data, this daily record data is put into interim buffer memory;
A14 after monitoring this lasting behavior end, merges into one with the daily record data that should continue behavior in the interim buffer memory and comprises the daily record data that continues duration, execution in step A15;
A15 is that statistics receives, have daily record data total degree, average, maximum and a minimum of identical network element device information of identification code, network element device number information, function number information and behavior identification information;
A16 according to total degree, average, maximum and the minimum that statistics obtains, makes up the daily record data of cluster.
Wherein, described method further comprises:
From receive, have the daily record data of identical network element device information of identification code, network element device number information, function number information and behavior identification information, extract the daily record data of predetermined threshold value, data time dot information and the duration information of the daily record data that record extracts generate the sampling set.
Wherein, the daily record data of described structure cluster comprises:
Judge whether the behavior identification information is misdeed information in the daily record data that receives, if, the misdeed daily record data of structure cluster, otherwise, the function daily record data of structure cluster.
Wherein, the function daily record data of described cluster comprises: network element device information of identification code, network element device number information, function number information, performance information acquisition time segment information, total degree information, equal value information, maximum information, minimum information and { sampling set (time, value) } information.
Wherein, the misdeed daily record data of described cluster comprises: network element device information of identification code, network element device number information, function number information, performance information acquisition time segment information and error message.
Wherein, described daily record data to cluster merges and comprises:
In the daily record data merging cycle that sets in advance, according to the daily record data of the cluster that receives, merge the daily record data that comprises identical network element device information of identification code, network element device number information and function number information, the daily record data that obtains merging.
Wherein, described method further comprises:
Show the daily record data of merging or the result that the network element device performance evaluation is carried out in displaying.
Wherein, described method further comprises:
When the network element device results of performance analysis shows that concurrent speed is lower than the rate-valve value that sets in advance, the number of users that inserts the intelligent television system is controlled.
A kind of system of monitoring network element device performance, this system comprises: network element device, acting server, convergence server and performance evaluation server, wherein,
The data format and the data transfer mode that are used for performance monitoring that network element device, storage set in advance; Acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with performance information, transmits daily record data according to the data transfer mode that sets in advance to acting server;
Acting server is used for receiving the daily record data that network element device sends, and the performance information collection period according to setting in advance carries out cluster to daily record data, exports convergence server to;
Convergence server is used for merging the cycle according to the daily record data that sets in advance, and the daily record data of the cluster that receives is merged, and exports the performance evaluation server to;
The performance evaluation server is used for handling the daily record data that obtains according to merging, and carries out the network element device performance evaluation.
Preferably, described performance evaluation server can be further used for showing the daily record data of merging or the result who carries out the network element device performance evaluation.
Preferably, described performance evaluation server comprises: daily record data memory cell, analytic unit, analysis result memory cell and analysis result display unit, wherein,
The daily record data memory cell is used for the transmission control protocol data bag that the storage convergence server is exported;
Analytic unit for the transmission control protocol data bag that reads the daily record data cell stores, is analyzed, and exports analysis result to the analysis result memory cell;
The analysis result memory cell is used for the analysis result that the inventory analysis unit is exported;
The analysis result display unit is used for reading analysis result and displaying from the analysis result memory cell.
Preferably, described acting server is deployed on the described network element device, and described network element device is transferred to daily record data the described acting server that is deployed on the described network element device by the User Datagram Protoco (UDP) mode.
Preferably, described system further comprises:
Configuration server is used for configuration and comprises the configuration information that data format, data transfer mode and network element device attribute are set, and configuration information is issued to network element device; The state of Monitor Daemon Server is when monitoring acting server when delaying machine, by the delay acting server of machine of Long-distance Control reparation and startup.
Preferably, described system further comprises:
Control Server is used for the network element device results of performance analysis that the analysis of reading performance Analysis server obtains, and is lower than the rate-valve value that sets in advance if the network element device results of performance analysis shows concurrent speed, and the number of users that inserts the intelligent television system is controlled.
As seen from the above technical solution, the method and system of a kind of monitoring network element device performance that the embodiment of the invention provides are in service layer monitoring network element device performance.Because acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with the performance information of gathering in real time, according to the data transfer mode transmission daily record data that sets in advance, so the present invention carries out performance evaluation at each daily record data.Then, receive the daily record data that sends, according to the performance information collection period that sets in advance, daily record data is carried out such as total degree, average, maximum and minimizing cluster, can effectively reduce daily record data amount and the backstage amount of calculation of transmission.At last, merge the cycle according to the daily record data that sets in advance, the daily record data of cluster is merged, handle the daily record data that obtains according to merging, carry out the network element device performance evaluation.Like this, the daily record data that carries out clustering processing can be contained the source data of this network element device performance in the intelligent television system, has promoted the reliability of analysis result.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art.Apparently, the accompanying drawing in below describing only is some embodiments of the present invention, for those of ordinary skills, can also obtain other embodiment and accompanying drawing thereof according to these accompanying drawing illustrated embodiments.
Fig. 1 is the method flow schematic diagram of embodiment of the invention monitoring network element device performance.
Fig. 2 is the system configuration schematic diagram of embodiment of the invention monitoring network element device performance.
Fig. 3 is the log data structures schematic diagram of embodiment of the invention network element device output.
Fig. 4 is the function log data structures schematic diagram of embodiment of the invention cluster.
The function log data structures schematic diagram that Fig. 5 merges for the embodiment of the invention.
The analysis result structural representation that Fig. 6 shows for the embodiment of the invention.
Embodiment
Below with reference to accompanying drawing the technical scheme of various embodiments of the present invention is carried out clear, complete description, obviously, described embodiment only is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are resulting all other embodiment under the prerequisite of not making creative work, all belong to the scope that the present invention protects.
The method of existing monitoring network element device performance, by sample mode acquisition performance information, generate daily record data and analyze, the daily record data that causes analyzing can not be contained the source data of this network element device real-time performance in the intelligent television system, makes that the result reliability of analyzing is lower.
User Datagram Protoco (UDP) (UDP, User Datagram Protocol) be open system interconnection (OSI, Open Systems Interconnection) a kind of connectionless transport layer protocol in the reference model, UDP does not provide packet grouping, assembling and ordering service, and the simple unreliable information transfer service towards affairs can only be provided.By udp protocol, network traffic data can be compressed into the form of UDP message bag, because UDP does not belong to the connecting-type agreement, thereby has the advantage that resource consumption is little, processing speed is fast, can be used between computer, transmitting the network application of data.For example, the network teleconference, audio frequency, video and general data transmit (ICQ and QQ) and use, and when such is applied in transmission, even lose a small amount of UDP message bag, also can not have much impact to reception result.
In the embodiment of the invention, propose a kind of method of monitoring network element device performance, in the network element device of intelligent television system, the daily record data by UDP message packet mode output reflection performance state is set.Like this, because the resource consumption of UDP message packet mode is little, hardly can be influential to the concurrent performance of network element device; The system of the monitoring network element device performance of the embodiment of the invention is after receiving the UDP message bag, daily record data in the mode merger UDP message bag of employing flow accounting, namely adopt mode merger daily record datas such as calculating merger counting, average, merger, minimax value, sampling, transmit then.Like this, not only can greatly reduce data quantity transmitted, and the daily record data of merger can be contained the source data of this network element device in the intelligent television system, from having kept the original appearance of daily record data to a great extent, thereby realize the requirement of monitoring in real time of the centralized performance of network element device.
Fig. 1 is the method flow schematic diagram of embodiment of the invention monitoring network element device performance.Referring to Fig. 1, this flow process comprises:
Step 101 in network element device, sets in advance data format and data transfer mode for performance monitoring;
In this step, data format and data transfer mode can be after configuration server sets, and are issued to each network element device again, also can be directly at each network element device data format and data transfer mode to be set.Wherein,
Data format comprises: information such as network element device identification code, function numbering, behavior sign, data time point and additional data.Wherein,
The network element device identification code is the network element device sign, is used for distinguishing each network element device of intelligent television system, and network element device identification code and network element device are one-to-one relationship;
The function numbering is used for the function of sign performance information under network element device, and namely performance information is which the concrete function data in the network element device, for example, and audio frequency, video etc.;
The behavior sign is used for the sign performance information in the behavior of network element device.Can be triggering behavior, lasting behavior or misdeed.Wherein,
The triggering behavior is represented when event takes place, and for example, when function is used, then records a corresponding daily record data.Continue the time that the behavior presentation of events continues, comprising: beginning behavioural information and end behavioural information.Misdeed represents that then mistake appears in current operation, misregistration data and reason.Wherein, the triggering behavior only need be added up triggering times, and for lasting behavior, not only adds up triggering times, goes back the statistical disposition time of the behavior.In the practical application, need report which kind of behavior, can be decided by the data statistics demand.For instance, if a function A has been triggered, then writing function A once is the triggering behavior; Time of continuing of writing function A if desired, for example, finishing this function needs 1 millisecond, then declares a lasting behavior and begin when function A begins, declare a lasting behavior again and finish when function A finishes, acting server will continue behavior automatically and begin and continue behavior and finish to carry out merger.
Data time point is the time point information of record performance information;
Additional data is concrete performance information.For example, when making a mistake behavior, additional data is the details that make a mistake; And the triggering behavior is when taking place, and additional data is Debugging message etc.
Preferably, data format can further include the network element device numbering, be used for the network element device that sign intelligent television system disposes, network element device and network element device numbering can be many-one relationship, and namely a network element device can have a plurality of network element device numberings.
Data transfer mode is the UDP transmission.
In this step, daily record data comprises: network element device information of identification code, network element device number information, function number information, behavior identification information, data time dot information and additional data information etc.
Network element device transmits daily record data by the UDP mode, and resource consumption is little, hardly can be influential to the concurrent performance of network element device.
In this step, the performance information collection period can be determined according to actual needs.
Daily record data is carried out cluster to be comprised:
A11 in the performance information collection period that sets in advance, resolves the daily record data that receives, and obtains the network element device information of identification code, network element device number information, function number information and the behavior identification information that comprise in the daily record data;
A12 judges and resolves whether the behavior identification information that obtains is to continue the behavior identification information, if, execution in step A13, otherwise, execution in step A15;
A13 continues behavior and begins corresponding data time dot information in the log data, this daily record data is put into interim buffer memory;
A14 after monitoring this lasting behavior end, merges into one with the daily record data that should continue behavior in the interim buffer memory and comprises the daily record data that continues duration, execution in step A15;
In this step, for the daily record data that continues behavior, begin daily record data when continuing behavior and finish and merge into one and comprise the daily record data that continues duration continuing behavior, can effectively reduce daily record data amount waiting for transmission.In the practical application, when finishing the behavior wait timeout, can be merged into an overtime lasting behavioral data (daily record data).After lasting behavior is merged, same lasting behavior, corresponding daily record data.
A15 is that statistics receives, have daily record data total degree, average, maximum and a minimum of identical network element device information of identification code, network element device number information, function number information and behavior identification information;
In this step, in the performance information collection period that sets in advance, add up the daily record data from identical function and identical behavior in the same network element device, thereby can monitor the performance situation of each function in the network element device.
In the embodiment of the invention, carry out daily record data average, the minimizing statistics of maximum value according to the behavior sign, the statistics granularity is bigger, for refinement statistics granularity, can also be to the daily record data process of aggregation of sampling, in order to keep some detailed performance informations as the reference of carrying out the network element device performance evaluation.For example, if 10,000 daily record datas that comprise same behavior of speciogenesis in one second, all this daily record data of record is the comparison difficulty, but can be by the sampling process of aggregation, for example, by the sample mode every the set time, record 20 daily record datas wherein, can reflect a part of details of network element device.Thereby preferably, this method can further include:
From receive, have the daily record data of identical network element device information of identification code, network element device number information, function number information and behavior identification information, extract the daily record data of predetermined threshold value, data time dot information and the duration information of the daily record data that record extracts generate the sampling set.
In this step, the sampling set is with { sampling set (time, value) } expression, and for example, { sampling set (time, value) } form can be { 2013-1-1018:10:20,20ms; 2013-1-1018:10:22,21ms; 2013-1-1018:10:22,28ms} wherein, is worth and is the duration, for example, 20ms.
A16 according to total degree, average, maximum and the minimum that statistics obtains, makes up the daily record data of cluster.
In this step, the daily record data that makes up cluster comprises:
Judge whether the behavior identification information is misdeed information in the daily record data that receives, if, the misdeed daily record data of structure cluster, otherwise, the function daily record data of structure cluster.
In this step, function daily record data for cluster comprises: network element device information of identification code, network element device number information, function number information, performance information acquisition time segment information, total degree information, equal value information, maximum information, minimum information and { sampling set (time, value) } information etc.Wherein,
Performance information acquisition time section be the behavior time started to the concluding time, the difference of concluding time and time started is the performance information collection period that sets in advance.For example, the performance information collection period that sets in advance is 60 seconds, and then performance information acquisition time section can be 2013-1-1018:10:20 to 2013-1-1018:11:20.
Misdeed daily record data for cluster comprises: network element device information of identification code, network element device number information, function number information, performance information acquisition time segment information and error message.
Certainly, in the practical application, in function daily record data and the misdeed daily record data, can also comprise the acting server information of identification code.
In the embodiment of the invention, daily record data carried out cluster after, be encapsulated as the tcp data bag, export convergence server to by the TCP mode.Like this, by real-time collection daily record data, the daily record data of gathering is encapsulated and clustering processing, for example, according to the daily record data of gathering, carry out total degree, average, maximum and minimizing clustering processing, then, carry out performance evaluation based on daily record data total degree, average, maximum and minimum that clustering processing obtains, need not to carry out performance evaluation at each daily record data, namely with prior art in, by periodically gathering daily record data, it is diverse that each daily record data that sampling is gathered carries out performance evaluation.The method of the monitoring network element device performance of the embodiment of the invention can make and carry out all source datas that daily record data after the clustering processing is contained network element device performance in the intelligent television system, has promoted the reliability of analysis result; And result's (total degree, average, maximum and minimum) of only transmitting clustering processing periodically gathers, and can effectively reduce daily record data amount and the backstage amount of calculation of transmission; Further, can also be by periodically gathering daily record data, in order to keep some detailed performance informations as the reference of carrying out the network element device performance evaluation.
In this step, the daily record data merging cycle can be determined according to actual needs.Preferably, the daily record data merging cycle is the integer multiple of performance information collection period.
The daily record data of cluster merged comprises:
In the daily record data merging cycle that sets in advance, according to the daily record data of the cluster that receives, merge the daily record data that comprises identical network element device information of identification code, network element device number information and function number information, the daily record data that obtains merging.
The daily record data that merges comprises: the misdeed daily record data of merging and the function daily record data of merging, wherein,
The function daily record data that merges comprises: acting server information of identification code, network element device information of identification code, network element device number information, function number information, daily record data merge time period information, merge total degree information, merge equal value information, merge maximum information, merge minimum information and merging { sampling set (time, value) } information.Wherein,
Daily record data merges the time period for merging the time started to merging the concluding time, and merging the concluding time is that the daily record data that sets in advance merges the cycle with the difference that merges the time started.
Merging total degree is in the daily record data merging cycle, number of times in each the performance information collection period that comprises is added up, merge average for the average in each the performance information collection period that comprises is averaged, merging maximum is the interior maximum of each performance information collection period that comprises, and merges sampling set gathering for all sampling of data set.
The misdeed daily record data that merges comprises: acting server information of identification code, network element device information of identification code, network element device number information, function number information, daily record data merge time period information and error message.
Preferably, convergence server receives the daily record data of cluster, the daily record data of cluster is merged processing after, the daily record data that merges is stored to a MySQL database.Like this, the performance evaluation server reads to merge from a MySQL database handles the daily record data that obtains, and carries out the network element device performance evaluation.
Preferably, the performance evaluation server is stored to the 2nd MySQL database with the network element device results of performance analysis after obtaining the network element device results of performance analysis.
About handling the daily record data that obtains according to merging, the detailed process that carries out the network element device performance evaluation specifically can not repeat them here referring to the correlation technique document.
Preferably, this method can further include:
Step 105 is showed the daily record data that merges or the result who carries out the network element device performance evaluation.
In this step, when showing the daily record data that merges, some information in the daily record data that can be combined are filtered, and namely need not to show all information that comprise in the daily record data of merging.For example, for the function daily record data that merges, the information of its displaying can comprise: network element device information of identification code, daily record data merge time period information, merge total degree information, merge equal value information, merge maximum information, merge minimum information and merging { sampling set (time, value) } information.
Certainly, in the practical application, this method can further include:
If the network element device results of performance analysis shows concurrent speed and is lower than the rate-valve value that sets in advance, the number of users that inserts the intelligent television system is controlled.
In this step, the detailed process to the number of users that inserts the intelligent television system is controlled specifically can not repeat them here referring to the correlation technique document.
Fig. 2 is the system configuration schematic diagram of embodiment of the invention monitoring network element device performance.Referring to Fig. 2, this system comprises: network element device, acting server, convergence server and performance evaluation server, wherein,
The data format and the data transfer mode that are used for performance monitoring that network element device, storage set in advance; Acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with performance information, transmits daily record data according to the data transfer mode that sets in advance to acting server;
Fig. 3 is the log data structures schematic diagram of embodiment of the invention network element device output.Referring to Fig. 3, in the embodiment of the invention, daily record data comprises: network element device information of identification code, network element device number information, function number information, behavior identification information, data time dot information and additional data information etc.
In the practical application, network element device can generate a random identification automatically at each lasting behavior.In follow-up, acting server occurs owing to continue behavior in pairs according to function and random identification ordering, when finding to have only the end behavior, abandons this daily record data; When finding to have only the beginning behavior, judge whether this begins behavior overtime, if overtimely just abandon; Otherwise, be merged into a daily record data.
Preferably, network element device transmits daily record data by the UDP mode.
Acting server is used for receiving the daily record data that network element device sends, and the performance information collection period according to setting in advance carries out cluster to daily record data, exports convergence server to;
In the embodiment of the invention, acting server receives the daily record data (UDP message) that network element device sends, the UDP message that receives is carried out cluster according to the performance information collection period that sets in advance, for example, to the UDP message that receives classify, gather, processing such as merger, filtration, sampling, obtain total degree information, all value information, maximum information, minimum information and sampling aggregate information etc.The daily record data that each network element device is sent carries out above-mentioned processing, generates the daily record data of cluster, and namely transmission control protocol (TCP, Transfer Control Protocol) packet exports convergence server to.
The daily record data of cluster comprises: the misdeed daily record data of cluster and the function daily record data of cluster.
Fig. 4 is the function log data structures schematic diagram of embodiment of the invention cluster.Referring to Fig. 4, the function daily record data of cluster comprises: network element device information of identification code, network element device number information, function number information, performance information acquisition time segment information, total degree information, equal value information, maximum information, minimum information and { sampling set (time, value) } information.
For the sampling combination, in the embodiment of the invention, adopt mean sample, in the performance information collection period that sets in advance, extract the sampled point of predetermined threshold value, for example, M point according to the counting in the performance information collection period, calculates average the extraction at interval.Specifically, in the performance information collection period that sets in advance, evenly extract M point, for instance, if 10000 points are arranged, need to extract 20(M now in the performance information collection period that sets in advance) individual point, then extract a sampled point every 10000/20=500 and get final product.Like this, the amount of calculation of acting server is less relatively, and required computational resource is little, but the calculating by acting server, can the daily record data that height is concurrent gather and be the statistics in the performance information collection period that sets in advance, make that the centralized monitor to network element device becomes possibility.
Acting server at the performance information collection period that sets in advance then carries out zero clearing to counting and handles.
Preferably, acting server is deployed on the network element device.Network element device is transferred to the acting server that is deployed on this network element device by the UDP mode with daily record data, and resource consumption is little, hardly can be influential to the concurrent performance of network element device.
Convergence server is used for merging the cycle according to the daily record data that sets in advance, and the daily record data of the cluster that receives is merged, and exports the performance evaluation server to;
In the embodiment of the invention, convergence server receives the tcp data bag of acting server output, carries out exporting the performance evaluation server to after the convergence processing.
Preferably, this system can further include:
Configuration server (ConfigServer) is used for configuration and comprises the configuration information that data format, data transfer mode and network element device attribute are set, and configuration information is issued to network element device; The state of Monitor Daemon Server is when monitoring acting server when delaying machine, by the delay acting server of machine of Long-distance Control reparation and startup.
In the embodiment of the invention, configuration server monitors acting server when delaying machine, can be long-range with the acting server pull-up, namely acting server is carried out Long-distance Control.Specifically, enter the Internet by the computer network strange land, be communicated with controlled acting server, use containment (SSH, Secure Shell) mode log-on proxy server, the desktop environment of controlled acting server is shown on the configuration server, by configuration server to the acting server that breaks down in strange land be configured, software installation procedure, modification etc., the fault of the acting server that breaks down with eliminating, and start the acting server of fixing a breakdown by the Remote Wake Up mode.
The network element device attribute can comprise: parameters such as network element device identification code, network element device numbering, function numbering, performance information collection period and sampling M value.
In the embodiment of the invention, configuration server can be that the principal and subordinate disposes, to guarantee high availability (HA, High Available).
The performance evaluation server is used for handling the daily record data that obtains according to merging, and carries out the network element device performance evaluation.
In the embodiment of the invention, the performance evaluation server receives the tcp data bag of convergence server output, the tcp data bag is deposited in the interim storage, and interim storage can be the MySQL database that is based upon temporary file system (TMPFS, Temporary File System).Because high concurrent data are carried out cluster by acting server according to the performance information collection period that sets in advance, therefore, it is less that convergence server carries out the required resource overhead of the required resource overhead of cluster and performance evaluation server stores.
In the embodiment of the invention, the performance evaluation server can use the query function of database, and the function daily record data was merged according to the daily record data merging cycle that sets in advance.
The daily record data that merges comprises: the misdeed daily record data of merging and the function daily record data of merging.
The function log data structures schematic diagram that Fig. 5 merges for the embodiment of the invention.Referring to Fig. 5, the function daily record data of merging comprises: acting server information of identification code, network element device information of identification code, network element device number information, function number information, daily record data merge time period information, merge total degree information, merge equal value information, merge maximum information, merge minimum information and merging { sampling set (time, value) } information.
Preferably, the performance evaluation server can be further used for showing the daily record data of merging or the result who carries out the network element device performance evaluation.
Certainly, in the practical application, this system can further include:
Control Server is used for the network element device results of performance analysis that the analysis of reading performance Analysis server obtains, and is lower than the rate-valve value that sets in advance if the network element device results of performance analysis shows concurrent speed, and the number of users that inserts the intelligent television system is controlled.
In the embodiment of the invention, the performance evaluation server comprises daily record data memory cell, analytic unit, analysis result memory cell and analysis result display unit (not shown), wherein,
The daily record data memory cell is used for the tcp data bag that the storage convergence server is exported;
Analytic unit for the tcp data bag that reads the daily record data cell stores, is analyzed, and exports analysis result to the analysis result memory cell;
The analysis result memory cell is used for the analysis result that the inventory analysis unit is exported;
In the embodiment of the invention, the analysis result memory cell adopts perdurable data library storage analysis result.For example, adopt Relational DBMS MySQL server persistent storage analysis result.Certainly, in the practical application, the daily record data memory cell also can adopt the MySql server stores daily record data that is structured on the internal memory.
The analysis result display unit is used for reading analysis result and displaying from the analysis result memory cell.
In the embodiment of the invention, analysis result display unit query analysis is the analysis result in the memory cell (result database) as a result, refreshes the variation of each data in the analysis time period that sets in advance in real time, and can make further query manipulation to data.
The analysis result structural representation that Fig. 6 shows for the embodiment of the invention.Referring to Fig. 6, the function daily record data of displaying comprises: network element device information of identification code, daily record data merge time period information, merge total degree information, merge equal value information, merge maximum information, merge minimum information and merging { sampling set (time, value) } information.
By as seen above-mentioned, the method and system of the monitoring network element device performance of the embodiment of the invention, be used for the data format of performance monitoring and the data transfer mode of UDP by setting in advance network element device, network element device acquisition performance information, according to the data format that sets in advance performance information is encapsulated as daily record data, adopt UDP transmission daily record data, thereby in service layer monitoring network element device performance, less to the concurrent performance impact of network element device; Acting server receives the daily record data that network element device sends, according to the performance information collection period that sets in advance, daily record data is carried out cluster, the daily record data that can effectively reduce daily record data amount and the backstage amount of calculation of transmission and carry out clustering processing can be contained the source data of this network element device performance in the intelligent television system, promoted the reliability of analysis result, analysis result can reflect the actual performance situation of network element device, controls according to this analysis result, controls effective; Daily record data to cluster merges processing again, analyzes at the daily record data that merges, and it is little to analyze required resource overhead, is easy to carry out the network element device performance monitoring.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also comprises these changes and modification interior.
Claims (10)
1. the method for a monitoring network element device performance in described network element device, sets in advance data format and data transfer mode for performance monitoring, and this method comprises:
Acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with the performance information of gathering, and transmits described daily record data according to the data transfer mode that sets in advance;
Receive the daily record data that sends, the performance information collection period according to setting in advance carries out cluster to described daily record data;
Merge the cycle according to the daily record data that sets in advance, the daily record data of cluster is merged, handle the daily record data that obtains according to merging, carry out the network element device performance evaluation.
2. the method for monitoring network element device performance according to claim 1, wherein,
Described data format comprises: information such as network element device identification code, function numbering, behavior sign, data time point and additional data.
3. the method for monitoring network element device performance according to claim 2, wherein, described behavior is designated triggering behavior sign, continues behavior sign or misdeed sign.
4. the method for monitoring network element device performance according to claim 3, wherein, described daily record data is carried out cluster comprise:
A11 in the performance information collection period that sets in advance, resolves the daily record data that receives, and obtains the network element device information of identification code, network element device number information, function number information and the behavior identification information that comprise in the daily record data;
A12 judges and resolves whether the behavior identification information that obtains is to continue the behavior identification information, if, execution in step A13, otherwise, execution in step A15;
A13 continues behavior and begins corresponding data time dot information in the log data, this daily record data is put into interim buffer memory;
A14 after monitoring this lasting behavior end, merges into one with the daily record data that should continue behavior in the interim buffer memory and comprises the daily record data that continues duration, execution in step A15;
A15 is that statistics receives, have daily record data total degree, average, maximum and a minimum of identical network element device information of identification code, network element device number information, function number information and behavior identification information;
A16 according to total degree, average, maximum and the minimum that statistics obtains, makes up the daily record data of cluster.
5. the method for monitoring network element device performance according to claim 4, wherein, described method further comprises:
From receive, have the daily record data of identical network element device information of identification code, network element device number information, function number information and behavior identification information, extract the daily record data of predetermined threshold value, data time dot information and the duration information of the daily record data that record extracts generate the sampling set.
6. the method for monitoring network element device performance according to claim 5, wherein, the daily record data of described structure cluster comprises:
Judge whether the behavior identification information is misdeed information in the daily record data that receives, if, the misdeed daily record data of structure cluster, otherwise, the function daily record data of structure cluster.
7. the system of a monitoring network element device performance is characterized in that, this system comprises: network element device, acting server, convergence server and performance evaluation server, wherein,
The data format and the data transfer mode that are used for performance monitoring that network element device, storage set in advance; Acquisition performance information is encapsulated as daily record data according to the data format that sets in advance with performance information, transmits daily record data according to the data transfer mode that sets in advance to acting server;
Acting server is used for receiving the daily record data that network element device sends, and the performance information collection period according to setting in advance carries out cluster to daily record data, exports convergence server to;
Convergence server is used for merging the cycle according to the daily record data that sets in advance, and the daily record data of the cluster that receives is merged, and exports the performance evaluation server to;
The performance evaluation server is used for handling the daily record data that obtains according to merging, and carries out the network element device performance evaluation.
8. the system of monitoring network element device performance according to claim 7 is characterized in that, described performance evaluation server can be further used for showing the daily record data of merging or the result who carries out the network element device performance evaluation.
9. the system of monitoring network element device performance according to claim 8 is characterized in that, described performance evaluation server comprises: daily record data memory cell, analytic unit, analysis result memory cell and analysis result display unit, wherein,
The daily record data memory cell is used for the transmission control protocol data bag that the storage convergence server is exported;
Analytic unit for the transmission control protocol data bag that reads the daily record data cell stores, is analyzed, and exports analysis result to the analysis result memory cell;
The analysis result memory cell is used for the analysis result that the inventory analysis unit is exported;
The analysis result display unit is used for reading analysis result and displaying from the analysis result memory cell.
10. the system of monitoring network element device performance according to claim 7, it is characterized in that, described acting server is deployed on the described network element device, described network element device is transferred to daily record data the described acting server that is deployed on the described network element device by the User Datagram Protoco (UDP) mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310104796.0A CN103200046B (en) | 2013-03-28 | 2013-03-28 | The method and system of monitoring network element device performance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310104796.0A CN103200046B (en) | 2013-03-28 | 2013-03-28 | The method and system of monitoring network element device performance |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103200046A true CN103200046A (en) | 2013-07-10 |
| CN103200046B CN103200046B (en) | 2016-01-20 |
Family
ID=48722412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310104796.0A Active CN103200046B (en) | 2013-03-28 | 2013-03-28 | The method and system of monitoring network element device performance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103200046B (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500071A (en) * | 2013-09-18 | 2014-01-08 | 湖南蚁坊软件有限公司 | Method and device for storing performance index data quantitatively |
| CN104579767A (en) * | 2014-12-29 | 2015-04-29 | 山石网科通信技术有限公司 | Method and system for sending gateway log information |
| CN105071946A (en) * | 2015-07-03 | 2015-11-18 | 北京奇虎科技有限公司 | System monitoring method and device |
| WO2015172508A1 (en) * | 2014-05-16 | 2015-11-19 | 中兴通讯股份有限公司 | Performance data processing method and device |
| CN105357584A (en) * | 2015-12-11 | 2016-02-24 | Tcl集团股份有限公司 | User behavior log classification uploading method and system based on intelligent television |
| CN105791049A (en) * | 2016-03-08 | 2016-07-20 | 成都广达新网科技股份有限公司 | Method for monitoring historical flow of EOC central office end equipment by means of network management system |
| CN106294866A (en) * | 2016-08-23 | 2017-01-04 | 北京奇虎科技有限公司 | A kind of log processing method and device |
| CN106453223A (en) * | 2016-07-15 | 2017-02-22 | 珠海金山网络游戏科技有限公司 | Seamless world game server system |
| CN106452867A (en) * | 2016-08-10 | 2017-02-22 | 贵阳朗玛信息技术股份有限公司 | Log message processing method and system |
| CN107196879A (en) * | 2017-05-18 | 2017-09-22 | 杭州敦崇科技股份有限公司 | Processing method, device and the forwarded device of UDP messages |
| CN107493315A (en) * | 2017-06-28 | 2017-12-19 | 武汉斗鱼网络科技有限公司 | A kind of collection method of behavioral data, Resource Server and storage medium |
| CN107515807A (en) * | 2016-06-17 | 2017-12-26 | 阿里巴巴集团控股有限公司 | A kind of method and device for storing monitoring data |
| CN107888445A (en) * | 2017-10-18 | 2018-04-06 | 金蝶软件（中国）有限公司 | Method, apparatus, computer equipment and the storage medium of performance state analysis |
| CN108259255A (en) * | 2016-12-29 | 2018-07-06 | 大唐移动通信设备有限公司 | A kind of network element data analysis method and device |
| CN108460161A (en) * | 2018-03-30 | 2018-08-28 | 腾讯科技（深圳）有限公司 | Layered sampling method, device and computer equipment |
| CN109492008A (en) * | 2018-11-13 | 2019-03-19 | 上海理想信息产业（集团）有限公司 | A kind of network big data design methods and system based on HBase |
| CN109861843A (en) * | 2018-11-28 | 2019-06-07 | 阿里巴巴集团控股有限公司 | Complete acquisition confirmation method, device and the equipment of journal file |
| CN111159129A (en) * | 2019-12-31 | 2020-05-15 | 北京神州绿盟信息安全科技股份有限公司 | Statistical method and device for log report |
| CN112256653A (en) * | 2020-11-06 | 2021-01-22 | 网易（杭州）网络有限公司 | Data sampling method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070066297A1 (en) * | 2005-09-20 | 2007-03-22 | Ghobad Heidari-Bateni | Network monitoring system and method |
| CN101174972A (en) * | 2006-11-03 | 2008-05-07 | 盛趣信息技术（上海）有限公司 | System and method for analysis data collection and statistics |
| CN101291399A (en) * | 2007-09-25 | 2008-10-22 | 深圳市同洲电子股份有限公司 | Digital television receiver, log system and log management method thereof |
| US20110173199A1 (en) * | 2010-01-11 | 2011-07-14 | International Business Machines Corporation | Computer system performance analysis |
| CN102902752A (en) * | 2012-09-20 | 2013-01-30 | 新浪网技术(中国)有限公司 | Method and system for monitoring log |
-
2013
- 2013-03-28 CN CN201310104796.0A patent/CN103200046B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070066297A1 (en) * | 2005-09-20 | 2007-03-22 | Ghobad Heidari-Bateni | Network monitoring system and method |
| CN101174972A (en) * | 2006-11-03 | 2008-05-07 | 盛趣信息技术（上海）有限公司 | System and method for analysis data collection and statistics |
| CN101291399A (en) * | 2007-09-25 | 2008-10-22 | 深圳市同洲电子股份有限公司 | Digital television receiver, log system and log management method thereof |
| US20110173199A1 (en) * | 2010-01-11 | 2011-07-14 | International Business Machines Corporation | Computer system performance analysis |
| CN102902752A (en) * | 2012-09-20 | 2013-01-30 | 新浪网技术(中国)有限公司 | Method and system for monitoring log |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500071B (en) * | 2013-09-18 | 2017-01-25 | 湖南蚁坊软件有限公司 | Method and device for storing performance index data quantitatively |
| CN103500071A (en) * | 2013-09-18 | 2014-01-08 | 湖南蚁坊软件有限公司 | Method and device for storing performance index data quantitatively |
| WO2015172508A1 (en) * | 2014-05-16 | 2015-11-19 | 中兴通讯股份有限公司 | Performance data processing method and device |
| CN104579767A (en) * | 2014-12-29 | 2015-04-29 | 山石网科通信技术有限公司 | Method and system for sending gateway log information |
| CN104579767B (en) * | 2014-12-29 | 2018-01-02 | 山石网科通信技术有限公司 | The sending method and system of gateway log information |
| CN105071946A (en) * | 2015-07-03 | 2015-11-18 | 北京奇虎科技有限公司 | System monitoring method and device |
| CN105357584A (en) * | 2015-12-11 | 2016-02-24 | Tcl集团股份有限公司 | User behavior log classification uploading method and system based on intelligent television |
| CN105357584B (en) * | 2015-12-11 | 2020-09-22 | Tcl科技集团股份有限公司 | User behavior log classification uploading method and system based on smart television |
| CN105791049A (en) * | 2016-03-08 | 2016-07-20 | 成都广达新网科技股份有限公司 | Method for monitoring historical flow of EOC central office end equipment by means of network management system |
| CN105791049B (en) * | 2016-03-08 | 2018-12-25 | 成都广达新网科技股份有限公司 | A method of EOC local-side device historical traffic is monitored using network management system |
| CN107515807A (en) * | 2016-06-17 | 2017-12-26 | 阿里巴巴集团控股有限公司 | A kind of method and device for storing monitoring data |
| CN107515807B (en) * | 2016-06-17 | 2021-05-07 | 阿里巴巴集团控股有限公司 | Method and device for storing monitoring data |
| CN106453223B (en) * | 2016-07-15 | 2020-03-31 | 珠海金山网络游戏科技有限公司 | Seamless world game server system |
| CN106453223A (en) * | 2016-07-15 | 2017-02-22 | 珠海金山网络游戏科技有限公司 | Seamless world game server system |
| CN106452867A (en) * | 2016-08-10 | 2017-02-22 | 贵阳朗玛信息技术股份有限公司 | Log message processing method and system |
| CN106294866A (en) * | 2016-08-23 | 2017-01-04 | 北京奇虎科技有限公司 | A kind of log processing method and device |
| CN106294866B (en) * | 2016-08-23 | 2020-02-11 | 北京奇虎科技有限公司 | Log processing method and device |
| CN108259255B (en) * | 2016-12-29 | 2020-05-15 | 大唐移动通信设备有限公司 | Network element data analysis method and device |
| CN108259255A (en) * | 2016-12-29 | 2018-07-06 | 大唐移动通信设备有限公司 | A kind of network element data analysis method and device |
| CN107196879B (en) * | 2017-05-18 | 2020-10-09 | 杭州敦崇科技股份有限公司 | UDP message processing method and device and network forwarding device |
| CN107196879A (en) * | 2017-05-18 | 2017-09-22 | 杭州敦崇科技股份有限公司 | Processing method, device and the forwarded device of UDP messages |
| CN107493315A (en) * | 2017-06-28 | 2017-12-19 | 武汉斗鱼网络科技有限公司 | A kind of collection method of behavioral data, Resource Server and storage medium |
| CN107888445B (en) * | 2017-10-18 | 2020-08-18 | 金蝶软件（中国）有限公司 | Method and device for analyzing performance state, computer equipment and storage medium |
| CN107888445A (en) * | 2017-10-18 | 2018-04-06 | 金蝶软件（中国）有限公司 | Method, apparatus, computer equipment and the storage medium of performance state analysis |
| CN108460161A (en) * | 2018-03-30 | 2018-08-28 | 腾讯科技（深圳）有限公司 | Layered sampling method, device and computer equipment |
| CN109492008A (en) * | 2018-11-13 | 2019-03-19 | 上海理想信息产业（集团）有限公司 | A kind of network big data design methods and system based on HBase |
| CN109861843A (en) * | 2018-11-28 | 2019-06-07 | 阿里巴巴集团控股有限公司 | Complete acquisition confirmation method, device and the equipment of journal file |
| CN109861843B (en) * | 2018-11-28 | 2021-11-23 | 阿里巴巴集团控股有限公司 | Method, device and equipment for completely collecting and confirming log files |
| CN111159129A (en) * | 2019-12-31 | 2020-05-15 | 北京神州绿盟信息安全科技股份有限公司 | Statistical method and device for log report |
| CN112256653A (en) * | 2020-11-06 | 2021-01-22 | 网易（杭州）网络有限公司 | Data sampling method and device |
| CN112256653B (en) * | 2020-11-06 | 2024-02-02 | 网易（杭州）网络有限公司 | Data sampling method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103200046B (en) | 2016-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103200046A (en) | Method and system for monitoring network cell device performance | |
| CN104424229B (en) | A kind of calculation method and system that various dimensions are split | |
| CN103870297B (en) | The performance data collection system and method for virtual machine in cloud computing environment | |
| CN109271412A (en) | The real-time streaming data processing method and system of smart city | |
| Meng et al. | State monitoring in cloud datacenters | |
| CN110413599A (en) | Generating date and storage system and method | |
| CN109560989B (en) | Link monitoring system | |
| CN106941493B (en) | Network security situation perception result output method and device | |
| WO2021169268A1 (en) | Data processing method, apparatus and device, and storage medium | |
| CN105577431A (en) | User information identification and classification method based on internet application and system thereof | |
| CN102156729A (en) | System and method for monitoring database servers | |
| CN102820983B (en) | System exception information collecting method and manager | |
| CN108880934B (en) | Data flow statistical method and device based on block chain | |
| CN110737647B (en) | Internet big data cleaning method | |
| CN109039817B (en) | Information processing method, device, equipment and medium for flow monitoring | |
| CN102231673A (en) | System and method for monitoring business server | |
| CN110858192A (en) | Log query method and system, log checking system and query terminal | |
| CN107346270A (en) | Method and system based on the sets cardinal calculated in real time | |
| CN112069049A (en) | Data monitoring management method and device, server and readable storage medium | |
| CN103517292A (en) | Mobile terminal information reporting method and apparatus | |
| CN103916463B (en) | Network access statistical analysis method and system | |
| CN111741007B (en) | Financial business real-time monitoring system and method based on network layer message analysis | |
| CN105471676B (en) | A kind of port scan IP network location liveness statistical system and method | |
| CN110633191A (en) | Method and system for monitoring service health degree of software system in real time | |
| CN207369077U (en) | Website user's behavioral data acquisition system based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170213 Address after: 266100 Shandong Province, Qingdao city Laoshan District Songling Road No. 399 Patentee after: Poly Polytron Technologies Inc Address before: 266061 Laoshan, Qingdao province Hongkong District No. East Road, room 248, room 131 Patentee before: Qingdao Hisense Media Networks Co., Ltd. |