CN102073767A - Method for managing metadata of virtual data warehouse of electric power information system group - Google Patents
Method for managing metadata of virtual data warehouse of electric power information system group Download PDFInfo
- Publication number
- CN102073767A CN102073767A CN 201110005537 CN201110005537A CN102073767A CN 102073767 A CN102073767 A CN 102073767A CN 201110005537 CN201110005537 CN 201110005537 CN 201110005537 A CN201110005537 A CN 201110005537A CN 102073767 A CN102073767 A CN 102073767A
- Authority
- CN
- China
- Prior art keywords
- data
- public
- attribute
- type
- name
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method for managing metadata of a virtual data warehouse of an electric power information system group. The method comprises the following steps of: a) managing an object data service of a public electric power information system, and managing the public data service attribute provided by a public object for query; b) managing the mapping relationship between a public data service and a private multi-dimension data service of each heterogeneous database, wherein the established mapping relationship of the public data service and the private multi-dimension data service of each heterogeneous database is finished through the incidence relation from the public data service attribute to each heterogeneous source table column; and c) managing a public data service interface and a maintenance interface, and managing a set of open standard interface (API) function library for providing external data services. The public data service interface comprises a unified retrieve definition interface and a unified data query service interface. By using the method, private data services provided by each power information system are integrated, and the public data services provided for a third party are summarized. The method can be conveniently applied to integration work of the electric power information group.
Description
Technical field
The present invention relates to the integrated technology of power information system database, especially especially relate to a kind of metadata management method that in the power information system group, makes up the virtual data warehouse, virtual data warehouse metadata management system by this method structure, the private data service that each power information system provides is integrated, be generalized into the public data services open, thereby realize providing a unified public data services platform electric power enterprise to the third party.
Background technology
The infosystem of a new generation's electric power enterprise need be considered the safe operation in the Power Market and the requirement of commercial operation.The basis of its application is common data platform of structure; surely arrange management system, technical support system for power market, Fault Management System, equipment monitoring system, water to transfer automated system, scheduling MIS and lightning location system etc. to unify interconnection Real-Time Scheduling system, electric energy metering system, relay protection, automatic safety device and intelligence, realize that the height of data and resource is shared.
At present, prefecture-level and above network system has all been set up several power information systems that comprise power network dispatching system.Have following difficult point alternately between these systems: the interface language difference that there is the data of different types model in (1) each system, data are handled, therefore the data, services that provides have nothing in common with each other be difficult to unified; (2) different, the memory location dispersion of each system database running environment.On logic and space, form the isomery infosystem thus.
Existing data demonstration, though now a lot of relevant for the integrated approach of electric power dispatching system uniform data platform,, have certain defective.Reason is as follows:
Data-interface unitized aspect, generally be data structure and interface language at different application systems, develop different interfaces and method.New system of every like this access just need develop a socket again, and construction cycle and cost are too high.The data structure of each application system all is privately owned simultaneously, is included in each system database and manages, and lacks the management of the multidimensional data of concentrating.Therefore lack a common interface that public service is provided for upper layer application based on standard data structure.
At the unitized management aspect of data, services, because each professional system all has separately model and object, privately owned professional service is provided separately, can not unify between each system, existing method is to set up the service call table for each system, call when the data query, but can't embody in each system common public data services attribute like this same physical equipment.Each database lacks the uniform data service management.
The storage of each system data unitized aspect, existing method is to set up a large-capacity data warehouse, and each data of database is drawn in the warehouse.The capacity of data warehouse is the summation of each database volume often, and this has brought the additional investment on the storage hardware, and large-capacity data extracts the load that has also increased each system and network.
In view of existing method can not fine processing power information system group integration problem, thereby press for a kind of mode of new virtual data warehouse, utilize the metadata management system of virtual varehouse, model, service and the data-interface of unified each power information system of centralized management, and summarize public model, service and the data-interface that a whole set of can be open to the third party.Definition and modeling method that a patented claim " integrated model and the modeling method of a kind of power information system heterogeneous database multidimensional data " has provided concrete database have been submitted simultaneously.
Summary of the invention
The present invention seeks to: in order to solve the model that a plurality of databases of existing power infosystem group exist when integrated, service and data-interface can't be concluded unified problem, a kind of metadata management method that makes up the virtual data warehouse in the power information system group has been proposed, utilize the metadata management system of virtual varehouse, the model of unified each power information system of centralized management, service and data-interface, and summarize the public model that a whole set of can be open to the third party, serve and data-interface, solved the integration Management problem of power information system group's multidimensional data.
Technical scheme of the present invention is: a kind of power information system group's virtual data warehouse metadata management method is characterized in that comprising following steps:
The Service Management of step a) public power infosystem object data; Adopt a kind of method of self study,, constantly expand public power infosystem object type and public service attribute according to object type in the model of existing power information system and the privately owned Service Properties that provides.By the metadata system management public power infosystem object is carried out the management of model, it is method by a kind of two tuples (common object--common object type correspondence), common object for each class, metadata management system is distributed to a kind of Container Type and is used to load this object, be associated with a kind of common object type simultaneously, managed public data services attribute inquiry that this common object provides; Step a) further comprises:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object and data type;
In second step, if fail to find the type of this public power infosystem object in the first step, then newly-built a kind of public power infosystem object type is with public power infosystem object and type matching;
The 3rd step, investigate the public data services attribute of common object type, each data rows of this service is associated with under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
Until the investigation of finishing N public power infosystem object;
Step b): the mapping relations management of the various dimensions data, services that public data services and each heterogeneous database are privately owned; The mapping relations of the various dimensions data, services that the public data services attribute of setting up and the database of each multidimensional are privately owned are to finish to the incidence relation of each isomery source database row by the public data services attribute; The public data services attribute is a multidimensional to the incidence relation to the database column of each multidimensional, and promptly the common object type can comprise a plurality of public data services attributes; The database column of multidimensional also is a multidimensional to last relation simultaneously, and promptly a common object type can be associated with the heterogeneous database private data Service Properties of a plurality of multidimensional by a plurality of public data services attributes.Thereby finished integrated to the public data services attribute of the multidimensional data of common object type.
The first step, the data source of investigating the 1st power information system is the public data services of the 1st inquiry that common object provides, and extracts its data structure about certain private data service;
Second step, in the multi-dimensional database of metadata management system, set up data structure about the private data service of the 1st power information system data source, insert " origin system table ", " source database table ", " source database row " respectively;
In the 3rd step, extract the public data services attribute and insert " public data services attribute list ", the incidence relation of the private data service of setting up at the external key place and setting up in second step;
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type " this public data services is configured on the pairing common object type, match concrete common object again;
Investigate the 2nd power information system data source, repeat first to fourth step;
Until the N step, finish the investigation of N power information system data source.
Step c) public data services interface and maintenance interface: standard interface (API) function library that the data clothes externally are provided that a cover is open.The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface:
Unified retrieval defining interface function:
(1) provides in the common object model one group of common object of the scope of dividing for application system for the object of retrieval or according to electric network composition or other dimensions.
(2) provide tables of data and data attribute in the common data structures for application system.
(3) with above the two in conjunction with as the query and search condition, submit the uniform data query interface to.
The uniform data query interface function:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) the unified data result collection of output.
The private data service that each power information system that the inventive method is integrated provides, and summarize the public data services open to the third party.By the following information of metadata management: service of power information system common object and interface, power information public data services and interface, privately owned various dimensions data, services and interface, public service and privately owned service and their mapping relations of each isomery power information system database.Utilize this method, each power information system has constituted a virtual data warehouse, metadata management is in the middle layer of integrated common data virtual data Stores Stressed Platform, it provides the various public model service of power information system, device object and data-interface service to upper layer application, comprises complete standard interface (API) function library of a cover; To down and each heterogeneous data source carry out alternately, obtain the information such as model, device object, data structure of each database.
The invention has the beneficial effects as follows: under the information automation system of electric power enterprise of new generation need the active demand with a plurality of power information data system integrations and the unified platformization, utilize the inventive method, can set up the power information system common data platform of many isomeric datas origin system by the mode in virtual data warehouse.The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface.The private data service that integrated each power information system provides, and summarize the public data services open to the third party.Each power information system has constituted a virtual data warehouse, by the following information of metadata management: power information public data services and interface, privately owned various dimensions data, services and interface, public service and privately owned service and their mapping relations of each isomery power information system database, thus instruct each system interaction, externally provide the common object service by metadata management system.The virtual data warehouse that utilizes this metadata management method to set up, do not need to build extra data storage center, but utilize each power information system legacy data storage, and having very low hardware-software requirement, can be applied to easily in power information system group's the integrated work.What mode was different in the past is, this method does not need to set up huge data storage center, but service and data-interface by each infosystem of metadata management system unified management, raw data still is stored in the database of each infosystem, having saved integrated work and cost greatly, is a kind of very practical method.
Description of drawings
The present invention is described in more detail below in conjunction with the drawings and specific embodiments.
The mapping relations of Fig. 1 public data services and the service of each data source systems private data
The extraction of Fig. 2 public data services and conversion
Fig. 3 public data services model multidimensional data table is integrated
Fig. 4 public data services interface querying flow
Metadata management general frame in Fig. 5 power information system group virtual data warehouse
Embodiment
Integrated for each heterogeneous database system of power information system of finishing convenient quick low-cost, the invention provides a kind of metadata management system of the virtual data warehouse that constitutes by the power information system group, comprise following content: mapping relations management (3) public data services and the open interface function storehouse of the various dimensions data, services that (1) public power object information model management (2) public data services and each heterogeneous database are privately owned.
One, public power object information model management
Virtual varehouse metadata system management is a method by a kind of two tuples (common object-common object type) to the management of public power object information model, object for each class, metadata management system can be distributed to a kind of Container Type and be used to load this object, be associated with a kind of common object type simultaneously, managed the public data services that this object is provided.
As shown in Figure 1, be loaded into the common object of container for each, there is unique common object type (PubObjectType) described, wherein comprises the public data services attribute (PubDataAttribute) that public data services attribute (DContains_DataAttribute) has been described inquiry that this common object provides.
PubObjectType (common object type) is defined as follows:
| Attribute-name | Data type | Describe |
| name | DT_STRING | Title |
| DMemberOf_ObjectTypeDefine | DT_S_DARRAY_MATE | Belong to the object type definition |
| DContains_DataAttribute | DT_S_DARRAY_COMP | Comprise the public data services attribute |
PubDataAttribute (public data services attribute) is defined as follows:
| Attribute-name | Data type | Describe |
| name | DT_STRING | Title |
| alias | DT_STRING | Another name |
| RefSourceTableColumn | DT_S_REF_SIM | Point to unidirectional the quoting of source data row |
| DMemberOf_ObjectType | DT_S_DARRAY_MATE | Belong to object type |
Concrete establishment step is as follows:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object type;
In second step, if fail to find the type of this object in the first step, then newly-built a kind of common object type is with object and type matching;
The 3rd step, investigate the public data services attribute of common object type, each data rows of this service is associated with under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
.......
Until the N step, finish the investigation of N public power infosystem object.
Two, the mapping relations of the privately owned various dimensions data, services of public data services and each heterogeneous database management
The service of virtual varehouse metadata system management data is divided into two parts: the data, services management and the mapping relations between the two of public data services management, each isomery database source.By metadata management integrated the private data service that provides of each power information system, and summarize the public data services open to the third party.Public data services provides unified data query structure to the application of common data platform; The data, services of each isomery database source is to the subquery based on each data source Agent agency, provide its privately owned service data structure; And common query is according to above-mentioned mapping relations between the two to the association of the subquery of each data source.
By hierarchical relationship the source data structure of each heterogeneous database is described out: origin system-source data-source database table-source database row.
SourceSystem (origin system) is defined as follows:
| Attribute-name | Data type | Describe |
| name | DT_STRING | Title |
| alias | DT_STRING | Another name |
| DContains_SourceDB | DT_S_DARRAY_COMP | Comprise source database |
SourceDB (source database) is defined as follows:
| Attribute-name | Data type | Describe |
| name | DT_STRING | Title |
| alias | DT_STRING | Another name |
| dataSourceType | DT_ENUM | Data source type (referring to real-time storehouse/history library etc.) |
| appName | DT_STRING | Apply names |
| mdlInputFile | DT_STRING | Model imports file |
| dllFile | DT_STRING | Dynamic library file |
| DContains_SourceTable | DT_S_DARRAY_COMP | Comprise the source database table |
| DMemberOf_SourceSystem | DT_S_DARRAY_MATE | Belong to origin system |
| lastMaintainTimestamp | DT_STIME | The last maintenance time |
SourceTable (source database table) is defined as follows:
| Attribute-name | Data type | Describe |
| name | DT_STRING | Title |
| alias | DT_STRING | Another name |
| tableID | DT_ULONG | Table I D |
| DMemberOf_SourceDB | DT_S_DARRAY_MATE | Belong to source database |
| DContams_SourceTableColumn | DT_S_DARRAY_COMP | Comprise the source data row |
SourceTableColumn (source database row) is defined as follows:
| Attribute-name | Data type | Describe |
| ?name | DT_STRING | Title |
| ?alias | DT_STRING | Another name |
| ?columnID | DT_ULONG | Row ID |
| ?DMemberOf_SourceTable | DT_S_DARRAY_MATE | Belong to the source data table |
The mapping relations of the various dimensions data, services that public data services and each heterogeneous database are privately owned, be to finish to the incidence relation of source database row (SourceTableColumn), conclude the process of setting up of each data source " remote measurement amount " data, services attribute as shown in Figure 2 by public data services attribute (PubDateAttribute):
The first step is investigated the 1st power information system data source, extracts its data structure about certain private data service
Second step, in metadata system, set up data structure about the private data service of this data source, insert " origin system table ", " source database table ", " source database row " respectively
In the 3rd step, extract public data services and insert " public data services attribute list ", the incidence relation of the private data service of setting up at the external key place and setting up in second step
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type " this public data services is configured on the pairing common object container,
Investigate the 2nd power information system data source, repeat first to fourth step
.......
Until the N step, finish the investigation of N power information system data source;
The public data services attribute is a multidimensional to last relation, and promptly the common object container can comprise a plurality of public data services attributes; It also is multidimensional that the while source database is listed as last relation, and promptly a container can be associated with the heterogeneous database private data Service Properties of a plurality of multidimensional by a plurality of public data services attributes.Thereby finished integrated to the public data services attribute of privately owned multidimensional data Service Properties.
As shown in Figure 3, be the integrated data dictionary that leaves meta-data region in of multidimensional data service of having finished a plurality of heterogeneous systems, comprise following data structure:
System's table:
ID (PK), system description, access mode, act on behalf of Agent, comprise object ID, comprise original table ID
The data dictionary table:
ID (PK), object range describe, comprise common object ID, come Source Type, apply names, database name, class name
The common object table:
ID (PK), data dictionary ID (PK), public name, comprise primary object ID, object type ID, the markers that comes into force, inefficacy markers
The primary object table:
ID (PK, system identifier (PK), common object ID (PK), inner ID, inner ID data type, inner ID data length, object type ID, the markers that comes into force, inefficacy markers
The object type table:
ID (PK), title, processing type, come Source Type, the rationality upper limit, rationality lower limit, measure unit
The public sheet table:
ID (PK), table name claim, show type, comprise row ID, model class ID, the model class name,
Common list:
ID (PK), public sheet ID (PK), row title, whether major key, data type, data length, model attributes ID, model member name
The Object Dimension table:
ID (PK), title, dimension type, comprise common object ID, comprise object type ID, comprise regional ID, comprise electric pressure ID, comprise factory station ID, comprise device id
Segment table during day:
ID (PK), title, type, period begin, the period finishes
The time dimension kilsyth basalt:
ID (PK), dimension name, dimension type, time quantity, chronomere, comprise data interval I D, comprise a day interval I D, comprise special typical period of time ID
Segment table during data:
ID (PK), title, type, period begin, the period finishes, special typical period of time ID (PK), title, type, period begin, the period finishes
Three, public data services and open interface function storehouse
The public data services interface is to the mutual data-interface of the unification of upper layer application, consistent standard data interface that can be after types of applications provides integration.Implementation is expanded on the basis of commercialization universal middleware component interface standard, and cross-platform service encapsulates form is provided.The public data services interface comprises two funtion parts: unified retrieval defining interface and uniform data query interface.
Unified retrieval defining interface function:
The first step provides in the common object model group objects of the scope of dividing for the object of retrieval or according to electric network composition or other dimensions for application system.
Second step is for application system provides tables of data and data attribute in the common data structures.
In the 3rd step, as the query and search condition, submit above the two combination to the uniform data query interface.
The uniform data query interface function, as shown in Figure 4:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) the unified data result collection of output
Concrete query interface function definition is as follows:
Open standard interface function library comprises a group polling interface and one group of maintenance interface, comprising:
* describe: open metadatabase
virtual?int?open(itn?flag)＝0；//flag：
* describe: close metadatabase
virtual?int?close()＝0；
* describe: according to object global title and global property name getattr value
virtual?result_set_ptr?get_attrs_value(const?QStringList&objs_name，
const?QString&attrs_name)＝0；
* describe: according to object Global ID and global property name getattr value
virtual?result_set_ptr?get_attrs_value(const?QList<ULongLong>&o?bjs_id，
const?QString&attrs_name)＝0；
* describe: obtain the period property value according to object global title and global property name
virtual?result_set_ptr?get_attrs_value(const?QStringList&objs_name，
const?QString&attrs_name，
int?type，
int?interval，
ULong?start_time，
ULong?end_time)＝0；
* describe: obtain the period property value according to object global title and global property name
virtual?result_set_ptr?get_attrs_value(const?QList<ULongLong>&objs_id，
const?QString&attrs_name，
inttype，
int?interval，
ULong?start_time，
ULong?end_time)＝0；
* describe: obtain Global ID according to the object global title
virtual?int?get_obj_id(const?QString&obj_name，
ULongLong&obj_id，
QList<vdb_obj_attr_desc>&additional_attrs)＝0；
* describe: obtain Global ID according to the object global title
virtual?int?get_objs_id(const?QStringList&objs_name，
QList<ULongLong>&objs_id)＝0；
* describe: Global ID obtains global title according to object
virtual?int?get_objs_name(const?QList<ULongLong>&objs_id，QStringList&objs_name)＝0；
// following be maintenance interface
* describe: register single object interface
virtual?int?register_obj(const?char＊obj_name，
const?char＊datasrc_name，
ULongLong?id_in_datasrc，
const?char＊id_str_in_datasrc，
int?id_datatype，
const?QList<vdb_obj_attr_desc>&additional_attrs)＝0；
* describe: delete single object
virtual?int?delete_obj(const?char＊obj_name)＝0；
* describe: revise the object global title
virtual?int?modify_obj_name(const?char*old_name，const?char＊new_name)＝0；
* describe: revise object adeditive attribute value
virtual?int?modify_obj(const?char＊obj_name，const?QList<vdb_obj_attr_desc>&additional_attrs)＝0；
* describe: increase global property
virtual?int?add_attr(const?char＊vdb_attr_name，
const?char＊datasrc_name，
const?char＊table_name_in_datasrc，
const?char＊attr_name_in_datasrc，
const?char＊obj_type)＝0；
* describe: the deletion global property
virtual?int?delete_attr(const?char＊vdb_attr_name)＝0；
* describe: revise the global property name
virtual?int?modify_attr_name(const?char＊old_name，const?char＊new_name)＝0；
* describe: the batch registration object
virtual?int?register_objs(const?QList<vdb_obj_desc>&objs_desc，
const?char＊datasrc_name，
QList<Short>&ret_codes)＝0；
* describe: delete object in batches
virtual?int?delete_objs(const?QStringList&objs_name，QList<Short>&ret_codes)＝0；
Four, in the power information system group virtual data warehouse based on the general frame of metadata management
As shown in Figure 5, in a power information system group, formed a virtual data warehouse, the public data services platform is provided by metadata management system.Metadata management system be in integrated system the middle layer, it provides public model, device object and public data services interface to upper layer application; To down and each heterogeneous data source carry out alternately, obtain the information such as model, device object, data structure of each database.
The mapping relations that metadata management system has been stored the public power information object, served to each data source private data with the public data services of object association, by public data services, can well cooperate with each data source agency (AGENT) by this mechanism, obtain the information and the data of each data source, to the data warehouse particularly the distributed virtual data warehouse good support is provided.Because the public data services interface section of metadata management system provides standardized open function interface to the upper strata, can be directly used in the data access of common data platform simultaneously.
Claims (6)
1. power information system group virtual data warehouse metadata management method is characterized in that comprising following steps:
The Service Management of step a) public power infosystem object data according to object type in the model of existing power information system and the privately owned Service Properties that provides, is constantly expanded public power infosystem object type and public service attribute; By the metadata system management public power infosystem object is carried out the management of model, be by a kind of two tuples, be common object--the method for common object type correspondence, common object for each class, metadata management system is distributed to a kind of Container Type and is used to load this object, be associated with a kind of common object type simultaneously, managed public data services attribute inquiry that this common object provides;
The mapping relations management of the various dimensions data, services that step b) public data services and each heterogeneous database are privately owned; The mapping relations of the various dimensions data, services that the public data services attribute of setting up and the database of each multidimensional are privately owned are to finish to the incidence relation of each isomery source database row by the public data services attribute; The public data services attribute is a multidimensional to the incidence relation to the database column of each multidimensional, and promptly the common object type can comprise a plurality of public data services attributes; The database column of multidimensional also is a multidimensional to last relation simultaneously, and promptly a common object type can be associated with the heterogeneous database private data Service Properties of a plurality of multidimensional by a plurality of public data services attributes.Thereby finished integrated to the public data services attribute of the multidimensional data of common object type;
Step c) public data services interface and maintenance interface: standard interface (API) function library that the data clothes externally are provided that a cover is open.The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface.
2. a kind of power information system group's virtual data as claimed in claim 1 warehouse metadata management method is characterized in that: comprise following data structure in the wherein related metadata management:
PubObjectType (common object type) is defined as follows:
PubDataAttribute (public data services attribute) is defined as follows:
SourceSystem (origin system) is defined as follows:
SourceDB (source database) is defined as follows:
SourceTable (source database table) is defined as follows:
SourceTableColumn (source database row) is defined as follows:
3. a kind of power information system group's virtual data as claimed in claim 1 warehouse metadata management method is characterized in that:, wherein the uniform data query interface provides the calling interface function library of standard for common data platform.
4. a kind of power information system group's virtual data as claimed in claim 1 warehouse metadata management method, it is characterized in that: step a) further comprises:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object and data type;
In second step, if fail to find the type of this public power infosystem object in the first step, then newly-built a kind of public power infosystem object type is with public power infosystem object and type matching;
The 3rd step, investigate the public data services attribute of common object type, each data rows of this service is associated with under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
.......
Until the investigation of finishing N public power infosystem object.
5. a kind of power information system group's virtual data as claimed in claim 1 warehouse metadata management method, it is characterized in that: step b) further comprises:
The first step, the data source of investigating the 1st power information system is the public data services of the 1st inquiry that common object provides, and extracts its data structure about certain private data service;
Second step, in the multi-dimensional database of metadata management system, set up data structure about the private data service of the 1st power information system data source, insert " origin system table ", " source database table ", " source database row " respectively;
In the 3rd step, extract the public data services attribute and insert " public data services attribute list ", the incidence relation of the private data service of setting up at the external key place and setting up in second step;
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type " this public data services is configured on the pairing common object type, match concrete common object again;
Investigate the 2nd power information system data source, repeat first to fourth step;
.......
Until the N step, finish the investigation of N power information system data source.
6. a kind of power information system group's virtual data as claimed in claim 1 warehouse metadata management method is characterized in that: unified retrieval defining interface function in the step c):
(1) provides in the common object model one group of common object of the scope of dividing for application system for the object of retrieval or according to electric network composition or other dimensions.
(2) provide tables of data and data attribute in the common data structures for application system.
(3) with above the two in conjunction with as the query and search condition, submit the uniform data query interface to.
And uniform data query interface function:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) the unified data result collection of output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100055373A CN102073767B (en) | 2011-01-12 | 2011-01-12 | Method for managing metadata of virtual data warehouse of electric power information system group |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100055373A CN102073767B (en) | 2011-01-12 | 2011-01-12 | Method for managing metadata of virtual data warehouse of electric power information system group |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102073767A true CN102073767A (en) | 2011-05-25 |
| CN102073767B CN102073767B (en) | 2012-10-31 |
Family
ID=44032305
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100055373A Active CN102073767B (en) | 2011-01-12 | 2011-01-12 | Method for managing metadata of virtual data warehouse of electric power information system group |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102073767B (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236735A (en) * | 2011-06-30 | 2011-11-09 | 内蒙古电力勘测设计院 | Method and system for processing data relationships in power design |
| CN102243676A (en) * | 2011-07-13 | 2011-11-16 | 国电南瑞科技股份有限公司 | Three-level modeling method of new energy comprehensive monitoring system |
| CN102360470A (en) * | 2011-10-14 | 2012-02-22 | 广东电网公司电力科学研究院 | Information matching method and system for electric power system |
| CN102542005A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | System and method for counting and inquiring data in growth-type database |
| CN102609884A (en) * | 2012-02-07 | 2012-07-25 | 中国南方电网有限责任公司 | System for managing electric power dispatching logs |
| CN102684307A (en) * | 2012-05-17 | 2012-09-19 | 云南电力试验研究院（集团）有限公司电力研究院 | Information intelligent layering and propelling method for comprehensively and automatically monitoring centralized control station and transformer substation |
| CN102682051A (en) * | 2011-12-09 | 2012-09-19 | 江苏省电力公司苏州供电公司 | Method for integrating time series database with intelligent grid scheduling technology support system |
| CN103034928A (en) * | 2012-12-11 | 2013-04-10 | 清华大学 | Self-regulation dispersive plug-and-play data platform and management method and application |
| CN103559189A (en) * | 2013-08-22 | 2014-02-05 | 国家电网公司 | Power simulation training resource management system and method based on metadata integration model |
| CN103970900A (en) * | 2014-05-27 | 2014-08-06 | 重庆大学 | Multi-dimensional cross data flexible management method and system based on industrial field |
| CN104331426A (en) * | 2014-10-20 | 2015-02-04 | 国电南瑞科技股份有限公司 | Quick retrieving method of power system retriever based on browser |
| CN104603780A (en) * | 2013-02-06 | 2015-05-06 | 株式会社日立制作所 | Computer system, metadata management method, and recording medium |
| CN105335900A (en) * | 2015-11-19 | 2016-02-17 | 南方电网科学研究院有限责任公司 | Integrated data processing method based on power equipment state monitoring system |
| CN106897550A (en) * | 2017-02-04 | 2017-06-27 | 中国石油天然气股份有限公司 | logging data processing method and device |
| CN106909645A (en) * | 2017-02-21 | 2017-06-30 | 中国科学院电子学研究所 | A kind of space-time data organization of unity method of expansible definition |
| CN107368588A (en) * | 2017-07-24 | 2017-11-21 | 人教数字出版有限公司 | A kind of heterogeneous resource Homogeneous method and device |
| CN107491662A (en) * | 2017-10-09 | 2017-12-19 | 上海德衡数据科技有限公司 | A kind of intelligent region portable medical integrated data centric system architecture based on metadata |
| CN107563925A (en) * | 2017-08-31 | 2018-01-09 | 上海德衡数据科技有限公司 | A kind of intelligent region emergency medical integrated data centric system architecture |
| CN107610760A (en) * | 2017-08-31 | 2018-01-19 | 上海德衡数据科技有限公司 | A kind of intelligent region emergency medical integrated data centric system architecture based on software definition |
| CN107818148A (en) * | 2017-10-23 | 2018-03-20 | 南京南瑞集团公司 | Self-service query and statistical analysis method based on natural language processing |
| CN108073635A (en) * | 2016-11-18 | 2018-05-25 | 中国电力科学研究院 | A kind of system and its loading method of the loading of power information system data scene |
| CN109345293A (en) * | 2018-09-17 | 2019-02-15 | 上海宝尊电子商务有限公司 | A kind of big data information service method and system towards brand electric business |
| CN109582695A (en) * | 2018-12-04 | 2019-04-05 | 用友网络科技股份有限公司 | Data general-purpose querying method and inquiry system under a kind of micro services framework |
| CN110012070A (en) * | 2019-03-06 | 2019-07-12 | 中国南方电网有限责任公司 | A method of the intelligent oscillograph same source data multi domain based on NameSpace |
| CN111767332A (en) * | 2020-06-12 | 2020-10-13 | 上海森亿医疗科技有限公司 | Data integration method, system and terminal for heterogeneous data sources |
| CN112383138A (en) * | 2020-10-14 | 2021-02-19 | 北京四方继保工程技术有限公司 | Relay protection data service method and master station system thereof |
| CN114647716A (en) * | 2022-05-13 | 2022-06-21 | 天津南大通用数据技术股份有限公司 | Generalization data warehouse |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100117856A1 (en) * | 2008-11-11 | 2010-05-13 | Itron, Inc. | System and method of high volume import, validation and estimation of meter data |
| CN101770518A (en) * | 2010-01-29 | 2010-07-07 | 华东电网有限公司 | Metadata management method of power grid enterprise integrated information die |
| CN101908176A (en) * | 2010-08-02 | 2010-12-08 | 国电南瑞科技股份有限公司 | Method for modeling on basis of power information data and applying metadata management |
-
2011
- 2011-01-12 CN CN2011100055373A patent/CN102073767B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100117856A1 (en) * | 2008-11-11 | 2010-05-13 | Itron, Inc. | System and method of high volume import, validation and estimation of meter data |
| CN101770518A (en) * | 2010-01-29 | 2010-07-07 | 华东电网有限公司 | Metadata management method of power grid enterprise integrated information die |
| CN101908176A (en) * | 2010-08-02 | 2010-12-08 | 国电南瑞科技股份有限公司 | Method for modeling on basis of power information data and applying metadata management |
Cited By (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236735A (en) * | 2011-06-30 | 2011-11-09 | 内蒙古电力勘测设计院 | Method and system for processing data relationships in power design |
| CN102243676B (en) * | 2011-07-13 | 2012-12-05 | 国电南瑞科技股份有限公司 | Three-level modeling method of new energy comprehensive monitoring system |
| CN102243676A (en) * | 2011-07-13 | 2011-11-16 | 国电南瑞科技股份有限公司 | Three-level modeling method of new energy comprehensive monitoring system |
| CN102360470A (en) * | 2011-10-14 | 2012-02-22 | 广东电网公司电力科学研究院 | Information matching method and system for electric power system |
| CN102682051A (en) * | 2011-12-09 | 2012-09-19 | 江苏省电力公司苏州供电公司 | Method for integrating time series database with intelligent grid scheduling technology support system |
| CN102682051B (en) * | 2011-12-09 | 2015-03-11 | 国家电网公司 | Method for integrating time series database with intelligent grid scheduling technology support system |
| CN102542005A (en) * | 2011-12-13 | 2012-07-04 | 中国电子科技集团公司第十五研究所 | System and method for counting and inquiring data in growth-type database |
| CN102609884A (en) * | 2012-02-07 | 2012-07-25 | 中国南方电网有限责任公司 | System for managing electric power dispatching logs |
| CN102684307A (en) * | 2012-05-17 | 2012-09-19 | 云南电力试验研究院（集团）有限公司电力研究院 | Information intelligent layering and propelling method for comprehensively and automatically monitoring centralized control station and transformer substation |
| CN102684307B (en) * | 2012-05-17 | 2014-07-23 | 云南电力试验研究院（集团）有限公司电力研究院 | Information intelligent layering and propelling method for comprehensively and automatically monitoring centralized control station and transformer substation |
| CN103034928A (en) * | 2012-12-11 | 2013-04-10 | 清华大学 | Self-regulation dispersive plug-and-play data platform and management method and application |
| CN103034928B (en) * | 2012-12-11 | 2015-11-18 | 清华大学 | The plug and play data platform of self-discipline dispersion and management method and application |
| CN104603780A (en) * | 2013-02-06 | 2015-05-06 | 株式会社日立制作所 | Computer system, metadata management method, and recording medium |
| CN103559189B (en) * | 2013-08-22 | 2017-10-24 | 国家电网公司 | Electric analog training resource management system and method based on Metadata integration model |
| CN103559189A (en) * | 2013-08-22 | 2014-02-05 | 国家电网公司 | Power simulation training resource management system and method based on metadata integration model |
| CN103970900A (en) * | 2014-05-27 | 2014-08-06 | 重庆大学 | Multi-dimensional cross data flexible management method and system based on industrial field |
| CN103970900B (en) * | 2014-05-27 | 2017-04-26 | 重庆大学 | Multi-dimensional cross data flexible management method and system based on industrial field |
| CN104331426B (en) * | 2014-10-20 | 2018-06-19 | 国电南瑞科技股份有限公司 | A kind of method for quickly retrieving of the electric system searcher based on browser |
| CN104331426A (en) * | 2014-10-20 | 2015-02-04 | 国电南瑞科技股份有限公司 | Quick retrieving method of power system retriever based on browser |
| CN105335900A (en) * | 2015-11-19 | 2016-02-17 | 南方电网科学研究院有限责任公司 | Integrated data processing method based on power equipment state monitoring system |
| CN108073635A (en) * | 2016-11-18 | 2018-05-25 | 中国电力科学研究院 | A kind of system and its loading method of the loading of power information system data scene |
| CN108073635B (en) * | 2016-11-18 | 2021-08-27 | 中国电力科学研究院有限公司 | System for loading data scene of electric power information system and loading method thereof |
| CN106897550A (en) * | 2017-02-04 | 2017-06-27 | 中国石油天然气股份有限公司 | logging data processing method and device |
| CN106897550B (en) * | 2017-02-04 | 2019-07-09 | 中国石油天然气股份有限公司 | Logging data processing method and device |
| CN106909645A (en) * | 2017-02-21 | 2017-06-30 | 中国科学院电子学研究所 | A kind of space-time data organization of unity method of expansible definition |
| CN106909645B (en) * | 2017-02-21 | 2019-03-26 | 中国科学院电子学研究所 | A kind of space-time data organization of unity method of expansible definition |
| CN107368588B (en) * | 2017-07-24 | 2020-09-01 | 人教数字出版有限公司 | Heterogeneous resource isomorphism method and device |
| CN107368588A (en) * | 2017-07-24 | 2017-11-21 | 人教数字出版有限公司 | A kind of heterogeneous resource Homogeneous method and device |
| CN107563925A (en) * | 2017-08-31 | 2018-01-09 | 上海德衡数据科技有限公司 | A kind of intelligent region emergency medical integrated data centric system architecture |
| CN107610760A (en) * | 2017-08-31 | 2018-01-19 | 上海德衡数据科技有限公司 | A kind of intelligent region emergency medical integrated data centric system architecture based on software definition |
| CN107491662A (en) * | 2017-10-09 | 2017-12-19 | 上海德衡数据科技有限公司 | A kind of intelligent region portable medical integrated data centric system architecture based on metadata |
| CN107818148A (en) * | 2017-10-23 | 2018-03-20 | 南京南瑞集团公司 | Self-service query and statistical analysis method based on natural language processing |
| CN109345293A (en) * | 2018-09-17 | 2019-02-15 | 上海宝尊电子商务有限公司 | A kind of big data information service method and system towards brand electric business |
| CN109582695A (en) * | 2018-12-04 | 2019-04-05 | 用友网络科技股份有限公司 | Data general-purpose querying method and inquiry system under a kind of micro services framework |
| CN110012070A (en) * | 2019-03-06 | 2019-07-12 | 中国南方电网有限责任公司 | A method of the intelligent oscillograph same source data multi domain based on NameSpace |
| CN110012070B (en) * | 2019-03-06 | 2022-02-15 | 中国南方电网有限责任公司 | Method for applying homologous data of intelligent wave recorder in multiple domains based on name space |
| CN111767332A (en) * | 2020-06-12 | 2020-10-13 | 上海森亿医疗科技有限公司 | Data integration method, system and terminal for heterogeneous data sources |
| CN111767332B (en) * | 2020-06-12 | 2021-07-30 | 上海森亿医疗科技有限公司 | Data integration method, system and terminal for heterogeneous data sources |
| CN112383138A (en) * | 2020-10-14 | 2021-02-19 | 北京四方继保工程技术有限公司 | Relay protection data service method and master station system thereof |
| CN114647716A (en) * | 2022-05-13 | 2022-06-21 | 天津南大通用数据技术股份有限公司 | Generalization data warehouse |
| CN114647716B (en) * | 2022-05-13 | 2022-08-30 | 天津南大通用数据技术股份有限公司 | System suitable for generalized data warehouse |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102073767B (en) | 2012-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102073767B (en) | Method for managing metadata of virtual data warehouse of electric power information system group | |
| CN102063509B (en) | Model and modeling method of multi-dimensional data integration of heterogeneous databases of electric power information system | |
| CN104391948B (en) | The data normalization construction method and system of data warehouse | |
| CN102609463B (en) | Data cluster management system based on quasi-realtime platform | |
| CN101599146A (en) | A kind of management method of die manufacturing information and system | |
| CN105278373A (en) | Substation integrated information processing system realizing method | |
| CN102426525B (en) | Panoramic modeling method of multi-application system | |
| CN106951552A (en) | A kind of user behavior data processing method based on Hadoop | |
| CN101984421A (en) | Real-time database based meteorological element data organization type-in and querying method | |
| CN104778188A (en) | Distributed device log collection method | |
| CN104599032A (en) | Distributed memory power grid construction method and system for resource management | |
| CN105224613A (en) | Based on integrating heterogeneous data source system and the integration method thereof of the federal technology of data | |
| CN102495916A (en) | Multi-application-system panoramic modeling method based on object matching | |
| CN102314480A (en) | Distributed data storage method specific to mass data | |
| CN103559189A (en) | Power simulation training resource management system and method based on metadata integration model | |
| CN110109987A (en) | A kind of agility data warehouse schema and its construction method and application | |
| CN105743870A (en) | Design method of intelligent substation integrated business platform service interfaces | |
| Lv et al. | Design of cloud data warehouse and its application in smart grid | |
| CN106257460A (en) | Data base's general-purpose accessing implementation method for micro-capacitance sensor monitoring system | |
| JP5659757B2 (en) | Distributed database management system and distributed database management method | |
| CN108446145A (en) | A kind of distributed document loads MPP data base methods automatically | |
| CN105574074A (en) | Smart grid WAMS-based time-series big data storage method | |
| CN105740296B (en) | Intelligent substation data subscription method based on access model | |
| Jun et al. | The research & application of ETL tool in business intelligence project | |
| CN103197926A (en) | Method for establishing IEC61970 electric energy quality common information model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |