CN103218389A - Data processing service system - Google Patents
Data processing service system Download PDFInfo
- Publication number
- CN103218389A CN103218389A CN2012105577302A CN201210557730A CN103218389A CN 103218389 A CN103218389 A CN 103218389A CN 2012105577302 A CN2012105577302 A CN 2012105577302A CN 201210557730 A CN201210557730 A CN 201210557730A CN 103218389 A CN103218389 A CN 103218389A
- Authority
- CN
- China
- Prior art keywords
- data
- service system
- product
- data processing
- processing service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to the technical field of data processing services and provides a data processing service system. The data processing service system consists of two major parts: a central control service model and a product processing service model. The data processing service system is mainly used for processing original data, such as data file parsing, format translating, standardizing, visualization and the like, and corresponding data products are generated. The system can be used for converting the original data which are complex and varied in format and type and are inconvenient to use into standardized scientific data.
Description
Technical field
The present invention relates to data processing field, be specifically related to a kind of data processing service system.
Background technology
At present, data product processing service system mainly is made up of central authorities' control service model and product treatment service model two large divisions, and it is mainly used in the science data processing.The data product processing subsystem with raw data (by compiling each station that subsystem compiles, node station, the observation data of each instrument and equipment) according to the processing that is correspondingly processed of its type, as the data document analysis, format conversion, standardization, visual etc., and generate corresponding data product (comprising standardized data file, visualized graphs file etc.).Particularly, central controlling models mainly is responsible for dispatching handling processing of request, and handles service accordingly according to dissimilar request calls, and its also is responsible for the data exchange interfaces with other subsystems; Handle service model and mainly be responsible for concrete processing service, it receives the processing service order from central controlling models, calls corresponding processing service and result is returned to central control module.The product that the product treatment model is final, just the standardized data file adopts CDF (Common Data Format) file layout, has comprised science data information and descriptor thereof (metadata information); The visualization model of handling in the service model simultaneously can be according to corresponding science data file rendered visualization graphic file, to serve the scientific research in later stage.The product treatment model has been introduced " data template " as the description to raw data file, template definition the relevant information of raw data, comprise its resolution rules, standardization, visual means etc., transaction module mainly are to handle raw data and generate corresponding science data product according to the relevant information in " data template ".
Because raw data format, type complexity are various, be not easy to use, the invention provides a kind of data product disposal system, promptly be by certain rule, resolve raw data and raw data is converted to standardized science data, simultaneously, can also carry out visual drawing to standardized data, generate science picture etc. according to the template corresponding content.Connect the database subsystem on the one hand, obtain pending data, carry out the processing of various routine data products, simultaneously treatment product is put in storage; On the other hand, provide with other subsystems and carry out mutual interface, data sharing and distribution subsystem can dynamically be called the service of processing, obtain the service of dynamic data product treatment.
Summary of the invention
The invention provides a kind of data processing service system, the data processing service system mainly is meant concrete data file, according to the processing of template descriptor, and returns the process of result.It mainly is divided into, and file layout transforms, the standardization of file and visual, and response dynamics is handled request etc., by middle control module uniform dispatching.
System adopts hierarchical schema, comprises data Layer, application layer and service layer; Can respond processing request, not only need to carry out customary data product and handle, and provide different data products to handle service for the different user of data distribution and shared Sub system from different sub-systems.Data product transaction module application layer connects raw data base and standardization, visual product library downwards, generate various routine data products according to relevant configuration, deposit raw data base in, connect data distribution and shared Sub system on the other hand, provide corresponding data product according to request, use for the user from distribution, shared Sub system.Data Layer also is the database subsystem, comprises a data source and two science data product libraries.Handle service system and be actually, resolve and do the standardization conversion, be converted into standard product file and visual science data and science data product library the certain rule of raw data foundation.Handle service system for data product, database can further specifically be divided into raw data base, standardization scientific library and visual scientific library again, deposits the science data product and the visual product data of raw data, standardized format respectively.
Because raw data format, type complexity are various, be not easy to use, adopt data product disposal system provided by the invention, connect the database subsystem on the one hand, obtain pending data, carry out the processing of various routine data products, simultaneously treatment product is put in storage; On the other hand, provide with other subsystems and carry out mutual interface, data sharing and distribution subsystem can dynamically be called the service of processing, obtain the service of dynamic data product treatment.
Description of drawings
Fig. 1 is a data product disposal system structural drawing.
Embodiment
The data processing service system mainly is meant concrete data file, according to the processing of template descriptor, and returns the process of result.It mainly is divided into, and file layout transforms, the standardization of file and visual, and response dynamics is handled request etc., by middle control module uniform dispatching.
System adopts hierarchical schema, comprises data Layer, application layer and service layer.Specifically as shown in Figure 1: the data product disposal system need respond the processing request from different sub-systems, not only needs to carry out customary data product and handles, and provide different data products to handle service for the different user of data distribution and shared Sub system.Data product transaction module application layer connects raw data base and standardization, visual product library downwards, generate various routine data products according to relevant configuration, deposit raw data base in, connect data distribution and shared Sub system on the other hand, provide corresponding data product according to request, use for the user from distribution, shared Sub system.Data Layer also is the database subsystem, comprises a data source and two science data product libraries.Handle service system and be actually, resolve and do the standardization conversion, be converted into standard product file and visual science data and science data product library the certain rule of raw data foundation.Handle service system for data product, database can further specifically be divided into raw data base, standardization scientific library and visual scientific library again, deposits the science data product and the visual product data of raw data, standardized format respectively.
Application layer and service layer are separate, and that service layer mainly serves is the terminal user, and it is responsible for the processing request is passed to application layer, so that application layer is made corresponding product treatment according to respective request.Application layer comprises a plurality of functional modules.The superiors of data product disposal system framework are service layers, this layer is handled service system for data distribution and data sharing subsystems provide data product, service provides with the Web Service form based on XML-RPC, and the framework of employing is the Twisted network frame.System's setting is meant the operation of operating personnel's management data product treatment subsystem, and operating personnel utilize the interface of software setting to carry out the setting of system.Summarize, the product treatment service system mainly comprises the raw data standardization, science data standardization, visualization processing, functions such as data-switching.
More than by diagram and explanation description of the invention has been proposed, above-mentioned for example, and non exhaustive, those of ordinary skill in the art can make improvements and be out of shape within the spirit and scope of the present invention.
Claims (5)
1. a data processing service system comprises data Layer, application layer and service layer, it is characterized in that described data processing service system can respond the data processing request from different sub-systems.
2. data processing service system as claimed in claim 1, described application layer connect raw data base and standardization, visual product library downwards.
3. data processing service system as claimed in claim 1, described data Layer comprise a data source and two science data product libraries.
4. data processing service system as claimed in claim 2, described database are divided into raw data base, standardization scientific library and visual scientific library, deposit the science data product and the visual product data of raw data, standardized format respectively.
5. data processing service system as claimed in claim 1, wherein application layer and service layer are separate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105577302A CN103218389A (en) | 2012-12-20 | 2012-12-20 | Data processing service system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105577302A CN103218389A (en) | 2012-12-20 | 2012-12-20 | Data processing service system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103218389A true CN103218389A (en) | 2013-07-24 |
Family
ID=48816179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012105577302A Pending CN103218389A (en) | 2012-12-20 | 2012-12-20 | Data processing service system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103218389A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103777593A (en) * | 2013-12-25 | 2014-05-07 | 中软信息系统工程有限公司 | Automatic product control and production system and realizing method thereof |
| CN104580474A (en) * | 2015-01-13 | 2015-04-29 | 深圳市融创天下科技有限公司 | Urban operation sign big data visualization multi-screen interaction display platform and method |
| CN106709784A (en) * | 2016-12-28 | 2017-05-24 | 广州虎鱼网络科技有限公司 | Cross-border e-commerce platform having high concurrency extensible distributed type architecture |
| CN107832340A (en) * | 2017-10-13 | 2018-03-23 | 中国煤炭地质总局物测队 | The big data system of data intellectual analysis is surveyed over the ground |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070139219A1 (en) * | 2005-12-16 | 2007-06-21 | Hunt Power, L.P. | Server and method for processing meter data into a common format |
| US7509327B2 (en) * | 2003-12-03 | 2009-03-24 | Microsoft Corporation | Business data migration using metadata |
| CN102377824A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Cloud computing-based spatial information service system |
| CN102495885A (en) * | 2011-12-08 | 2012-06-13 | 中国信息安全测评中心 | Method for integrating information safety data based on base-networking engine |
-
2012
- 2012-12-20 CN CN2012105577302A patent/CN103218389A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7509327B2 (en) * | 2003-12-03 | 2009-03-24 | Microsoft Corporation | Business data migration using metadata |
| US20070139219A1 (en) * | 2005-12-16 | 2007-06-21 | Hunt Power, L.P. | Server and method for processing meter data into a common format |
| CN102377824A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Cloud computing-based spatial information service system |
| CN102495885A (en) * | 2011-12-08 | 2012-06-13 | 中国信息安全测评中心 | Method for integrating information safety data based on base-networking engine |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103777593A (en) * | 2013-12-25 | 2014-05-07 | 中软信息系统工程有限公司 | Automatic product control and production system and realizing method thereof |
| CN103777593B (en) * | 2013-12-25 | 2016-10-05 | 中软信息系统工程有限公司 | A kind of product automation manipulation production system and its implementation |
| CN104580474A (en) * | 2015-01-13 | 2015-04-29 | 深圳市融创天下科技有限公司 | Urban operation sign big data visualization multi-screen interaction display platform and method |
| CN106709784A (en) * | 2016-12-28 | 2017-05-24 | 广州虎鱼网络科技有限公司 | Cross-border e-commerce platform having high concurrency extensible distributed type architecture |
| CN107832340A (en) * | 2017-10-13 | 2018-03-23 | 中国煤炭地质总局物测队 | The big data system of data intellectual analysis is surveyed over the ground |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2386272A1 (en) | Collaborative design | |
| US20090172553A1 (en) | Spreadsheet Software Services | |
| CN104932895A (en) | Middleware based on SOA (Service-Oriented Architecture) and information publishing method thereof | |
| CN206249316U (en) | A kind of Data Centre in Hospital plateform system based on high in the clouds | |
| CN101083656A (en) | Data stream technique based multi-source heterogeneous data integrated system | |
| US10642895B2 (en) | Method and system for converting one type of data schema to another type of data schema | |
| CN106774192A (en) | Heat treatment intelligence system and its control method based on MES | |
| CN103218389A (en) | Data processing service system | |
| CN106055881A (en) | Cloud platform for medical data processing | |
| CN102567330A (en) | Heterogeneous database integration system | |
| Dibowski et al. | Using Semantic Technologies to Manage a Data Lake: Data Catalog, Provenance and Access Control. | |
| AU2017254506A1 (en) | Method, apparatus, computing device and storage medium for data analyzing and processing | |
| CN110069450A (en) | Interactive electronic technical manual platform based on S1000D standard | |
| CN106685707A (en) | Asset information control method in distributed infrastructure system | |
| CN105426527A (en) | Method for unified data modeling in informatization surveying and mapping production equipment integration process | |
| CN107153679A (en) | A kind of extraction statistical method and system for semi-structured big data | |
| CN101470734A (en) | Data identification and analyzing method and apparatus | |
| KR20200098380A (en) | Method and apparatus for managing knowledge base, device and medium | |
| CN107301239A (en) | A kind of database converter and conversion method | |
| CN115794804A (en) | Engineering internal control data visualization processing system and method based on big data technology | |
| CN113449061A (en) | Intelligent building operation and maintenance cloud platform system based on 5G network | |
| CN102521359A (en) | Interface data file comparison method and device | |
| CN111159158A (en) | Data normalization method and device, computer readable storage medium and electronic equipment | |
| CN108269227A (en) | A kind of computer graphical processing system | |
| EP3511843A1 (en) | Method and system for integrating data received from one or more data sources |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130724 |