CN103778066B - Data processing method and device - Google Patents

Data processing method and device Download PDF

Info

Publication number
CN103778066B
CN103778066B CN201410035027.4A CN201410035027A CN103778066B CN 103778066 B CN103778066 B CN 103778066B CN 201410035027 A CN201410035027 A CN 201410035027A CN 103778066 B CN103778066 B CN 103778066B
Authority
CN
China
Prior art keywords
data
updated
communication area
database systems
sequence number
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410035027.4A
Other languages
Chinese (zh)
Other versions
CN103778066A (en
Inventor
罗东晓
王旭光
陈志祥
郭海球
吴毅
邢善云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN201410035027.4A priority Critical patent/CN103778066B/en
Publication of CN103778066A publication Critical patent/CN103778066A/en
Application granted granted Critical
Publication of CN103778066B publication Critical patent/CN103778066B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention provides a data processing method and a data processing device, wherein the method comprises the steps that instructions to be processed are obtained, wherein the instructions to be processed carry data to be processed and data marks; basic data corresponding to the data marks in a basic information communication region is read, wherein the basic data is read from a database system and is stored into the basic information communication region; the data to be processed is processed according to the basic data, and data to be updated obtained after the processing is registered into a data updating communication region; under the conditions that the data in the data updating communication region meets the preset conditions, the data to be updated in the data updating communication region is updated to the database system. The method and the device provided by the embodiment of the invention solve the technical problem of low data processing efficiency of the database system caused by requirement of frequent access of the database system in the prior art, and the technical effect of effectively improving the processing efficiency is reached.

Description

Data processing method and device
Technical field
The present invention relates to technical field of computer data storage, more particularly to a kind of data processing method and device.
Background technology
With enterprise information system using more and more extensively, enterprise information system needs data to be processed also to get more and more, The logical structure of internal system also becomes increasingly complex.Therefore, how to improve system effectiveness becomes to enterprise information system research Main way.Database Systems are the core positions of enterprise information system, and many application systems are required for accessing data base System, however, current Database Systems are the bottlenecks of enterprise information system.For example: corporate client has handled a business, is entering During row data processing, relate generally to many accounting entries and process, and each accounting entry processes and can be related to keep accounts, register The operations such as detailed, registration daily record, such application system is accomplished by accessing Database Systems once and again, accesses every time and is directed to Set up the processes such as connection, data transfer and data processing.So will certainly lead between application system and Database Systems Repeatedly connect, the resource consumption of Database Systems is larger, greatly reduce whole enterprise information system data processing and operation Efficiency.
Content of the invention
Embodiments provide a kind of data processing method, to reach the resource consumption reducing Database Systems, carry The purpose of high data-handling efficiency, the method includes:
Obtain pending instruction, wherein, carry in described pending instruction: pending data data mark;
Read Back ground Information communication area described in the corresponding basic data of Data Identification, wherein, described basic data be from Read in Database Systems and store in described Back ground Information communication area;
According to described basic data, described pending data is processed, the data registration to be updated obtaining after processing Update communication area to data;
Data update communication area in data meet pre-conditioned in the case of, by described data update communication area in Data to be updated updates in Database Systems.
In one embodiment, before reading the corresponding basic data of Data Identification described in Back ground Information communication area, Methods described also includes:
Determine whether to receive the pending instruction carrying described Data Identification for the first time;
If it is, being connected to described Database Systems;
Read the basic data of Data Identification described in described Database Systems;
The basic data of the described Data Identification reading from described Database Systems is stored described Back ground Information lead to In news area.
In one embodiment, data update communication area in data meet pre-conditioned in the case of, by described number Update in Database Systems according to updating data to be updated corresponding with described Data Identification in communication area, comprising:
Reach default data volume when described data updates the data to be updated in communication area, or data to be updated exists When the time that described data updates in communication area reaches preset time threshold, by described data update in communication area with described data Identify corresponding data to be updated to update in described Database Systems.
In one embodiment, the data to be updated obtaining after processing is registered in data and updates communication area, comprising:
Obtain and need to update the sequence number collection in Database Systems, wherein, described sequence number collection is all and described data mark Know the set of the sequence number of corresponding data to be updated;
The sequence number that described sequence number is concentrated is ranked up;
Updated communication area from described data according to the sequence number collection after sequence and read data to be updated one by one;
The data to be updated reading is updated in described Database Systems.
In one embodiment, after described pending data is processed, the number to be updated that obtains after processing Before being registered in data renewal communication area, methods described includes:
Sequence number generator is called to generate the sequence number corresponding to this data to be updated.
The embodiment of the present invention additionally provides a kind of data processing equipment, to reach the resource consumption reducing Database Systems, Improve the purpose of data-handling efficiency, this device includes:
Acquisition module, for obtaining pending instruction, wherein, described pending instruction in carry: pending data and Data Identification;
First read module, for reading the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, Described basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module, for being processed to described pending data according to described basic data, obtains after processing Data to be updated is registered in data and updates communication area;
Update module, for data update communication area in data meet pre-conditioned in the case of, by described data The data to be updated updating in communication area updates in Database Systems.
In one embodiment, above-mentioned data processing equipment also includes:
Determining module, before the corresponding basic data of Data Identification described in reading Back ground Information communication area, really Whether fixed be to receive the pending instruction carrying described Data Identification for the first time;
Link block, in the case of determining to be primary in described determining module, is connected to described Database Systems;
Second read module, for reading the basic data of Data Identification described in described Database Systems;
Memory module, for storing institute by the basic data of the described Data Identification reading from described Database Systems State in Back ground Information communication area.
In one embodiment, described update module specifically for updating the data to be updated in communication area when described data Reach default data volume, or the time in described data renewal communication area for the data to be updated reaches preset time threshold When, described data is updated to be updated data corresponding with described Data Identification in communication area and updates described Database Systems In.
In one embodiment, described update module includes:
Acquiring unit, needs to update the sequence number collection in Database Systems for obtaining, wherein, described sequence number collection is all The set of the sequence number of to be updated data corresponding with described Data Identification;
Sequencing unit, the sequence number for concentrating to described sequence number is ranked up;
Reading unit, reads number to be updated one by one for updating communication area from described data according to the sequence number collection after sequence According to;
Updating block, for updating the data to be updated reading in described Database Systems.
In one embodiment, above-mentioned data processing equipment also includes:
Calling module, for the data to be updated after described pending data is processed, obtaining after processing Before being registered in data renewal communication area, sequence number generator is called to generate the sequence number corresponding to this data to be updated.
In embodiments of the present invention, basic data is stored in advance from Database Systems in Back ground Information communication area, When needing to obtain basic data, directly obtain from Back ground Information communication area, treat more for obtain after processing New data first stores data and updates in communication area, and then unified renewal, in Database Systems, solves by the way again The technology that the data-handling efficiency of Database Systems that frequently accesses Database Systems and lead to is low is needed in prior art Problem, has reached the technique effect effectively improving treatment effeciency.
Brief description
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, not Constitute limitation of the invention.In the accompanying drawings:
Fig. 1 is the flow chart of the data processing method of the embodiment of the present invention;
Fig. 2 is the structural representation of the data-storage system of the embodiment of the present invention;
Fig. 3 is the flow chart of the application program of the embodiment of the present invention;
Fig. 4 is the master control of the embodiment of the present invention and the flow chart of interface unit;
Fig. 5 is the master control of the embodiment of the present invention and the flow chart of interface unit;
Fig. 6 is the flow chart of the Back ground Information acquiring unit of the embodiment of the present invention;
Fig. 7 is the flow chart of the Back ground Information communication area access unit of the embodiment of the present invention;
Fig. 8 is that the data of the embodiment of the present invention updates the flow chart communicating area's access unit;
Fig. 9 is the flow chart of the communication area monitoring unit of the embodiment of the present invention;
Figure 10 be the embodiment of the present invention update the data the flow chart being stored in unit;
Figure 11 is the structured flowchart of the data processing equipment of the embodiment of the present invention.
Specific embodiment
Embodiments provide a kind of data processing method, as shown in figure 1, comprising the following steps:
Step 101: obtain pending instruction, wherein, carry in described pending instruction: pending data data mark Know;
Step 102: read the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described basis Data is to be read from Database Systems in advance and store in described Back ground Information communication area;
Step 103: processed to described pending data according to described basic data, obtain after processing treats more New data is registered in data and updates communication area;
Step 104: the data that data updates in communication area meet pre-conditioned in the case of, described data is updated logical Data to be updated in news area updates in Database Systems.
In the above-described embodiments, basic data is stored in advance from Database Systems in Back ground Information communication area, When needing to obtain basic data, directly obtain from Back ground Information communication area, to be updated for obtain after processing Data first stores data and updates in communication area, and then unified renewal, in Database Systems, solves by the way again The low technology of data-handling efficiency needing the Database Systems frequently accessing Database Systems and leading in prior art is asked Topic, has reached the technique effect effectively improving treatment effeciency.
Above-mentioned Back ground Information communication area can be a kind of quick storage region, for example: the built-in storage of computer system, Above-mentioned basic data refers to when pending data is processed, the common data being relied on, for example: in an account When the amount of money is updated operation, need to know the information such as name in an account book, the place of the account, these information just belong to the model of basic data Farmland, so if necessary to repeatedly process to pending data, then may need to repeatedly use identical basic data.
In view of needing to look for the time communicating the data Cun Chudao Back ground Information in Database Systems in area, one In individual embodiment, Database Systems can be connected, by data when first time receiving the pending instruction that certain data represents Store in Back ground Information communication area, for example, can in the following ways basic data be stored in advance from Database Systems In described Back ground Information communication area: before reading the corresponding basic data of Data Identification described in Back ground Information communication area, really Whether fixed be to receive the pending instruction carrying described Data Identification for the first time;If it is, being connected to described data base System;Read the basic data of Data Identification described in described Database Systems;The institute that will read from described Database Systems The basic data stating Data Identification stores in described Back ground Information communication area.
Consider for the data to be updated in data renewal communication area to update the renewal frequency in Database Systems Reasonability, in one embodiment, data update communication area in data meet pre-conditioned in the case of, by described data Update to be updated data corresponding with described Data Identification in communication area to update in Database Systems, may include that when described The data to be updated that data updates in communication area reaches default data volume, or data to be updated updates in described data and leads to When time in news area reaches preset time threshold, described data is updated corresponding with described Data Identification in communication area treating more New data updates in described Database Systems.That is, update the data volume in communication area in data and reach predetermined value, or In the case that the time of storage reaches predetermined value, data is once updated by the data unification in communication area with regard to centrality and updates to number According in the system of storehouse.
In one embodiment, the major key of the data to be updated being registered in data renewal communication area may include that data Mark and the sequence number of data to be updated, by sequence number come mark data.Specifically, this sequence number can be to described pending number After being processed, after processing, the data to be updated that obtain is registered in before data updates communication area, calls sequence number to occur Device generates.
Update in Database Systems data being updated data to be updated corresponding with described Data Identification in communication area During, in order to ensure that data can update Database Systems in order effectively, can follow the steps below:
Step 1: obtain and need to update the sequence number collection in Database Systems, wherein, described sequence number collection is all described numbers Set according to the sequence number identifying corresponding data to be updated, i.e. sequence number is exactly to treat to update the data to be numbered, follow-up to ensure Process to it is not missed or repeats;
Step 2: the sequence number that described sequence number is concentrated is ranked up;
Step 3: updated communication area from described data according to the sequence number collection after sequence and read data to be updated one by one;
Step 4: the data to be updated reading is updated in described Database Systems.
The embodiment of the present invention additionally provides a specific embodiment and the present invention is specifically described, but is worth note Meaning, this specific embodiment, merely to preferably describing the present invention, does not constitute inappropriate limitation of the present invention.
In this example, there is provided a kind of data-storage system based on bus and method, maintenance data total demand pairs evidence is entered Unified being stored in, read and transmit operation of row.
You Lianglei common communication area:
1) what a class preserved is Back ground Information, and that is, application program first will obtain base from data base when carrying out data processing Plinth information, for example: customer information, its major key is Data Identification (id), and this region is named as Back ground Information communication area;
2) another kind of preservation is pending data information, and that is, this kind of data is updated Database Systems by application system In, for example: accounting entry information, major key is Data Identification+sequence number, and sequence number can be the serial number of pending data, by this area Domain is named as data and updates communication area.
For the pending data of same Data Identification, the first stroke pending data, when processing, can first connect To in data base, the Back ground Information of this Data Identification is read in Back ground Information communication area, for follow-up to this data mark When the other pending datas (i.e. pending data in addition to the first stroke) known are processed, read in Back ground Information communication area Basic data connects Database Systems reading basic data to substitute.
For each pending data, after processing, it is not updated directly in Database Systems, but first steps on Remember that data updates in communication area, reach certain data volume or reach pre- when data updates the data to be updated in communication area After fixing time, the data unification to be updated automatically updating data in communication area updates in Database Systems.From data base System reads data and updates in Database Systems to " Back ground Information communication area " with by the data in " data updates communication area " Can be completed by special data/address bus processing meanss, application program only needs and " Back ground Information communication area " and " number Communicate area according to updating " carry out data exchange.Therefore, " Back ground Information communication area " and " data updates communication area " is the formation of The bus of application data access, so-called bus is exactly in computer systems, is responsible for the list with multiple parts swap data Unit, transparent to each application program, application program does not need to directly access the database system, thus greatly reducing Database Systems Connection number of times, thus improve the data-handling efficiency of Database Systems and enterprise information system.
It is the data/address bus memory system architecture figure that this example provides as shown in Figure 2, this bus storage system includes: application journey Sequence 1, data administrator 2, data storage device 3 database system 4.Application program 1 will need instruction and data to be processed Send data administrator 2 to, realize the tables of data of the data/address bus database system 4 of data storage device 3 is stored in, reads The data manipulation such as take, transmit and monitor.Application program 1 need to send data administrator 2 to by instruction and data to be processed, real Border is master control and the interface unit 5 sending data administrator 2 to, calls base by master control and interface unit 5 according to command content Plinth information acquisition unit 6, Back ground Information communication area access unit 7, data renewal communication area access unit 8, the monitoring of communication area are single Unit 9 and update the data and be stored in the different units such as unit 10 and realize corresponding function, each processing unit can be an independence Module, module reuse can be realized each other.Back ground Information communication area 11 data is included in data storage device 3 Update communication area 12, communicate, in Back ground Information, multiple Back ground Informations 13 that are stored with area 11, update in communication area 12 in data and deposit Contain multiple data to be updated 4, be stored with Database Systems 4 multiple tables of data 15.
Below each device unit in above-mentioned data/address bus storage system is specifically described:
It is the data structure that Back ground Information communicates in area 11 as shown in table 1, be stored in data storage device 3, wherein protect Deposit is the basic data that application program obtains in advance when carrying out data processing from Database Systems 4, this basic data Major key is Data Identification.
Table 1
Domain name describes Purposes
Data Identification Unique id of mark data
Back ground Information The Back ground Information of this Data Identification
As shown in table 2 data updates the data structure in communication area 12, is stored in data storage device 3, preservation be Data to be updated, that is, application system need this kind of data will be updated in Database Systems, the major key of these data is several According to mark+sequence number, sequence number is the serial number of this Data Identification data to be updated.
Table 2
Domain name describes Purposes
Data Identification Unique id of mark data
Sequence number The serial number of this Data Identification data to be updated
Data to be updated Application system updates this kind of data in Database Systems
It is the process chart of application program 1 as shown in Figure 3, comprise the following steps:
Step 301: application program 1 obtains needs instruction and data to be processed;
Step 302: master control and interface unit need to be transferred to by instruction and data to be processed;
Step 303: wait master control and interface unit to call different units process to carry out data processing;
Step 304: obtain master control and the result of interface unit, to terminate whole flow process.
It is the flow chart that master control and interface unit 5 are interacted with application program 1 as shown in Figure 4, comprise the following steps:
Step 401: master control and interface unit 5 are interacted with application program, obtains and needs instruction and data to be processed, data Major key is Data Identification, and being also equivalent to get needs Data Identification to be processed;
Step 402: judge whether it is the first stroke pending data of this Data Identification, if it is, execution step 403, If it is not, then then execution step 404;
Step 403: call Back ground Information acquiring unit 6;
Step 404: connect data base and read the basic data of this Data Identification in Back ground Information communication area 11;
Step 405: call Back ground Information communicate area access unit 7 read the basic data that Back ground Information communicates in area 11 with Substitute and connect Database Systems reading Back ground Information;
Step 406: call data to update communication area access unit 8, pending data is registered in data and updates communication area In 12, wherein, major key is Data Identification+sequence number, and sequence number is the serial number of this Data Identification data to be updated, and this sequence number can be Generated by sequence number generator;
Step 407: judge whether also pending Data Identification, if it is, transposing step 402 continues next data The handling process of mark, if it is not, then terminate whole flow process.
The flow chart being master control and interface unit 5 background process as shown in Figure 5, as shown in figure 5, comprising the following steps:
Step 501: after the data that data updates in communication area 12 reaches certain data volume or the scheduled time, communicate area Monitoring unit 9 monitors notice master control and interface unit 5;
Step 502: called by master control and interface unit 5 update the data be stored in unit 10 by data to be updated unify renewal to In Database Systems, terminate whole flow process.
It is the flow chart of Back ground Information acquiring unit 6 as shown in Figure 6, master control and interface unit 5 judge if data mark The first stroke pending data known, then call Back ground Information acquiring unit 6 to connect the basic number that data base reads this Data Identification Communicate in area 11 according to Back ground Information, other pending datas of this same Data Identification (treat by the other in addition to the first stroke later Processing data) when being processed again, read the basic data that Back ground Information communicates in area 11 and connect Database Systems and read to substitute Take basic data, as shown in fig. 6, comprising the following steps:
Step 601: obtain and need Data Identification to be processed;
Step 602: be connected with Database;
Step 603: obtain the basic data of Data Identification;
Step 604: set up with data storage device and be connected;
Step 605: the basic data of Data Identification is deposited in Back ground Information communication area 11.
It is the flow chart that Back ground Information communicates area's access unit 7 as shown in Figure 7, comprise the following steps:
Step 701: obtain and need Data Identification to be processed;
Step 702: set up with data storage device and be connected;
Step 703: Back ground Information communication area 11 is read according to Data Identification and obtains basic data;
Step 704: the Back ground Information of this Data Identification obtaining is returned to master control and interface unit 5.
As shown in figure 8, being the flow chart that data updates communication area access unit 8, comprise the following steps:
Step 801: obtain and need Data Identification to be processed;
Step 802: set up with data storage device and be connected;
Step 803: call sequence number generator to generate sequence number, wherein, sequence number is the flowing water of this Data Identification data to be updated Number;
Step 804: pending data is registered in data and updates communication area, wherein, major key is Data Identification+sequence number.
It is the flow chart of communication area monitoring unit 9 as shown in Figure 9, communication area monitoring unit 9 is that monitoring data updates communication The working condition in area 12, judges whether that data is full or reaches the warehouse-in condition such as certain time, thus meeting warehouse-in condition All data statisticss to be updated are out.Specifically as shown in figure 9, comprising the following steps:
Step 901: set up with data storage device and be connected;
Step 902: ergodic data updates communication area;
Step 903: judge whether pending data meets warehouse-in condition, if it is, Data Identification+sequence number is preserved Come, if it is not, then skipping;
Step 904: judge whether also pending data, if it has, then continuing the handling process of next pending data, If it is not, exiting the handling process of pending data;
Step 905: the Data Identification saving+sequence number collection is returned to master control and interface unit 5.
To update the data the flow chart being stored in unit 10 as shown in Figure 10, update the data be stored in unit 10 for by meet into The data all to be updated of storehouse condition is unified to be updated in Database Systems.As shown in Figure 10, comprise the following steps:
Step 1001: obtain the Data Identification+sequence number collection needing to update;
Step 1002: Data Identification, sequence number ascending sort are carried out to Data Identification+sequence number collection;
Step 1003: set up with data storage device and be connected;
Step 1004: data is read according to Data Identification+sequence number and updates all data to be updated of communication area acquisition;
Step 1005: judge whether the first stroke data to be updated, if it is execution step 1006, otherwise execution step 1007;
Step 1006: set up this Data Identification with Database Systems and be connected;
Step 1007: judge whether this data to be updated is identical with the Data Identification of last time data to be updated, if phase With, then execution step 1008, otherwise execution step 1009, why increase this step and be because it is considered that this mark of updating If knowing identical with last time, then just the data of explanation last time is also in buffer area (that is, data field to be updated), at this moment, need First the data of last time to be first stored in data base, otherwise, after this data enters buffer area, the data of last time will be covered Lid falls, and the data of last time also just lost, and the data of last time is subsequently just had no chance to update data base again and suffered;
Step 1008: the data all to be updated of last time Data Identification is updated in Database Systems;
Step 1009: be connected with this Data Identification of Database;
Step 1010: judge whether to need to be updated the data, if it is, continuing next data to be updated to be stored in data base Handling process, if it is not, then execution step 1011;
Step 1011: the data all to be updated of last time Data Identification is updated in data base.
In this example it is proposed that a kind of data-storage system based on bus and method, the total demand pairs of maintenance data are according to entering Unified being stored in, read and transmit operation of row, preserving application program using data renewal communication area of Back ground Information communication area needs Back ground Information to be accessed and needs update the data arriving data base, and application program accesses the data renewal of Back ground Information communication area Communication area is to substitute connected reference Database Systems.The data to be updated updating in communication area in data is monitored to and reaches necessarily Data or when reaching predetermined after, automatically unified update in Database Systems.As can be seen here, apply journey by the way Sequence does not need to directly access the database system, greatly reduces the connection number of times of Database Systems, thus improve data base set System and the data-handling efficiency of enterprise information system.
Specifically, above-mentioned data storage method is mainly using the technological means of following several respects:
1) the total demand pairs of maintenance data, according to carrying out unifying to preserve, update communication area using Back ground Information communication area data and protect Depositing application program needs the Back ground Information accessing and needs the data to be updated updating to data base;
2) according to carrying out unifying to access, application program accesses Back ground Information communication area data and updates the total demand pairs of maintenance data Communication area is to substitute connected reference Database Systems;
3) data storage standardization, data unification is stored in Back ground Information communication area data and updates communication area, decreases Communication area is excessive and field names the different problems brought, and simplifies system structure, decreases maintenance difficulties;
Decrease the connection number of times of application system and Database Systems by the way, decrease the money of Database Systems Source consumes, and improves the data-handling efficiency of Database Systems and enterprise information system, reduces management cost, improves entirety Economic benefit.
Based on same inventive concept, in the embodiment of the present invention, additionally provide a kind of data processing equipment, as following enforcement Example is described.Because the principle of data processing equipment solve problem is similar to data processing method, the therefore reality of data processing equipment Apply the enforcement that may refer to data processing method, repeat no more in place of repetition.Used below, term " unit " or " mould Block " can realize the software of predetermined function and/or the combination of hardware.Although the device described by following examples is preferably with soft Part is realizing, but hardware, or the realization of the combination of software and hardware is also may and to be contemplated.Figure 11 is that the present invention is real Apply a kind of structured flowchart of the data processing equipment of example, as shown in figure 11, comprising: acquisition module 1101, the first read module 1102nd, processing module 1103 and update module 1104, illustrate to this structure below.
Acquisition module 1101, for obtaining pending instruction, wherein, carries in described pending instruction: pending number According to data mark;
First read module 1102, for reading the corresponding basic data of Data Identification described in Back ground Information communication area, Wherein, described basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module 1103, for being processed to described pending data according to described basic data, will obtain after processing To data to be updated be registered in data update communication area;
Update module 1104, for data update communication area in data meet pre-conditioned in the case of, will be described The data to be updated that data updates in communication area updates in Database Systems.
In one embodiment, above-mentioned data processing equipment also comprises determining that module, for reading Back ground Information communication Before the corresponding basic data of Data Identification described in area, it is determined whether be to receive for the first time to carry described Data Identification Pending instruction;Link block, in the case of determining to be primary in described determining module, is connected to described data base set System;Second read module, for reading the basic data of Data Identification described in described Database Systems;Memory module, is used for The basic data of the described Data Identification reading from described Database Systems is stored in described Back ground Information communication area.
In one embodiment, update module 1104 specifically for updating the data to be updated in communication area when described data Reach default data volume, or the time in described data renewal communication area for the data to be updated reaches preset time threshold When, described data is updated to be updated data corresponding with described Data Identification in communication area and updates described Database Systems In.
In one embodiment, update module 1104 includes: acquiring unit, arrives Database Systems for obtaining to need to update In sequence number collection, wherein, described sequence number collection is the set of the sequence number of the corresponding data to be updated of all and described Data Identification;Row Sequence unit, the sequence number for concentrating to described sequence number is ranked up;Reading unit, for according to sequence after sequence number collection from described Data updates in communication area and reads data to be updated one by one;Updating block, described for updating the data to be updated reading In Database Systems.
In one embodiment, above-mentioned data processing equipment also includes: calling module, for described pending data After being processed, after processing, the data to be updated that obtain is registered in before data updates communication area, calls sequence number generator Generate the sequence number corresponding to this data to be updated.
In another embodiment, additionally provide a kind of software, this software is used for executing above-described embodiment and preferably real Apply the technical scheme described in mode.
In another embodiment, additionally provide a kind of storage medium, be stored with this storage medium above-mentioned software, should Storage medium includes but is not limited to: CD, floppy disk, hard disk, scratch pad memory etc..
As can be seen from the above description, the embodiment of the present invention achieves following technique effect: by basic data in advance Store in Back ground Information communication area from Database Systems, when needing to obtain basic data, directly from Back ground Information Communication obtains in area, first stores data for the data to be updated obtaining after processing and updates in communication area, then unites again One updates in Database Systems, and solving by the way needs in prior art frequently to access Database Systems and lead to Database Systems the low technical problem of data-handling efficiency, reached the technique effect effectively improving treatment effeciency.
Obviously, those skilled in the art should be understood that each module of the above-mentioned embodiment of the present invention or each step are permissible Realized with general computing device, they can concentrate on single computing device, or be distributed in multiple computing devices On the network being formed, alternatively, they can be realized with the executable program code of computing device, it is thus possible to by it Store to be executed by computing device in the storage device, and in some cases, can be to hold different from order herein The shown or described step of row, or they are fabricated to respectively each integrated circuit modules, or will be multiple in them Module or step are fabricated to single integrated circuit module to realize.So, the embodiment of the present invention be not restricted to any specifically hard Part and software combine.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for the skill of this area For art personnel, the embodiment of the present invention can have various modifications and variations.All within the spirit and principles in the present invention, made Any modification, equivalent substitution and improvement etc., should be included within the scope of the present invention.

Claims (4)

1. a kind of data processing method is it is characterised in that include:
Obtain pending instruction, wherein, carry in described pending instruction: pending data data mark;
Read the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described basic data is from data Read in the system of storehouse and store in described Back ground Information communication area;
According to described basic data, described pending data is processed, the data to be updated obtaining after processing is registered in number Communicate area according to updating;
Data update communication area in data meet pre-conditioned in the case of, by described data update communication area in treating more New data updates in Database Systems;
Wherein, data update communication area in data meet pre-conditioned in the case of, by described data update communication area in To be updated data corresponding with described Data Identification updates in Database Systems, comprising: when described data updates in communication area Data to be updated reach default data volume, or data to be updated updates the time in communication area in described data and reaches During preset time threshold, to be updated data corresponding with described Data Identification in described data renewal communication area is updated described In Database Systems;
Wherein, described data is updated the data to be updated in communication area and update in Database Systems, comprising: obtain and need more The new sequence number collection in Database Systems, wherein, described sequence number collection is the corresponding data to be updated of all and described Data Identification Sequence number set;The sequence number that described sequence number is concentrated is ranked up;Updated logical from described data according to the sequence number collection after sequence News read data to be updated in area one by one;The data to be updated reading is updated in described Database Systems;
Wherein, after described pending data is processed, the data to be updated obtaining after processing is registered in data more Before new communication area, methods described includes: calls sequence number generator to generate the sequence number corresponding to this data to be updated.
2. the method for claim 1 is it is characterised in that correspond to reading Data Identification described in Back ground Information communication area Basic data before, methods described also includes:
Determine whether to receive the pending instruction carrying described Data Identification for the first time;
If it is, being connected to described Database Systems;
Read the basic data of Data Identification described in described Database Systems;
The basic data of the described Data Identification reading from described Database Systems is stored described Back ground Information communication area In.
3. a kind of data processing equipment is it is characterised in that include:
Acquisition module, for obtaining pending instruction, wherein, carries in described pending instruction: pending data data Mark;
First read module, for reading the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described Basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module, for being processed to described pending data according to described basic data, obtain after processing treats more New data is registered in data and updates communication area;
Update module, for data update communication area in data meet pre-conditioned in the case of, by described data update Data to be updated in communication area updates in Database Systems;
Wherein, described update module is specifically for reaching default data when described data updates the data to be updated in communication area Amount, or when the time in described data renewal communication area for the data to be updated reaches preset time threshold, by described data Update to be updated data corresponding with described Data Identification in communication area to update in described Database Systems;
Wherein, described update module includes: acquiring unit, needs to update the sequence number collection in Database Systems for obtaining, its In, described sequence number collection is the set of the sequence number of the corresponding data to be updated of all and described Data Identification;Sequencing unit, for right The sequence number that described sequence number is concentrated is ranked up;Reading unit, for updating communication according to the sequence number collection after sequence from described data Data to be updated is read one by one in area;Updating block, for updating the data to be updated reading in described Database Systems;
Wherein, data processing equipment also includes: calling module, for, after described pending data is processed, locating Before the data to be updated obtaining after reason is registered in data renewal communication area, sequence number generator is called to generate to be updated corresponding to this The sequence number of data.
4. device as claimed in claim 3 is it is characterised in that also include:
Determining module, for, before reading the corresponding basic data of Data Identification described in Back ground Information communication area, determination is No is to receive the pending instruction carrying described Data Identification for the first time;
Link block, in the case of determining to be primary in described determining module, is connected to described Database Systems;
Second read module, for reading the basic data of Data Identification described in described Database Systems;
Memory module, for storing described base by the basic data of the described Data Identification reading from described Database Systems In plinth information communication area.
CN201410035027.4A 2014-01-24 2014-01-24 Data processing method and device Active CN103778066B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410035027.4A CN103778066B (en) 2014-01-24 2014-01-24 Data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410035027.4A CN103778066B (en) 2014-01-24 2014-01-24 Data processing method and device

Publications (2)

Publication Number Publication Date
CN103778066A CN103778066A (en) 2014-05-07
CN103778066B true CN103778066B (en) 2017-02-01

Family

ID=50570327

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410035027.4A Active CN103778066B (en) 2014-01-24 2014-01-24 Data processing method and device

Country Status (1)

Country Link
CN (1) CN103778066B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104317749B (en) * 2014-10-31 2017-12-05 小米科技有限责任公司 Information write-in method and device
CN104750774A (en) * 2014-12-15 2015-07-01 北京星网锐捷网络技术有限公司 Database upgrading method and device
CN105912486B (en) * 2016-04-27 2019-03-29 联想(北京)有限公司 Information processing method and processor
CN107239306A (en) * 2017-05-26 2017-10-10 黄晓咏 One kind game communication data processing system
CN108829732B (en) * 2018-05-16 2021-10-19 创新先进技术有限公司 Data processing method and device
CN110162563B (en) * 2019-05-28 2023-11-17 深圳市网心科技有限公司 Data warehousing method and system, electronic equipment and storage medium
CN110209654A (en) * 2019-06-05 2019-09-06 深圳市网心科技有限公司 A kind of text file data storage method, system and electronic equipment and storage medium
CN111275585B (en) * 2020-02-25 2021-05-14 上海贤旅网络科技有限公司 Multi-factor-based hotel data updating system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6516312B1 (en) * 2000-04-04 2003-02-04 International Business Machine Corporation System and method for dynamically associating keywords with domain-specific search engine queries
CN1834942A (en) * 2005-03-17 2006-09-20 富士通株式会社 Information processing device and data control method in information processing device
CN1858814A (en) * 2005-04-29 2006-11-08 邓斌涛 Quick paying method and system
CN101576918A (en) * 2009-06-19 2009-11-11 用友软件股份有限公司 Data buffering system with load balancing function

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6516312B1 (en) * 2000-04-04 2003-02-04 International Business Machine Corporation System and method for dynamically associating keywords with domain-specific search engine queries
CN1834942A (en) * 2005-03-17 2006-09-20 富士通株式会社 Information processing device and data control method in information processing device
CN1858814A (en) * 2005-04-29 2006-11-08 邓斌涛 Quick paying method and system
CN101576918A (en) * 2009-06-19 2009-11-11 用友软件股份有限公司 Data buffering system with load balancing function

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"实时数据仓库关键技术的研究与实现";肖裕洪;《中国优秀硕士学位论文全文数据库 信息科技辑》;20111231(第12期);第13-15页 *

Also Published As

Publication number Publication date
CN103778066A (en) 2014-05-07

Similar Documents

Publication Publication Date Title
CN103778066B (en) Data processing method and device
CN109241191B (en) Distributed data source heterogeneous synchronization platform and synchronization method
CN108683818B (en) Method, system, equipment and storage medium for distributing seats in call center
CN108737325A (en) A kind of multi-tenant data partition method, apparatus and system
CN108667725A (en) A kind of industrial AnyRouter and implementation method based on a variety of accesses and edge calculations
US20140137110A1 (en) Capacity reclamation and resource adjustment
US9229993B2 (en) Processing hybrid co-tenancy in a multi-database cloud
CN108183947A (en) Distributed caching method and system
CN102725753A (en) Method and apparatus for optimizing data access, method and apparatus for optimizing data storage
CN101071434B (en) User distributing method, device and system for distributed database system
CN107909486A (en) Commission management method, application server and computer-readable recording medium
CN107071036A (en) A kind of method, the webserver and system for downloading driving file
CN109981757A (en) A kind of API gateway load-balancing algorithm towards small-scale micro services framework
CN107133231A (en) A kind of data capture method and device
CN109492856A (en) Service request processing method, device, computer equipment and storage medium
CN102760073B (en) Method, system and device for scheduling task
CN109471725A (en) Resource allocation methods, device and server
CN108563776A (en) Off-line data acquisition methods and system, server and storage medium
CN108881651A (en) Data processing method, device, equipment and the storage medium of call platform
CN104410511B (en) A kind of server management method and system
CN108564345A (en) Insurance platform data processing method, electronic device and computer readable storage medium
CN110247807A (en) A kind of port management method and device
CN105871659A (en) Monitoring method and device of newly added server
CN104915246A (en) High-configurable distributed real-time calculation engine based on workflow and control method
CN104394198A (en) A global scheduling method based on an ESB

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant