CN103778066B - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN103778066B CN103778066B CN201410035027.4A CN201410035027A CN103778066B CN 103778066 B CN103778066 B CN 103778066B CN 201410035027 A CN201410035027 A CN 201410035027A CN 103778066 B CN103778066 B CN 103778066B
- Authority
- CN
- China
- Prior art keywords
- data
- updated
- communication area
- database systems
- sequence number
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention provides a data processing method and a data processing device, wherein the method comprises the steps that instructions to be processed are obtained, wherein the instructions to be processed carry data to be processed and data marks; basic data corresponding to the data marks in a basic information communication region is read, wherein the basic data is read from a database system and is stored into the basic information communication region; the data to be processed is processed according to the basic data, and data to be updated obtained after the processing is registered into a data updating communication region; under the conditions that the data in the data updating communication region meets the preset conditions, the data to be updated in the data updating communication region is updated to the database system. The method and the device provided by the embodiment of the invention solve the technical problem of low data processing efficiency of the database system caused by requirement of frequent access of the database system in the prior art, and the technical effect of effectively improving the processing efficiency is reached.
Description
Technical field
The present invention relates to technical field of computer data storage, more particularly to a kind of data processing method and device.
Background technology
With enterprise information system using more and more extensively, enterprise information system needs data to be processed also to get more and more,
The logical structure of internal system also becomes increasingly complex.Therefore, how to improve system effectiveness becomes to enterprise information system research
Main way.Database Systems are the core positions of enterprise information system, and many application systems are required for accessing data base
System, however, current Database Systems are the bottlenecks of enterprise information system.For example: corporate client has handled a business, is entering
During row data processing, relate generally to many accounting entries and process, and each accounting entry processes and can be related to keep accounts, register
The operations such as detailed, registration daily record, such application system is accomplished by accessing Database Systems once and again, accesses every time and is directed to
Set up the processes such as connection, data transfer and data processing.So will certainly lead between application system and Database Systems
Repeatedly connect, the resource consumption of Database Systems is larger, greatly reduce whole enterprise information system data processing and operation
Efficiency.
Content of the invention
Embodiments provide a kind of data processing method, to reach the resource consumption reducing Database Systems, carry
The purpose of high data-handling efficiency, the method includes:
Obtain pending instruction, wherein, carry in described pending instruction: pending data data mark;
Read Back ground Information communication area described in the corresponding basic data of Data Identification, wherein, described basic data be from
Read in Database Systems and store in described Back ground Information communication area;
According to described basic data, described pending data is processed, the data registration to be updated obtaining after processing
Update communication area to data;
Data update communication area in data meet pre-conditioned in the case of, by described data update communication area in
Data to be updated updates in Database Systems.
In one embodiment, before reading the corresponding basic data of Data Identification described in Back ground Information communication area,
Methods described also includes:
Determine whether to receive the pending instruction carrying described Data Identification for the first time;
If it is, being connected to described Database Systems;
Read the basic data of Data Identification described in described Database Systems;
The basic data of the described Data Identification reading from described Database Systems is stored described Back ground Information lead to
In news area.
In one embodiment, data update communication area in data meet pre-conditioned in the case of, by described number
Update in Database Systems according to updating data to be updated corresponding with described Data Identification in communication area, comprising:
Reach default data volume when described data updates the data to be updated in communication area, or data to be updated exists
When the time that described data updates in communication area reaches preset time threshold, by described data update in communication area with described data
Identify corresponding data to be updated to update in described Database Systems.
In one embodiment, the data to be updated obtaining after processing is registered in data and updates communication area, comprising:
Obtain and need to update the sequence number collection in Database Systems, wherein, described sequence number collection is all and described data mark
Know the set of the sequence number of corresponding data to be updated;
The sequence number that described sequence number is concentrated is ranked up;
Updated communication area from described data according to the sequence number collection after sequence and read data to be updated one by one;
The data to be updated reading is updated in described Database Systems.
In one embodiment, after described pending data is processed, the number to be updated that obtains after processing
Before being registered in data renewal communication area, methods described includes:
Sequence number generator is called to generate the sequence number corresponding to this data to be updated.
The embodiment of the present invention additionally provides a kind of data processing equipment, to reach the resource consumption reducing Database Systems,
Improve the purpose of data-handling efficiency, this device includes:
Acquisition module, for obtaining pending instruction, wherein, described pending instruction in carry: pending data and
Data Identification;
First read module, for reading the corresponding basic data of Data Identification described in Back ground Information communication area, wherein,
Described basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module, for being processed to described pending data according to described basic data, obtains after processing
Data to be updated is registered in data and updates communication area;
Update module, for data update communication area in data meet pre-conditioned in the case of, by described data
The data to be updated updating in communication area updates in Database Systems.
In one embodiment, above-mentioned data processing equipment also includes:
Determining module, before the corresponding basic data of Data Identification described in reading Back ground Information communication area, really
Whether fixed be to receive the pending instruction carrying described Data Identification for the first time;
Link block, in the case of determining to be primary in described determining module, is connected to described Database Systems;
Second read module, for reading the basic data of Data Identification described in described Database Systems;
Memory module, for storing institute by the basic data of the described Data Identification reading from described Database Systems
State in Back ground Information communication area.
In one embodiment, described update module specifically for updating the data to be updated in communication area when described data
Reach default data volume, or the time in described data renewal communication area for the data to be updated reaches preset time threshold
When, described data is updated to be updated data corresponding with described Data Identification in communication area and updates described Database Systems
In.
In one embodiment, described update module includes:
Acquiring unit, needs to update the sequence number collection in Database Systems for obtaining, wherein, described sequence number collection is all
The set of the sequence number of to be updated data corresponding with described Data Identification;
Sequencing unit, the sequence number for concentrating to described sequence number is ranked up;
Reading unit, reads number to be updated one by one for updating communication area from described data according to the sequence number collection after sequence
According to;
Updating block, for updating the data to be updated reading in described Database Systems.
In one embodiment, above-mentioned data processing equipment also includes:
Calling module, for the data to be updated after described pending data is processed, obtaining after processing
Before being registered in data renewal communication area, sequence number generator is called to generate the sequence number corresponding to this data to be updated.
In embodiments of the present invention, basic data is stored in advance from Database Systems in Back ground Information communication area,
When needing to obtain basic data, directly obtain from Back ground Information communication area, treat more for obtain after processing
New data first stores data and updates in communication area, and then unified renewal, in Database Systems, solves by the way again
The technology that the data-handling efficiency of Database Systems that frequently accesses Database Systems and lead to is low is needed in prior art
Problem, has reached the technique effect effectively improving treatment effeciency.
Brief description
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, not
Constitute limitation of the invention.In the accompanying drawings:
Fig. 1 is the flow chart of the data processing method of the embodiment of the present invention;
Fig. 2 is the structural representation of the data-storage system of the embodiment of the present invention;
Fig. 3 is the flow chart of the application program of the embodiment of the present invention;
Fig. 4 is the master control of the embodiment of the present invention and the flow chart of interface unit;
Fig. 5 is the master control of the embodiment of the present invention and the flow chart of interface unit;
Fig. 6 is the flow chart of the Back ground Information acquiring unit of the embodiment of the present invention;
Fig. 7 is the flow chart of the Back ground Information communication area access unit of the embodiment of the present invention;
Fig. 8 is that the data of the embodiment of the present invention updates the flow chart communicating area's access unit;
Fig. 9 is the flow chart of the communication area monitoring unit of the embodiment of the present invention;
Figure 10 be the embodiment of the present invention update the data the flow chart being stored in unit;
Figure 11 is the structured flowchart of the data processing equipment of the embodiment of the present invention.
Specific embodiment
Embodiments provide a kind of data processing method, as shown in figure 1, comprising the following steps:
Step 101: obtain pending instruction, wherein, carry in described pending instruction: pending data data mark
Know;
Step 102: read the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described basis
Data is to be read from Database Systems in advance and store in described Back ground Information communication area;
Step 103: processed to described pending data according to described basic data, obtain after processing treats more
New data is registered in data and updates communication area;
Step 104: the data that data updates in communication area meet pre-conditioned in the case of, described data is updated logical
Data to be updated in news area updates in Database Systems.
In the above-described embodiments, basic data is stored in advance from Database Systems in Back ground Information communication area,
When needing to obtain basic data, directly obtain from Back ground Information communication area, to be updated for obtain after processing
Data first stores data and updates in communication area, and then unified renewal, in Database Systems, solves by the way again
The low technology of data-handling efficiency needing the Database Systems frequently accessing Database Systems and leading in prior art is asked
Topic, has reached the technique effect effectively improving treatment effeciency.
Above-mentioned Back ground Information communication area can be a kind of quick storage region, for example: the built-in storage of computer system,
Above-mentioned basic data refers to when pending data is processed, the common data being relied on, for example: in an account
When the amount of money is updated operation, need to know the information such as name in an account book, the place of the account, these information just belong to the model of basic data
Farmland, so if necessary to repeatedly process to pending data, then may need to repeatedly use identical basic data.
In view of needing to look for the time communicating the data Cun Chudao Back ground Information in Database Systems in area, one
In individual embodiment, Database Systems can be connected, by data when first time receiving the pending instruction that certain data represents
Store in Back ground Information communication area, for example, can in the following ways basic data be stored in advance from Database Systems
In described Back ground Information communication area: before reading the corresponding basic data of Data Identification described in Back ground Information communication area, really
Whether fixed be to receive the pending instruction carrying described Data Identification for the first time;If it is, being connected to described data base
System;Read the basic data of Data Identification described in described Database Systems;The institute that will read from described Database Systems
The basic data stating Data Identification stores in described Back ground Information communication area.
Consider for the data to be updated in data renewal communication area to update the renewal frequency in Database Systems
Reasonability, in one embodiment, data update communication area in data meet pre-conditioned in the case of, by described data
Update to be updated data corresponding with described Data Identification in communication area to update in Database Systems, may include that when described
The data to be updated that data updates in communication area reaches default data volume, or data to be updated updates in described data and leads to
When time in news area reaches preset time threshold, described data is updated corresponding with described Data Identification in communication area treating more
New data updates in described Database Systems.That is, update the data volume in communication area in data and reach predetermined value, or
In the case that the time of storage reaches predetermined value, data is once updated by the data unification in communication area with regard to centrality and updates to number
According in the system of storehouse.
In one embodiment, the major key of the data to be updated being registered in data renewal communication area may include that data
Mark and the sequence number of data to be updated, by sequence number come mark data.Specifically, this sequence number can be to described pending number
After being processed, after processing, the data to be updated that obtain is registered in before data updates communication area, calls sequence number to occur
Device generates.
Update in Database Systems data being updated data to be updated corresponding with described Data Identification in communication area
During, in order to ensure that data can update Database Systems in order effectively, can follow the steps below:
Step 1: obtain and need to update the sequence number collection in Database Systems, wherein, described sequence number collection is all described numbers
Set according to the sequence number identifying corresponding data to be updated, i.e. sequence number is exactly to treat to update the data to be numbered, follow-up to ensure
Process to it is not missed or repeats;
Step 2: the sequence number that described sequence number is concentrated is ranked up;
Step 3: updated communication area from described data according to the sequence number collection after sequence and read data to be updated one by one;
Step 4: the data to be updated reading is updated in described Database Systems.
The embodiment of the present invention additionally provides a specific embodiment and the present invention is specifically described, but is worth note
Meaning, this specific embodiment, merely to preferably describing the present invention, does not constitute inappropriate limitation of the present invention.
In this example, there is provided a kind of data-storage system based on bus and method, maintenance data total demand pairs evidence is entered
Unified being stored in, read and transmit operation of row.
You Lianglei common communication area:
1) what a class preserved is Back ground Information, and that is, application program first will obtain base from data base when carrying out data processing
Plinth information, for example: customer information, its major key is Data Identification (id), and this region is named as Back ground Information communication area;
2) another kind of preservation is pending data information, and that is, this kind of data is updated Database Systems by application system
In, for example: accounting entry information, major key is Data Identification+sequence number, and sequence number can be the serial number of pending data, by this area
Domain is named as data and updates communication area.
For the pending data of same Data Identification, the first stroke pending data, when processing, can first connect
To in data base, the Back ground Information of this Data Identification is read in Back ground Information communication area, for follow-up to this data mark
When the other pending datas (i.e. pending data in addition to the first stroke) known are processed, read in Back ground Information communication area
Basic data connects Database Systems reading basic data to substitute.
For each pending data, after processing, it is not updated directly in Database Systems, but first steps on
Remember that data updates in communication area, reach certain data volume or reach pre- when data updates the data to be updated in communication area
After fixing time, the data unification to be updated automatically updating data in communication area updates in Database Systems.From data base
System reads data and updates in Database Systems to " Back ground Information communication area " with by the data in " data updates communication area "
Can be completed by special data/address bus processing meanss, application program only needs and " Back ground Information communication area " and " number
Communicate area according to updating " carry out data exchange.Therefore, " Back ground Information communication area " and " data updates communication area " is the formation of
The bus of application data access, so-called bus is exactly in computer systems, is responsible for the list with multiple parts swap data
Unit, transparent to each application program, application program does not need to directly access the database system, thus greatly reducing Database Systems
Connection number of times, thus improve the data-handling efficiency of Database Systems and enterprise information system.
It is the data/address bus memory system architecture figure that this example provides as shown in Figure 2, this bus storage system includes: application journey
Sequence 1, data administrator 2, data storage device 3 database system 4.Application program 1 will need instruction and data to be processed
Send data administrator 2 to, realize the tables of data of the data/address bus database system 4 of data storage device 3 is stored in, reads
The data manipulation such as take, transmit and monitor.Application program 1 need to send data administrator 2 to by instruction and data to be processed, real
Border is master control and the interface unit 5 sending data administrator 2 to, calls base by master control and interface unit 5 according to command content
Plinth information acquisition unit 6, Back ground Information communication area access unit 7, data renewal communication area access unit 8, the monitoring of communication area are single
Unit 9 and update the data and be stored in the different units such as unit 10 and realize corresponding function, each processing unit can be an independence
Module, module reuse can be realized each other.Back ground Information communication area 11 data is included in data storage device 3
Update communication area 12, communicate, in Back ground Information, multiple Back ground Informations 13 that are stored with area 11, update in communication area 12 in data and deposit
Contain multiple data to be updated 4, be stored with Database Systems 4 multiple tables of data 15.
Below each device unit in above-mentioned data/address bus storage system is specifically described:
It is the data structure that Back ground Information communicates in area 11 as shown in table 1, be stored in data storage device 3, wherein protect
Deposit is the basic data that application program obtains in advance when carrying out data processing from Database Systems 4, this basic data
Major key is Data Identification.
Table 1
Domain name describes | Purposes |
Data Identification | Unique id of mark data |
Back ground Information | The Back ground Information of this Data Identification |
As shown in table 2 data updates the data structure in communication area 12, is stored in data storage device 3, preservation be
Data to be updated, that is, application system need this kind of data will be updated in Database Systems, the major key of these data is several
According to mark+sequence number, sequence number is the serial number of this Data Identification data to be updated.
Table 2
Domain name describes | Purposes |
Data Identification | Unique id of mark data |
Sequence number | The serial number of this Data Identification data to be updated |
Data to be updated | Application system updates this kind of data in Database Systems |
It is the process chart of application program 1 as shown in Figure 3, comprise the following steps:
Step 301: application program 1 obtains needs instruction and data to be processed;
Step 302: master control and interface unit need to be transferred to by instruction and data to be processed;
Step 303: wait master control and interface unit to call different units process to carry out data processing;
Step 304: obtain master control and the result of interface unit, to terminate whole flow process.
It is the flow chart that master control and interface unit 5 are interacted with application program 1 as shown in Figure 4, comprise the following steps:
Step 401: master control and interface unit 5 are interacted with application program, obtains and needs instruction and data to be processed, data
Major key is Data Identification, and being also equivalent to get needs Data Identification to be processed;
Step 402: judge whether it is the first stroke pending data of this Data Identification, if it is, execution step 403,
If it is not, then then execution step 404;
Step 403: call Back ground Information acquiring unit 6;
Step 404: connect data base and read the basic data of this Data Identification in Back ground Information communication area 11;
Step 405: call Back ground Information communicate area access unit 7 read the basic data that Back ground Information communicates in area 11 with
Substitute and connect Database Systems reading Back ground Information;
Step 406: call data to update communication area access unit 8, pending data is registered in data and updates communication area
In 12, wherein, major key is Data Identification+sequence number, and sequence number is the serial number of this Data Identification data to be updated, and this sequence number can be
Generated by sequence number generator;
Step 407: judge whether also pending Data Identification, if it is, transposing step 402 continues next data
The handling process of mark, if it is not, then terminate whole flow process.
The flow chart being master control and interface unit 5 background process as shown in Figure 5, as shown in figure 5, comprising the following steps:
Step 501: after the data that data updates in communication area 12 reaches certain data volume or the scheduled time, communicate area
Monitoring unit 9 monitors notice master control and interface unit 5;
Step 502: called by master control and interface unit 5 update the data be stored in unit 10 by data to be updated unify renewal to
In Database Systems, terminate whole flow process.
It is the flow chart of Back ground Information acquiring unit 6 as shown in Figure 6, master control and interface unit 5 judge if data mark
The first stroke pending data known, then call Back ground Information acquiring unit 6 to connect the basic number that data base reads this Data Identification
Communicate in area 11 according to Back ground Information, other pending datas of this same Data Identification (treat by the other in addition to the first stroke later
Processing data) when being processed again, read the basic data that Back ground Information communicates in area 11 and connect Database Systems and read to substitute
Take basic data, as shown in fig. 6, comprising the following steps:
Step 601: obtain and need Data Identification to be processed;
Step 602: be connected with Database;
Step 603: obtain the basic data of Data Identification;
Step 604: set up with data storage device and be connected;
Step 605: the basic data of Data Identification is deposited in Back ground Information communication area 11.
It is the flow chart that Back ground Information communicates area's access unit 7 as shown in Figure 7, comprise the following steps:
Step 701: obtain and need Data Identification to be processed;
Step 702: set up with data storage device and be connected;
Step 703: Back ground Information communication area 11 is read according to Data Identification and obtains basic data;
Step 704: the Back ground Information of this Data Identification obtaining is returned to master control and interface unit 5.
As shown in figure 8, being the flow chart that data updates communication area access unit 8, comprise the following steps:
Step 801: obtain and need Data Identification to be processed;
Step 802: set up with data storage device and be connected;
Step 803: call sequence number generator to generate sequence number, wherein, sequence number is the flowing water of this Data Identification data to be updated
Number;
Step 804: pending data is registered in data and updates communication area, wherein, major key is Data Identification+sequence number.
It is the flow chart of communication area monitoring unit 9 as shown in Figure 9, communication area monitoring unit 9 is that monitoring data updates communication
The working condition in area 12, judges whether that data is full or reaches the warehouse-in condition such as certain time, thus meeting warehouse-in condition
All data statisticss to be updated are out.Specifically as shown in figure 9, comprising the following steps:
Step 901: set up with data storage device and be connected;
Step 902: ergodic data updates communication area;
Step 903: judge whether pending data meets warehouse-in condition, if it is, Data Identification+sequence number is preserved
Come, if it is not, then skipping;
Step 904: judge whether also pending data, if it has, then continuing the handling process of next pending data,
If it is not, exiting the handling process of pending data;
Step 905: the Data Identification saving+sequence number collection is returned to master control and interface unit 5.
To update the data the flow chart being stored in unit 10 as shown in Figure 10, update the data be stored in unit 10 for by meet into
The data all to be updated of storehouse condition is unified to be updated in Database Systems.As shown in Figure 10, comprise the following steps:
Step 1001: obtain the Data Identification+sequence number collection needing to update;
Step 1002: Data Identification, sequence number ascending sort are carried out to Data Identification+sequence number collection;
Step 1003: set up with data storage device and be connected;
Step 1004: data is read according to Data Identification+sequence number and updates all data to be updated of communication area acquisition;
Step 1005: judge whether the first stroke data to be updated, if it is execution step 1006, otherwise execution step
1007;
Step 1006: set up this Data Identification with Database Systems and be connected;
Step 1007: judge whether this data to be updated is identical with the Data Identification of last time data to be updated, if phase
With, then execution step 1008, otherwise execution step 1009, why increase this step and be because it is considered that this mark of updating
If knowing identical with last time, then just the data of explanation last time is also in buffer area (that is, data field to be updated), at this moment, need
First the data of last time to be first stored in data base, otherwise, after this data enters buffer area, the data of last time will be covered
Lid falls, and the data of last time also just lost, and the data of last time is subsequently just had no chance to update data base again and suffered;
Step 1008: the data all to be updated of last time Data Identification is updated in Database Systems;
Step 1009: be connected with this Data Identification of Database;
Step 1010: judge whether to need to be updated the data, if it is, continuing next data to be updated to be stored in data base
Handling process, if it is not, then execution step 1011;
Step 1011: the data all to be updated of last time Data Identification is updated in data base.
In this example it is proposed that a kind of data-storage system based on bus and method, the total demand pairs of maintenance data are according to entering
Unified being stored in, read and transmit operation of row, preserving application program using data renewal communication area of Back ground Information communication area needs
Back ground Information to be accessed and needs update the data arriving data base, and application program accesses the data renewal of Back ground Information communication area
Communication area is to substitute connected reference Database Systems.The data to be updated updating in communication area in data is monitored to and reaches necessarily
Data or when reaching predetermined after, automatically unified update in Database Systems.As can be seen here, apply journey by the way
Sequence does not need to directly access the database system, greatly reduces the connection number of times of Database Systems, thus improve data base set
System and the data-handling efficiency of enterprise information system.
Specifically, above-mentioned data storage method is mainly using the technological means of following several respects:
1) the total demand pairs of maintenance data, according to carrying out unifying to preserve, update communication area using Back ground Information communication area data and protect
Depositing application program needs the Back ground Information accessing and needs the data to be updated updating to data base;
2) according to carrying out unifying to access, application program accesses Back ground Information communication area data and updates the total demand pairs of maintenance data
Communication area is to substitute connected reference Database Systems;
3) data storage standardization, data unification is stored in Back ground Information communication area data and updates communication area, decreases
Communication area is excessive and field names the different problems brought, and simplifies system structure, decreases maintenance difficulties;
Decrease the connection number of times of application system and Database Systems by the way, decrease the money of Database Systems
Source consumes, and improves the data-handling efficiency of Database Systems and enterprise information system, reduces management cost, improves entirety
Economic benefit.
Based on same inventive concept, in the embodiment of the present invention, additionally provide a kind of data processing equipment, as following enforcement
Example is described.Because the principle of data processing equipment solve problem is similar to data processing method, the therefore reality of data processing equipment
Apply the enforcement that may refer to data processing method, repeat no more in place of repetition.Used below, term " unit " or " mould
Block " can realize the software of predetermined function and/or the combination of hardware.Although the device described by following examples is preferably with soft
Part is realizing, but hardware, or the realization of the combination of software and hardware is also may and to be contemplated.Figure 11 is that the present invention is real
Apply a kind of structured flowchart of the data processing equipment of example, as shown in figure 11, comprising: acquisition module 1101, the first read module
1102nd, processing module 1103 and update module 1104, illustrate to this structure below.
Acquisition module 1101, for obtaining pending instruction, wherein, carries in described pending instruction: pending number
According to data mark;
First read module 1102, for reading the corresponding basic data of Data Identification described in Back ground Information communication area,
Wherein, described basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module 1103, for being processed to described pending data according to described basic data, will obtain after processing
To data to be updated be registered in data update communication area;
Update module 1104, for data update communication area in data meet pre-conditioned in the case of, will be described
The data to be updated that data updates in communication area updates in Database Systems.
In one embodiment, above-mentioned data processing equipment also comprises determining that module, for reading Back ground Information communication
Before the corresponding basic data of Data Identification described in area, it is determined whether be to receive for the first time to carry described Data Identification
Pending instruction;Link block, in the case of determining to be primary in described determining module, is connected to described data base set
System;Second read module, for reading the basic data of Data Identification described in described Database Systems;Memory module, is used for
The basic data of the described Data Identification reading from described Database Systems is stored in described Back ground Information communication area.
In one embodiment, update module 1104 specifically for updating the data to be updated in communication area when described data
Reach default data volume, or the time in described data renewal communication area for the data to be updated reaches preset time threshold
When, described data is updated to be updated data corresponding with described Data Identification in communication area and updates described Database Systems
In.
In one embodiment, update module 1104 includes: acquiring unit, arrives Database Systems for obtaining to need to update
In sequence number collection, wherein, described sequence number collection is the set of the sequence number of the corresponding data to be updated of all and described Data Identification;Row
Sequence unit, the sequence number for concentrating to described sequence number is ranked up;Reading unit, for according to sequence after sequence number collection from described
Data updates in communication area and reads data to be updated one by one;Updating block, described for updating the data to be updated reading
In Database Systems.
In one embodiment, above-mentioned data processing equipment also includes: calling module, for described pending data
After being processed, after processing, the data to be updated that obtain is registered in before data updates communication area, calls sequence number generator
Generate the sequence number corresponding to this data to be updated.
In another embodiment, additionally provide a kind of software, this software is used for executing above-described embodiment and preferably real
Apply the technical scheme described in mode.
In another embodiment, additionally provide a kind of storage medium, be stored with this storage medium above-mentioned software, should
Storage medium includes but is not limited to: CD, floppy disk, hard disk, scratch pad memory etc..
As can be seen from the above description, the embodiment of the present invention achieves following technique effect: by basic data in advance
Store in Back ground Information communication area from Database Systems, when needing to obtain basic data, directly from Back ground Information
Communication obtains in area, first stores data for the data to be updated obtaining after processing and updates in communication area, then unites again
One updates in Database Systems, and solving by the way needs in prior art frequently to access Database Systems and lead to
Database Systems the low technical problem of data-handling efficiency, reached the technique effect effectively improving treatment effeciency.
Obviously, those skilled in the art should be understood that each module of the above-mentioned embodiment of the present invention or each step are permissible
Realized with general computing device, they can concentrate on single computing device, or be distributed in multiple computing devices
On the network being formed, alternatively, they can be realized with the executable program code of computing device, it is thus possible to by it
Store to be executed by computing device in the storage device, and in some cases, can be to hold different from order herein
The shown or described step of row, or they are fabricated to respectively each integrated circuit modules, or will be multiple in them
Module or step are fabricated to single integrated circuit module to realize.So, the embodiment of the present invention be not restricted to any specifically hard
Part and software combine.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for the skill of this area
For art personnel, the embodiment of the present invention can have various modifications and variations.All within the spirit and principles in the present invention, made
Any modification, equivalent substitution and improvement etc., should be included within the scope of the present invention.
Claims (4)
1. a kind of data processing method is it is characterised in that include:
Obtain pending instruction, wherein, carry in described pending instruction: pending data data mark;
Read the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described basic data is from data
Read in the system of storehouse and store in described Back ground Information communication area;
According to described basic data, described pending data is processed, the data to be updated obtaining after processing is registered in number
Communicate area according to updating;
Data update communication area in data meet pre-conditioned in the case of, by described data update communication area in treating more
New data updates in Database Systems;
Wherein, data update communication area in data meet pre-conditioned in the case of, by described data update communication area in
To be updated data corresponding with described Data Identification updates in Database Systems, comprising: when described data updates in communication area
Data to be updated reach default data volume, or data to be updated updates the time in communication area in described data and reaches
During preset time threshold, to be updated data corresponding with described Data Identification in described data renewal communication area is updated described
In Database Systems;
Wherein, described data is updated the data to be updated in communication area and update in Database Systems, comprising: obtain and need more
The new sequence number collection in Database Systems, wherein, described sequence number collection is the corresponding data to be updated of all and described Data Identification
Sequence number set;The sequence number that described sequence number is concentrated is ranked up;Updated logical from described data according to the sequence number collection after sequence
News read data to be updated in area one by one;The data to be updated reading is updated in described Database Systems;
Wherein, after described pending data is processed, the data to be updated obtaining after processing is registered in data more
Before new communication area, methods described includes: calls sequence number generator to generate the sequence number corresponding to this data to be updated.
2. the method for claim 1 is it is characterised in that correspond to reading Data Identification described in Back ground Information communication area
Basic data before, methods described also includes:
Determine whether to receive the pending instruction carrying described Data Identification for the first time;
If it is, being connected to described Database Systems;
Read the basic data of Data Identification described in described Database Systems;
The basic data of the described Data Identification reading from described Database Systems is stored described Back ground Information communication area
In.
3. a kind of data processing equipment is it is characterised in that include:
Acquisition module, for obtaining pending instruction, wherein, carries in described pending instruction: pending data data
Mark;
First read module, for reading the corresponding basic data of Data Identification described in Back ground Information communication area, wherein, described
Basic data is to read from Database Systems and store in described Back ground Information communication area;
Processing module, for being processed to described pending data according to described basic data, obtain after processing treats more
New data is registered in data and updates communication area;
Update module, for data update communication area in data meet pre-conditioned in the case of, by described data update
Data to be updated in communication area updates in Database Systems;
Wherein, described update module is specifically for reaching default data when described data updates the data to be updated in communication area
Amount, or when the time in described data renewal communication area for the data to be updated reaches preset time threshold, by described data
Update to be updated data corresponding with described Data Identification in communication area to update in described Database Systems;
Wherein, described update module includes: acquiring unit, needs to update the sequence number collection in Database Systems for obtaining, its
In, described sequence number collection is the set of the sequence number of the corresponding data to be updated of all and described Data Identification;Sequencing unit, for right
The sequence number that described sequence number is concentrated is ranked up;Reading unit, for updating communication according to the sequence number collection after sequence from described data
Data to be updated is read one by one in area;Updating block, for updating the data to be updated reading in described Database Systems;
Wherein, data processing equipment also includes: calling module, for, after described pending data is processed, locating
Before the data to be updated obtaining after reason is registered in data renewal communication area, sequence number generator is called to generate to be updated corresponding to this
The sequence number of data.
4. device as claimed in claim 3 is it is characterised in that also include:
Determining module, for, before reading the corresponding basic data of Data Identification described in Back ground Information communication area, determination is
No is to receive the pending instruction carrying described Data Identification for the first time;
Link block, in the case of determining to be primary in described determining module, is connected to described Database Systems;
Second read module, for reading the basic data of Data Identification described in described Database Systems;
Memory module, for storing described base by the basic data of the described Data Identification reading from described Database Systems
In plinth information communication area.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410035027.4A CN103778066B (en) | 2014-01-24 | 2014-01-24 | Data processing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410035027.4A CN103778066B (en) | 2014-01-24 | 2014-01-24 | Data processing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103778066A CN103778066A (en) | 2014-05-07 |
CN103778066B true CN103778066B (en) | 2017-02-01 |
Family
ID=50570327
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410035027.4A Active CN103778066B (en) | 2014-01-24 | 2014-01-24 | Data processing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103778066B (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104317749B (en) * | 2014-10-31 | 2017-12-05 | 小米科技有限责任公司 | Information write-in method and device |
CN104750774A (en) * | 2014-12-15 | 2015-07-01 | 北京星网锐捷网络技术有限公司 | Database upgrading method and device |
CN105912486B (en) * | 2016-04-27 | 2019-03-29 | 联想(北京)有限公司 | Information processing method and processor |
CN107239306A (en) * | 2017-05-26 | 2017-10-10 | 黄晓咏 | One kind game communication data processing system |
CN108829732B (en) * | 2018-05-16 | 2021-10-19 | 创新先进技术有限公司 | Data processing method and device |
CN110162563B (en) * | 2019-05-28 | 2023-11-17 | 深圳市网心科技有限公司 | Data warehousing method and system, electronic equipment and storage medium |
CN110209654A (en) * | 2019-06-05 | 2019-09-06 | 深圳市网心科技有限公司 | A kind of text file data storage method, system and electronic equipment and storage medium |
CN111275585B (en) * | 2020-02-25 | 2021-05-14 | 上海贤旅网络科技有限公司 | Multi-factor-based hotel data updating system and method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6516312B1 (en) * | 2000-04-04 | 2003-02-04 | International Business Machine Corporation | System and method for dynamically associating keywords with domain-specific search engine queries |
CN1834942A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Information processing device and data control method in information processing device |
CN1858814A (en) * | 2005-04-29 | 2006-11-08 | 邓斌涛 | Quick paying method and system |
CN101576918A (en) * | 2009-06-19 | 2009-11-11 | 用友软件股份有限公司 | Data buffering system with load balancing function |
-
2014
- 2014-01-24 CN CN201410035027.4A patent/CN103778066B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6516312B1 (en) * | 2000-04-04 | 2003-02-04 | International Business Machine Corporation | System and method for dynamically associating keywords with domain-specific search engine queries |
CN1834942A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Information processing device and data control method in information processing device |
CN1858814A (en) * | 2005-04-29 | 2006-11-08 | 邓斌涛 | Quick paying method and system |
CN101576918A (en) * | 2009-06-19 | 2009-11-11 | 用友软件股份有限公司 | Data buffering system with load balancing function |
Non-Patent Citations (1)
Title |
---|
"实时数据仓库关键技术的研究与实现";肖裕洪;《中国优秀硕士学位论文全文数据库 信息科技辑》;20111231(第12期);第13-15页 * |
Also Published As
Publication number | Publication date |
---|---|
CN103778066A (en) | 2014-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103778066B (en) | Data processing method and device | |
CN109241191B (en) | Distributed data source heterogeneous synchronization platform and synchronization method | |
CN108683818B (en) | Method, system, equipment and storage medium for distributing seats in call center | |
CN108737325A (en) | A kind of multi-tenant data partition method, apparatus and system | |
CN108667725A (en) | A kind of industrial AnyRouter and implementation method based on a variety of accesses and edge calculations | |
US20140137110A1 (en) | Capacity reclamation and resource adjustment | |
US9229993B2 (en) | Processing hybrid co-tenancy in a multi-database cloud | |
CN108183947A (en) | Distributed caching method and system | |
CN102725753A (en) | Method and apparatus for optimizing data access, method and apparatus for optimizing data storage | |
CN101071434B (en) | User distributing method, device and system for distributed database system | |
CN107909486A (en) | Commission management method, application server and computer-readable recording medium | |
CN107071036A (en) | A kind of method, the webserver and system for downloading driving file | |
CN109981757A (en) | A kind of API gateway load-balancing algorithm towards small-scale micro services framework | |
CN107133231A (en) | A kind of data capture method and device | |
CN109492856A (en) | Service request processing method, device, computer equipment and storage medium | |
CN102760073B (en) | Method, system and device for scheduling task | |
CN109471725A (en) | Resource allocation methods, device and server | |
CN108563776A (en) | Off-line data acquisition methods and system, server and storage medium | |
CN108881651A (en) | Data processing method, device, equipment and the storage medium of call platform | |
CN104410511B (en) | A kind of server management method and system | |
CN108564345A (en) | Insurance platform data processing method, electronic device and computer readable storage medium | |
CN110247807A (en) | A kind of port management method and device | |
CN105871659A (en) | Monitoring method and device of newly added server | |
CN104915246A (en) | High-configurable distributed real-time calculation engine based on workflow and control method | |
CN104394198A (en) | A global scheduling method based on an ESB |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |