US20010011278A1 - Data structure in database, database system for managing database and database managing method and system - Google Patents

Data structure in database, database system for managing database and database managing method and system Download PDF

Info

Publication number
US20010011278A1
US20010011278A1 US09/044,163 US4416398A US2001011278A1 US 20010011278 A1 US20010011278 A1 US 20010011278A1 US 4416398 A US4416398 A US 4416398A US 2001011278 A1 US2001011278 A1 US 2001011278A1
Authority
US
United States
Prior art keywords
data
database
state
time series
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US09/044,163
Inventor
Takayoshi Shimokawa
Kazuo Masai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Assigned to HITACHI, LTD. reassignment HITACHI, LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MASAI, KAZUO, SHIMOKAWA, TAKAYOSHI
Publication of US20010011278A1 publication Critical patent/US20010011278A1/en
Priority to US10/084,222 priority Critical patent/US7225178B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing

Definitions

  • the present invention relates to a time series database processing system of especially ultra-large scale for storing data pieces serving as updating detailed information in sequence of time series in a database and for controlling addition/deletion/retrieval of data.
  • indexing is effective when an item serving as a key during retrieval can be specified.
  • the indexing is a contrivance in which specified key items of a database are collected, a pointer is provided over the key items to take the form of a balanced tree (B tree), and the tree can be traced at a high speed up to a location corresponding to a leaf of the tree in accordance with information indicating which range a key of a specified value lies in.
  • B tree balanced tree
  • a utility for data loading uses a technique for writing data directly to a physical area of a database and therefore, with this utility, data can be written at a high speed.
  • the utility for high-speed data loading generally inhibits direct data write to the physical area during data loading from conflicting area at other retrieval or updating access.
  • data load shall compulsorily be executed while inhibiting access to a specified table for retrieval/updating or a part of a table for retrieval/updating. This forces retrieval of the database to be once stopped each time that time series data added almost every day is loaded. In a database of ultra-large scale, it takes one day or more for retrieval per se in some applications.
  • An object of the invention is to provide method and system which can eliminate conflict of the operation of time series data loading and data deletion with the operation of data retrieval in a database system and which can mitigate suppression imposed on retrieval by the system.
  • Another object of the invention is to provide a database managing system which can dispense with reorganization of an index tree which loses balance owing to addition of time series data.
  • a database managing method for managing data pieces in a database comprising the steps of:
  • the method further comprises the steps of:
  • the state transition information included in the detected bookmark information indicates either a value indicative of the loading state or a value indicative of the empty state, it can be decided that the data retrieval request is not responded to.
  • the method further comprises the steps of:
  • the method further comprises the steps of:
  • bookmark information having bookmark information indicative of a time corresponding to the data piece for the predetermined time and state transition information indicative of a state of the data piece for the predetermined time and loading resulting data pieces in the plurality of data areas in the database in sequence of times corresponding to the time series data pieces.
  • a data structure realized in a database comprises:
  • a predetermined bookmark information area having bookmark information indicative of a time corresponding to a time series data piece loaded in each of the data areas and state transition information indicative of a state of the data piece in each data area
  • the state transition information has one of a value indicative of an online state in which the data area is permitted to be retrieved and a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved.
  • the data pieces are arranged consecutively in the database while having a predetermined data capacity so that the plurality of bookmark information areas in the plurality of data areas may be read consecutively.
  • the database is divided into segments which are each minimum blocks for storage area management and time series data pieces are stored in the segments.
  • a time at which the data is loaded is stored as a bookmark at a predetermined location in a start segment from which the addition starts with the database. Thanks to the bookmark, when retrieval of time designation or time interval designation is carried out, the retrieval range can be narrowed physically by utilizing the bookmark.
  • the database can be brought into a loading unfinished state by locating the bookmark in other place than the place in which the data is being loaded. Consequently, data can be loaded directly on a physical segment without affecting other retrieval.
  • the bookmark is written in the above other place and the database is recognized by such assigning a bookmark thereto.
  • the present invention is effective for a computer system having a database and especially for a database system for retrieval in which data pieces reach the database system in sequence of time series and data change other than addition or insertion and deletion of time series data is not carried out.
  • FIG. 1 is a diagram showing indices of a tree which loses balance owing to addition/deletion of time series data.
  • FIG. 2 is a diagram showing an embodiment of system construction according to the present invention.
  • FIG. 3 is a diagram showing the construction of an embodiment of a storage apparatus of the present invention.
  • FIG. 4 is a diagram for explaining a bookmark information area.
  • FIG. 5 is a flow chart of an embodiment of the retrieval processing.
  • FIG. 6 is a diagram showing the state of the storage apparatus to explain the flow chart of FIG. 4.
  • FIG. 7 is a flow chart showing an embodiment of the data load processing.
  • FIG. 8 is a diagram showing the state of the storage apparatus in mid course to explain the flow chart of FIG. 6.
  • FIG. 9 is a diagram showing the final state of the storage apparatus to explain the flow chart of FIG. 6.
  • FIG. 10 is a flow chart of an embodiment of the deletion processing.
  • FIG. 11 is a diagram showing the state of the storage apparatus in mid course to explain the flow chart of FIG. 9.
  • FIG. 12 is a diagram showing the construction of the storage apparatus to explain an embodiment of a wraparound architecture.
  • FIG. 13 is a diagram showing the construction of another embodiment of the storage apparatus of the present invention.
  • FIG. 2 there is illustrated an embodiment of system construction according to the present invention.
  • a database system principally comprises a database system apparatus 10 having a central processing unit (CPU) 11 and a storage apparatus 13 for physically storing data.
  • a database management program 12 operates on the system apparatus 10 to store actual data from a cumulative data area 8 onto the storage apparatus 13 .
  • Provided in the storage apparatus 13 are a data area 14 and a system definition information area 15 for storing definition information of data.
  • the area 8 may have a data entity area 8 A and an empty area 8 B in order to store time series data pieces for a predetermined time and transfer the stored data to the storage apparatus 13 .
  • the construction of the storage apparatus is shown in greater detail to give a detailed explanation of the system definition information area 15 and data area 14 .
  • the data area 14 has consecutive areas secured on the storage apparatus 13 so as to be divided into management blocks called segments 20 .
  • Data pieces generated in time series fashion are put together in the area 8 by means of the management program 12 until they reach an amount for a constant time.
  • the collected data pieces are stored in one of the management block segments of the consecutive areas of the database in the form of the storage apparatus 13 , along with a time for storage which is read out of a clock 9 and stored in the same segment or otherwise at a different location.
  • the segment 20 includes, for example, a data storage area 21 for storing real data and a bookmark information area 22 for storing management information for the data stored in the data storage area 21 .
  • the segment 20 consists of a plurality of pages each being a unit of disk input/output.
  • the system definition information 15 has information for managing the storage location of time series data, including information for pointing a segment 20 which is the oldest in time series and information for pointing the start of an empty segment area.
  • the bookmark information area includes a time information area 23 for storing information concerning a time which is specific to data stored in the segment 20 and which is delivered out of the clock 9 and a status flag area 24 for storing status flag information indicative of a shifting or transition state (to be described below) of the segment 20 .
  • the shifting or transition state is classified into three states or modes including “online” indicating that the data storage area is accessible, “loading” indicating that data is now being inserted and “empty” indicating that no data is present in the data storage area.
  • the status of the segment 20 shifts from one mode or state to another.
  • time series database retrieval for which time is specified is frequently practiced. For example, the title and the date of issue of a book published by a publisher are stored in time series fashion in a time series database of the publisher by using the issue date as a key and an instance will be described hereunder in which the database is retrieved for a list of titles of books issued over three months which range from March, 1994 to May, 1994.
  • FIG. 5 is a flow chart showing an embodiment of the retrieval processing in the present embodiment
  • FIG. 6 is a diagram showing the state of the storage apparatus useful to explain the flow chart of FIG. 5.
  • information for pointing a segment 20 which stores the oldest data in time series is first acquired from the system definition information 15 (step 500 ). Then, the database system acquires time information t (February, 1994) and status information (online) from a bookmark information area 22 of the pointed segment 20 (step 501 ). Acquisition of the system definition information is carried out at a high speed because a predetermined capacity of data can be acquired starting with the start of a plurality of segments arrayed at equi-capacity intervals on the database.
  • the acquired status information is “empty” or “loading”
  • the data to be retrieved has not been stored in the segment 20 or data is now being inserted in the segment 20 and hence it is determined that access is impossible and the retrieval processing ends (step 502 ).
  • step 503 If the status information is “online”, access is permitted and the program proceeds to the next process (step 503 ).
  • the posterior retrieval request time ( May, 1994) is compared with the time information (February, 1994) stored in the bookmark information area 22 to decide whether the intended data is stored in the database. If the result of comparison is “Yes”, in a test whether the stored newer data is newer than the range of the retrieval object (March, 1994 to May, 1994), the retrieval processing ends.
  • “No” is issued in the decision process, the program proceeds to the next process (step 504 ) to decide whether the segment 20 now pointed is within the retrieval request time (March, 1994 to May, 1994).
  • this data storage area 21 is excluded from the retrieval object and a segment 20 for storing data which succeeds in terms of time series is pointed (step 506 ).
  • a segment 20 for storing data which succeeds in terms of time series is pointed (step 506 ).
  • the succeeding segment can be pointed by moving the size of segment (a moving amount relative to the magnetic head) starting from the header of the present disk.
  • step 504 the decision process like the above (steps 502 , 503 and 504 ) is executed.
  • step 504 data is read out of the corresponding data storage area 21 in the segment 20 (step 505 ). Since the header of the disk points the start of a segment 20 which stores the next data in terms of time series after the data has been read out of the data storage area 21 (step 506 ), time information is again acquired from a bookmark information area 22 and thereafter, the decision is repeated in a similar way. In this manner, the segments 20 are sequentially read. Since in the decision process (step 503 ) of a segment 20 the segment is determined to be outside the retrieval object, the retrieval processing ends at that time.
  • FIG. 7 is a flow chart showing the data load processing in the present embodiment.
  • data pieces of from July, 1994 to August, 1994 are loaded from the system apparatus to the database, that is, data loading is carried out. It is now assumed that data pieces to be inputted in the form of files have already been sorted in terms of time series. The following description will be given by referring to an example where data is added to the initial state illustrated in FIG. 6.
  • empty segment information is read out of the system definition information 15 (step 600 ). An empty segment 20 is pointed by that information.
  • the input file is accessed and data (July, 1994) is read (step 602 ). Because of the presence of the data, “presence” is determined in the process (step 602 ) and the program proceeds to the process (step 603 ).
  • a write process is executed. Firstly, the time, information (July, 1994) is written at the time information area and a flag “loading” indicating currently loading at the status flag area in the bookmark information area 22 , and data is written into the data storage area 21 . After completion of write, a state as shown in FIG. 8 prevails.
  • the database system After write of data for one segment has been terminated, the database system reads the next input data from the file (step 601 ). Because of the presence of data for August, 1994, “presence” is determined in the decision process (step 602 ). Through the same logic as that used for writing the data for July, 1994, time information (August, 1994), a status flag “loading” and data are written at the time information area 23 , status flag area 24 and data storage area 21 in a segment 20 (step 603 ).
  • step 601 After completion of write, the system is about to read the next data from the file (step 601 ). But, since data has already been absent in the file, “absence” is determined in the decision process (step 602 ) and the program proceeds to the next process (step 604 in FIG. 7).
  • the database system After write of the input data to the database has been finished, the database system starts updating the status flag in the bookmark information area in order to make the segments written with the new data accessible (step 604 ).
  • the database system reads the empty segment information 16 in the system definition information 15 and points a segment 20 which has initially been written with the new data. Since in that segment 20 the status flag in the bookmark area 22 is set with “loading”, this flag is shifted to “online”. This permits that segment to be retrieved.
  • the size of segment is defined as in the case of retrieval and therefore, a segment 20 stored with the next information in time series fashion can be pointed.
  • the shift or transition processing from “loading” to “online” ends when the status flag of the read bookmark information area indicates “empty” and address information for that segment is set in the empty segment information 16 in the system definition information 15 (step 605 ).
  • a state in which the data load processing is thoroughly completed is shown in FIG. 9.
  • FIG. 10 is a flow chart showing an embodiment of the deletion processing.
  • the state shown in FIG. 6 is considered as the initial state and the segment 20 for February, 1994 is deleted.
  • start segment information 16 is read out of the system definition information 15 (step 700 ).
  • Time information (February, 1994) is acquired from the bookmark information area 22 of the segment 20 and it is decided whether the segment 20 is one which is an object to be deleted (step 701 ).
  • time information is set to the bookmark information area 22 (step 703 ) and “empty” is set to the status flag (step 704 ).
  • the segment 20 can be shifted to an inaccessible state.
  • a segment 20 which is next in terms of time series is pointed (step 705 ) and time information (March, 1994) is acquired from the bookmark information area 22 of that segment 20 .
  • the acquired time information (March, 1994) is compared with February, 1994 for the deletion object and it is determined that the segment 20 is not the deletion object (step 701 ), thus ending the deletion processing.
  • the database assumes a state as shown in FIG. 11.
  • the segments are used in wrap-around fashion to attain an advantage that no reorganization is needed even when addition/deletion is repeated. Finally, the wraparound architecture will be described.
  • a method of wrap-around which uses the respective segments temporally cyclically can be realized by setting a “start” flag 26 and a start address area 25 in the bookmark information area 22 of each segment 20 .
  • “1” is set in the “start” flag 26 and an address of a start one 20 of the segments is set in the start address area 25 .
  • this setting can be realized easily by adding a process of jumping to the start address on the extension of the retrieval/deletion/insertion processing because the processing of referring to the bookmark information area is always employed in the retrieval/deletion/insertion processing.
  • a database is shown which always holds data of the latest six months in a minimal segment capacity.
  • FIG. 13 shows an embodiment of the present invention which meets this case.
  • a system is available in which bookmark information pieces are stored in a bookmark information area 22 in the system definition information 15 so as to undergo centralized control. This system is more practical because it has such a merit that the area to be written with data is not limited by the bookmark information area and the respective segments need not have capacities which are matched to the same value.
  • the intended data can be accessed without resort to index by retrieving thoroughly only the specified control information storage range without retrieving the whole of the database.
  • data loading can be accomplished at a very high speed without stopping retrieval by temporarily making addition of data to a different empty segment in advance and at the time of completion of the data loading, assigning the data with a bookmark in the form of a table of the database.
  • a segment to be deleted in connection with deletion of data for which a constant time is exceeded, can be specified by retrieving the bookmark and the segment is a unit of area management of the database so that the area may be emptied, with the result that deletion can be accomplished within a very short time (typically, approximately several seconds to several minutes).
  • the scale of the bookmark information can be small as compared to the data amount which is very large, thus ensuring that the maintenance processing can be realized very easily and the bookmark information can be retrieved within a very short time even in a large-scale database.

Abstract

Bookmark information having bookmark information indicative of a time corresponding to a given time series data piece for a predetermined time and state transition information indicative of a state of the time series data piece for the predetermined time is loaded, along with the time series data piece, in a database. The state transition information has one of a value indicative of an online state in which the data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved and a value indicative of a state in which data in the data area is empty. The time series data pieces for the predetermined times are loaded in a plurality of data areas of the database in sequence of times. Even during deletion or addition of data, all data retrieval requests need not be suppressed. In accordance with a data deletion request, state transition information corresponding to a data piece of interest is set to a value indicating that the data piece of interest is empty. For data retrieval, the state transition information can be read from a storage area being in online condition. Degradation of the performance of a database system caused by B tree indexing eccentrically extending in one direction owing to addition of time series data can be prevented.

Description

    BACKGROUND OF THE INVENTION
  • The present invention relates to a time series database processing system of especially ultra-large scale for storing data pieces serving as updating detailed information in sequence of time series in a database and for controlling addition/deletion/retrieval of data. [0001]
  • When data pieces are loaded on a database of large scale and a specified data piece is retrieved from the database, index is generally applied. Indexing is effective when an item serving as a key during retrieval can be specified. The indexing is a contrivance in which specified key items of a database are collected, a pointer is provided over the key items to take the form of a balanced tree (B tree), and the tree can be traced at a high speed up to a location corresponding to a leaf of the tree in accordance with information indicating which range a key of a specified value lies in. “An Introduction to Database Systems, 3.4 Indexing” by C. J. Date, Addison-Wesley, 1986, pp.68-77 teaches a contrivance in which information corresponding to storage locations of all data items can be obtained for all the data items. If the database is for about million cases or events, there occurs no problem but in a database of ultra-large scale for billion cases or trillion cases, however, the maintenance of index per se swells and especially, keys which are added in time series fashion may not be handled well. [0002]
  • When data pieces are added in time series fashion, the indexing grows in a direction in which time increases, as shown in FIG. 1. Further, from the standpoint of deletion, it is known that as deletion of indices for which a constant time has expired proceeds, data pieces remain at only one side portion of the indexing tree and values of items are lost in spite of the existence of nodes on the other side portion, thereby placing the indexing in very inefficient condition. In such an event, it is necessary that the indexing be reconstructed by a technique called reorganization to delete wasteful areas in the indexing and promote the efficiency. But in the time series database of ultra-large scale, this is not practical because work far exceeding the permissible range is required. [0003]
  • A utility for data loading uses a technique for writing data directly to a physical area of a database and therefore, with this utility, data can be written at a high speed. However, the utility for high-speed data loading generally inhibits direct data write to the physical area during data loading from conflicting area at other retrieval or updating access. In other words, data load shall compulsorily be executed while inhibiting access to a specified table for retrieval/updating or a part of a table for retrieval/updating. This forces retrieval of the database to be once stopped each time that time series data added almost every day is loaded. In a database of ultra-large scale, it takes one day or more for retrieval per se in some applications. In that case, data loading cannot be permitted unless retrieval is stopped, leading to fatal inconvenience. To avoid such situations, data can be added through usual data insertion operation without resort to data loading but in this case, the performance is degraded by approximately by one order as compared to data loading of physical write type and besides, locking must be acquired for concealing data during addition, largely affecting the performance of operation for retrieval of all cases or events in the database. [0004]
  • In order to delete a data piece in the database for which a constant time has expired, the data piece is typically required to be retrieved and even in the presence of index, time comparable to that for inserting data piece by piece is consumed. In the absence of index, all data pieces are retrieved for the purpose of deleting a data piece of interest and consequently, in the database of ultra-large scale, it takes one day or more to operate only the deletion processing and practically, the time series database cannot be materialized. [0005]
  • Thus, for the deletion of data for which a constant time has expired, time exceeding that for retrieval of all pieces of data is consumed in the absence of index but conversely, in the presence of index, indexing is updated during deletion, leading to an operation which consumes much time as in the case of data insertion. Accordingly, it is practically difficult to realize daily data deletion for the database which takes one day or more to retrieve all data pieces. [0006]
  • SUMMARY OF THE INVENTION
  • An object of the invention is to provide method and system which can eliminate conflict of the operation of time series data loading and data deletion with the operation of data retrieval in a database system and which can mitigate suppression imposed on retrieval by the system. [0007]
  • Another object of the invention is to provide a database managing system which can dispense with reorganization of an index tree which loses balance owing to addition of time series data. [0008]
  • According to the present invention, there is provided a database managing method for managing data pieces in a database, comprising the steps of: [0009]
  • adding, to a given time series data piece for a predetermined time, book mark information having bookmark information indicative of the corresponding time and state transition information indicative of a state of the time series data piece for the predetermined time; [0010]
  • providing, as the state transition information, one of a value indicative of an online state in which a data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved, and a value indicative of an empty state in which data in the data area is empty; and [0011]
  • loading time series data pieces for the predetermined time in a plurality of data areas in the database in sequence of times corresponding to the time series data pieces. [0012]
  • The method further comprises the steps of: [0013]
  • reading, from the plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data retrieval request applied to the database by designating a time; and [0014]
  • detecting the bookmark information including the designated time and when the state transition information included in the detected bookmark information indicates the online state, reading a time series data piece corresponding to the detected bookmark information. [0015]
  • When the state transition information included in the detected bookmark information indicates either a value indicative of the loading state or a value indicative of the empty state, it can be decided that the data retrieval request is not responded to. [0016]
  • The method further comprises the steps of: [0017]
  • reading, from the plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data deletion request applied to the database by designating a time; and [0018]
  • detecting the bookmark information including the designated time and when the state transition information included in the detected bookmark information indicates the online state, setting a value indicative of the empty state in the state transition information included in the detected bookmark information. [0019]
  • The method further comprises the steps of: [0020]
  • cumulating repeatedly applied time series data pieces in a cumulative data storage area until they reach total data for the predetermined time; and [0021]
  • after the repeatedly applied time series data pieces have been collected up to the total data for the predetermined time, adding, to a data piece in the cumulative data storage area, bookmark information having bookmark information indicative of a time corresponding to the data piece for the predetermined time and state transition information indicative of a state of the data piece for the predetermined time and loading resulting data pieces in the plurality of data areas in the database in sequence of times corresponding to the time series data pieces. [0022]
  • According to the present invention, a data structure realized in a database comprises: [0023]
  • a plurality of data areas for loading given time series data pieces at predetermined locations of the database in sequence of times; and [0024]
  • a predetermined bookmark information area having bookmark information indicative of a time corresponding to a time series data piece loaded in each of the data areas and state transition information indicative of a state of the data piece in each data area, [0025]
  • wherein the state transition information has one of a value indicative of an online state in which the data area is permitted to be retrieved and a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved. The data pieces are arranged consecutively in the database while having a predetermined data capacity so that the plurality of bookmark information areas in the plurality of data areas may be read consecutively. [0026]
  • In the present invention, the database is divided into segments which are each minimum blocks for storage area management and time series data pieces are stored in the segments. When data is loaded on the database, a time at which the data is loaded is stored as a bookmark at a predetermined location in a start segment from which the addition starts with the database. Thanks to the bookmark, when retrieval of time designation or time interval designation is carried out, the retrieval range can be narrowed physically by utilizing the bookmark. [0027]
  • When data loading is effected, the database can be brought into a loading unfinished state by locating the bookmark in other place than the place in which the data is being loaded. Consequently, data can be loaded directly on a physical segment without affecting other retrieval. At the time that the data loading is completed, the bookmark is written in the above other place and the database is recognized by such assigning a bookmark thereto. [0028]
  • In the case of data deletion, when data pieces following a specified bookmark are to be deleted collectively, the areas are effectively emptied changing the bookmark for the unit of segment within a short time without actually accessing to the data. By managing the areas of the database in a unit of segment in wrap-around fashion, the always pooled consecutive areas can be used from one side to load data and replenish an area from the other side of the consecutive areas. [0029]
  • The present invention is effective for a computer system having a database and especially for a database system for retrieval in which data pieces reach the database system in sequence of time series and data change other than addition or insertion and deletion of time series data is not carried out. [0030]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagram showing indices of a tree which loses balance owing to addition/deletion of time series data. [0031]
  • FIG. 2 is a diagram showing an embodiment of system construction according to the present invention. [0032]
  • FIG. 3 is a diagram showing the construction of an embodiment of a storage apparatus of the present invention. [0033]
  • FIG. 4 is a diagram for explaining a bookmark information area. [0034]
  • FIG. 5 is a flow chart of an embodiment of the retrieval processing. [0035]
  • FIG. 6 is a diagram showing the state of the storage apparatus to explain the flow chart of FIG. 4. [0036]
  • FIG. 7 is a flow chart showing an embodiment of the data load processing. [0037]
  • FIG. 8 is a diagram showing the state of the storage apparatus in mid course to explain the flow chart of FIG. 6. [0038]
  • FIG. 9 is a diagram showing the final state of the storage apparatus to explain the flow chart of FIG. 6. [0039]
  • FIG. 10 is a flow chart of an embodiment of the deletion processing. [0040]
  • FIG. 11 is a diagram showing the state of the storage apparatus in mid course to explain the flow chart of FIG. 9. [0041]
  • FIG. 12 is a diagram showing the construction of the storage apparatus to explain an embodiment of a wraparound architecture. [0042]
  • FIG. 13 is a diagram showing the construction of another embodiment of the storage apparatus of the present invention. [0043]
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The present invention will now be described by way of example with reference to the accompanying drawings. [0044]
  • Referring to FIG. 2, there is illustrated an embodiment of system construction according to the present invention. [0045]
  • As shown in FIG. 2, a database system principally comprises a [0046] database system apparatus 10 having a central processing unit (CPU) 11 and a storage apparatus 13 for physically storing data. A database management program 12 operates on the system apparatus 10 to store actual data from a cumulative data area 8 onto the storage apparatus 13. Provided in the storage apparatus 13 are a data area 14 and a system definition information area 15 for storing definition information of data. The area 8 may have a data entity area 8A and an empty area 8B in order to store time series data pieces for a predetermined time and transfer the stored data to the storage apparatus 13.
  • Referring to FIG. 3, the construction of the storage apparatus is shown in greater detail to give a detailed explanation of the system [0047] definition information area 15 and data area 14. In the present embodiment, the data area 14 has consecutive areas secured on the storage apparatus 13 so as to be divided into management blocks called segments 20. Data pieces generated in time series fashion are put together in the area 8 by means of the management program 12 until they reach an amount for a constant time. The collected data pieces are stored in one of the management block segments of the consecutive areas of the database in the form of the storage apparatus 13, along with a time for storage which is read out of a clock 9 and stored in the same segment or otherwise at a different location. The segment 20 includes, for example, a data storage area 21 for storing real data and a bookmark information area 22 for storing management information for the data stored in the data storage area 21. In the present embodiment, the segment 20 consists of a plurality of pages each being a unit of disk input/output.
  • The [0048] system definition information 15 has information for managing the storage location of time series data, including information for pointing a segment 20 which is the oldest in time series and information for pointing the start of an empty segment area.
  • As shown in FIG. 4 useful to explain the [0049] bookmark information area 22, the bookmark information area includes a time information area 23 for storing information concerning a time which is specific to data stored in the segment 20 and which is delivered out of the clock 9 and a status flag area 24 for storing status flag information indicative of a shifting or transition state (to be described below) of the segment 20. The shifting or transition state is classified into three states or modes including “online” indicating that the data storage area is accessible, “loading” indicating that data is now being inserted and “empty” indicating that no data is present in the data storage area. The status of the segment 20 shifts from one mode or state to another.
  • Next, the operation of the present embodiment will be described. [0050]
  • In the time series database, retrieval for which time is specified is frequently practiced. For example, the title and the date of issue of a book published by a publisher are stored in time series fashion in a time series database of the publisher by using the issue date as a key and an instance will be described hereunder in which the database is retrieved for a list of titles of books issued over three months which range from March, 1994 to May, 1994. [0051]
  • The retrieval processing of the present embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a flow chart showing an embodiment of the retrieval processing in the present embodiment and FIG. 6 is a diagram showing the state of the storage apparatus useful to explain the flow chart of FIG. 5. [0052]
  • In the database system of the present embodiment, information for pointing a [0053] segment 20 which stores the oldest data in time series is first acquired from the system definition information 15 (step 500). Then, the database system acquires time information t (February, 1994) and status information (online) from a bookmark information area 22 of the pointed segment 20 (step 501). Acquisition of the system definition information is carried out at a high speed because a predetermined capacity of data can be acquired starting with the start of a plurality of segments arrayed at equi-capacity intervals on the database.
  • If the acquired status information is “empty” or “loading”, the data to be retrieved has not been stored in the [0054] segment 20 or data is now being inserted in the segment 20 and hence it is determined that access is impossible and the retrieval processing ends (step 502).
  • If the status information is “online”, access is permitted and the program proceeds to the next process (step [0055] 503). The posterior retrieval request time (May, 1994) is compared with the time information (February, 1994) stored in the bookmark information area 22 to decide whether the intended data is stored in the database. If the result of comparison is “Yes”, in a test whether the stored newer data is newer than the range of the retrieval object (March, 1994 to May, 1994), the retrieval processing ends. When “No” is issued in the decision process, the program proceeds to the next process (step 504) to decide whether the segment 20 now pointed is within the retrieval request time (March, 1994 to May, 1994). Since the segment 20 is of February, 1994, this data storage area 21 is excluded from the retrieval object and a segment 20 for storing data which succeeds in terms of time series is pointed (step 506). For example, it is assumed that a magnetic disk device is used as the storage apparatus 13 and given that all of the segments 20 have the same size, the succeeding segment can be pointed by moving the size of segment (a moving amount relative to the magnetic head) starting from the header of the present disk.
  • Next, for that succeeding [0056] segment 20, the decision process like the above ( steps 502, 503 and 504) is executed. When it is determined in the process (step 504) that the segment 20 is one which meets the retrieval request, data is read out of the corresponding data storage area 21 in the segment 20 (step 505). Since the header of the disk points the start of a segment 20 which stores the next data in terms of time series after the data has been read out of the data storage area 21 (step 506), time information is again acquired from a bookmark information area 22 and thereafter, the decision is repeated in a similar way. In this manner, the segments 20 are sequentially read. Since in the decision process (step 503) of a segment 20 the segment is determined to be outside the retrieval object, the retrieval processing ends at that time.
  • Next, the data load processing will be described with reference to FIG. 7. FIG. 7 is a flow chart showing the data load processing in the present embodiment. In the present embodiment, an instance will be described in which data pieces of from July, 1994 to August, 1994 are loaded from the system apparatus to the database, that is, data loading is carried out. It is now assumed that data pieces to be inputted in the form of files have already been sorted in terms of time series. The following description will be given by referring to an example where data is added to the initial state illustrated in FIG. 6. [0057]
  • Firstly, empty segment information is read out of the system definition information [0058] 15 (step 600). An empty segment 20 is pointed by that information. In order to read input data, the input file is accessed and data (July, 1994) is read (step 602). Because of the presence of the data, “presence” is determined in the process (step 602) and the program proceeds to the process (step 603). In the process (step 603), a write process is executed. Firstly, the time, information (July, 1994) is written at the time information area and a flag “loading” indicating currently loading at the status flag area in the bookmark information area 22, and data is written into the data storage area 21. After completion of write, a state as shown in FIG. 8 prevails.
  • After write of data for one segment has been terminated, the database system reads the next input data from the file (step [0059] 601). Because of the presence of data for August, 1994, “presence” is determined in the decision process (step 602). Through the same logic as that used for writing the data for July, 1994, time information (August, 1994), a status flag “loading” and data are written at the time information area 23, status flag area 24 and data storage area 21 in a segment 20 (step 603).
  • After completion of write, the system is about to read the next data from the file (step [0060] 601). But, since data has already been absent in the file, “absence” is determined in the decision process (step 602) and the program proceeds to the next process (step 604 in FIG. 7).
  • After write of the input data to the database has been finished, the database system starts updating the status flag in the bookmark information area in order to make the segments written with the new data accessible (step [0061] 604).
  • When write of the final data is completed, the database system reads the [0062] empty segment information 16 in the system definition information 15 and points a segment 20 which has initially been written with the new data. Since in that segment 20 the status flag in the bookmark area 22 is set with “loading”, this flag is shifted to “online”. This permits that segment to be retrieved. In the present embodiment, the size of segment is defined as in the case of retrieval and therefore, a segment 20 stored with the next information in time series fashion can be pointed.
  • The shift or transition processing from “loading” to “online” ends when the status flag of the read bookmark information area indicates “empty” and address information for that segment is set in the [0063] empty segment information 16 in the system definition information 15 (step 605). A state in which the data load processing is thoroughly completed is shown in FIG. 9. As will be seen from the above, even during loading, the database system need not suppress the data retrieval request because by adopting the flag, it is possible to realize such a setting operation that access to the disk having a segment in which the “loading” flag is not raised can be permitted and access to the disk having a segment in which the flag is raised cannot be permitted.
  • Next, the deletion processing will be described with reference to FIG. 10. FIG. 10 is a flow chart showing an embodiment of the deletion processing. [0064]
  • In the present embodiment, the state shown in FIG. 6 is considered as the initial state and the [0065] segment 20 for February, 1994 is deleted.
  • Firstly, start [0066] segment information 16 is read out of the system definition information 15 (step 700). Time information (February, 1994) is acquired from the bookmark information area 22 of the segment 20 and it is decided whether the segment 20 is one which is an object to be deleted (step 701).
  • Since the deletion object is of February, 1994, that [0067] segment 20 is determined to be the deletion object. The start segment information 16 in the system definition information 15 is shifted to the next segment 20 (for March, 1994) in time series fashion. The segment size is determined and therefore, a start segment address can be obtained by adding by the segment size (step 702).
  • Subsequently, time information (null) is set to the bookmark information area [0068] 22 (step 703) and “empty” is set to the status flag (step 704). By initializing the bookmark information area 22 (steps 703 and 704), the segment 20 can be shifted to an inaccessible state.
  • A [0069] segment 20 which is next in terms of time series is pointed (step 705) and time information (March, 1994) is acquired from the bookmark information area 22 of that segment 20. The acquired time information (March, 1994) is compared with February, 1994 for the deletion object and it is determined that the segment 20 is not the deletion object (step 701), thus ending the deletion processing. After the completion, the database assumes a state as shown in FIG. 11.
  • In the present deletion processing, internal data need not be directly accessed and only the bookmark information area is taken as the object, thereby making it possible to perform deletion within a short time and during online. [0070]
  • The segments are used in wrap-around fashion to attain an advantage that no reorganization is needed even when addition/deletion is repeated. Finally, the wraparound architecture will be described. [0071]
  • Referring now to FIG. 12, there is illustrated an embodiment of the wrap-around architecture. A method of wrap-around which uses the respective segments temporally cyclically can be realized by setting a “start” [0072] flag 26 and a start address area 25 in the bookmark information area 22 of each segment 20. In a segment which is at the physically lowest position, “1” is set in the “start” flag 26 and an address of a start one 20 of the segments is set in the start address area 25. Even in the processing of retrieval/deletion/insertion, this setting can be realized easily by adding a process of jumping to the start address on the extension of the retrieval/deletion/insertion processing because the processing of referring to the bookmark information area is always employed in the retrieval/deletion/insertion processing. In this example, a database is shown which always holds data of the latest six months in a minimal segment capacity.
  • Data pieces over a certain constant time are frequently managed by a plurality of [0073] segments 20. FIG. 13 shows an embodiment of the present invention which meets this case. In the present embodiment, a system is available in which bookmark information pieces are stored in a bookmark information area 22 in the system definition information 15 so as to undergo centralized control. This system is more practical because it has such a merit that the area to be written with data is not limited by the bookmark information area and the respective segments need not have capacities which are matched to the same value.
  • As described above, according to the embodiments of the present invention, the intended data can be accessed without resort to index by retrieving thoroughly only the specified control information storage range without retrieving the whole of the database. [0074]
  • In an embodiment of the present invention, data loading can be accomplished at a very high speed without stopping retrieval by temporarily making addition of data to a different empty segment in advance and at the time of completion of the data loading, assigning the data with a bookmark in the form of a table of the database. [0075]
  • In an embodiment of the present invention, in connection with deletion of data for which a constant time is exceeded, a segment to be deleted can be specified by retrieving the bookmark and the segment is a unit of area management of the database so that the area may be emptied, with the result that deletion can be accomplished within a very short time (typically, approximately several seconds to several minutes). [0076]
  • According to the present invention, the scale of the bookmark information can be small as compared to the data amount which is very large, thus ensuring that the maintenance processing can be realized very easily and the bookmark information can be retrieved within a very short time even in a large-scale database. [0077]
  • According to the present invention, in a large-scale database which has a very large amount of data and in which storage and deletion of data pieces which arrive in sequence of time series, high-speed retrieval can be carried out and even during online, the data load and deletion processing can be realized. [0078]

Claims (20)

1. A data structure realized in a database comprising:
a plurality of data areas in which given time series data pieces are loaded in sequence of times; and
bookmark information areas respectively provided at predetermined locations in said plurality of data areas and each having a pair of bookmark information indicative of a time corresponding to a time series data piece loaded in each of said data areas and state transition information indicative of a state of the data piece in each data area, said state transition information being allowed to have one of a value indicative of an online state in which the data area is permitted to be retrieved and a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved.
2. A data structure according to
claim 1
, wherein said plurality of data areas have each a predetermined data capacity and are arranged consecutively in said database in order that said plurality of bookmark information areas in said plurality of data areas can be read consecutively.
3. A data structure according to
claim 1
, wherein the state transition information in at least one of said plurality of data areas is allowed to have one of a value indicative of an online state in which the data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved and a value indicative of a state in which data in the data area is empty.
4. A data structure realized in a database comprising:
a plurality of data areas in which given time series data pieces are loaded at predetermined locations, respectively, in said database in sequence of times; and
predetermined bookmark information areas each having a pair of bookmark information indicative of a time corresponding to a time series data piece loaded in each of said data areas and state transition information indicative of a state of the data piece in each data area, said state transition information having one of a value indicative of an online state in which the data area is permitted to be retrieved and a value indicative of a loading state in which loading of data in each data area has not yet been completed and the data area is not permitted to be retrieved.
5. A data structure according to
claim 5
, said plurality of data areas have each a predetermined data capacity and are arranged consecutively in said database in order that said plurality of bookmark information areas in said plurality of data areas can be read consecutively.
6. A data structure according to
claim 4
, wherein the state transition information in at least one of said plurality of data areas has a value indicative of an online state in which the data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved and a value indicative of a state in which data in at least one data area is empty.
7. A database managing method for managing data in a database comprising the steps of:
adding, to a predetermined location in a given time series data piece for a predetermined time, bookmark information having bookmark information indicative of a time corresponding to said time series data piece for said predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time;
providing, as said state transition information, one of a value indicative of an online state in which the data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved and a value indicative of a state in which data in the data area is empty; and
loading time series data pieces for predetermined times in a plurality of data areas in said database in sequence of times corresponding to said time series data pieces.
8. A database managing method according to
claim 7
further comprising the steps of:
reading, from said plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data retrieval request applied to said database by designating a time; and
detecting the bookmark information including said designated time and when the state transition information included in said detected bookmark information indicates said online state, reading a time series data piece corresponding to said detected bookmark information.
9. A database managing method according to
claim 7
further comprising the step of:
when the state transition information included in said detected bookmark information indicates either a value indicative of said loading state or a value indicative said empty state, determining that said data retrieval request is not responded to.
10. A database managing method according to
claim 7
further comprising the steps of:
reading, from said plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data deletion request applied to said database by designating a time; and
detecting the bookmark information including said designated time and when the state transition information included in said detected bookmark information indicates said online state, setting a value indicative of an empty state in said state transition information included in said detected bookmark information.
11. A database managing method according to
claim 7
further comprising the steps of:
cumulating repeatedly applied time series data pieces in a cumulative data storage area until they reach total data for said predetermined time; and
after said repeatedly applied time series data pieces have been collected up to said total data for said predetermined time, adding, to a data piece in said cumulative data storage area, bookmark information having bookmark information indicative of a time corresponding to the data piece for said predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time and loading resulting data pieces in said plurality of data areas of said database in sequence of times corresponding to said time series data pieces.
12. A database managing method for managing data in a database comprising the steps of:
adding, to a predetermined location in a given time series data piece for a predetermined time, bookmark information having bookmark information indicative of a time corresponding to said time series data piece for said predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time and start area information having a flag indicating whether the area is the final one of a plurality of areas in said database and an address area for setting an address;
providing, as said state transition information, one of a value indicative of an online state in which the data area is permitted to be retrieved and a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved;
loading time series data pieces for predetermined times in a plurality of consecutive data areas in said database in sequence of times corresponding to said time series data pieces; and
raising said flag of start area information in the final one of said plurality of consecutive data areas and setting an address of first one of said plurality of consecutive data areas in said address area.
13. A database managing method according to
claim 12
further comprising the steps of:
adding, to a predetermined location in a time series data piece for a predetermined time applied so as to be loaded in said database, bookmark information having bookmark information indicative of a time corresponding to said time series data piece for said predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time;
reading all state transition information pieces in said database to detect bookmark information having the oldest time and loading said time series data piece for said predetermined time applied so as to be loaded in said database in a data area corresponding to said oldest bookmark information; and
updating said oldest bookmark information to said bookmark information corresponding to said loaded data.
14. A database managing method for managing data in a database comprising the steps of:
reading bookmark information having bookmark information indicative of a time corresponding to a given time series data piece for a predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time from a predetermined bookmark area and setting the state of said time series data piece in said state transition information to a value indicative of a state in which data is empty so as to write said bookmark information in said database;
loading given time series data pieces for given predetermined times in a plurality of data areas in said database in sequence of times corresponding to said time series data pieces; and
after the step of loading said data pieces has been completed, writing bookmark information having bookmark information indicative of a time corresponding to a time series data piece for said predetermined time and state transition information indicative of an online state of said time series data piece for said predetermined time in said predetermined bookmark area.
15. A database managing method according to
claim 14
further comprising the step of loading time series data pieces for predetermined times in a plurality of data areas in said database in sequence of times corresponding to said time series data pieces.
16. A database managing method according to
claim 15
further comprising the steps of:
reading, from said plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data retrieval request applied to said database by designating a time; and
detecting the bookmark information including said designated time and when the state transition information included in said detected bookmark information indicates said online state, reading a time series data piece corresponding to said detected bookmark information.
17. A database managing method according to
claim 14
further comprising the step of:
when the state transition information included in said detected bookmark information indicates either a value indicative of said loading state or a value indicative of said empty state, determining that said data retrieval request is not responded to.
18. A database managing method according to
claim 14
further comprising the steps of:
reading, from said plurality of data areas, a plurality of bookmark information pieces each having state transition information and bookmark information in accordance with a data deletion request applied to said database by designating a time; and
detecting the bookmark information including said designated time and when the state transition information included in said detected bookmark information indicates said online state, setting a value indicative of said empty state in said state transition information included in said detected bookmark information.
19. A database managing method according to
claim 14
further comprising the steps of:
cumulating repeatedly applied time series data pieces in a cumulative storage area until they reach total data for said predetermined time; and
after said repeatedly applied time series data pieces have been collected up to said total data for said predetermined time, adding, to a data piece in said cumulative data storage area, bookmark information having bookmark information indicative of a time corresponding to said data piece for said predetermined time and state transition information indicative of a state of said time series data piece for said predetermined time and loading resulting data pieces in said plurality of data areas in said database in sequence of times corresponding to said time series data pieces.
20. A database managing system comprising:
a processor having a memory for storing given time series data pieces for predetermined times and a clock for reading times at which said time series data pieces are applied; and
a database connected to said processor and having bookmark information indicative of a time corresponding to a time series data piece for a predetermined time, state transition information indicative of a state of said time series data piece of said predetermined time and said time series data pieces for said predetermined times, said state transition information having one of a value indicative of an online state in which the data area is permitted to be retrieved, a value indicative of a loading state in which loading of data in the data area has not yet been completed and the data area is not permitted to be retrieved and a value indicative of a state in which data in the data area is empty.
US09/044,163 1997-03-19 1998-03-19 Data structure in database, database system for managing database and database managing method and system Abandoned US20010011278A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/084,222 US7225178B2 (en) 1997-03-19 2002-02-28 Data structure in database, database system for managing database and database managing method and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP09-065919 1997-03-19
JP9065919A JPH10260876A (en) 1997-03-19 1997-03-19 Data structure of database, and data processing method for database

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/084,222 Continuation US7225178B2 (en) 1997-03-19 2002-02-28 Data structure in database, database system for managing database and database managing method and system

Publications (1)

Publication Number Publication Date
US20010011278A1 true US20010011278A1 (en) 2001-08-02

Family

ID=13300869

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/044,163 Abandoned US20010011278A1 (en) 1997-03-19 1998-03-19 Data structure in database, database system for managing database and database managing method and system
US10/084,222 Expired - Fee Related US7225178B2 (en) 1997-03-19 2002-02-28 Data structure in database, database system for managing database and database managing method and system

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/084,222 Expired - Fee Related US7225178B2 (en) 1997-03-19 2002-02-28 Data structure in database, database system for managing database and database managing method and system

Country Status (2)

Country Link
US (2) US20010011278A1 (en)
JP (1) JPH10260876A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2568399A3 (en) * 2011-09-09 2013-07-10 Onzo Limited Data storage method and system
US8825583B2 (en) 2009-12-18 2014-09-02 Onzo Limited Utility data processing system
US8843332B2 (en) 2009-11-12 2014-09-23 Onzo Limited Method and apparatus for noise reduction and data compression
US9483737B2 (en) 2011-05-18 2016-11-01 Onzo Limited Identifying an event associated with consumption of a utility

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4159151B2 (en) * 1998-10-21 2008-10-01 Necエンジニアリング株式会社 Alarm history recording device
US7155450B2 (en) * 2001-05-10 2006-12-26 Automsoft R & D Limited Plant information management system
US8874561B2 (en) * 2003-03-31 2014-10-28 Sap Se Time series data management
EP1751672A4 (en) * 2004-05-03 2007-05-09 Lg Electronics Inc Method and apparatus for managing bookmark information for content stored in a networked media server
JP4082614B2 (en) * 2004-11-12 2008-04-30 インターナショナル・ビジネス・マシーンズ・コーポレーション Database management system, database management method, and program
JP4813155B2 (en) * 2005-11-17 2011-11-09 三菱電機株式会社 Data management apparatus, data management method for data management apparatus, and data management program
JP4148529B2 (en) * 2006-12-28 2008-09-10 インターナショナル・ビジネス・マシーンズ・コーポレーション System, method and program for checking index consistency in a database
US7487184B1 (en) 2008-05-09 2009-02-03 International Business Machines Corporation Method, system, and computer program product for improved round robin for time series data
JP5341209B2 (en) 2009-12-25 2013-11-13 インターナショナル・ビジネス・マシーンズ・コーポレーション System, method and program for checking pointer consistency in hierarchical database
JP5354606B2 (en) * 2010-02-10 2013-11-27 日本電信電話株式会社 Data storage device and method and program, and data search device and method and program
EP2515246B1 (en) * 2011-04-18 2013-10-23 Qualtera Data processing method and device

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4646229A (en) * 1982-11-15 1987-02-24 At&T Bell Laboratories Time-ordered data base
US4648036A (en) * 1985-03-06 1987-03-03 At&T Bell Laboratories Method for controlling query and update processing in a database system
US4823310A (en) * 1987-08-10 1989-04-18 Wang Laboratories, Inc. Device for enabling concurrent access of indexed sequential data files
US4961134A (en) * 1988-07-15 1990-10-02 International Business Machines Corporation Method for minimizing locking and reading in a segmented storage space
US4954981A (en) * 1988-09-16 1990-09-04 Coworks Method and apparatus for accessing and manipulating time series
US5261069A (en) * 1990-08-13 1993-11-09 Hewlett-Packard Company Method of maintaining consistency of cached data in a database system
US5289397A (en) * 1991-07-22 1994-02-22 Itt Corporation High-speed modulo exponentiator device
JPH0581049A (en) * 1991-09-20 1993-04-02 Fujitsu Ltd Time management system for memory
US5280612A (en) 1991-11-26 1994-01-18 International Business Machines Corporation Multiple version database concurrency control system
JP3612339B2 (en) * 1992-10-23 2005-01-19 株式会社日立製作所 Data processing method and apparatus
US5361202A (en) * 1993-06-18 1994-11-01 Hewlett-Packard Company Computer display system and method for facilitating access to patient data records in a medical information system
US5481296A (en) * 1993-08-06 1996-01-02 International Business Machines Corporation Apparatus and method for selectively viewing video information
JPH08152976A (en) * 1994-11-28 1996-06-11 Fujitsu Ltd Access method for storage device
US5835915A (en) 1995-01-24 1998-11-10 Tandem Computer Remote duplicate database facility with improved throughput and fault tolerance
JPH08212019A (en) * 1995-01-31 1996-08-20 Mitsubishi Electric Corp Semiconductor disk device
US5748952A (en) * 1995-05-10 1998-05-05 International Business Machines Corporation System and method for avoiding complete index tree traversals in sequential and almost sequential index probes
US5933820A (en) * 1996-05-20 1999-08-03 International Business Machines Corporation System, method, and program for using direct and indirect pointers to logically related data and targets of indexes
US5878410A (en) * 1996-09-13 1999-03-02 Microsoft Corporation File system sort order indexes
US6012060A (en) * 1997-05-30 2000-01-04 Oracle Corporation Sharing, updating data blocks among multiple nodes in a distributed system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8843332B2 (en) 2009-11-12 2014-09-23 Onzo Limited Method and apparatus for noise reduction and data compression
US8874623B2 (en) 2009-11-12 2014-10-28 Onzo Limited Data storage and transfer
US8825583B2 (en) 2009-12-18 2014-09-02 Onzo Limited Utility data processing system
US9483737B2 (en) 2011-05-18 2016-11-01 Onzo Limited Identifying an event associated with consumption of a utility
EP2568399A3 (en) * 2011-09-09 2013-07-10 Onzo Limited Data storage method and system

Also Published As

Publication number Publication date
US20020091675A1 (en) 2002-07-11
JPH10260876A (en) 1998-09-29
US7225178B2 (en) 2007-05-29

Similar Documents

Publication Publication Date Title
US5893120A (en) Methods and apparatus for information storage and retrieval using a hashing technique with external chaining and on-the-fly removal of expired data
US7225178B2 (en) Data structure in database, database system for managing database and database managing method and system
US6023744A (en) Method and mechanism for freeing disk space in a file system
CA2209549C (en) Method and apparatus for loading data into a database in a multiprocessor environment
KR930002331B1 (en) Method and apparatus for concurrent modification of an index tree
CN1026631C (en) Method of concurrency access for useing indexed tree to data base record
RU2182360C2 (en) Method for computer system stored data access, method for data filing, and computer system for implementing these methods
EP1342173B1 (en) Database management system and method for databases having large objects
US5053948A (en) File index system for mass storage device
US5946700A (en) Method and apparatus for preserving non-current information that can be overwritten in a computer file
US6584555B2 (en) Information storage and retrieval system
US7693875B2 (en) Method for searching a data page for inserting a data record
CN88100793A (en) Method for quickly opening magnetic disc file identified by path name
CN101278289A (en) System and method for providing an ojbect to support data structures in WORM storage
JP2001142751A (en) Method and device for data base management and storage medium with recorded database managing program
JP4101410B2 (en) Time version data storage device
US20080162591A1 (en) Method of Logging Transactions and a Method of Reversing a Transaction
US6029229A (en) Digital data storage subsystem including directory for efficiently providing formatting information for stored records
US7016911B2 (en) Management of user-defined routine libraries in database environments
AU664763B2 (en) Entity-relation database
EP1850250A1 (en) Method and system for renewing an index
US5666527A (en) System for dynamically changing logical data structure of database
JPH03116248A (en) Data maintenance system for data base
JP3622443B2 (en) T-tree index construction method and apparatus, and storage medium storing T-tree index construction program
Johnson et al. Updating an Inverted Index—a Performance Comparison of Two Techniques

Legal Events

Date Code Title Description
AS Assignment

Owner name: HITACHI, LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHIMOKAWA, TAKAYOSHI;MASAI, KAZUO;REEL/FRAME:009048/0386

Effective date: 19980306

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION