CN104881464A

CN104881464A - Data file format defining method

Info

Publication number: CN104881464A
Application number: CN201510271136.0A
Authority: CN
Inventors: 冯昱川
Original assignee: Beijing Ting Ruan Science And Technology Ltd
Current assignee: Beijing Ting Ruan Science And Technology Ltd
Priority date: 2015-05-26
Filing date: 2015-05-26
Publication date: 2015-09-02

Abstract

The invention belongs to the technical field of computers, and provides a data file format defining method. A format of a data file is defined by utilizing a configuration file comprising a relational database tabling statement. The configuration file comprises the column amount of the data file, the column name of each column, the data type, the data length, the empty or not field, the effective value range and the ordering of the column. The problems of uncertainty of the content in a text file and a hard code and the like are solved.

Description

A kind of document format data define method

Technical field

The invention belongs to a kind of document format data define method in field of computer technology.

Background technology

The content of text can be undertaken checking, revising by the default multiple text editor provided of operating system, and linux, unix system also provide the utility routines such as cat, more, head, tail, wc, grep, diff, sort, uniq, sed, awk, optionally can show text, filter, the operation such as amendment, therefore adopt text files memory data to be convenient to exploitation, the debugging of handling procedure, be also convenient to the maintenance of system.Text files memory is clear data in addition, does not deposit label and descriptor makes data space comparatively save, and the efficiency of transmission, process is higher.Therefore text uses widely under linux, unix environment, uses through being usually used in cross-system Data Migration, usually as the file layout of a system derived data, is also the carrier of data transmission and the data source of a system.

Text extensively, frequent use while, also have that deposit data degree of freedom is large, the non-self-described of data, store data content, form define indefinite problem, namely do not have metadata to define.Text lacks metadata definition and causes programming usually to adopt hard coded mode to realize, this makes the data source of text be difficult to revise as required, application developer changes indigestion, the maintenances of rear text, program, and exploitation New function is extremely difficult further.

Text is usually used in importing and exporting of system data, and the multiplex relevant database of system carries out the longer-term storage of data and supporting business is handled, and therefore also requires that text has consistent structure with the table imported and exported corresponding in system.Text lack metadata definition make the consistance of text structure and list structure ensure difficulty, be unfavorable for data importing, derivation engineering carry out and system cloud gray model time conventional maintenance.

Above-mentioned text describes the problem that causes and brings a lot of uncertain and difficult owing to lacking metadata to application and development, system maintenance, inter-system data migration.

Text, text compression stores, text cryptographic storage and other change store the problem that all there is form definition, and this few class file is referred to as data file in this patent, and the form definition of these data files is all within this patent range of application.

Summary of the invention

The present invention is directed to the problems referred to above in data file use, provide a kind of document format data define method.By providing a configuration file comprising data file definition information, determine the form of store data in data file uniquely, to comprise in data file the row name of each row, data type, length, whether can empty, valid value range, also determine quantity and the ordering of data file row simultaneously.The description that data file and these two files of its configuration file not only carry data itself but also contain data, solves the form, the uncertain problem of business implication that wherein store data when only having a data file.

Configuration file content is used for reference relevant database and is built predicative sentence to realize the definition of document format data, and configuration file itself is also a text.

Embodiment

For making the object, technical solutions and advantages of the present invention clearly, describe the embodiment of a kind of document format data define method of the present invention in detail below with reference to example.Whereby to a kind of document format data define method of the present invention how application technology means technical solution problem, and the implementation procedure reaching technique effect can fully understand and implement according to this.

Embodiment

The present embodiment provides a kind of document format data define method, and for root name is yuser, the data file having 32 row realizes document format data definition, comprising:

Step 1: fully understand the data file needing definition.

This step fully understands for needing the data file of definition, understand what is the purposes comprising such as data file? the total how many row of data file? what does is the purposes often arranged? does is which kind of type store data? does is length how many? be empty? can do you span be determined?

If there is corresponding table in relevant database, so list structure definition can help to understand data file.

Step 2: the configuration file writing data file.

This step is need the target data file of clear and definite form definition to create configuration file, and correctly arranges the content of configuration file.Configuration filename can be mapped to Data Filename, be named can traditionally, realize convenience decide.By linux, UNIX custom, might as well to fetch data filename important name by configuration file important name, extension name gets .conf.

Under linux operating system, vi yuser.conf input content is as shown in table 1.

Table 1 configuration file content is illustrated

Column data type is consistent with the definition in relevant database, can use char, varchar, longvar, short, tinyint, smallint, int, integer, bigint, long, num, numeric, real, dec, decimal, float, double, date, time, datetime, timestamp.

Content in this arrangements of steps file also can utilize Database Modeling instrument as ERWin, PowerDesigner, by graphical interfaces and the mutualization operation generation of modeling tool, these instrument annexation type databases also can be utilized to read list structure and generate.Modeling tool must not use, and the object mentioned here is that remind can the definition of multiplexing existing list structure, reduces the workload of generating configuration file content, increases work efficiency.

Step 3: resolve configuration file, obtain the definition of data file.

Configuration file store content be exactly in fact standard build predicative sentence, to be also not difficult the rule that finds wherein by this example, the configuration file of foregoing of can having programmed is resolved, and obtains the definition of data file.

Reading file and string processing is the basic function that any programming language all provides, is also the basic program capability of programmer, for ease of implementing, only extracts the roughly process of C statement parse here, can for reference when realizing.

● open configuration file

● first pass configuration file, logarithmic data file number also distributes data file metadata storage space

● second compiles scan profile, the number arranged in logarithmic data object, and allocated column metadata store space

● the 3rd time scan profile, resolve and record the metadata of all row, comprising row name, data type, length, whether can be empty, valid value range.

Step 4: according to the definition process data file of data file.

Understand according to the document format data that step 3 parses, process data file.

Claims

1. a document format data define method, is characterized in that, comprising:

The form of the configuration file definition data file of building predicative sentence is comprised by content.

2. method as claimed in claim 1, wherein builds the standard DDL statement that predicative sentence refers to relevant database, the one section of text guided with " CREATE TABLE " character, and in text, all character boundaries are write insensitive; The independent word followed closely after " CREATE TABLE " key word is data file important name, and the first character Duan Ze building the definition of predicative sentence is first row defining data file, the like complete the definition of all row in data file; Method as claimed in claim 1, wherein data file refers to text, the storage file that the compression storage file of text, the cryptographic storage file of text and File generate via other conversion process, data file stores text data character by it and determines, and its root name, extended file name have nothing to do.

3. method as claimed in claim 2, wherein data file important name refers to the partial document name in filename before character ". "; The definition of data file row comprise row title, data type, length, whether can the information such as sky, valid value range.

4. method as claimed in claim 1, wherein configuration file need comprise at least one and builds predicative sentence, and many also can be had to build predicative sentence for defining the form of multiple data file simultaneously; Building except predicative sentence except comprising in configuration file, comment statement and other required contents can also be had.