CN101246498A - News web page searching method - Google Patents

Abstract

The invention discloses a searching method for a news webpage, comprising the steps of: A, creating a news webpage index, determining a weight parameter of each news webpage corresponding to a relevant retrieval data according to text content, time and reprint situation; B, retrieving matched new webpage information from the news webpage index according to an input retrieval data when retrieving a news webpage; C, outputting ordered retrieval result. The invention is capable of accomplish effective retrieval order for a news webpage, and improving precision for news retrieval, so as to enable the retrieval result close to virtual retrieval requirement of user.

Description

A kind of searching method of news web page

Technical field

The present invention relates to the Internet search technology, relate in particular to a kind of searching method of news web page.

Background technology

Network search engines is to use frequent a kind of service system on the present internet.Network search engines has been concentrated the information of thousands upon thousands websites, and major function is to help these websites of user search, also can classify by the website that some are good, searches related data to make things convenient for the user.

At present, many search techniques all adopt inversed document frequency (IDF) technology to carry out Webpage search.IDF is proposed by Si Bake-Jones of Cambridge University the earliest, is an important technology in the information retrieval.IDF can distinguish a word to one piece of proportion that the document expression of significance is shared.Such as one piece of document more word appears as " vector ", and " vector " this word only occurs in the document of minority, " vector " this word just can well be distinguished this piece document so, can affirm that the theme that this piece document talks about is relevant with vector.On the contrary, as similar " can " wait word, the more discrimination that can not show this speech of the appearance word frequency in one piece of document (TF, i.e. occurrence number) to this piece document.The weighing computation method of IDF generally is according to formula: IDF=lg (N/n) obtains, and wherein, N is total number of files, and n is the number of documents that certain word occurs.

But, in the web search technology, needing different search techniques at object search, for example news search technology and picture searching technology, music searching technology have very big difference.The news search technology is a kind of search technique that approaches Webpage search most, and single piece of text of its index is longer, the various attributes that the object of description has unlike picture etc.The difference of news web page search technique and simple Webpage search is that the news web page search needs to pay attention to ageing more and takes into account correlativity the time.If handle bad, the result that might return or more relevant, but whether very new; Very new, but whether very relevant, not the news of extensively being paid close attention at present, do not satisfy user's search need.So the relevance ranking of its result for retrieval has certain degree of difficulty relatively.

In the prior art, a kind of news web page search technique also do not occur, make the existing very strong correlativity of news web page searching order result, have very strong ageing again.Therefore the news search result's of prior art accuracy is relatively poor, can't satisfy user's true search need.

Summary of the invention

In view of this, technical matters to be solved by this invention is to provide a kind of searching method of news web page, realize effective searching order at news web page, improve accuracy, make Search Results approach user's true search need more news search.

In order to realize the foregoing invention purpose, main technical schemes of the present invention is:

A kind of searching method of news web page comprises:

A, set up the news web page index, determine the weight parameter that each news web page is corresponding with the coordinate indexing string according to content of text, time and reprinting situation;

B, in search during news web page, from described news web page index, retrieve the news web page information of coupling according to the retrieval string of input, and sort according to the weight parameter corresponding with described input retrieval string;

Search Results after C, the output ordering.

Preferably, in the steps A,, determine this news web page and the corresponding weight parameter of this retrieval string according to following method at one piece of specific news web page and a specific retrieval string:

A1, determine the text relevant weights W of described retrieval string and described news web page _Text(Q, doc); Determine the numerical value relevance weight W of described retrieval string and described news web page _Num(doc), this W _Num(doc) mainly comprise time span weight and the situation of reprinting weight in;

A2, be described W _Text(Q, doc) and W _Num(doc) the adjusting parameter lambda is set respectively _TextAnd λ _Num

A3, the described λ of combination calculation _Text* W _Text(Q, doc) and λ _Num* W _Num(doc) obtain described news web page and the corresponding weight parameter of described retrieval string.

Preferably, steps A 3 according to formula: Weight (Q, doc)=(1+ λ _Text* W _Text(Q, doc)) * (1+ λ _Num* W _Num(doc)) carry out described combination calculation, obtain the described news web page weight parameter Weight corresponding with described retrieval string (Q, doc).

Preferably, in the steps A 1, determine the numerical value relevance weight W of described retrieval string and described news web page _Num(doc) concrete grammar is:

A11, determine the time span weights W _Time, reprinting rate weights W _Du, and reprint speed W _Dv

A12, be described W _Time, W _Du, and W _DvThe adjusting parameter lambda is set respectively _Time, λ _Du, and λ _Dv

A13, the described λ of combination calculation _Time* W _Time, λ _Du* W _Du, and λ _Dv* W _DvObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

Preferably, in the steps A 13, according to formula: W _Num(doc)=(1+ λ _Time* W _Time) * (1+ λ _Du* W _Du) * (1+ λ _Dv* W _Dv) carry out described combination calculation, obtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

Preferably, in the steps A 11, according to formula: $W_{\mathrm{time}}=\frac{\mathrm{MaxTimeSpanWeight}}{{\left(\frac{t+b}{b}\right)}^{\mathrm{\α}}}$ Determine W _TimeWherein, MaxTimeSpanWeight is a maximum time span weight, and b is a Preset Time unit, and the default constant of α one, t are that described news pages goes out the time span of now to current time on network.

Preferably, in the steps A 11, described reprinting rate weights W _DuDefinite method be: add up the number of times that described news web page is reprinted, with the number of times that counts and reference value contrast, the ratio that obtains is W _Du

Preferably, in the steps A 11, according to formula: W _Dv=W _Dn/ (T _e-T _b) determine described reprinting speed W _Dv, wherein, W _DnBe the number of times that described news web page is reprinted in the schedule time, T _bBe the reproduced time of beginning, T _eIt is last reproduced time.

Preferably, further determine the authoritative weights W of news web page in the steps A 11 _GA, and be this W in steps A 12 _GAThe adjusting parameter lambda is set _GA, the described λ of combination calculation in steps A 13 _Time* W _Time, λ _Du* W _Du, λ _Dv* W _Dv, and λ _GA* W _GAObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

Preferably, in the steps A 13 according to formula: W _Num(doc)=(1+ λ _Time* W _Time) * (1+ λ _Du* W _Du) * (1+ λ _Dv* W _Dv) * (1+ λ _GA* W _GA) carry out combination calculation, obtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

Preferably, in the steps A 11, according to formula W _GA=W _Page* W _StDetermine described W _GA, W wherein _PageBe the page weight of the described news web page affiliated web site rank of reflection and this news web page page location of living in, W _StBe that whether news web page is the thematic weight of thematic webpage under the reflection.

Preferably, in the steps A 1, determine the text relevant weights W of described retrieval string and described news web page _Text(Q, concrete grammar doc) is:

A11, determine the relevance weight W that described retrieval string hits in described news web page title _TI(Q, doc) and the relevance weight W that in described news web page text, hits of described retrieval string _Tx(Q, doc);

A12, be described W _TI(Q, doc) and W _Tx(Q doc) is provided with the adjusting parameter lambda respectively _TIAnd λ _Tx, and λ _TI+ λ _Tx=1;

A13, according to formula W _Text(Q, doc)=λ _TI* W _TI(Q, doc)+λ _Tx* W _Tx(Q doc) determines the text relevant weights W of described retrieval string and described news web page _Text(Q, doc).

Preferably, among the step a11, according to formula $W_{\mathrm{TI}}(Q,\mathrm{doc})=\frac{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*\mathrm{HitTitle}(q,\mathrm{doc})}{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)}$ Determine described W _TI(Q, doc), wherein, described Q is the retrieval string, q is a term in the retrieval string, W _IDF(q) be the inversed document frequency IDF weight of q, (q doc) gets 1, otherwise gets 0 HitTitle when q is included in the described news web page title.

Preferably, among the step a11, according to formula W _Tx(Q, doc)=log ₂(1+WTF (Q, doc)) determines described W _Tx(Q, doc); (Q is doc) according to formula for WTF $\mathrm{WTF}(Q,\mathrm{doc})=\underset{\mathrm{pos}\∈\left\{\mathrm{POS}\right\}}{\mathrm{\Σ}}(\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*{\log }_2(1+\mathrm{tf}(q,\mathrm{pos})))$ Determine that wherein { POS} is the huge location sets of news web page text, and pos is one of them huge position, and (q pos) is the frequency that occurs in the huge position of term q in described news web page text, W to tf _IDF(q) be the inversed document frequency IDF weight of q.

Preferably, described W _IDF(q) according to formula $W_{\mathrm{IDF}}\left(q\right)=\log (\frac{N-\mathrm{df}\left(q\right)+0.5}{\mathrm{df}\left(q\right)+0.5}+1.0)$ Determine that wherein N is the total number of documents order in the index, df (q) is the number of files that term q hits.

Among the present invention, for the search of news web page except considering the relevance ranking technology of traditional full-text search, the objective characteristic of also taking into account simultaneously according to the emphasis timeliness and the correlativity of news web page, pass through the time, the reprinting rate, rotary speed, even factor such as website weight is carried out weight calculation, thereby make the existing very strong content of text correlativity of final searching order result, can embody the degree of concern that is subjected to of news web page strongly, have very strong ageing again, thereby improve accuracy, make Search Results approach user's true search need more news search.

Description of drawings

Fig. 1 is the main process flow diagram of the method for the invention;

Fig. 2 a and Fig. 2 b are W _TimeExemplary graph with time relationship.

Embodiment

Below by specific embodiments and the drawings the present invention is described in further details.

Fig. 1 is the main process flow diagram of the method for the invention.Referring to Fig. 1, this flow process comprises:

Step 101, set up the news web page index, according to content of text, time and reprinting situation determine each news web page weight parameter Weight corresponding with the coordinate indexing string (Q, doc).

Step 102, in search during news web page, from described news web page index, retrieve the news web page information of coupling according to the retrieval string of input, and sort according to the weight parameter corresponding with described input retrieval string;

Search Results after step 103, the output ordering.

Wherein, step 101 is key technical features of the present invention.In the step 101,, determine this news web page and the corresponding weight parameter of this retrieval string according to following method at one piece of specific news web page and a specific retrieval string:

Step 111, determine the text relevant weights W of described retrieval string and described news web page _Text(Q, doc); Determine the numerical value relevance weight W of described retrieval string and described news web page _Num(doc), this W _Num(doc) mainly comprise time span weight and the situation of reprinting weight in.Described Q is the retrieval string, Q={q ₁, q ₂..., q _n, q is a term in the retrieval string, n is the term number after the cutting of retrieval string.

Step 112, be described W _Text(Q, doc) and W _Num(doc) the adjusting parameter lambda is set respectively _TextAnd λ _Num

Step 113, the described λ of combination calculation _Text* W _Text(Q, doc) and λ _Num* W _Num(doc) obtain described news web page and the corresponding weight parameter of described retrieval string.Described adjusting parameter lambda _TextAnd λ _NumCan transfer big according to actual needs or turn its corresponding W down _Text(Q, doc), W _Num(doc) degree of influence can be transferred big accordingly or turn down.

Concrete, the weight parameter Weight that described news web page is corresponding with described retrieval string (Q, doc) can determine according to following formula (1) combination calculation:

Weight(Q，doc)＝(1+λ _text*W _text(Q，doc))*(1+λ _num*W _num(doc)) (1)

In the above-mentioned formula (1), λ _Text* W _Text(Q, doc) and λ _Num* W _Num(doc) correlation has adopted the multiplication mode when combination calculation, also can adopt add mode, promptly Weight (Q, doc)=(1+ λ _Text* W _Text(Q, doc))+(1+ λ _Num* W _Num(doc)), but adopt the mode that multiplies each other more to be applicable to the searching order of news web page, as long as wherein the parameter value of any weight is higher, adopt the mode of multiplying each other total weighted value can be drawn high, promote the sorting position of this news web page in Search Results greatly.

Introduce how to determine described W respectively below _Text(Q, doc) and W _Num(doc).

One, W _Text(Q, definite method doc).

The field that index is set up in news search has header field and body field, at definite W _Text(Q in the time of doc), needs to consider the hit situation of retrieval string in header field and body field.

Concrete, the text relevant weights W of described retrieval string and described news web page _Text(Q, definite process doc) comprises:

Step a11, determine the relevance weight W that described retrieval string hits in described news web page title _TI(Q, doc) and the relevance weight W that in described news web page text, hits of described retrieval string _Tx(Q, doc).

Step a12, be described W _TI(Q, doc) and W _Tx(Q doc) is provided with the adjusting parameter lambda respectively _TIAnd λ _Tx, and λ _TI+ λ _Tx=1.

Step a13, determine the text relevant weights W of described retrieval string and described news web page according to following formula (2) _Text(Q, doc).

W _text(Q，doc)＝λ _TI*W _TI(Q，doc)+λ _tx*W _tx(Q，doc) (2)

In step a11, determine described W according to following formula (3) _TI(Q, doc):

$W_{\mathrm{TI}}(Q,\mathrm{doc})=\frac{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*\mathrm{HitTitle}(q,\mathrm{doc})}{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)}---\left(3\right)$

In the formula (3), described Q is the retrieval string, and q is a term in the retrieval string, W _IDF(q) be the inversed document frequency IDF weight of q, (q doc) gets 1, otherwise gets 0 HitTitle when q is included in the described news web page title.Only considered in the formula (3) that the title of news web page is to Q={q ₁, q ₂..., q _nCoverage rate, do not consider each entry q word frequency TF in title, reason is in the title of news web page, important centre word generally only occurs once, is that unessential speech occurrence number is more on the contrary.

In step a11, determine described W according to following formula (4) _Tx(Q, doc):

W _tx(Q，doc)＝log ₂(1+WTF(Q，doc)) (4)

In the formula (4), and WTF (Q is to be an entry with retrieval string Q total abstract doc), the weighting frequency in the news web page document, and this value can be regarded a kind of TF of broad sense as.

Concrete, WTF (Q, doc) determine according to following formula (5):

$\mathrm{WTF}(Q,\mathrm{doc})=\underset{\mathrm{pos}\∈\left\{\mathrm{POS}\right\}}{\mathrm{\Σ}}(\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*{\log }_2(1+\mathrm{tf}(q,\mathrm{pos})))---\left(5\right)$

In the formula (5), { POS} is the huge location sets of news web page text, and pos is one of them huge position, and (q pos) is the frequency that occurs in the huge position of term q in described news web page text, W to tf _IDF(q) be the IDF weight of q.

Described W _IDF(q) determine according to following formula (6):

$W_{\mathrm{IDF}}\left(q\right)=\log (\frac{N-\mathrm{df}\left(q\right)+0.5}{\mathrm{df}\left(q\right)+0.5}+1.0)---\left(6\right)$

In the formula (6), described N is the total number of documents order in the index, and df (q) is the number of files that term q hits.Certainly, above-mentioned formula (6) can be done simple transformation, for example can be according to formula $W_{\mathrm{IDF}}\left(q\right)=\log (\frac{N+0.5}{\mathrm{df}\left(q\right)+0.5}+1.0)$ Determine described W _IDF(q), perhaps more simply utilize formula: $W_{\mathrm{IDF}}\left(q\right)=\log \left(\frac{N}{\mathrm{df}\left(q\right)}\right)$ Determine described W _IDF(q), the embodiment of only above-mentioned formula (6) more can draw back the ordering distance of the corresponding news web page of different terms, make the ranking results of the news web page that searches out by the hot news term obtain more embodying the ageing and correlativity of the Search Results of standing out in advance.

Two, W _Num(doc) definite method.

Determine the numerical value relevance weight W of described retrieval string and described news web page _Num(doc) concrete grammar is:

Steps A 11, determine the time span weights W _Time, reprinting rate weights W _Du, and reprint speed W _Dv

Steps A 12, be described W _Time, W _Du, and W _DvThe adjusting parameter lambda is set respectively _Time, λ _Du, and λ _DvDescribed adjusting parameter can be provided with according to actual needs, transfers and turns described adjusting parameter, the W that it is corresponding greatly down _Time, W _Du, W _DvDegree of influence can corresponding transfer big or turn down.

Steps A 13, the described λ of combination calculation _Time* W _Time, λ _Du* W _Du, and λ _Dv* W _DvObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).Concrete, can carry out described combination calculation according to following formula (7), obtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

W _num(doc)＝(1+λ _time*W _time)*(1+λ _du*W _du)*(1+λ _dv*W _dv) (7)

In the formula (7), when combination calculation, (1+ λ _Time* W _Time), (1+ λ _Du* W _Du) and (1+ λ _Dv* W _Dv) between adopted the account form that multiplies each other, also can adopt add mode, i.e. W _Num(doc)=(1+ λ _Time* W _Time) * (1+ λ _Du* W _Du) * (1+ λ _Dv* W _Dv), still, adopt the calculation mode that multiplies each other can more be applicable to the searching order of news web page, as long as wherein the parameter value of any weight is higher, then can be with W _Num(doc) weighted value is drawn high, and promotes the sorting position of corresponding news web page greatly.

Among the above-mentioned steps A11, W _TimeSpan be [0～100], determine described W according to formula (8) _Time:

$W_{\mathrm{time}}=\frac{\mathrm{MaxTimeSpanWeight}}{{\left(\frac{t+b}{b}\right)}^{\mathrm{\α}}}---\left(8\right)$

In the formula (8), MaxTimeSpanWeight is a maximum time span weight, can value be 100 for example herein; B be one with t time corresponding unit, t be second in the present embodiment, b=3600 then, promptly one hour second number; α is the constant of described power function, can be preset as 0.5 herein, and t is that described news pages goes out now to the time span of current time on network.

Fig. 2 a and Fig. 2 b are W _TimeWith the exemplary graph of time relationship, wherein the horizontal ordinate of Fig. 2 a is minute, and ordinate is the time span weights W _TimeValue (Weight), the horizontal ordinate of Fig. 2 b is hour that ordinate is the time span weights W _TimeValue (Weight).Data result referring to Fig. 2 a and Fig. 2 b:

0 minute, W _Time=100;

3 hours, W _Time=50;

15 hours, W _Time=25;

24 hours, W _Time=20.

By Fig. 2 a and Fig. 2 b as can be seen, for news web page, definite method of above-mentioned formula (8) has demonstrated fully the ageing of news web page, be that the time is near more, weighted value is high more, in case surpass section sometime, then weighted value decay rapidly, thus make the webpage sorting position of latest news shift to an earlier date greatly.

In steps A 11, described reprinting rate weights W _DuSpan be [0～100].The method of determining is: add up the number of times that described news web page is reprinted on the backstage of search engine, with the number of times and the reference value contrast that count, the ratio that obtains is W _Du

In steps A 11, described reprinting speed W _DvSpan be [0～100].Specifically determine according to following formula (9):

W _dv＝W _dn/(T _e-T _b) (9)

In the formula (9), W _DnBe the number of times that described news web page is reprinted in the schedule time (for example 48 hours), T _bBe the reproduced time of beginning, T _eIt is last reproduced time.In a kind of preferred embodiment,, generally can only consider the reprinting speed in 48 hours, T according to the appearance characteristic of news web page _e-T _bMaximal value be 48 hours, and T _e-T _bUnit be hour that less than one hour was calculated by one hour.

Can also further determine the authoritative weights W of news web page in the steps A 11 _GA, and be this W in steps A 12 _GAThe adjusting parameter lambda is set _GA, λ _GAAccent turn corresponding W greatly down _GADegree of influence can be transferred big accordingly or turn down.The described λ of combination calculation in steps A 13 _Time* W _Time, λ _Du* W _Du, λ _Dv* W _Dv, and λ _GA* W _GAObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).Specifically carry out combination calculation, obtain the numerical value relevance weight W of described retrieval string and described news web page according to following formula (10) _Num(doc).

W _num(doc)＝(1+λ _time*W _time)*(1+λ _du*W _du)*(1+λ _dv*W _dv)*(1+λ _GA*W _GA) (10)

Certainly, also can utilize formula:

W _num(doc)＝(1+λ _time*W _time)+(1+λ _du*W _du)+(1+λ _dv*W _dv)+(1+λ _GA*W _GA)

Determine described W _Num(doc), just adopt the calculation mode that multiplies each other can more be applicable to the searching order of news web page, as long as wherein the parameter value of any weight is higher, then can be with W _Num(doc) weighted value is drawn high, and promotes the sorting position of corresponding news web page greatly.

The authoritative weights W of described news web page _GACan determine according to formula (11):

W _GA＝W _page*W _st (11)

In the formula (11), W _PageBeing page weight, is that the search engine backstage combines the rank of website, news web page place and the weighted value that page location calculates.W _StBe thematic weighting, if a page is special topic (special topic), then W _StEqual one greater than 1 constant, as W _St=1.2; If a page is not the thematic page, then W _St=1.

The above; only for the preferable embodiment of the present invention, but protection scope of the present invention is not limited thereto, and anyly is familiar with the people of this technology in the disclosed technical scope of the present invention; the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.

Claims (15)

1, a kind of searching method of news web page is characterized in that, comprising:

A, set up the news web page index, determine the weight parameter that each news web page is corresponding with the coordinate indexing string according to content of text, time and reprinting situation;

B, in search during news web page, from described news web page index, retrieve the news web page information of coupling according to the retrieval string of input, and sort according to the weight parameter corresponding with described input retrieval string;

Search Results after C, the output ordering.

2, method according to claim 1 is characterized in that, in the steps A, at one piece of specific news web page and a specific retrieval string, determines this news web page and the corresponding weight parameter of this retrieval string according to following method:

A1, determine the text relevant weights W of described retrieval string and described news web page _Text(Q, doc); Determine the numerical value relevance weight W of described retrieval string and described news web page _Num(doc), this W _Num(doc) mainly comprise time span weight and the situation of reprinting weight in;

A2, be described W _Text(Q, doc) and W _Num(doc) the adjusting parameter lambda is set respectively _TextAnd λ _Num

A3, the described λ of combination calculation _Text* W _Text(Q, doc) and λ _Num* W _Num(doc) obtain described news web page and the corresponding weight parameter of described retrieval string.

3, method according to claim 2 is characterized in that, steps A 3 according to formula: Weight (Q, doc)=(1+ λ _Text* W _Text(Q, doc)) * (1+ λ _Num* W _Num(doc)) carry out described combination calculation, obtain the described news web page weight parameter Weight corresponding with described retrieval string (Q, doc).

4, method according to claim 2 is characterized in that, in the steps A 1, determines the numerical value relevance weight W of described retrieval string and described news web page _Num(doc) concrete grammar is:

A11, determine the time span weights W _Time, reprinting rate weights W _Du, and reprint speed W _Dv

A12, be described W _Time, W _Du, and W _DvThe adjusting parameter lambda is set respectively _Time, λ _Du, and λ _Dv

A13, the described λ of combination calculation _Time* W _Time, λ _Du* W _Du, and λ _Dv* W _DvObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

5, method according to claim 4 is characterized in that, in the steps A 13, according to formula: W _Num(doc)=(1+ λ _Time* W _Time) * (1+ λ _Du* W _Du) * (1+ λ _Dv* W _Dv) carry out described combination calculation, obtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

6, method according to claim 4 is characterized in that, in the steps A 11, according to formula: $W_{\mathrm{time}}=\frac{\mathrm{MaxTimeSpanWeight}}{{\left(\frac{t+b}{b}\right)}^{\mathrm{\α}}}$ Determine W _TimeWherein, MaxTimeSpanWeight is a maximum time span weight, and b is a Preset Time unit, and the default constant of α one, t are that described news pages goes out the time span of now to current time on network.

7, method according to claim 4 is characterized in that, in the steps A 11, and described reprinting rate weights W _DuDefinite method be: add up the number of times that described news web page is reprinted, with the number of times that counts and reference value contrast, the ratio that obtains is W _Du

8, method according to claim 4 is characterized in that, in the steps A 11, according to formula: W _Dv=W _Dn/ (T _e-T _b) determine described reprinting speed W _Dv, wherein, W _DnBe the number of times that described news web page is reprinted in the schedule time, T _bBe the reproduced time of beginning, T _eIt is last reproduced time.

9, method according to claim 4 is characterized in that, further determines the authoritative weights W of news web page in the steps A 11 _GA, and be this W in steps A 12 _GAThe adjusting parameter lambda is set _GA, the described λ of combination calculation in steps A 13 _Time* W _Time, λ _Du* W _Du, λ _Dv* W _Dv, and λ _GA* W _GAObtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

10, method according to claim 9 is characterized in that, in the steps A 13 according to formula: W _Num(doc)=(1+ λ _Time* W _Time) * (1+ λ _Du* W _Du) * (1+ λ _Dv* W _Dv) * (1+ λ _GA* W _GA) carry out combination calculation, obtain the numerical value relevance weight W of described retrieval string and described news web page _Num(doc).

11, method according to claim 9 is characterized in that, in the steps A 11, according to formula W _GA=W _Page* W _StDetermine described W _GA, W wherein _PageBe the page weight of the described news web page affiliated web site rank of reflection and this news web page page location of living in, W _StBe that whether news web page is the thematic weight of thematic webpage under the reflection.

12, method according to claim 2 is characterized in that, in the steps A 1, determines the text relevant weights W of described retrieval string and described news web page _Text(Q, concrete grammar doc) is:

A11, determine the relevance weight W that described retrieval string hits in described news web page title _TI(Q, doc) and the relevance weight W that in described news web page text, hits of described retrieval string _Tx(Q, doc);

A12, be described W _TI(Q, doc) and W _Tx(Q doc) is provided with the adjusting parameter lambda respectively _TIAnd λ _Tx, and λ _TI+ λ _Tx=1;

A13, according to formula W _Text(Q, doc)=λ _TI* W _TI(Q, doc)+λ _Tx* W _Tx(Q doc) determines the text relevant weights W of described retrieval string and described news web page _Text(Q, doc).

13, method according to claim 12 is characterized in that, among the step a11, according to formula $W_{\mathrm{TI}}(Q,\mathrm{doc})=\frac{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*\mathrm{HitTitle}(q,\mathrm{doc})}{\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)}$ Determine described W _TI(Q, doc), wherein, described Q is the retrieval string, q is a term in the retrieval string, W _IDF(q) be the inversed document frequency IDF weight of q, (q doc) gets 1, otherwise gets 0 HitTitle when q is included in the described news web page title.

14, method according to claim 12 is characterized in that, among the step a11, according to formula W _Tx(Q, doc)=log ₂(1+WTF (Q, doc)) determines described W _Tx(Q, doc); (Q is doc) according to formula for WTF $\mathrm{WTF}(Q,\mathrm{doc})=\underset{\mathrm{pos}\∈\left\{\mathrm{POS}\right\}}{\mathrm{\Σ}}(\underset{q\∈Q}{\mathrm{\Σ}}{W}_{\mathrm{IDF}}\left(q\right)*{\log }_2(1+\mathrm{tf}(q,\mathrm{pos})))$ Determine that wherein { POS} is the huge location sets of news web page text, and pos is one of them huge position, and (q pos) is the frequency that occurs in the huge position of term q in described news web page text, W to tf _IDF(q) be the inversed document frequency IDF weight of q.

15, according to claim 13 or 14 described methods, it is characterized in that described W _IDF(q) according to formula $W_{\mathrm{IDF}}\left(q\right)=\log (\frac{N-\mathrm{df}\left(q\right)+0.5}{\mathrm{df}\left(q\right)+0.5}+1.0)$ Determine that wherein N is the total number of documents order in the index, df (q) is the number of files that term q hits.

Images