Suche Bilder Maps Play YouTube News Gmail Drive Mehr »
Anmelden
Nutzer von Screenreadern: Klicke auf diesen Link, um die Bedienungshilfen zu aktivieren. Dieser Modus bietet die gleichen Grundfunktionen, funktioniert aber besser mit deinem Reader.

Patentsuche

  1. Erweiterte Patentsuche
VeröffentlichungsnummerCN103186619 A
PublikationstypAnmeldung
AnmeldenummerCN 201110457424
Veröffentlichungsdatum3. Juli 2013
Eingetragen30. Dez. 2011
Prioritätsdatum30. Dez. 2011
Veröffentlichungsnummer201110457424.7, CN 103186619 A, CN 103186619A, CN 201110457424, CN-A-103186619, CN103186619 A, CN103186619A, CN201110457424, CN201110457424.7
Erfinder曹中宇, 王超东
Antragsteller北京百度网讯科技有限公司
Zitat exportierenBiBTeX, EndNote, RefMan
Externe Links:  SIPO, Espacenet
Method and device for evaluating search results based on non click operation information
CN 103186619 A
Zusammenfassung
The invention aims at providing a method and a device for evaluating search results based on non click operation information. The method comprises the steps as follows: at first, obtaining one or more non click operation information of a user to the search results to be evaluated based on the same inquiry sequence; and then, evaluating the search results according to the non click operation information. Compared with the prior art, the non click operation information of the user to the search results to be evaluated based on the same inquiry sequence is obtained and comprises whether a new inquiry sequence is input, operation of sorting the search results and the like, and the search results are evaluated based on a predetermined evaluation rule, so that search requirements can be included in evaluation standards when the search results are subjected to non click operation by the user, thereby providing a more reliable basis for improving the accuracy of evaluating the search results.
Ansprüche(10)  übersetzt aus folgender Sprache: Chinesisch
1.一种计算机实现的用于评价搜索结果的方法,该方法包括以下步骤: a.获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息; b.根据所述非点击操作信息,对所述搜索结果进行评价。 1. A method for the evaluation of search results computer-implemented method comprising the steps of: a Get one or more users to take the evaluation of non-click operation information based on the search results for the same query sequence; b. According to the. Non-click operation information, evaluate the results of the search.
2.根据权利要求1所述的方法,其中,所述非点击操作信息包括以下至少任一项: -所述用户输入新的查询序列的操作信息; -所述用户对所述搜索结果的各个搜索结果项的划选操作信息; -所述用户对所述搜索结果的各个搜索结果项的悬停操作信息。 2. The method of claim 1, wherein said non-click operation information including at least any one of the following: - the user enters a new operation information of the query sequence; - the user of the respective search results Plan selected operating information search result items; - the user hovers operating information for the search results for each search result item.
3.根据权利要求2所述的方法,其中,所述用户对所述搜索结果的各个搜索结果项的悬停操作信息包括以下至少任一项: -用户在所述搜索结果的各个搜索结果项上的悬停操作次数; -用户在所述搜索结果的各个搜索结果项上的每次悬停操作的持续时间。 3. The method according to claim 2, wherein the user hovers operating information for the search results of each search result item includes at least one of any of the following: - The user of the search results for each search result item Hovering on the number of operations; - users on the search results for each search result item duration of each operation hover.
4.根据权利要求1至3中任一项所述的方法,其中,所述步骤b包括: -根据所述非点击操作信息以及所述非点击操作信息发生的时间信息,对所述搜索结果进行评价。 4. The method according to any one of claims 3, wherein said step b comprises: - a click operation according to the non-information and time information of the non-occurrence of a click operation information, to the search result were evaluated.
5.根据权利要求1至4中任一项所述的方法,其中,所述步骤b包括: -根据所述非点击操作信息,并结合所述用户对所述搜索结果的点击操作信息,对所述搜索结果进行评价。 The method according to any one of claims 1 to 4, Claim, wherein said step b comprises: - a click operation according to the non-information, and combining the user clicks on the search result information, for The search results were evaluated.
6.一种用于评价搜索结果的设备,该设备包括: 操作信息获取装置,用于获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息; 评价装置,用于根据所述非点击操作信息,对所述搜索结果进行评价。 6. A method for the evaluation of search results, the apparatus comprising: an operating information acquisition means for acquiring one or more users to take the evaluation based on the same search query sequence and results-click operation information; evaluation means for According to the non-operational information click on the search results were evaluated.
7.根据权利要求6所述的设备,其中,所述非点击操作信息包括以下至少任一项: -所述用户输入新的查询序列的操作信息; -所述用户对所述搜索结果的各个搜索结果项的划选操作信息; -所述用户对所述搜索结果的各个搜索结果项的悬停操作信息。 7. The apparatus of claim 6, wherein said non-click operation information including at least any one of the following: - the user enters a new operation information of the query sequence; - the user of the respective search results Plan selected operating information search result items; - the user hovers operating information for the search results for each search result item.
8.根据权利要求7所述的设备,其中,所述用户对所述搜索结果的各个搜索结果项的悬停操作信息包括以下至少任一项: -用户在所述搜索结果的各个搜索结果项上的悬停操作次数; -用户在所述搜索结果的各个搜索结果项上的每次悬停操作的持续时间。 8. The apparatus according to claim 7, wherein the user hovers operating information for the search results for each search result item includes at least one of any of the following: - The user of the search results for each search result item Hovering on the number of operations; - users on the search results for each search result item duration of each operation hover.
9.根据权利要求6至8中任一项所述的设备,其中,所述评价装置用于根据所述非点击操作信息以及所述非点击操作信息发生的时间信息,对所述搜索结果进行评价。 6 to 9. The apparatus according to any one of claim 8, wherein said means for evaluation in accordance with the non-click operation of the information and the time information of the non-occurrence of a click operation information, to the search results Evaluation.
10.根据权利要求6至9中任一项所述的设备,其中,所述评价装置用于根据所述非点击操作信息,并结合所述用户对所述搜索结果的点击操作信息,对所述搜索结果进行评价。 6 to 10. The apparatus according to any one of claim 9, wherein said means for evaluation of information in accordance with the non-click operation, and binding the user clicks on the search result information, to the said search results were evaluated.
Beschreibung  übersetzt aus folgender Sprache: Chinesisch

一种基于非点击操作信息的评价搜索结果的方法与设备 A method and apparatus for non-click operation based on the evaluation of information search results

技术领域 Technical Field

[0001] 本发明涉及计算机领域,尤其涉及一种用于评价搜索结果的技术。 [0001] The present invention relates to the field of computers, and more particularly to a technique for the evaluation of the search results.

背景技术 Background

[0002] 在现有技术中,对搜索结果的评价主要依赖于用户对搜索结果的点击行为,而未考虑用户在搜索过程中不需对所述搜索结果进行点击操作即可满足其搜索需求的情形,例如,用户仅通过搜索结果页面展示的搜索结果摘要即可满足查询需求,而无需点击各搜索结果项的链接以进入其所对应的页面。 [0002] In the prior art, the evaluation of the results of the search depends on the user clicks on the search results, without considering the user in the search process without the results of the search clicks to meet the needs of their search case, for example, users can only search through the search results summary page showing the results of a query can meet demand without having to click on the link for each search result item to enter its corresponding page. 由于忽略对用户无点击操作的评价,从而导致对搜索结果评价的不够准确。 By ignoring the user clicks no evaluation, leading to the search results of the evaluation is not accurate enough.

[0003] 因此,如何有效并准确地评价搜索结果,成为目前亟待解决的问题之一。 [0003] Therefore, how to effectively and accurately evaluate the search results and become one of the problems to be solved now.

发明内容 DISCLOSURE

[0004] 本发明的目的是提供一种用于评价搜索结果的方法与设备。 [0004] The object of the present invention to provide a method and apparatus for evaluating search results.

[0005] 根据本发明的一个方面,提供了一种计算机实现的用于评价搜索结果的方法,该方法包括以下步骤: [0005] In accordance with one aspect of the present invention, there is provided a method for the evaluation of a computer-implemented search results, the method comprising the steps of:

[0006] a.获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作 [0006] a. Get one or more user evaluation treat non-clicks on the search results for the same query sequence

信息; Information;

[0007] b.根据所述非点击操作信息,对所述搜索结果进行评价。 [0007] b. According to the non-operational information click on the search results were evaluated.

[0008] 根据本发明的另一方面,还提供了一种用于评价搜索结果的设备,该设备包括: [0008] According to another aspect of the present invention, there is provided an apparatus for evaluating search results, the apparatus comprising:

[0009] 操作信息获取装置,用于获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息; [0009] The operation information acquisition means for acquiring one or more users to take the evaluation of non-operational information click on the search results for the same query sequence based;

[0010] 评价装置,用于根据所述非点击操作信息,对所述搜索结果进行评价。 [0010] The evaluation means for the non-click operation information, evaluate the results of the search.

[0011] 与现有技术相比,本发明通过获取用户对待评价的基于相同查询序列的搜索结果的非点击操作信息,如是否输入新的查询序列、对搜索结果项的划选操作等,并基于预定评价规则对该搜索结果进行评价,将用户对搜索结果执行无点击操作时即可满足搜索需求的情形包含至评价标准中,从而为提高搜索结果评价的准确性提供更为可靠的依据。 [0011] Compared with the prior art, the present invention is by getting users to take the evaluation based on the same search query sequence and results-click operation information, such as whether to enter a new query sequence, the search result items designated election operation, and case evaluation of the search results based on predetermined evaluation rule, the user search results to meet the search needs when performing no click operation to contain the evaluation criteria, thereby providing a more reliable basis in order to improve the accuracy of search results of the evaluation.

附图说明 Brief Description

[0012] 通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显: [0012] Non-limiting detailed description of embodiments given with reference to the following drawings taken by reading and other features, objects and advantages of the present invention will become more apparent:

[0013] 图1示出根据本发明一个方面的用于评价搜索结果的设备示意图; [0013] FIG. 1 shows a schematic diagram of the evaluation device search results for one aspect of the present invention is based on;

[0014] 图2示出根据本发明另一个方面的用于评价搜索结果的方法流程图。 [0014] Figure 2 shows a flow chart of the evaluation method of the search results to another aspect of the present invention is used in accordance with.

[0015] 附图中相同或相似的附图标记代表相同或相似的部件。 [0015] In the drawings the same or similar reference numerals refer to the same or like parts.

具体实施方式 DETAILED DESCRIPTION

[0016] 下面结合附图对本发明作进一步详细描述。 [0016] The present invention below with reference to the drawings described in further detail. [0017] 图1示出根据本发明一个方面的评价搜索结果的设备示意图。 [0017] FIG. 1 shows a schematic diagram of the device according to one aspect of the present invention, the evaluation of the search results. 其中,评价设备I包括操作信息获取装置111和评价装置112。 Wherein the evaluation device I includes an operation information acquisition means 111 and the evaluation device 112.

[0018] 在此,评价设备I可以是一个网络设备或位于其中的功能模块,其中,网络设备包括但不限于计算机、网络主机、单个网络服务器、多个网络服务器集或多个服务器构成的云,在此,云由基于云计算(Cloud Computing)的大量计算机或网络服务器构成,其中,云计算是分布式计算的一种,由一群松散耦合的计算机集组成的一个超级虚拟计算机;评价设备I也可以是用户设备,其包括但不限于任何一种可与用户通过键盘、遥控器、触摸板、或声控设备进行人机交互的电子产品,例如计算机、智能手机、PDA、游戏机、或IPTV等。 [0018] Here, the evaluation device I may be a network device or function modules located therein, wherein the network devices include, but are not limited to computers, network host, a single network server and multiple network servers sets or more servers configured Cloud In this, the cloud from the cloud-based computing (Cloud Computing) A number of computers or a network server configuration, where cloud computing is a distributed computing, a super virtual computer by the computer sets consisting of a group of loosely coupled; evaluation equipment I or a user equipment, including but not limited to any one with the user through the keyboard, remote control, touchpad, or interactive voice device electronic products such as computers, smart phones, PDA, game consoles, or IPTV and so on.

[0019] 以下参照图1来对评价设备I评价搜索结果的过程进行详细描述: [0019] with reference to FIG. 1 to the evaluation device I evaluation process of the search results described in detail:

[0020] 具体地,操作信息获取装置111获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息。 [0020] Specifically, the operation information acquisition means 111 acquires one or more users to take the evaluation based on the same search query sequence and results-click operation information.

[0021] 在此,所述非点击操作信息包括但不限于以下任一项: [0021] In this case, the non-click operation information includes, but is not limited to, any of the following:

[0022] I)用户输入新的查询序列的操作信息;例如,在已获得搜索结果后,用户在搜索结果页面中的搜索输入框又进行输入操作,且该输入操作对应的新的查询序列与前次查询序列相关,例如两个查询序列中有部分查询关键字完全相同,则可确定用户在其搜索需求未被满足的情况下输入新的查询序列; [0022] I) user input operation information for the new query sequence; for example, after having obtained the search results, the user in the search results page the search box and perform input operations, and the new query sequence corresponding to the input operation and relevant previous query sequence, such as a query sequence in which the two parts of the same keyword query, you can query to determine the user to enter a new sequence in the case of their search needs unmet;

[0023] 2)用户对搜索结果的各个搜索结果项的划选操作信息;其中,所述划选操作信息包括但不限于用户对搜索结果的各个搜索结果项进行划选操作的次数;例如,根据鼠标点下的操作相关信息,如点下的位置坐标及点下的时间信息,以及相应地释放鼠标时该鼠标释放的操作相关信息,如释放的位置坐标及释放的时间信息,以记录该等操作为一次划选操作,同时,根据该点下的位置坐标与释放的位置坐标,确定该次划选操作对应的搜索结果项,并根据该点下的时间信息与放开的时间信息,确定该次划选操作的时长; [0023] 2) Plan selected user of search results each search result item operation information; wherein the selected operating frequency planning operation information includes, but is not limited to users of the search results for each search result item diced election; for example, According to information related to the operation under the mouse, the time information such as position coordinates and point at the next point, as well as operation-related information when you release the mouse accordingly release the mouse, such as the release position coordinates and time information released to record the and other operations as a draw election operations, while, according to the position coordinates of the position coordinates of the point of release under determine the sub-option plan corresponding to the operation of the search result items, and the time information at the point and time of release of information, determines that the second operation plan selected length;

[0024] 3)用户对搜索结果的各个搜索结果项的悬停操作信息; [0024] 3) the user hovers over the operation information of search results each search result item;

[0025] 其中,所述用户对所述搜索结果的各个搜索结果项的悬停操作信息包括以下至少任一项: [0025] wherein the user hovers operating information for the search results of each search result item includes at least one of any of the following:

[0026] a)用户在搜索结果的各个搜索结果项上的悬停操作次数;例如,实时地获取鼠标移入搜索结果的某个搜索结果项所在区域的时间以及移出该区域的时间,当移入时间与移出时间的时间间隔超过预定时间间隔阈值时,记录为一次悬停操作,进而统计用户在该搜索结果所在搜索结果页面中的总的悬停操作次数; [0026] a) the user hovers the number of operations on the search results for each search result item; time, for example, real-time access to the mouse into the search results of a search result entry area and out of the area where the time when time moved out of time with the time interval exceeds a predetermined time interval threshold value, recorded as a hovering operations, and then hover users of statistics total number of operations in the search results where the search results page;

[0027] b)用户在搜索结果的各个搜索结果项上的每次悬停操作的持续时间;例如,实时地获取鼠标移入搜索结果的某个搜索结果项所在区域的时间以及移出该区域的时间,记录移入时间与移出时间的时间间隔,即每次悬停操作的持续时间。 [0027] b) users on the search results for each search result item duration of the operation of each hovering; for example, real-time access to the mouse into the search results of a search result entry area and out of the area where the time , record time and out of time into intervals that the duration of each operation hover.

[0028] 本领域技术人员应能理解上述悬停操作信息仅为举例,其他现有的或今后可能出现的悬停操作信息如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0028] skilled in the art should be understood that the above example only hover operating information, other existing or possible future hover operating information as applicable to the present invention, it should also be included within the scope of the present invention, and incorporated herein by reference.

[0029] 本领域技术人员应能理解上述非点击操作信息仅为举例,其他现有的或今后可能出现的非点击操作信息如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0029] skilled in the art should be understood that the above information is only an example of non-click operation, other existing or future non-click operation information may arise as applicable to the present invention, it should also be included within the scope of the present invention, and incorporated herein by reference.

[0030] 在此,所述获取非点击操作信息的方式包括但不限于以下任一情形:[0031] I)操作信息获取装置111获取一个用户通过用户设备对待评价的基于相同查询序列的搜索结果执行的非点击操作信息; [0030] In this case, the non-acquisition mode click operation information includes, but is not limited to, any of the following situations: [0031] I) the operation information acquisition means 111 acquires a user via the user equipment to treat the evaluation results based on the same search query sequence Click to perform non-operational information;

[0032] 2)操作信息获取装置111应事件触发实时地、或周期地接收来自第三方设备发送的多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息。 [0032] 2) the operation information obtaining means 111 to be triggered in real-time event, or from a third-party user equipment receiving a plurality of transmission treat periodically evaluated based on the same search query sequence non-click operation information.

[0033] 在一示例中,当评价设备I为网络设备时,首先,用户借助用户设备的交互装置,包括但不限于键盘、鼠标、遥控器、触摸板、或手写设备,与用户设备的浏览器软件或客户端软件进行交互。 [0033] In one example, the time when I evaluate equipment for network equipment, first of all, the user by means of user interaction means equipment, including but not limited to, a keyboard, mouse, remote control, touchpad, or handwriting device, and the user equipment Browse software or client software to interact. 以鼠标为例,用户在用户设备的浏览器软件的搜索结果页面中进行划选操作时,该用户设备实时地获取用户对搜索结果的某一搜索结果项的划选操作,例如用户设备首先获取鼠标点下的操作相关信息,如点下的位置坐标及点下的时间信息,接着当释放该鼠标时,获取该鼠标释放的操作相关信息,如释放的位置坐标及释放的时间信息,并记录该次操作为划选操作,同时,根据该点下的位置坐标与释放的位置坐标,确定该次划选操作对应的搜索结果项,并根据该点下的时间信息与释放的时间信息,确定该次划选操作的时长;从而确定与该用户划选操作相对应的非点击操作信息,然后将该非点击操作信息通过约定的通信方式发送至评价设备I;接着,操作信息获取装置111实时地接收该非点击操作信息。 In the mouse, for example, when the user selected operating plan in the search results page a user device browser software, the user equipment in real-time access to user operation of the plan selected search results a search result item, such as a user device first acquisition Operating under the mouse-related information, such as location coordinates and time information at the point of the next point, and then when you release the mouse, the acquisition time information about the location coordinates of the mouse release operation-related information, such as the release and the release and record The operations of the operation plan is selected, while, according to the position coordinates of the position coordinates of the point of release under the determined corresponding to the second operation plan selected search terms, and the time information and the time information of the point is released under determined The second operation plan selected length of time; click operation in order to determine the non-user information with the designated operation corresponding to the option, and then click on the non-operational information transmitted to the evaluation device via communication I agreed; Next, the operation information acquisition means 111 in real time Click for receiving the non-operational information.

[0034] 在另一示例中,操作信息获取装置111经由第三方设备提供的应用编程接口(API),受预定条件或事件触发地、或定期地向该第三方设备发送接收多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息的请求消息,并接收该第三方设备响应于该请求消息返回的多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息。 [0034] In another example, the operation information acquisition means 111 provided via a third-party device application programming interface (API), subject to a predetermined condition or event-triggered, or to the third-party device periodically transmitting and receiving a plurality of user evaluation treat Based on non-click operation information request message search results for the same query sequence of execution and the third-party device in response to receiving a plurality of users to the request message to return to take the evaluation of non-click operation information sequence based on the search results for the same query execution . 在又一示例中,第三方设备主动向评价设备I推送多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息,操作信息获取装置111接收该多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息。 In yet another example, the third instrument reviews the initiative to push a plurality of user devices I treat treat evaluated based on evaluation of the search result information non-click operation performed by the same query sequence, the operation information acquisition means 111 receives the plurality of users based on the same Non-clicks the search query results of the execution sequence.

[0035] 本领域技术人员应能理解上述获取非点击操作信息的方式仅为举例,其他现有的或今后可能出现的获取非点击操作信息的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0035] skilled in the art should be understood that the above information to obtain a non-click operation way of example only, other existing non-click operation to obtain information or that may arise in the future as applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0036] 接着,评价装置112根据操作信息获取装置111获取的非点击操作信息,对搜索结果进行评价。 [0036] Next, the evaluation device 112 to obtain a non-click operation information acquisition device 111 according to the operation information, the search results were evaluated.

[0037] 在此,根据预定的评价规则对所述搜索结果进行评价的情形包括但不限于以下至少任一项: [0037] In this case, according to circumstances predetermined evaluation rules evaluate the search results include, but are not limited to, any of the following at least one of:

[0038] I)用户在获得搜索结果后输入新的查询序列; [0038] I) users get search results after entering a new query sequence;

[0039] 例如,若用户在获得搜索结果后在搜索结果页面中重新输入新的查询序列,则评价装置112确定该搜索结果的评价等级为低; Rank [0039] For example, if a user in obtaining the search results on the search results page, re-enter the new query sequence, the evaluation unit 112 determines that the search results is low;

[0040] 2)用户在搜索结果的各个搜索结果项的划选次数超过预定划选次数阈值; [0040] 2) the number of users in planning the election results of each search term of search results exceeds a predetermined threshold number selected plan;

[0041] 例如,若用户在搜索结果的各个搜索结果项的划选次数超过预定划选次数阈值范围最大值,则评价装置112确定该搜索结果的评价等级为高; Rank [0041] For example, if the user selected the designated number of times each search result item search results exceeds a predetermined threshold value maximum stroke frequency range is selected, the evaluation unit 112 determines that the search result is high;

[0042] 3)用户在搜索结果的各个搜索结果项的悬停次数超过预定悬停次数阈值; [0042] 3) the user hovers over each search result item number of search results exceeds a predetermined threshold number hovers;

[0043] 例如,若用户在搜索结果的各个搜索结果项的悬停次数超过预定悬停次数阈值范围最大值,则评价装置112确定该搜索结果的评价等级为高; [0043] For example, if a user hovers over the number of search results for each search result item hover over a predetermined frequency range of the maximum threshold value, the evaluation unit 112 determines that the search results evaluation level is high;

[0044] 4)用户在搜索结果的各个搜索结果项的悬停时长超过预定悬停时长阈值;[0045] 例如,若用户在搜索结果的各个搜索结果项的悬停时长超过预定悬停时长阈值范围最大值,则评价装置112确定该搜索结果的评价等级为高。 When the [0044] 4) when the user hovers over the search results for each search result item longer than a predetermined hover long threshold value; [0045] For example, if users hover the search results for each search result item longer than a predetermined hover length threshold maximum range, the evaluation unit 112 determines that the search results evaluation level is high.

[0046] 本领域技术人员应能理解,上述各项预定的评价规则不仅可以单独用于评价装置对搜索结果进行评价,还可以将其中多项结合用于评价装置对搜索结果进行评价。 [0046] The skilled in the art will appreciate that the above predetermined evaluation rules can not only be used for the evaluation device to evaluate the search results, many of which can also be used to assess the binding means to evaluate the results of the search.

[0047] 在此,对所述搜索结果进行评价的评价标准包括但不限于以下任一形式: [0047] In this case, the search results for the evaluation of the evaluation criteria include, but are not limited to, any of the following forms:

[0048] a)预定评价等级,如预定评价等级为高、中、低;例如,预定多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后均输入新的查询序列且未对各个搜索结果项有划选、悬停等操作,则评价等级为低级;再例如,预定多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,对该搜索结果的某一搜索结果项的划选次数超过预定划选次数阈值范围最大值,则评价等级为中级;又例如,预设多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,符合上述对搜索结果进行评价的情形2)、3)、4)中的两项或两项以上,且未输入新的查询序列,则评价等级为高级; [0048] a) predetermined evaluation rating, as scheduled Rank as high, medium, low; for example, a predetermined plurality of users in more than 80% of users to get search results based on the same query sequence after both the query sequence and not enter a new each search result items are designated election, hover and other operations, the evaluation level is low; another example, the predetermined plurality of users in more than 80% of users to get search results based on the same after the query sequence, the result of a search choose a designated number of search result items exceeds a predetermined threshold range plan selected maximum number of times, it was evaluated for the intermediate grade; another example, the preset multiple users in more than 80% of users get the search results based on the same query sequence, in line with case evaluation of the search results above 2), 3), 4) two or more, and did not enter a new query sequence, the evaluation grade senior;

[0049] b)预定评价标准为好/不好,例如,如果多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后均输入新的查询序列且未对各个搜索结果项有划选、悬停等操作,则评价结果为不好;又例如,如果多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,符合上述对搜索结果进行评价的情形2)、3)、4)中的两项或两项以上,且为输入新的查询序列,则评价结果为好。 [0049] b) a predetermined evaluation criteria for the good / bad, for example, if multiple users in more than 80% of users to get search results based on the same query sequence after both enter a new query sequence and did not have the results for each search term draw election, hover and other operations, the evaluation result is bad; another example, if a plurality of users over 80% of users get search results based on the same after the query sequence, in line with the situation on the search results were evaluated by the two) , 3), 4) two or more, and is entering a new query sequence, the evaluation result is good.

[0050] 在一示例中,非点击操作信息示出多个用户中85%的用户在基于同一查询序列“丁丁历险记”的搜索结果的搜索结果页面中重新输入新的查询序列,且对该搜索结果的各个搜索结果项没有划选、悬停等操作,则评价装置112对该搜索结果进行评价的评价等级为低。 [0050] In one example, the non-click operation information showing a plurality of users 85% of users based on the same query sequence "Tintin," the search results pages of search results re-enter a new query sequence and the search results for each search result item selected is not classified, hover and other operations, the evaluation unit 112 for evaluating the results of the search evaluation level is low.

[0051] 优选地,还可根据预定的加权规则给上述预定评价规则赋予权重,评价装置112根据该等权重,加权获取非点击操作信息所对应的评价值以确定评价等级,从而实现对搜索结果进行评价。 [0051] Preferably, also based on a predetermined weighting rule to the predetermined rule is weighted evaluation, the evaluation device 112 in accordance with such a weight, weighted to obtain non-click operation information corresponding to the evaluation value to determine the evaluation level, enabling the search results were evaluated.

[0052] 在一示例中,预设的加权规则示出: [0052] In one example, the default weighted rules shows:

[0053] I)当对搜索结果进行评价的情形为:多个用户中80%以上的用户在基于相同查询序列的获得搜索结果后输入新的查询序列,则该情形对应的评价值为-10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.5, [0053] I) When the circumstances of the search results were evaluated as follows: a plurality of users in more than 80% of users enter a new query sequence obtained after the search results based on the same query sequence corresponding evaluation of the situation is -10 and the evaluation value is used to determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.5,

[0054] 2)当对搜索结果进行评价的情形为:多个用户在搜索结果的各个搜索结果项的划选次数均值超过预定划选次数阈值范围最大值3次,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.2, [0054] 2) When the circumstances of the search results were evaluated as follows: the number of multiple users draw each search result item selected search results mean more than a predetermined threshold frequency range plan selected maximum three times, then the situation corresponding evaluation value 10, and the evaluation value in the evaluation value of the entire non-click operation information is used to determine the corresponding weight has 0.2,

[0055] 3)多个用户在搜索结果的各个搜索结果项的悬停次数均值超过预定悬停次数阈值范围最大值5次,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.2, [0055] 3) the number of multiple users over to each search result item search results mean more than a predetermined number of times over to five times the maximum threshold range, corresponding to the evaluation of the situation is 10, and the evaluation value for determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.2,

[0056] 4)多个用户在搜索结果的各个搜索结果项的悬停时长均值超过预定悬停时长阈值范围最大值120秒,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.1 ; [0056] 4) When multiple users hover the search results for each search result item hover length exceeds a predetermined length of the average threshold range maximum 120 seconds, corresponding to evaluate the situation is 10, and the evaluation value for determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.1;

[0057] 非点击操作信息示出多个用户在基于同一查询序列“国家大剧院”的搜索结果的搜索结果页面中对各个搜索结果项划选操作次数均值为5次,即超过预定划选次数阈值范围最大值3次,该等用户在该搜索结果页面中对各个搜索结果项的悬停次数均值为6次,即超过预定悬停次数阈值范围最大值5次,该等用户在该搜索结果页面中对各个搜索结果项的悬停时长均超过预定悬停时长阈值范围最大值120秒,且该等用户中90%的用户在该搜索结果页面中未输入新的查询序列,则评价装置112对该等非点击操作信息所对应的评价值加权获取对搜索结果的评价值为5( = 10X0.2+10X0.2+10X0.1),大于预定权值范围最大值3,确定评价等级为高级。 [0057] Non-click operation information showing a plurality of users based on the same query sequence "National Theatre," the search results page of search results for each search term planning election results mean five times the number of operations, or more than a predetermined number of times designated election 3 times the maximum threshold range, such subscribers in the search results page to hover mean frequency of each search result item is 6 times, or more than a predetermined number of times over to five times the maximum threshold range, such subscribers in the search results When the page of each search result hover long term average exceeds a predetermined threshold value hovers long range maximum 120 seconds, and these users 90% of users do not enter a new query sequence in the search results page, the evaluation device 112 Click on this and other non-operational information corresponding to the evaluation value weighted to obtain the search results rating is 5 (= 10X0.2 + 10X0.2 + 10X0.1), is greater than a predetermined maximum range of weights 3, determine the evaluation class Advanced.

[0058] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0058] The skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0059] 优选地,操作信息获取装置111和评价装置112之间是持续不断地工作。 [0059] Preferably, the operation information acquisition means 111 between means 112 and the evaluation is ongoing work. 具体地,操作信息获取装置111持续地获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息;接着,评价装置112也持续地根据所述非点击操作信息,对所述搜索结果进行评价。 Specifically, the operation information acquisition device 111 continues to get one or more users to take the evaluation based on the same search query sequence and results-click operation information; then, the evaluation device 112 according to the non-continuous click operation information, to the said search results were evaluated. 在此,本领域技术人员应理解“持续”是指各装置不断进行上述非点击操作信息的获取、对搜索结果的评价,直至满足预定停止条件,例如请求获取装置111在较长时间内停止对非点击操作信息的获取。 In this case, the skilled artisan will appreciate that "persistent" means that each device constantly get the non-click operation information, the evaluation of the results of the search until it satisfies a predetermined stop condition, such as a request acquisition means 111 in a long time to stop Non-clicks access to information.

[0060] 优选地(参照图1),评价装置112根据非点击操作信息以及该等非点击操作信息发生的时间信息,对搜索结果进行评价。 [0060] Preferably (see Figure 1), the evaluation device 112 according to the non-click operation information and time information such non-operational information click occurs, evaluate the results of the search.

[0061] 在此,所述非点击操作信息包括用户输入新的查询序列的操作信息、对搜索结果的各个搜索结果项的划选操作信息、悬停操作信息以及该等输入、划选、悬停操作发生的时间信息。 [0061] In this case, the non-click operation information includes a user input query sequence of operation of the new information, the election draw operational information, hover the operation of such input information and the search results for each search result item, designated election, suspended stop operation time information occurred.

[0062] 在此,用户的在后操作可以代表对其在前操作的否定,由此在后发生的非点击操作的评价权重大于在前发生的非点击操作的评价权重。 [0062] In this case, the user after the operation on behalf of its former negative actions, which in the first major evaluation of the right to non-click operation of the non-occurrence of re-evaluation right after the click operation occurred.

[0063] 在一示例中,非点击操作信息示出某一用户在获得搜索结果后未输入新的查询序列,同时对搜索结果中的搜索结果项A进行划选操作且该划选操作结束的时间为12:01PM,且该用户对该等搜索结果中的搜索结果项B也进行划选操作且该划选操作结束的时间为12:03PM ;则评价装置112根据预定的加权规则,对在后发生的对搜索结果项B的划选操作赋予评价值20,且权重0.8,对搜索结果项A的划选操作赋予评价值10,且的权重0.2,接着对该等非点击操作信息所对应的权重加权获取权值为9 ( = (20X0.8+10X0.2)/2),位于预定权值范围出至11)中,确定评价等级为中级。 [0063] In one example, the non-click operation information shows that after obtaining a user's search query results of the new sequence is not entered, while the search results A search result items were selected operating plan and the plan selected operation end time is 12:01 PM, and the users of the other search results in the search result item B was also selected operating plan and the plan selected operation end time is 12:03 PM; it was evaluated according to a predetermined weighting 112 regular fixture on the After the occurrence of stroke selected operating search result item B of giving an evaluation value 20, and the weight 0.8, giving an evaluation value 10 to draw selected operating search result item A, and the weight of 0.2, then the other non-click operation information corresponding to the weight weighted get the right value of 9 (= (20X0.8 + 10X0.2) / 2), at a predetermined weight range out to 11), determine the evaluation rating to medium.

[0064] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0064] skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0065] 更优选地(参照图1),评价装置112根据非点击操作信息,并结合用户对搜索结果的点击操作信息,对该搜索结果进行评价。 [0065] More preferably, (see Fig. 1), the evaluation device 112 according to the non-click operation information, and information with the user clicks on the search results, the search results were evaluated.

[0066] 具体地,评价装置112可对非点击操作和点击操作赋予权重,根据预定加权规则,获取加权后的评价值,以确定对搜索结果的评价等级。 [0066] In particular, the evaluation device 112 may be non-click operation and click operation is weighted according to a predetermined weighting rules, obtain an evaluation value weighted to determine the search results of the evaluation level.

[0067] 在一示例中,预定加权规则示出:点击操作对应的评价权重为0.6,非点击操作的评价权重为0.4 ;用户对各个搜索结果项有点击操作,且该点击操作对应的评价值为8,同时根据非点击操作信息确定与其相应的评价等级为高、其权值值为为18,则评价装置112计算获得权值12( = 8X0.6+18X0.4),12大于预定评价等级阈值范围最大值11,则确定评价等级为高级。 [0067] In one example, the predetermined weighting rules shown: Click evaluate right operation corresponds to a weight of 0.6, non-click operation evaluation weight of 0.4; user clicks each search result items, and evaluate the value of the clicks corresponding 8, while determining its corresponding rating level is high, its weight is 18, the evaluation device 112 calculated weights 12 (= 8X0.6 + 18X0.4) The non-click operation information, 12 more than the predetermined evaluation maximum 11 level threshold range, then determine the evaluation class advanced.

[0068] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0068] skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0069] 在此,将一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作和点击操作相结合,可将用户通过点击搜索结果以满足搜索需求和不用点击即可满足搜索需求的情形均包含至评价标准中,进一步提高对搜索结果进行评价的准确性。 [0069] In this case, one or more user treatment based on the same search query sequence non-clicks and clicks combined evaluation, the user can click on the search result to meet the search needs and do not click to satisfy the search demand situation evaluation criteria are included to further improve the accuracy of search results evaluation.

[0070] 图2示出根据本发明一个方面的评价搜索结果的方法流程图。 [0070] Figure 2 shows a flow chart of a method for the evaluation of the search results to one aspect of the present invention.

[0071] 在此,评价设备I可以是一个网络设备或位于其中的功能模块,其中,网络设备包括但不限于计算机、网络主机、单个网络服务器、多个网络服务器集或多个服务器构成的云,在此,云由基于云计算(Cloud Computing)的大量计算机或网络服务器构成,其中,云计算是分布式计算的一种,由一群松散耦合的计算机集组成的一个超级虚拟计算机;评价设备I也可以是用户设备,其包括但不限于任何一种可与用户通过键盘、遥控器、触摸板、或声控设备进行人机交互的电子产品,例如计算机、智能手机、PDA、游戏机、或IPTV等。 [0071] Here, the evaluation device I may be a network device or function modules located therein, wherein the network devices include, but are not limited to computers, network host, a single network server and multiple network servers sets or more servers configured Cloud In this, the cloud from the cloud-based computing (Cloud Computing) A number of computers or a network server configuration, where cloud computing is a distributed computing, a super virtual computer by the computer sets consisting of a group of loosely coupled; evaluation equipment I or a user equipment, including but not limited to any one with the user through the keyboard, remote control, touchpad, or interactive voice device electronic products such as computers, smart phones, PDA, game consoles, or IPTV and so on.

[0072] 以下参照图2来对评价设备I评价搜索结果的过程进行详细描述: [0072] Referring to FIG. 2 for the following evaluation device I evaluation results of the search process is described in detail:

[0073] 具体地,在步骤SI中,评价设备I获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息。 [0073] Specifically, in step SI, the evaluation device I get one or more users to take the evaluation of non-operational information click on the search results for the same query sequence based.

[0074] 在此,所述非点击操作信息包括但不限于以下任一项: [0074] In this case, the non-click operation information includes, but is not limited to any of the following:

[0075] I)用户输入新的查询序列的操作信息;例如,在已获得搜索结果后,用户在搜索结果页面中的搜索输入框又进行输入操作,且该输入操作对应的新的查询序列与前次查询序列相关,例如两个查询序列中有部分查询关键字完全相同,则可确定用户在其搜索需求未被满足的情况下输入新的查询序列; [0075] I) user input operation information for the new query sequence; for example, after having obtained the search results, the user in the search results page the search box and perform input operations, and the new query sequence corresponding to the input operation and relevant previous query sequence, such as a query sequence in which the two parts of the same keyword query, you can query to determine the user to enter a new sequence in the case of their search needs unmet;

[0076] 2)用户对搜索结果的各个搜索结果项的划选操作信息;其中,所述划选操作信息包括但不限于用户对搜索结果的各个搜索结果项进行划选操作的次数;例如,根据鼠标点下的操作相关信息,如点下的位置坐标及点下的时间信息,以及相应地释放鼠标时该鼠标释放的操作相关信息,如释放的位置坐标及释放的时间信息,以记录该等操作为一次划选操作,同时,根据该点下的位置坐标与释放的位置坐标,确定该次划选操作对应的搜索结果项,并根据该点下的时间信息与放开的时间信息,确定该次划选操作的时长; [0076] 2) Plan selected user of search results each search result item operation information; wherein the selected operating frequency planning operation information includes, but is not limited to users of the search results for each search result item diced election; for example, According to information related to the operation under the mouse, the time information such as position coordinates and point at the next point, as well as operation-related information when you release the mouse accordingly release the mouse, such as the release position coordinates and time information released to record the and other operations as a draw election operations, while, according to the position coordinates of the position coordinates of the point of release under determine the sub-option plan corresponding to the operation of the search result items, and the time information at the point and time of release of information, determines that the second operation plan selected length;

[0077] 3)用户对搜索结果的各个搜索结果项的悬停操作信息; [0077] 3) the user hovers over the operation information of search results each search result item;

[0078] 其中,所述用户对所述搜索结果的各个搜索结果项的悬停操作信息包括以下至少任一项: [0078] wherein the user hovers operating information for the search results of each search result item includes at least one of any of the following:

[0079] a)用户在搜索结果的各个搜索结果项上的悬停操作次数;例如,实时地获取鼠标移入搜索结果的某个搜索结果项所在区域的时间以及移出该区域的时间,当移入时间与移出时间的时间间隔超过预定时间间隔阈值时,记录为一次悬停操作,进而统计用户在该搜索结果所在搜索结果页面中的总的悬停操作次数; [0079] a) the user hovers the number of operations on the search results for each search result item; time, for example, real-time access to the mouse into the search results of a search result entry area and out of the area where the time when time moved out of time with the time interval exceeds a predetermined time interval threshold value, recorded as a hovering operations, and then hover users of statistics total number of operations in the search results where the search results page;

[0080] b)用户在搜索结果的各个搜索结果项上的每次悬停操作的持续时间;例如,实时地获取鼠标移入搜索结果的某个搜索结果项所在区域的时间以及移出该区域的时间,记录移入时间与移出时间的时间间隔,即每次悬停操作的持续时间。 [0080] b) users on the search results for each search result item duration of the operation of each hovering; for example, real-time access to the mouse into the search results of a search result entry area and out of the area where the time , record time and out of time into intervals that the duration of each operation hover. [0081] 本领域技术人员应能理解上述悬停操作信息仅为举例,其他现有的或今后可能出现的悬停操作信息如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0081] skilled in the art should be understood that the above example only hover operating information, other existing or possible future hover operating information as applicable to the present invention, it should also be included within the scope of the present invention, and incorporated herein by reference.

[0082] 本领域技术人员应能理解上述非点击操作信息仅为举例,其他现有的或今后可能出现的非点击操作信息如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0082] skilled in the art should be understood that the above information is only an example of non-click operation, other existing or future non-click operation information may arise as applicable to the present invention, it should also be included within the scope of the present invention, and incorporated herein by reference.

[0083] 在此,所述获取非点击操作信息的方式包括但不限于以下任一情形: [0083] In this case, the acquiring non-click operation information including but not limited to any of the following situations:

[0084] I)在步骤SI中,评价设备I获取一个用户通过用户设备对待评价的基于相同查询序列的搜索结果执行的非点击操作信息; [0084] I) in step SI, the evaluation device I get a user evaluation treat non-click operation information based on the search results for the same query sequence performed by the user equipment;

[0085] 2)在步骤SI中,评价设备I应事件触发实时地、或周期地接收来自第三方设备发送的多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息。 [0085] 2) In step SI, the evaluation device triggering event I should be in real time, from a third party or a user equipment receiving a plurality of transmission treat periodically evaluated based on the same search query sequence non-click operation information.

[0086] 在一示例中,当评价设备I为网络设备时,首先,用户借助与用户设备的交互方式,包括但不限于键盘、鼠标、遥控器、触摸板、或手写设备,与用户设备的浏览器软件或客户端软件进行交互。 [0086] In one example, when the evaluation device I network equipment, first of all, the user interacts with the user by means of the device, including but not limited to a keyboard, mouse, remote control, touchpad, or handwriting device, and the user equipment browser software or client software to interact. 以鼠标为例,用户在用户设备的浏览器软件的搜索结果页面中进行划选操作时,该用户设备实时地获取用户对搜索结果的某一搜索结果项的划选操作,例如用户设备首先获取鼠标点下的操作相关信息,如点下的位置坐标及点下的时间信息,接着当释放该鼠标时,获取该鼠标释放的操作相关信息,如释放的位置坐标及释放的时间信息,并记录该次操作为划选操作,同时,根据该点下的位置坐标与释放的位置坐标,确定该次划选操作对应的搜索结果项,并根据该点下的时间信息与释放的时间信息,确定该次划选操作的时长;从而确定与该用户划选操作相对应的非点击操作信息,然后将该非点击操作信息通过约定的通信方式发送至评价设备I;接着,在步骤Si中,评价设备I实时地接收该非点击操作信息。 In the mouse, for example, when the user selected operating plan in the search results page a user device browser software, the user equipment in real-time access to user operation of the plan selected search results a search result item, such as a user device first acquisition Operating under the mouse-related information, such as location coordinates and time information at the point of the next point, and then when you release the mouse, the acquisition time information about the location coordinates of the mouse release operation-related information, such as the release and the release and record The operations of the operation plan is selected, while, according to the position coordinates of the position coordinates of the point of release under the determined corresponding to the second operation plan selected search terms, and the time information and the time information of the point is released under determined The second stroke length of time selected operation; to determine the user selected operating plan corresponding non-click operation information, then the information is sent to a non-click operation evaluation device via communication I agreed; then, in step Si, the evaluation equipment I receive the non-real-time information click operation.

[0087] 在另一示例中,在步骤SI中,评价设备I经由第三方设备提供的应用编程接口(API),受预定条件或事件触发地、或定期地向该第三方设备发送接收多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息的请求消息,并接收该第三方设备响应于该请求消息返回的多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息。 [0087] In another example, in step SI, the evaluation equipment via a third-party device I provided application programming interface (API), subject to a predetermined condition or event-triggered, or in regularly to the transmitting and receiving a plurality of third-party devices Based on user evaluation treat non-click operation information request message search results for the same query sequence of execution and the third-party device in response to receiving a plurality of users to treat the request message to return search results based on the same non-execution of the query sequence evaluation click operation information. 在又一示例中,第三方设备主动向评价设备I推送多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息,在步骤SI中,评价设备I接收该多个用户对待评价的基于相同查询序列的搜索结果执行的非点击操作信息。 In yet another example, a third-party device evaluation device I push the initiative to treat multiple users based on evaluation of non-operational information click on the search results for the same query sequence is executed, in step SI, the evaluation equipment I receive the plurality of user evaluation treat Non-click operation information to perform the same search results based on the query sequence.

[0088] 本领域技术人员应能理解上述获取非点击操作信息的方式仅为举例,其他现有的或今后可能出现的获取非点击操作信息的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0088] skilled in the art should be understood that the above information to obtain a non-click operation way of example only, other existing non-click operation to obtain information or that may arise in the future as applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0089] 接着,在步骤S2中,评价设备I根据其在步骤SI中获取的非点击操作信息,对搜索结果进行评价。 [0089] Next, in step S2, the evaluation device I according to the non-click operation information acquired in step SI, the search results were evaluated.

[0090] 在此,根据预定的评价规则对所述搜索结果进行评价的情形包括但不限于以下至少任一项: [0090] In this case, according to circumstances predetermined evaluation rules evaluate the search results include, but are not limited to, any of the following at least one of:

[0091] I)用户在获得搜索结果后输入新的查询序列; [0091] I) users get search results after entering a new query sequence;

[0092] 例如,若用户在获得搜索结果后在搜索结果页面中重新输入新的查询序列,则在步骤S2中,评价设备I确定该搜索结果的评价等级为低;[0093] 2)用户在搜索结果的各个搜索结果项的划选次数超过预定划选次数阈值; [0092] For example, after obtaining the search results if the user to re-enter the new query sequence in the search results page, then in step S2, the evaluation device determines that the search results I evaluation level is low; [0093] 2) Users Plan selected each search result item number of search results exceeds a predetermined threshold number selected plan;

[0094] 例如,若用户在搜索结果的各个搜索结果项的划选次数超过预定划选次数阈值范围最大值,则在步骤S2中,评价设备I确定该搜索结果的评价等级为高; [0094] For example, if the user selected the designated number of times each search result item search results exceeds a predetermined threshold range plan selected maximum number of times, then in step S2, the evaluation device determines that the search results I evaluation level is high;

[0095] 3)用户在搜索结果的各个搜索结果项的悬停次数超过预定悬停次数阈值; [0095] 3) the user hovers over each search result item number of search results exceeds a predetermined threshold number hovers;

[0096] 例如,若用户在搜索结果的各个搜索结果项的悬停次数超过预定悬停次数阈值范围最大值,则在步骤S2中,评价设备I确定该搜索结果的评价等级为高; [0096] For example, if the maximum number of times a user hovers the search results for each search result item hover over a predetermined number of times threshold range, then in step S2, the evaluation device determines that the search results I evaluation level is high;

[0097] 4)用户在搜索结果的各个搜索结果项的悬停时长超过预定悬停时长阈值; Long threshold [0097] 4) when the user hovers over the search results for each search result item for longer than a predetermined hover;

[0098] 例如,若用户在搜索结果的各个搜索结果项的悬停时长超过预定悬停时长阈值范围最大值,则在步骤S2中,评价设备I确定该搜索结果的评价等级为高。 [0098] For example, if users hover the search results for each search result item hover longer than a predetermined maximum length threshold range, then in step S2, the evaluation device determines that the search results I evaluation level is high.

[0099] 本领域技术人员应能理解,上述各项预定的评价规则不仅可以单独用于评价设备I对搜索结果进行评价,还可以将其中多项结合用于评价设备I对搜索结果进行评价。 [0099] The skilled in the art will appreciate that the above predetermined evaluation rules can not only be used for the evaluation device I evaluated the search results, many of which can also be used to evaluate the equipment I combine search results were evaluated.

[0100] 在此,对所述搜索结果进行评价的评价标准包括但不限于以下任一形式: [0100] In this case, the search results for the evaluation of the evaluation criteria include, but are not limited to, any of the following forms:

[0101] a)预定评价等级,如预定评价等级为高、中、低;例如,预定多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后均输入新的查询序列且未对各个搜索结果项有划选、悬停等操作,则评价等级为低级;再例如,预定多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,对该搜索结果的某一搜索结果项的划选次数超过预定划选次数阈值范围最大值,则评价等级为中级;又例如,预设多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,符合上述对搜索结果进行评价的情形2)、3)、4)中的两项或两项以上,且未输入新的查询序列,则评价等级为高级; [0101] a) predetermined evaluation rating, as scheduled Rank as high, medium, low; for example, a predetermined plurality of users in more than 80% of users to get search results based on the same query sequence after both the query sequence and not enter a new each search result items are designated election, hover and other operations, the evaluation level is low; another example, the predetermined plurality of users in more than 80% of users to get search results based on the same after the query sequence, the result of a search choose a designated number of search result items exceeds a predetermined threshold range plan selected maximum number of times, it was evaluated for the intermediate grade; another example, the preset multiple users in more than 80% of users get the search results based on the same query sequence, in line with case evaluation of the search results above 2), 3), 4) two or more, and did not enter a new query sequence, the evaluation grade senior;

[0102] b)预定评价标准为好/不好,例如,如果多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后均输入新的查询序列且未对各个搜索结果项有划选、悬停等操作,则评价结果为不好;又例如,如果多个用户中80%以上的用户在获得基于相同查询序列的搜索结果后,符合上述对搜索结果进行评价的情形2)、3)、4)中的两项或两项以上,且为输入新的查询序列,则评价结果为好。 [0102] b) a predetermined evaluation criteria for the good / bad, for example, if multiple users in more than 80% of users to get search results based on the same query sequence after both enter a new query sequence and did not have the results for each search term draw election, hover and other operations, the evaluation result is bad; another example, if a plurality of users over 80% of users get search results based on the same after the query sequence, in line with the situation on the search results were evaluated by the two) , 3), 4) two or more, and is entering a new query sequence, the evaluation result is good.

[0103] 在一示例中,非点击操作信息示出多个用户中85%的用户在基于同一查询序列“丁丁历险记”的搜索结果的搜索结果页面中重新输入新的查询序列,且对该搜索结果的各个搜索结果项没有划选、悬停等操作,则在步骤S2中,评价设备I对该搜索结果进行评价的评价等级为低。 [0103] In one example, the non-click operation information showing a plurality of users 85% of users based on the same query sequence "Tintin," the search results pages of search results re-enter a new query sequence and the search results for each search result item selected is not classified, hover and other operations, then in step S2, the evaluation device I evaluated the search results of the evaluation level is low.

[0104] 优选地,还可根据预定的加权规则给上述预定评价规则赋予权重,在步骤S2中,评价设备I根据该等权重,加权获取非点击操作信息所对应的评价值以确定评价等级,从而实现对搜索结果进行评价。 [0104] Preferably, also based on a predetermined weighting rule to evaluate rules given above predetermined weight, in step S2, the evaluation equipment I have under such weight, weighted to obtain non-click operation information corresponding to the evaluation value to determine the evaluation rating, enabling evaluation of the search results.

[0105] 在一示例中,预设的加权规则示出: [0105] In one example, the default weighted rules shows:

[0106] I)当对搜索结果进行评价的情形为:多个用户中80%以上的用户在基于相同查询序列的获得搜索结果后输入新的查询序列,则该情形对应的评价值为-10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.5, [0106] I) When the circumstances of the search results were evaluated as follows: a plurality of users in more than 80% of users enter a new query sequence obtained after the search results based on the same query sequence corresponding evaluation of the situation is -10 and the evaluation value is used to determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.5,

[0107] 2)当对搜索结果进行评价的情形为:多个用户在搜索结果的各个搜索结果项的划选次数均值超过预定划选次数阈值范围最大值3次,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.2, [0107] 2) When the circumstances of the search results were evaluated as follows: the number of multiple users draw each search result item selected search results mean more than a predetermined threshold frequency range plan selected maximum three times, then the situation corresponding evaluation value 10, and the evaluation value in the evaluation value of the entire non-click operation information is used to determine the corresponding weight has 0.2,

[0108] 3)多个用户在搜索结果的各个搜索结果项的悬停次数均值超过预定悬停次数阈值范围最大值5次,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.2, [0108] 3) the number of multiple users over to each search result item search results mean more than a predetermined number of times over to five times the maximum threshold range, corresponding to the evaluation of the situation is 10, and the evaluation value for determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.2,

[0109] 4)多个用户在搜索结果的各个搜索结果项的悬停时长均值超过预定悬停时长阈值范围最大值120秒,则该情形对应的评价值为10,且该评价值在用于确定整个非点击操作信息所对应的评价值中所具有的权重为0.1 ; [0109] 4) When multiple users hover the search results for each search result item hover length exceeds a predetermined length of the average threshold range maximum 120 seconds, corresponding to evaluate the situation is 10, and the evaluation value for determine the entire non-click operation information corresponding to the evaluation value has a weight of 0.1;

[0110] 非点击操作信息示出多个用户在基于同一查询序列“国家大剧院”的搜索结果的搜索结果页面中对各个搜索结果项划选操作次数均值为5次,即超过预定划选次数阈值范围最大值3次,该等用户在该搜索结果页面中对各个搜索结果项的悬停次数均值为6次,即超过预定悬停次数阈值范围最大值5次,该等用户在该搜索结果页面中对各个搜索结果项的悬停时长均超过预定悬停时长阈值范围最大值120秒,且该等用户中90%的用户在该搜索结果页面中未输入新的查询序列,则在步骤S2中,评价设备I对该等非点击操作信息所对应的评价值加权获取对搜索结果的评价值为5( = 10X0.2+10X0.2+10X0.1),大于预定权值范围最大值3,确定评价等级为高级。 [0110] Non-click operation information showing a plurality of users based on the same query sequence "National Theatre," the search results page of search results for each search term planning election results mean five times the number of operations, or more than a predetermined number of times designated election 3 times the maximum threshold range, such subscribers in the search results page to hover mean frequency of each search result item is 6 times, or more than a predetermined number of times over to five times the maximum threshold range, such subscribers in the search results When the page of each search result hover long term average exceeds a predetermined threshold value hovers long range maximum 120 seconds, and these users 90% of users do not enter a new query sequence in the search results page, then in step S2 , the evaluation of such equipment I click operation information corresponding to the non-evaluation value weighted obtain the search results rating is 5 (= 10X0.2 + 10X0.2 + 10X0.1), greater than the predetermined weight range maximum 3 determine the evaluation grades for advanced.

[0111] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0111] skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0112] 优选地,评价设备I在步骤SI和步骤S2中是持续不断地工作。 [0112] Preferably, the evaluation device I was constantly in step SI and step S2. 具体地,在步骤SI中,评价设备I持续地获取一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作信息;接着,在步骤S2中,评价设备I也持续地根据所述非点击操作信息,对所述搜索结果进行评价。 Specifically, in step SI, the evaluation equipment I continued to get one or more users to take the evaluation based on the same search query sequence and results-click operation information; then, in step S2, the evaluation device I also continued according to the said non-click operation information, evaluate the results of the search. 在此,本领域技术人员应理解“持续”是指评价设备I在各步骤中不断进行上述非点击操作信息的获取、对搜索结果的评价,直至满足预定停止条件,例如评价设备I在较长时间内停止对非点击操作信息的获取。 In this case, the skilled artisan will appreciate that "persistent" refers to an evaluation device I in each step of the non-continuous click operation information acquisition, evaluation of the results of the search until it satisfies a predetermined stop condition, such as a longer evaluation equipment I time for non-stop access to information click operation.

[0113] 优选地(参照图2),在步骤S2中,评价设备I根据非点击操作信息以及该等非点击操作信息发生的时间信息,对搜索结果进行评价。 [0113] Preferably (see Fig. 2), in step S2, the evaluation device I according to the non-click operation information and time information such non-operational information click occurs, evaluate the results of the search.

[0114] 在此,所述非点击操作信息包括用户输入新的查询序列的操作信息、对搜索结果的各个搜索结果项的划选操作信息、悬停操作信息以及该等输入、划选、悬停操作发生的时间信息。 [0114] In this case, the non-click operation information includes a user input query sequence of operation of the new information, the election draw operational information, hover the operation of such input information and the search results for each search result item, designated election, suspended stop operation time information occurred.

[0115] 在此,用户的在后操作可以代表对其在前操作的否定,由此在后发生的非点击操作的评价权重大于在前发生的非点击操作的评价权重。 [0115] In this case, the user after the operation on behalf of its former negative actions, which in the first major evaluation of the right to non-click operation of the non-occurrence of re-evaluation right after the click operation occurred.

[0116] 在一示例中,非点击操作信息示出某一用户在获得搜索结果后未输入新的查询序列,同时对搜索结果中的搜索结果项A进行划选操作且该划选操作结束的时间为12:01PM,且该用户对该等搜索结果中的搜索结果项B也进行划选操作且该划选操作结束的时间为12:03PM ;则在步骤S2中,评价设备I根据预定的加权规则,对在后发生的对搜索结果项B的划选操作赋予评价值20,且权重0.8,对搜索结果项A的划选操作赋予评价值10,且的权重0.2,接着对该等非点击操作信息所对应的权重加权获取权值为9 (=(20X0.8+10X0.2)/2),位于预定权值范围(6至11)中,确定评价等级为中级。 [0116] In one example, the non-click operation information shows that after obtaining a user's search query results of the new sequence is not entered, while the search results A search result items were selected operating plan and the plan selected operation end time is 12:01 PM, and the users of the other search results in the search result item B was also selected operating plan and the plan selected End time is 12:03 PM; then in step S2, the evaluation device I according to a predetermined weighting rules, the search result item B of the plan selected operations in the aftermath of the given evaluation value 20, and the weight of 0.8, giving an evaluation value 10 to draw selected operating search result item A, and the weight of 0.2, then the other non- Right click operation information corresponding to the heavy weighting to obtain the right value of 9 (= (20X0.8 + 10X0.2) / 2), at a predetermined weight range (6-11), it is determined for the intermediate evaluation grades.

[0117] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0117] skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference. [0118] 更优选地(参照图2),在步骤S2中,评价设备I根据非点击操作信息,并结合用户对搜索结果的点击操作信息,对该搜索结果进行评价。 [01] More preferably, (see Fig. 2), in step S2, the evaluation device I according to the non-click operation information, and information with the user clicks on the search results, the search results were evaluated.

[0119] 具体地,在步骤S2中,评价设备I可对非点击操作和点击操作赋予权重,根据预定加权规则,获取加权后的评价值,以确定对搜索结果的评价等级。 [0119] Specifically, in step S2, the evaluation equipment I can operate non-clicks and clicks is weighted according to a predetermined weighting rules, obtain an evaluation value weighted to determine the search results of the evaluation level.

[0120] 在一示例中,预定加权规则示出:点击操作对应的评价权重为0.6,非点击操作的评价权重为0.4 ;用户对各个搜索结果项有点击操作,且该点击操作对应的评价值为8,同时根据非点击操作信息确定与其相应的评价等级为高、其权值值为为18,则在步骤S2中,评价设备I计算获得权值12( = 8X0.6+18X0.4),12大于预定评价等级阈值范围最大值11,则确定评价等级为高级。 [0120] In one example, the predetermined weighting rules shown: Click evaluate right operation corresponds to a weight of 0.6, non-click operation evaluation weight of 0.4; user clicks each search result items, and evaluate the value of the clicks corresponding 8, while according to the non-click operation information for determining its corresponding rating level is high, the weight value is 18, then in step S2, the evaluation device I calculated weight value 12 (= 8X0.6 + 18X0.4) 12 is greater than a predetermined threshold value range maximum evaluation level 11, then determine the evaluation class advanced.

[0121] 本领域技术人员应能理解上述对搜索结果进行评价的方式仅为举例,其他现有的或今后可能出现的对搜索结果进行评价的方式如可适用于本发明,也应包含在本发明保护范围以内,并以引用方式包含于此。 [0121] skilled in the art should be understood that the above manner to evaluate the results of the search is only an example, other existing or future evaluation of search results that may occur as a way applicable to the present invention, should also be included in this Within the scope of the invention, and is incorporated herein by reference.

[0122] 在此,将一个或多个用户对待评价的基于相同查询序列的搜索结果的非点击操作和点击操作相结合,可将用户通过点击搜索结果以满足搜索需求和不用点击即可满足搜索需求的情形均包含至评价标准中,进一步提高对搜索结果进行评价的准确性。 [0122] In this case, one or more user treatment based on the same search query sequence non-clicks and clicks combined evaluation, the user can click on the search result to meet the search needs and do not click to satisfy the search demand situation evaluation criteria are included to further improve the accuracy of search results evaluation.

[0123] 对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。 Case [0123] The present skilled in the art, the present invention is clearly not limited to the exemplary embodiments of the details, but without departing from the spirit or essential characteristics of the present invention, the present invention can be achieved in other specific forms. 因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。 Therefore, whether from what point of view, should be regarded as an exemplary embodiment, but not limiting the scope of the invention is defined by the appended claims rather than the foregoing description define, the appended claims are therefore intended to All changes which come within the meaning and range of equivalents of the elements in the present invention covers. 不应将权利要求中的任何附图标记视为限制所涉及的权利要求。 The claims should not be seen as the right to restrict any reference signs covered requirements. 此夕卜,显然“包括” 一词不排除其他单元或步骤,单数不排除复数。 Bu this evening, apparently "comprising" does not exclude other elements or steps, singular does not exclude a plurality. 装置权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。 A plurality of units or devices recited in the claims means by one unit, or may be realized by means of software or hardware. 第一,第二等词语用来表示名称,而并不表示任何特定的顺序。 The first, second, etc. word used to indicate the name, and does not indicate any particular order.

Patentzitate
Zitiertes PatentEingetragen Veröffentlichungsdatum Antragsteller Titel
CN1818908A *16. März 200616. Aug. 2006董崇军Feedbakc information use of searcher in search engine
CN101030210A *8. Okt. 20065. Sept. 2007胡继强Method for searching sort by user action
CN101454780A *30. März 200710. Juni 2009谷歌公司Method of generating a website profile bases on monitoring user activities
CN102298615A *29. Juli 201128. Dez. 2011百度在线网络技术(北京)有限公司一种计算机实现的用于展示搜索结果的方法与设备
US6269361 *28. Mai 199931. Juli 2001Goto.ComSystem and method for influencing a position on a search result list generated by a computer network search engine
Klassifizierungen
Internationale KlassifikationG06F3/0481, G06F17/30
Juristische Ereignisse
DatumCodeEreignisBeschreibung
3. Juli 2013C06Publication
22. Okt. 2014C10Entry into substantive examination