US20060259476A1 - System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services - Google Patents

System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services Download PDF

Info

Publication number
US20060259476A1
US20060259476A1 US11/419,431 US41943106A US2006259476A1 US 20060259476 A1 US20060259476 A1 US 20060259476A1 US 41943106 A US41943106 A US 41943106A US 2006259476 A1 US2006259476 A1 US 2006259476A1
Authority
US
United States
Prior art keywords
user
secure
accessing
source
sources
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/419,431
Inventor
Sundar Kadayam
Gregory Bishop
William Miller
Viral Vora
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Business Objects Americas Inc
Original Assignee
Business Objects Americas Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Business Objects Americas Inc filed Critical Business Objects Americas Inc
Priority to US11/419,431 priority Critical patent/US20060259476A1/en
Publication of US20060259476A1 publication Critical patent/US20060259476A1/en
Assigned to BUSINESS OBJECTS AMERICAS reassignment BUSINESS OBJECTS AMERICAS CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION SERIAL NO.TO 11/419,431. INCORRECT APPLICATION NO. 11/419,443 WAS TYPED IN THE ORIGINAL COVERSHEET. PREVIOUSLY RECORDED ON REEL 020487 FRAME 0541. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECT APPLICATION NO. 11/419,431. Assignors: INXIGHT SOFTWARE, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9532Query formulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99934Query formulation, input preparation, or translation

Definitions

  • the present invention is a computerized system and method for searching through and retrieving information from a plurality of information sources; and more particularly, the present invention is an enterprise-scale system and method for searching for and retrieving information from a plurality of disparate electronic information sources within a large computer network and/or from the Internet.
  • a federated search system by its very definition, distributes search queries in real-time to the information sources selected for querying.
  • a very large scale federated search system one that involves hundreds or even thousands of information sources, the method of real-time querying of large numbers of information sources becomes impractical. It is desired to bring some intelligence to the search process that would permit an appropriate subset of the information sources to be selected for querying rather than all the available sources.
  • Secure information sources within a federated search system also pose a unique set of challenges.
  • the federated search system should be able to proxy the user credentials to a secure information source (i.e., make it appear to the secure information source that the user was natively interacting with it). This is complicated, however, by the following circumstances: multiple secure information sources could be in the searching mix at the same time; each secure information source could require different methods for handling security (this can include LDAP, HTTP-basic authentication, HTTPS, cookie-based authentication using custom forms, proprietary single-sign-ons, etc.); and the system should transparently handle the security log-ins, parameters and protocols for multiple users, possibly accessing multiple secure information sources at the same time.
  • brokers sometimes referred to as “wrappers”
  • wrappers to define and interface between the system and the respective multiple searchable information sources accessed by the system. It is desired to reduce user interaction needed to create and maintain the brokers by providing an automated, or semi-automated broker generation capability.
  • the present invention provides an enterprise-scale system and method for searching and retrieving electronic information from disparate electronic information sources within a large organization (an intranet) and/or from the Internet.
  • a “federated search” architecture and system that enables a single search query from a user to be delivered in real-time to various selected islands of information.
  • the system can collate results, removes duplicates and dead-links, apply composite relevance scoring, and deliver the relevant results to the user.
  • each island of information is a searchable source that is represented in the system by a “broker”, which defines how the system accesses the respective information source and how the system handles the interface between the system and the information source.
  • a broker-definition tool referred to as the “agent development kit” (ADK) is used to create the brokers in a semi-automated fashion (and, possibly, a completely automated fashion) and deploy them to the live, operational system.
  • the exemplary embodiment of the system and method of the present invention also provides a technique, referred to as “adaptive search”, which intelligently selects subsets of information sources (from a body of available information sources) to route search queries to in the large federated search scenario.
  • the selection of sources is based upon an analysis of the subject matter of the query.
  • the search in this selected subset of information sources can occur automatically, or the user can be provided the option to have the search run in this subset of information sources (when the general search results are displayed, for example).
  • This adaptive search function is facilitated, in the exemplary embodiment, by the use of a knowledge-base (also referred to as a “subject taxonomy”), which is a hierarchical arrangements of subjects, where each subject is represented by a “fingerprint” of information that will typically be found in documents specific to such subjects. These fingerprints can be generated from example documents provided for each of the subjects in the taxonomy. Subjects in the subject taxonomy can also be linked to entity lists, which provide a list of names, symbols or other terms typically associated with a respective subject. By comparing the search query against the subject taxonomy and/or the entity lists, the subject matter of the search query can be determined within a desired level of confidence.
  • the exemplary embodiment of the present invention also utilizes a comprehensive, multi-user, multi-source, multi-modal security handling architecture to allow users to query open sources (non-secure sources) as well as secure sources simultaneously in a substantially transparent fashion. Additionally, the exemplary embodiment of the present invention provides a methodology to incorporate the security handling protocols and parameters into the definitions of the brokers, again, in a semi-automated fashion.
  • a computer implemented method for accessing information from a plurality of searchable information sources includes the steps of: (a) analyzing a user search query to determine a subject matter of the query; and (b) selecting a sub-set of information from the plurality of information sources based upon the determined subject matter of the query.
  • the analyzing step combines at least two different methods of deriving a subject matter from the search query.
  • the method further includes the step of (c) searching at least one information source in the sub-set of information sources for documents relevant to the search query.
  • one deriving method of the analyzing step includes the step of comparing at least a portion of the search query against a plurality of entity lists, where each entity list includes a list of phrases, and where each of the phrases corresponds with one or more subject matters; and the comparing step includes the step of matching the phrase in an entity list against at least a portion of the search query, and upon such match, returning a subject matter corresponding to the matched phrase in the entity list.
  • one deriving method of the analyzing step includes the step of comparing the search query against a knowledge base, where the knowledge base includes a taxonomy of subject matters and a set of terms for at least some of the respective subject matters in the taxonomy, where the set of terms represent information likely to be found for the respective subject matters; and the comparing step compares at least portions of the search query against the set of terms in the knowledge base to determine the respective subject matters of the matching terms.
  • the method further includes the step of building the knowledge base, where the building step includes the steps of: (i) defining a taxonomy of subject matters; (ii) for at least some of the subject matters in the taxonomy, providing at least one example document that represents content typically found for the respective subject matter; (iii) generating a set of terms from the example document; and (iv) linking the set of terms to the respective subject matter.
  • the taxonomy is structured as a multi-tier hierarchy.
  • the step of comparing the search query against the knowledge-base further includes a step of assigning a score to the determined subject matter based upon a confidence level of the comparison.
  • the step of determining a subject matter of the query further includes the steps of displaying one or more of the subject matters having a score greater than a predetermined threshold and selecting, by a user, at least one of the displayed subject matters.
  • the analyzing step determines a plurality of the subject matters, and the method further includes a step of organizing the determined plurality of subject matters according, at least in part, to the scores assigned to the plurality of subject matters.
  • the steps of selecting a sub-set of information sources includes the steps of (i) providing a category-to-source map that includes a plurality of categories, where the categories have at least one information source linked thereto, (ii) obtaining at least one category pertaining to the subject matter of the query, and (iii) adding the information source linked to the category in the category-to-source map to the sub-set of information sources.
  • each information source is assigned a performance score pertaining to at least one performance quality of the information source.
  • the method further includes the steps of searching at least one information source in the sub-set of information sources for document(s) relevant to the search query and displaying the search results from the output of the searching step, where the displaying step displays the search results in an order based upon, at least in part, the performance scores of the information sources from which the search results are obtained.
  • the performance quality is based upon the frequency that the respective information source is accessed, the amount of time spent accessing the respective information source, the frequency of problems accessing the respective information source, and/or feedback provided by users of the respective information source.
  • the method further includes the step of eliminating from the sub-set of information sources any information source having a performance score lower than a predetermined threshold.
  • the method further includes the steps of (c) assigning each information source in the sub-set of information sources a performance score pertaining to performance qualities of the information source; (d) searching the information sources in the sub-set of information sources for documents relevant to the search query; and (e) displaying search results from the output of the searching step, where the search results are ordered based upon, at least in part, the performance scores of the information sources from which the search results are obtained.
  • the performance scores are calculated based, at least in part, upon the number of times the respective information source is accessed by a community of users.
  • the method further includes the steps of (c) searching the information sources in the sub-set of information sources for document relevant to the search query; and (d) displaying the search results from the output of the searching step, where the search results are segregated for each of the information sources in the sub-set of information sources.
  • the searching step searches the information sources in the sub-set of information sources substantially in parallel and the displaying step displays the segregated searches in parallel.
  • the method further includes the steps of: (c) searching a standard information source (such as the World Wide Web) for documents relevant to the search query; and (d) displaying the results of the step of searching the standard information source along with an option, selectable by the user, for searching the sub-set of information sources for documents relevant to the search query upon selection of the option by the user.
  • a standard information source such as the World Wide Web
  • this standard information source could be the World Wide Web and further, the sub-set of information sources may be maintained, for example, on a private computer network.
  • the analyzing step determines a plurality of subject matters from the query
  • the selecting step selects a sub-set of information sources for each of the plurality of the subject matters determined in the analyzing step
  • the displaying step displays the plurality of options for each subject matter determined in the analyzing step, where each option is identified by its respective subject matter in the displaying step and where each option is provided for searching the sub-set of information sources associated therewith for documents relevant to the search query upon selection of the option by the user.
  • the method further includes the steps of (c) searching a standard information source for documents relevant to the search query, (d) searching the sub-set of information sources for documents relevant to the search query, and (e) simultaneously displaying the results of the step of searching the standard information source and the step of searching the sub-set of information sources.
  • the displaying step segregates the results of the step of searching the standard information source from the step of searching the sub-set of information sources.
  • the analyzing step determines a plurality of subject matters from the query, and the selecting step selects a sub-set of information sources for each of the plurality of subject matters determined in the analyzing step.
  • the method further includes the step of automatically searching the sub-set of information sources associated with the subject matter having the closest match to the search query for documents relevant to the search query.
  • This method includes the steps of: (a) storing security credentials necessary for accessing the secure source; (b) accessing the secure source utilizing the stored security credentials; (c) accessing a non-secure source; (d) searching the accessed sources, substantially in parallel, for documents relevant to a search query; and (e) displaying results of the searching step.
  • the plurality of information sources includes a plurality of secure sources
  • the step of storing security credentials includes the step of storing respective security credentials necessary for accessing each secure source
  • the step of accessing the secure source involves the step of accessing the plurality of secure sources, substantially in parallel, using the respective stored security credentials.
  • the method operates on a computer network system having a plurality of users and the step of storing security credentials includes the step of storing respective security credentials for accessing each secure server by each user of the computer network system.
  • the security credentials are stored in a database that includes a table for each user, where each table includes a set of respective security credentials for accessing each secure source by each respective user. It is within the scope of the invention that at least certain of the security credentials may be shared by certain users (or groups of users) during the accessing and/or searching steps.
  • the step of storing security credentials includes the steps of recording a user's security credentials as the user preliminarily enters the secure source and storing the recorded user's security credentials for the step of accessing the secure server.
  • the stored user's security credentials are reusable for multiple steps of accessing the secured server.
  • the security credentials are used substantially transparently to the user during the step of accessing the secure server.
  • the step of accessing the secure source further includes the step of storing session cookies set by the source for the duration of the search process.
  • the method includes the steps of: (a) for each user, storing security credentials necessary for accessing the secure source; (b) accessing, by each user, the secure source utilizing the stored security credentials for each user; and (c) searching the accessed secure source, by the plurality of users, substantially in parallel, for documents relevant to one or more search queries.
  • the method further includes the step of (d) creating a session record for each user accessing the secure source.
  • the session record includes cookies, session parameters, session IDs, and/or a session state.
  • the information sources include a plurality of secure sources
  • the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of the secure sources
  • the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user
  • the searching step includes the step of searching the accessed secure sources, by the plurality of users, for documents relevant to one or more search queries.
  • a session record is created each time a user accesses a secure source.
  • the information sources include a plurality of secure sources
  • the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of secure sources
  • the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user
  • the searching step includes the step of searching the accessed secured sources, by the plurality of users, for documents relevant to one or more search queries.
  • the method includes the steps of: (a) accessing a given searchable source; (b) performing an example search on the given searchable source to produce search results by that searchable source; and (c) identifying regular expressions from the search results.
  • the method further includes the step of storing the regular expressions for the given searchable source for subsequent reuse by a federated search system.
  • the step of identifying regular expressions is performed substantially automatically, the method further includes the step of reviewing, by a user, output of applying the regular expressions to search results produced by the given searchable source, and the method further includes the step of approving by the user the regular expressions based upon the reviewing step.
  • the method further includes a step of modifying the regular expressions by the user before the approving step, if the user determines the modifying step is necessary based upon the reviewing step.
  • the reviewing step involves the step of simultaneously displaying to the user the search results produced by the given search and the output of applying the regular expressions to the search results.
  • the step of identifying regular expressions includes the steps of: (i) parsing the search results to distill a structure of the search results; (ii) identifying repeating blocks of information from the parsed search results; (iii) identifying essential search-result elements from the repeating blocks of information; and (iv) generating a regular expression for each identified essential search-result element and a regular expression for the repeating block.
  • the essential search-result elements include a title, a URL, a date, a keywords, a summary, a passage, and/or a score.
  • the method includes the steps of: analyzing a user's search query to determine a subject matter of the query; selecting a subset of information sources from the plurality of information sources based upon the determined subject matter of the query, wherein at least one of the subset of information sources is a secure information source; accessing the secure information source utilizing stored security credentials for the information source; and searching the information sources in the subset of information sources for documents relevant to the search query.
  • the searching step involves the step of searching the information sources in the subset of information sources, substantially in parallel, for documents relevant to the query.
  • the step of accessing the secure information source utilizes the stored security credentials substantially automatically and substantially transparently to the user.
  • the step of searching the information sources in the subset of information sources utilizes source brokers for each of the information sources in the subset of information sources, where the source brokers define patterns of search-result information specific to their respective information source.
  • the source broker for the secure information source includes the stored security credentials utilized in the accessing step.
  • method further includes the step of defining the source broker for each of the information sources in the subset of information sources.
  • the defining step includes the steps of: preliminarily accessing the respective information source; preliminarily performing an example search on the respective information source to produce example search results; identifying regular expressions from the example search results; and storing the regular expressions as at least part of the source broker.
  • the defining step further includes the steps of detecting whether the respective information source is a secure information source, and if the detecting step determines that the respective information source is a secure information source, performing the additional steps of: providing a log-in form for the secure information source; logging into the secure information source by entering the appropriate log-in information to the log-in form by the user; recording security credential information provided by the user during the logging step; and storing the security credential information with the respective source broker.
  • FIG. 1 is a general block diagram of the system architecture of the exemplary embodiment of the present invention
  • FIG. 2 is an example screen-shot illustrating the universal search interface of the exemplary embodiment
  • FIG. 3 is an example screen-shot of the exemplary embodiment illustrating intelligent source selection capabilities combined with general search results
  • FIG. 4 is an example screen shot of the exemplary embodiment illustrating intelligent query routing to subsets of information sources with general search results
  • FIG. 5 is an illustration of a source taxonomy, an organization of searchable information sources in XML format, of the exemplary embodiment
  • FIG. 6 is an illustration of a structure of mapping subjects to information sources, maintained in an XML file, of the exemplary embodiment
  • FIG. 7 is a block diagram representation of the interplay between the intelligent source selection, federated search and adaptive learner functions of the exemplary embodiment
  • FIG. 8 is an illustration of example entity lists according to the exemplary embodiment
  • FIG. 9 is an illustration of a structure of mapping entity lists to information sources, maintained in an XML file, of the exemplary embodiment
  • FIG. 10 is an illustration of a subject taxonomy and example documents linked to the subjects in the subject taxonomy, according to the exemplary embodiment
  • FIG. 11 is an illustration of the information performance source ranking structure according to the exemplary embodiment
  • FIG. 12 is an example output representation of a broker definition generated by the broker-definition tool according to the exemplary embodiment
  • FIG. 13 a block diagram representation of the multi-user, multi-source, multi-modal secure information source architecture according to the exemplary embodiment
  • FIG. 14 is an illustration of a session-details database utilized by the exemplary embodiment for secure information source handling
  • FIG. 15 is an example screen shot of the exemplary embodiment illustrating an initial stage of the broker-definition tool
  • FIG. 16 is an example screen shot of the exemplary embodiment illustrating an extraction testing stage of the broker-definition tool
  • FIG. 17 is an example screen shot of the exemplary embodiment illustrating a query definition stage of the broker-definition tool
  • FIG. 18 is an example screen shot of the exemplary embodiment illustrating another testing stage of the broker-definition tool.
  • FIG. 19 is an example screen shot of the exemplary embodiment illustrating secure source handling stage of the broker-definition tool.
  • the present invention provides an enterprise-scale system and method for searching and retrieving electronic information from disparate electronic information sources within a large organization (an intranet) and/or from the Internet.
  • a “federated search” architecture and system that enables a single search query from a user to be delivered (preferably, in real-time) to various searchable information sources.
  • information source refers to searchable information sources accessible over a data network such as, for example, the World Wide Web or a proprietary computer network.
  • the searchable information sources will typically be search engines, or may include search engines or search capabilities associated therewith that provides the ability for a user to search the searchable information source for desired information. It is not necessary, however, for the searchable information source to have its own search capabilities embedded therein or associated therewith, as such search capabilities can be provided elsewhere. Examples of such searchable information sources accessible over the World Wide Web include, MSN.com, LYCOS.com, TEOMA.com, Intellihealth.com, WebMD.com, WSJ.com, etc.
  • secure information source “secure source” and “secure searchable information source” pertain to such searchable information sources that require certain security credentials (such as passwords, for example) to access and/or perform searches therein/therewith.
  • search query and “query” pertain to an expression of the information that a user or system wishes or requests to search for in one or more searchable information sources. While the expression will typically be in the form of a term or phrase typed into a field of an electronic form by the user, it is within the scope of the invention that the expression be automatically generated and presented to the searchable information source(s) and it is within the scope of the invention that the expression be pre-stored and presented to the searchable information source(s).
  • document means an electronic body or collection of information or data that the user or system will typically be provided access to by the searchable information source(s) in the search result(s) provided by the searchable information source(s) (although some searchable information sources only identify the documents, without providing access). This is typically the body or collection of information or data that the user/system is ultimately seeking in the searching process.
  • the act of “searching” an information source or within an information source, and the act of “searching by” an information source pertains to the act of applying the search query to one or more of the searchable information sources to produce search results, which may or may not provide the user/system access to documents; but which will usually provide at least the identity of document(s) if the search is successful. It is to be understood that the present invention is not limited to any specific searching algorithm or technique.
  • the act of “comparing” or “matching” a search query (or any other expression of information/data) against another expression of information/data pertains to the use of any available techniques and/or algorithms to perform a lexical comparison of the expression (or a portion of the expression) against terms, phrases or other expressions of information or data in the other entity.
  • the results of this comparison often do not necessitate exact matches to be considered “successful”; and, thus, often include confidence scores with the results that indicate the relative confidence or closeness of the comparison.
  • the exemplary embodiments herein often refer to lexical comparisons, it is within the scope of the invention that alternate techniques/algorithms be used when the comparison is not a language-based comparison.
  • FIG. 1 provides a functional flow diagram representation of the federated search system deployed according to an exemplary embodiment of the present invention.
  • the searching function 10 provides a configurable, hierarchically organized group of information sources, described below, to users to fulfill different information needs and requests from the multiple groups of users.
  • a simple search involves taking search query terms from the user to conduct the search.
  • An advanced search enables users to select multiple groups of sources, or multiple sources within a group, and to control many settings, including the depth of the search, analysis options, and time-outs.
  • Personalized searching preferences are stored for each user by the system. Searches initiated in the system are conducted in real-time, and results are displayed in configurable web page format or in XML format.
  • a user's search query is analyzed to determine the subject matter corresponding to the user's query.
  • a sub-set of information sources can be isolated from the vast body of information sources to perform the search.
  • a search for “pancreatic cancer treatment protocol” can be determined by the system to be broadly based on the subject-heading of “health”, and more specifically, on the specific subjects of “diseases and conditions”, and “endocrinal disorders”.
  • the sub-set of information sources is selected by consulting an information source hierarchy, or subject-to-source map, to find the best sources for the identified subject matters. These best performing sources can automatically be given preference for searching in real-time in addition to user-selected information sources, or these best sources can be offered as recommendations to the user for performing further related searches.
  • the federated searching function 14 implements the actual real-time, distributed searching mechanism. This function receives as inputs the search query parameters and other optional advance settings, and accesses one or more groups of information sources to perform the federated searching in all or certain subsets of the information sources.
  • Information sources from which the real-time federated searching may be conducted include visible Web sources 16 accessible over the Internet, invisible Web sources 18 accessible over the Internet, enterprise sources 20 (private information sources accessible by the system over the system's intranet, for example), and subscription sources 22 , which may be accessible over the Internet or through separate network connections. Each information source in the sub-set of selected information sources is searched by the system in real-time, with user credentials being transparently proxied, if necessary, to each secure source 22 .
  • This federated searching function 14 translates a user's search query into the native forms required for each information source, communicates with each information source using native protocols and methods, navigates through one or more search result sets from each source, extracts search result records including uniquely defined fields of information for each of the records from each source, normalizes the results, removes duplicates, and performs composite relevance ranking based upon specified, configurable relevance ranking criteria.
  • An XML result stream is produced that can be operated upon by other components in the system.
  • the analysis/filtering function 24 is optionally triggered by the user to perform real-time retrieval and analysis of the full-text contents (documents) for each result from the composite result set delivered from the federated searching function 14 .
  • Each “document” is retrieved from the corresponding information source in the essential text content along with relevant meta-data is extracted from it.
  • This function 24 in essence, “converts” content from different document formats like Adobe PDF, Microsoft Word, etc. to native text.
  • the text and meta-data content corresponding to each result record is then passed through a real-time filtering component that takes one or more search queries representing the user's input and then determines the strength of match of the result to the user's need.
  • the passages (sentences or paragraphs) from the documents matching the user's query are extracted and ranked to determine the strength of the match and to compute a native “analysis score” which is used for relevance ranking purposes.
  • a dynamic summary is composed from the extracted passages for each matching document.
  • Each result record is then enhanced with additional meta-data including an “analysis score”, an updated relevance score, a dynamic summary snippet, as well as additional information when the result document doesn't match the user's query.
  • the categorization function 26 categorizes the results from the federated searching (and, optionally, the analysis/filtering function 24 ) into a configured subject taxonomy.
  • An administrator first creates a taxonomy of subjects representing a given information domain, provides example documents for each subject, and runs an administrative tool to train the taxonomy and create a model that is used for the real-time categorization of the search result documents.
  • the categorization process involves deriving a “fingerprint” (important terms representative of a respective content of the record, which can be phrases or individual words) from each result record and matching it with the taxonomy model configured for use in the system.
  • the best matching subject is determined for each result record, and is tagged as additional meta-data in the result record.
  • the results from the previous steps of searching 10 , analysis/filtering 24 , and categorization 26 are received in XML.
  • a standards-based template mechanism allows the results to be displayed rapidly in any desired format.
  • Information can be organized into multiple views such as “by relevance,” “by source”, and “by concept.”
  • the relevance view orders the results at decreasing order based upon the “relevance score”.
  • the source view provides a graphical tree-view of the results organized by the sources from which they came from.
  • the concept view provides a graphical, tree-view of the results, organized into the matching taxonomy of subjects from the categorization process 26 .
  • the tracking/alerts function 30 is an optional function that may be set up to run periodic searches for a given search query or set of search queries automatically and to alert the user when a desired set of results are obtained from the periodic searches, or when any results are obtained.
  • an example screen display 32 of initial searching screen provides a field 34 into which a searcher can enter a search query. If the user enters the search query in this field, the exemplary embodiment will perform an automatic search as described in further detail below.
  • the user can select specific subjects from the source taxonomy 36 (provided in this exemplary embodiment in the form of hyperlinks) to allow the search to be performed within narrow sub-sets of information sources specific to the subject matter of interest.
  • the taxonomy 36 in the exemplary embodiment includes an upper level of subjects 38 that generally define a subject matter and a second tier of more specific subject matters 40 .
  • the system upon selecting an identified subject (hyperlink) in the source taxonomy 36 displayed in the window 32 , the system will then perform the searching in the specific sub-set of sources represented by the subject heading/subject 38 / 40 selected by the user.
  • an example screen shot 42 is provided that illustrates the results of performing a general search of the exemplary embodiment using the search query of “cjd”.
  • the exemplary embodiment will perform the search set forth in the search query from a federated group of Web search engines (such as “MSN”, “LYCOS”, “TEOMA”, etc.) and display the results of the search on the screen in order based upon relevance of the documents from the search results in comparison to the subject of the search query.
  • a federated group of Web search engines such as “MSN”, “LYCOS”, “TEOMA”, etc.
  • the exemplary embodiment also analyzes the search query to determine a subject matter (or subject matters) of the query and provides links to the subsets of information sources 44 (in the form of hyperlinks) associated with the subject matter(s) determined from the search query above the general search results. If the user selects the identified subsets of information sources 44 , the system will perform the same search in the sub-set of information sources. Exemplary methods for identifying the subject matters from the search query 34 are discussed in further detail below.
  • the search query “cjd” was identified by the system as being related to the specific subject matters, “Health tips”, “Health news” and “Health discussions”. The system was able to make this recommendation based upon analyzing the query and identifying that the closest subject heading that it corresponded to was health; hence, the recommendation from the system that this search be conducted within “health-related” sources.
  • the exemplary embodiment may also be configured to automatically perform the search within a sub-set of information sources corresponding to a subject matter matching the search query.
  • the display 46 shown in FIG. 4 illustrates that the specific search for the search query “cjd” was automatically conducted within the sub-set of information sources associated with the “Health Tips” subject matter.
  • the search results resulting from this specific search may come from information sources such as “American Medical Association”, “Intellihealth”, and “WebMD”, etc. for the best results on the subject.
  • FIG. 5 illustrates the exemplary structure of the source taxonomy 36
  • FIG. 6 illustrates the exemplary subject-to-source map 42 (also referred to, herein, as a category-to-source map).
  • the subject-to-source map 42 is used to identify one or more information sources corresponding to identified subject matters of the search query, to allow for more focused searching of the subject matter in these sources.
  • the subject-to-source map 42 in the exemplary embodiment, is arranged as a hierarchy that includes an upper level of subject headings 38 (such as “health”), and for each subject heading 38 there are one or more information source subsets 41 such as “health news”, “health publications”, “health tips”, and “alternative medicine” linked thereto.
  • information source subset 41 there are linked to it one or more information sources 48 .
  • the specific subject “health tips” will have linked to it information sources such as “American Medical Association”, “Intellihealth.com”, “WebMD.com”, etc.
  • FIG. 6 more specifically illustrates how a subject in the ontology is mapped to a group of sources or to a single source by an administrator in the exemplary embodiment.
  • Health as a general subject 38 may be mapped to a group of searchable sources 40 called “health tips”.
  • the more narrow subjects under the general subject “health”, such as “cancer”, may be mapped to specialized sources providing information on cancer treatment, cancer trials, etc.
  • the ability to map the subject headers and specific subjects to information source(s) is completely flexible and can be tuned to the needs of the specific search scenario in which the system will be used.
  • the intelligent source selection function 12 utilizes a query analysis algorithm to determine a subject matter or subject matters of the search query, where such identified subject matters are used to help the user identify specific sub-sets of information sources to perform more focused searches.
  • the query analysis algorithm uses a combination of deterministic look-ups within a group of provided entities lists 50 along with fuzzy look-ups (“auto-categorization”) within a knowledge-base 54 to determine within a certain degree of confidence the subject matter of the query. Then, based upon the determined subject matter(s), subsets of information sources can be provided for these subject matter(s) using the subject-to-source map 42 .
  • entity lists 50 can be found in FIG. 8 .
  • an entity list can include a list of ticker symbols or an entity list can include a list of company names.
  • Other representative entity lists could be, for example, health conditions, places, sports, etc.
  • an entity list 50 is a list of words, names, or other terms that collectively fall under a general subject heading 38 or fall under a specific subject 40 .
  • the more general entity lists are referred in the exemplary embodiment as “fall through” lists (having a lower confidence level) and the more specific entity lists are referred to as non-fall through lists (having a higher confidence level).
  • FIG. 9 provides an example entity list-to-source mapping 52 which maps certain entity lists directly to specific subject matters.
  • the mapping shown in FIG. 9 includes the entity list “places” mapped to the specific subject matters “maps”, “travel guides”, “almanacs”, and “encyclopedias”. Additionally, the entity list “ticker symbols” is mapped to the subjects “financial discussions”, “financial tips”, “company profiles”, “SEC filings”, and “mutual funds”.
  • the fuzzy look-up step involves a “digital fingerprint” match of terms in the search query with “digital fingerprint” of topics in a subject knowledge-base 54 .
  • This methodology is referred to as “auto-categorization”, emanating from the problem of trying to “automatically” find the “category” in a taxonomy that a stream of input text corresponds to.
  • An example of the knowledge-base is shown in FIG. 10 .
  • the left pane 56 in the display illustrates a subject hierarchy labeled the “Whole Web Subject Taxonomy”.
  • the first level 58 in the hierarchy are the general subject headings such as “Health”, the next level 60 in the hierarchy includes more specific subject headings such as “Alternative”, “Child Health”, and “Conditions and Diseases” and the most specific level 62 in the hierarchy includes very specific subject matters such as “Cancer”, “Cardio-Vascular Disorders”, “Communication Disorders”, “Digestive Disorders”, etc., which are specific subjects of the “Conditions and Diseases” subject heading in the second tier 60 .
  • the right pane 64 of the display provides a list of example documents 65 identified by the administrator as being relevant to the selected subject, “Digestive Disorders”, in the specific level 62 of the subject hierarchy 56 .
  • the system will then learn from these example documents to create the knowledge-base 54 of subject matter representing the ontology.
  • the knowledge-base includes a list of words, phrases or other terms “learned” from the example documents provided for each subject.
  • the methodology for “learning” from a taxonomy of subjects and example documents for each subject is based upon creating topic or subject specific “digital fingerprints” using the familiar vector-space model for analyzing and representing a body of unstructured texts.
  • the “digital fingerprints” for topics are, in essence, weighted vectors of terms (words and phrases) that best represent information most likely to be found in those specific topics. This “digital fingerprint” information is then stored in the “subject knowledge-base” for enabling the query analysis.
  • a vector-space model is trained off-line by parsing the collection of example documents for each subject to generate a representative vector of terms and frequencies for that subject.
  • the terms identified can be individual words or phrases (phrases are determined via a measure known as mutual information).
  • the subject matter vectors are normalized in some fashion, to account for variation in the size and number of training documents.
  • a uniqueness score is calculated for each term associated with a given subject. This uniqueness score is often referred to as “IDF” for “inverse document frequency” since one over the number of documents that a term appears in is one way to measure uniqueness.
  • the uniqueness score is one over the total of all normalized category vector weights for that term.
  • a vector-space classifier parses the text to be classified to generate the vector of terms in frequencies. This vector is compared with the vectors computed off-line for each subject matter, taking into account the uniqueness of each term.
  • the term frequency from the text is multiplied with the normalized weight for the subject matter, then that value is multiplied by the uniqueness score for the term exponentiated by a configurable constant. These values are summed to give a score for each subject matter. The resulting values determine which subject matters best match the text.
  • the search query analysis program operates substantially as follows. Given a user's search query, at least portions of the search query (i.e., after possibly eliminating stock words, and/or after stemming remaining words to root form) are compared against zero or more of the entity lists 50 , each of which may be stored in RAM as a dictionary. As discussed above, the general entity lists (having lower confidence levels) are designated as fall-through lists, while the more specific entity lists (having a higher confidence value) are designated as non-fall-through lists. Accordingly, the fall-through lists are assigned a confidence score of 1.0 and the non-fall-through lists are assigned confidence scores of 1.5.
  • the exemplary embodiment does not perform the “auto-categorization” of the search query; however, if not found in a non-fall-through list, then the query is compared against the “fingerprints” in the knowledge-base 54 to identify subject matters corresponding to the “fingerprint” of the search query. Any matches in this comparison will be assigned confidence levels from 0 to 1 depending upon the confidence of the match.
  • the subject matters developed from the auto-categorization step are added to the array of subject matters developed in the comparison with the entity lists above.
  • each entry in the subject matter array is linked to a sub-set of information sources using the subject-to-source map 42 as discussed above.
  • the parent category will be checked for a sub-set of information sources. For example, if the subject matter heading “health/conditions&diseases/digestive_disorders” is not found, then a look-up will be made for “health/conditions&diseases”.
  • This step is repeated until a sub-set of information sources is matched to the subject matter (i.e., if “health/conditions&diseases” is not matched with a sub-set of information sources, then a look-up will be made for the general heading of “health”).
  • a sub-set of information sources i.e., if “health/conditions&diseases” is not matched with a sub-set of information sources, then a look-up will be made for the general heading of “health”).
  • each information source in each respective sub-set of information sources may also be ranked with respect to each other utilizing the adaptive learner function 56 .
  • the adaptive learner function 56 provides a method for prioritizing the information sources by rating (in real-time) the information sources based upon the popularity of the source or upon other performance or statistical considerations (or combinations thereof) to provide performance scores 57 for the information sources.
  • the adaptive learner process is a means to learn the on-going performance of sources (in the manner in which they return relevant results to users on various subjects), so that the intelligent source selection function 12 continually improves and keeps pace with the changing content or behavior of the individual sources. From a simplistic perspective, this method simply rates the up-to-minute popularity of each source for each subject in the ontology.
  • an internal database 58 maintains an internal ranking of the performance of sources in specific subject areas. For example, the highlighted source in FIG. 11 “Mayo health” database has been rated as the best performing source by the system having a performance score 57 of 0.61.
  • Some of the performance criteria utilized in adjusting this performance score include: (a) adjusting the performance score based upon the number of times users access the source from search result listings; (b) adjusting the score based upon the amount of time spent on each source; (c) adjusting the score based upon access problems or performance of the source (such as, lowering the score if users have trouble accessing the source at various times); and (d) adjusting the score based upon user feedback, such as through questionnaires or rating polls.
  • the impact of the adaptive learner function 56 is not typically instantaneous to start with. Depending on the subject-spread of the queries being performed, the source is put to use, and the volume of users and queries, the adaptive learner process 56 , over time, provides a reasonably accurate measure of the performance of specific sources on specific subjects.
  • the adaptive learner process 56 gauges the “popularity” of a particular information source for a particular subject measured, in the exemplary embodiment, through result “click-throughs” from the community of users.
  • the result links returned from the federated search function 14 are directed to a “click-through” handler when activated by a user.
  • the “click-through” handler redirects the user's browser to the actual result after optionally updating the per-source category weights for the information sources that returned the result.
  • the per-source category weights can be adjusted by the “click-through” handler periodically (i.e., every 100 th access) to reduce the rate of change.
  • each result link returned from the federated search function 14 include the following: the original result link; a list of the information sources that returned the result; the ESS query; and a list of the subjects assigned to the search query.
  • the federated search function 14 performs the substantially parallel real-time searches on the plurality of information sources.
  • the federated search function 14 utilizes brokers 66 which are electronic definitions stored on the system that define for each of the information sources to the federated search function 14 how to interface with the respective information source; for example, how the federated search function 14 is to communicate with the information source, how the federated search function is to structure its queries (in its native form) to the specific information source, how the federated search function 14 interprets results from the particular information source, how the federated search function is to navigate through multiple “pages” of the results set from the specific information source, any security methods used by the particular information source, etc.
  • An example broker definition for the Intellihealth.com information source is provided in FIG. 12 .
  • the present invention also makes it possible for non-operational brokers (brokers can become non-operational if the information source they correspond to ceases to exist, moves to a different location, delivers different content, delivers content in a different format, has new capabilities for search and retrieval, has new security structures, etc.) to be healed automatically through an automated background testing process.
  • non-operational brokers brokers can become non-operational if the information source they correspond to ceases to exist, moves to a different location, delivers different content, delivers content in a different format, has new capabilities for search and retrieval, has new security structures, etc.
  • the brokers 66 can provide the security parameters and credentials necessary for federated search system to access a secure or subscription information source or sources 22 . Consequently, the present invention also provides a security handling architecture that enables the system to proxy user credentials for multiple users to multiple secure sources using multiple security methods in real-time.
  • the multi-user, multi-source, multi-modal security architecture utilizes a security broker function 68 within the federated search system that utilizes user security information 70 and security parameters embedded within the brokers 66 to drive the multi-user session manager 72 .
  • the multi-user session manager 72 creates an active user session 74 for each secure source 22 respectively accessed by each user. Therefore, if, for example, WSJ Archives are accessed by thirty-three of the active users, then thirty-three active user sessions 74 will be created for each individual access.
  • the security broker 68 is invoked during the federated search function 14 for each secure information source in the search request.
  • the security broker 68 examines the broker definition 66 to determine the type of authentication (e.g., basic authentication, challenge-response, log-in form, etc.) required by the secure information source 22 .
  • the broker definition 66 will also describe the log-in parameters used by the information source.
  • the security broker 68 retrieves the authentication credentials 70 assigned to the user for the secure information source. This information is stored in the user security database 70 .
  • the security broker 68 performs the initial steps in the establishment of the per-user session and verifies that the session has been successfully initialized.
  • the security broker 68 extracts the parameters from the response and stores them in the respective active user session 74 . From this point on, the federated search process 14 proceeds normally. If the secure information source 22 uses session parameters, the security broker 68 will be re-invoked at each step in the search process to transmit the appropriate session parameters for the respective active user session 74 . As discussed above, the session manager 72 is responsible for maintaining a separate active user session 74 for each user/source combination. Separate “session parameters” are maintained by the session manager 72 for each active user session 74 .
  • FIG. 14 illustrates the conceptual organization of the internal security information structure maintained by the session manager.
  • session parameters are stored in “Session Details” records and state is managed for each secure source searched by each user in real-time.
  • Such session parameters may include, cookies, session parameters, session IDs, sessions date, etc.
  • the session parameters will vary depending upon the mode, type of security encountered at each secure source.
  • the session manager 72 maintains the integrity of the unique security requirements at each secure source 22 in a multi-user environment, while at the same time, not compromising a user's privacy of individual security requirements. It should be understood that it is within the scope of the invention that at least certain of the security credentials and/or session parameters may be shared by certain users (or groups of users) during the accessing and/or searching steps. These shared credentials/parameters may be included in the “Session Details” records for each user or in a shared record accessible for all users sharing the credentials/parameters.
  • FIG. 15 illustrates a visual broker-definition tool 76 (referred to as the “Agent Development Kit” or “ADK”) that provides the exemplary embodiment of the present invention with the ability to create the brokers 66 for the information sources using a substantially automated process.
  • This broker-definition tool 76 automatically analyzes the structure and form from the search result content generated by a searchable information source to determine patterns that exist within it; and automatically generates the necessary pattern extraction logic for the broker substantially without any user involvement.
  • the broker-definition tool 76 in this exemplary embodiment, utilizes familiar “wizards” interface in a left pane 78 to guide the user rapidly through the broker generation process.
  • the right pane 80 provides visual results of the information source search result output or of the broker output. As can be seen in FIG.
  • the interface pane 78 first requests that the user enter the information source address in field 82 and activate the “Capture” icon 84 .
  • the graphical interface for the selected information source is presented.
  • the interface 78 requests that the user run a search query on the requested information source and wait for the results to be displayed.
  • the user has requested a search for documents related to “patio furniture”.
  • this interface 78 requests that the user enter the number of results received on the page shown in the pane 80 .
  • the user activates the “Next” icon 86 .
  • the broker-definition tool 76 then automatically extracts search results 88 from the search results generated by the information source shown in the pane 80 .
  • the broker-definition tool accomplishes this utilizing automatic pattern detection, extraction and generation.
  • the basis for this process can be understood by noting that virtually every searchable source provides its search output through a program-generated HTML page. Inherent in this observation is the fact that program-generated pages (especially where repeating elements are included, like a series of search results) have some pattern driving its production. This makes it possible, in most cases, to put together a methodology to find that pattern, and generate logic to extract it.
  • the broker-definition tool extracts the search results from the information source, generally, using the following methodology; first, the HTML document corresponding to the result page shown in the pane 80 is saved locally to a file; next, the file is parsed utilizing a specialized parser that distills the “structure” of the page (locating tables, paragraphs, divisions, etc.) from the “cosmetics” of the page (what font is being used, what color is being used, where an image is inserted, etc.); next, with this distilled structure of the page, the broker-definition tool proceeds to find “blocks” of structure (paragraphs, table rows, tables, etc.) repeating some minimum number of times (the broker-definition tool takes the input provided by the user on the previous page answering the question “enter the number of results you received on the page.”); next, if at least some minimum number of repeating blocks are discovered, then the broker-definition tool looks to see that these blocks contain some essential elements that are typical of search results (“essential elements”, for example,
  • a “regular expression” is a classic computer science device utilized to “extract” the desired portion of text or other information from a larger stream of text. See
  • the broker-definition tool 76 is successful in performing the automatic pattern detection, regular expression generation and result extraction for every single source available, then the broker generation process could indeed become 100% automatic. Nevertheless, the process is semi-automated because there are typically situations where there are exceptions that cannot be dealt with automatically by the broker-definition tool such as, for example: when unique fields of information exist within the result records, (for example, a thumbnail picture, a price, a delivery date, etc., that may all be specific to a search source, these need to be specified by the user and then the broker-definition tool can generate the expressions for them); and when the search result records vary in structure for each record (for example, the source may optionally include, for example, a special discount price only for a few of the returned records).
  • exceptions that cannot be dealt with automatically by the broker-definition tool such as, for example: when unique fields of information exist within the result records, (for example, a thumbnail picture, a price, a delivery date, etc., that may all be specific to
  • FIG. 17 illustrates a source-specific “search query translation” in the interface 78 of the broker-definition tool 76 to enable universal searches to be conducted using a single query language to multiple disparate sources.
  • the interface pane 78 the user is able to select alternate languages other than English that are supported in the information source's query field.
  • the interface provides fields 92 where the user can specify the symbols or terms used for the boolean operations of a general search tool. Therefore, the system of the exemplary embodiment of the present invention implements capabilities such as searching for “all of the words”, “any of the words”, “phrase”, “boolean”.
  • Boolean queries specifically allow users to combine terms using operators such as ‘AND’, ‘OR’, ‘AND NOT’, ‘NEAR’, ‘NEAR/N’ to accurately gather the type of information needed.
  • Each information source is equipped with different levels of capability for searching the information repositories they provide access to.
  • the query language syntax may vary widely. For example, in some sources, the search for
  • FIG. 18 illustrates a self-contained testing capability within the broker-definition tool 76 that permits a broker that has been created to be tested immediately.
  • the interface pane 78 provides fields 94 for the user to enter a search query, a search type and list the number of pages in the results. These fields may also request a user name and password if the source is a secure source. Once these fields are filled in the user activates the “test icon” and a testing interface will actually perform a live query against the information source (for which the broker is being defined), just as the federated search function 14 would in the run-time system, and gathers the result data, and applies the broker definition to extract result records in all the defined fields of each result record.
  • This extracted result set is presented in the right pane 80 to give instant feedback to the user on how well their broker definition is working and if it is ready for deploying to the run-time system.
  • FIG. 19 illustrates how the broker-definition tool 76 is able to capture security information for a secure source.
  • the broker definition can capture information by multiple security methods including the standard “HTTP basic authentication”, and “web-based log-in forms”.
  • the interface pane 78 includes a form 98 in which the user can identify the type of security that is being used by the search engine and a field 100 where the user enters the URL or address of the secure information source.
  • the broker-definition tool captures the necessary log-in details, such as navigating the log-in form, logging in, navigating to the search interface, etc., by “watching” (recoding) the user's interaction with the information source in the right pane 80 .
  • These security credentials will then be stored in the brokers 66 as discussed above.
  • the security broker 68 during the federated searching function 14 will essentially “replay” the log-in process to connect to the secure information source, and to supply the user's credentials for that source transparently, prior to performing a search.
  • Nuances such as handling session cookies that may be set for each user, by each secure source, are transparently handled by the security broker 68 at run-time.

Abstract

A system and method is provided for accessing information from a plurality of searchable information sources. The method includes the steps of: analyzing a user search query to determine a subject matter of the query; and selecting a sub-set of information from the plurality of information sources based upon the determined subject matter of the query. In further detailed embodiment, the analyzing step combines at least two methods of deriving the subject matter from the search query; and the method further includes the step of searching the information source(s) in the sub-set of information sources, substantially in parallel, for documents relevant to the search query. A system and method is also provided for searching a plurality of searchable information sources, where the information sources include at least one secure source. This method includes the steps of: (a) storing security credentials necessary for accessing the secure source; (b) accessing the secure source utilizing the stored security credentials; (c) accessing a non-secure source; (d) searching the accessed sources, substantially in parallel, for documents relevant to a search query; and (e) displaying results of the searching step.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • The present application is a division of U.S. patent application Ser. No. 10/738,554, filed 3 Mar. 2003, entitled SYSTEM AND METHOD FOR RETRIEVING AND ORGANIZING INFORMATION FROM DISPARATE COMPUTER NETWORK INFORMATION SOURCES; which claims the benefit from U.S. Provisional Patent Application Ser. No. 60/360,754, filed Mar. 1, 2002, entitled SYSTEM AND METHOD FOR RETRIEVING AND ORGANIZING INFORMATION FROM DISPARATE COMPUTER NETWORK INFORMATION SOURCES; the contents of which are incorporated herein by reference.
  • BACKGROUND
  • The present invention is a computerized system and method for searching through and retrieving information from a plurality of information sources; and more particularly, the present invention is an enterprise-scale system and method for searching for and retrieving information from a plurality of disparate electronic information sources within a large computer network and/or from the Internet.
  • A federated search system, by its very definition, distributes search queries in real-time to the information sources selected for querying. In a very large scale federated search system, one that involves hundreds or even thousands of information sources, the method of real-time querying of large numbers of information sources becomes impractical. It is desired to bring some intelligence to the search process that would permit an appropriate subset of the information sources to be selected for querying rather than all the available sources.
  • Secure information sources within a federated search system also pose a unique set of challenges. At a fundamental level, the federated search system should be able to proxy the user credentials to a secure information source (i.e., make it appear to the secure information source that the user was natively interacting with it). This is complicated, however, by the following circumstances: multiple secure information sources could be in the searching mix at the same time; each secure information source could require different methods for handling security (this can include LDAP, HTTP-basic authentication, HTTPS, cookie-based authentication using custom forms, proprietary single-sign-ons, etc.); and the system should transparently handle the security log-ins, parameters and protocols for multiple users, possibly accessing multiple secure information sources at the same time.
  • Finally, in a large federated search system, a reasonable effort could involve manually creating brokers (sometimes referred to as “wrappers”) to define and interface between the system and the respective multiple searchable information sources accessed by the system. It is desired to reduce user interaction needed to create and maintain the brokers by providing an automated, or semi-automated broker generation capability.
  • SUMMARY
  • The present invention provides an enterprise-scale system and method for searching and retrieving electronic information from disparate electronic information sources within a large organization (an intranet) and/or from the Internet. At the heart of the system is a “federated search” architecture and system that enables a single search query from a user to be delivered in real-time to various selected islands of information. Depending upon the embodiment, the system can collate results, removes duplicates and dead-links, apply composite relevance scoring, and deliver the relevant results to the user.
  • In an exemplary embodiment, each island of information is a searchable source that is represented in the system by a “broker”, which defines how the system accesses the respective information source and how the system handles the interface between the system and the information source. Further, in the exemplary embodiment, a broker-definition tool referred to as the “agent development kit” (ADK) is used to create the brokers in a semi-automated fashion (and, possibly, a completely automated fashion) and deploy them to the live, operational system.
  • The exemplary embodiment of the system and method of the present invention also provides a technique, referred to as “adaptive search”, which intelligently selects subsets of information sources (from a body of available information sources) to route search queries to in the large federated search scenario. The selection of sources is based upon an analysis of the subject matter of the query. The search in this selected subset of information sources can occur automatically, or the user can be provided the option to have the search run in this subset of information sources (when the general search results are displayed, for example).
  • This adaptive search function is facilitated, in the exemplary embodiment, by the use of a knowledge-base (also referred to as a “subject taxonomy”), which is a hierarchical arrangements of subjects, where each subject is represented by a “fingerprint” of information that will typically be found in documents specific to such subjects. These fingerprints can be generated from example documents provided for each of the subjects in the taxonomy. Subjects in the subject taxonomy can also be linked to entity lists, which provide a list of names, symbols or other terms typically associated with a respective subject. By comparing the search query against the subject taxonomy and/or the entity lists, the subject matter of the search query can be determined within a desired level of confidence.
  • The exemplary embodiment of the present invention also utilizes a comprehensive, multi-user, multi-source, multi-modal security handling architecture to allow users to query open sources (non-secure sources) as well as secure sources simultaneously in a substantially transparent fashion. Additionally, the exemplary embodiment of the present invention provides a methodology to incorporate the security handling protocols and parameters into the definitions of the brokers, again, in a semi-automated fashion.
  • Therefore, it is a first aspect of the present invention to provide A computer implemented method for accessing information from a plurality of searchable information sources. The method includes the steps of: (a) analyzing a user search query to determine a subject matter of the query; and (b) selecting a sub-set of information from the plurality of information sources based upon the determined subject matter of the query. In a detailed embodiment, the analyzing step combines at least two different methods of deriving a subject matter from the search query. In a further detailed embodiment, the method further includes the step of (c) searching at least one information source in the sub-set of information sources for documents relevant to the search query. In another alternate detailed embodiment, one deriving method of the analyzing step includes the step of comparing at least a portion of the search query against a plurality of entity lists, where each entity list includes a list of phrases, and where each of the phrases corresponds with one or more subject matters; and the comparing step includes the step of matching the phrase in an entity list against at least a portion of the search query, and upon such match, returning a subject matter corresponding to the matched phrase in the entity list.
  • In yet another alternate embodiment of the first aspect of the present invention, one deriving method of the analyzing step includes the step of comparing the search query against a knowledge base, where the knowledge base includes a taxonomy of subject matters and a set of terms for at least some of the respective subject matters in the taxonomy, where the set of terms represent information likely to be found for the respective subject matters; and the comparing step compares at least portions of the search query against the set of terms in the knowledge base to determine the respective subject matters of the matching terms. In a further detailed embodiment, the method further includes the step of building the knowledge base, where the building step includes the steps of: (i) defining a taxonomy of subject matters; (ii) for at least some of the subject matters in the taxonomy, providing at least one example document that represents content typically found for the respective subject matter; (iii) generating a set of terms from the example document; and (iv) linking the set of terms to the respective subject matter. In yet a further detailed embodiment, the taxonomy is structured as a multi-tier hierarchy. In an alternate detailed embodiment, the step of comparing the search query against the knowledge-base further includes a step of assigning a score to the determined subject matter based upon a confidence level of the comparison. In yet a further detailed embodiment, the step of determining a subject matter of the query further includes the steps of displaying one or more of the subject matters having a score greater than a predetermined threshold and selecting, by a user, at least one of the displayed subject matters. In yet another alternate detailed embodiment, the analyzing step determines a plurality of the subject matters, and the method further includes a step of organizing the determined plurality of subject matters according, at least in part, to the scores assigned to the plurality of subject matters.
  • In yet another alternate detailed embodiment of the first aspect of the present invention, the steps of selecting a sub-set of information sources includes the steps of (i) providing a category-to-source map that includes a plurality of categories, where the categories have at least one information source linked thereto, (ii) obtaining at least one category pertaining to the subject matter of the query, and (iii) adding the information source linked to the category in the category-to-source map to the sub-set of information sources. In a further detailed embodiment, each information source is assigned a performance score pertaining to at least one performance quality of the information source. In yet a further detailed embodiment, the method further includes the steps of searching at least one information source in the sub-set of information sources for document(s) relevant to the search query and displaying the search results from the output of the searching step, where the displaying step displays the search results in an order based upon, at least in part, the performance scores of the information sources from which the search results are obtained. In an alternate detailed embodiment, the performance quality is based upon the frequency that the respective information source is accessed, the amount of time spent accessing the respective information source, the frequency of problems accessing the respective information source, and/or feedback provided by users of the respective information source. In yet a further alternate detailed embodiment, the method further includes the step of eliminating from the sub-set of information sources any information source having a performance score lower than a predetermined threshold.
  • In an alternate detailed embodiment of the first aspect of the present information, the method further includes the steps of (c) assigning each information source in the sub-set of information sources a performance score pertaining to performance qualities of the information source; (d) searching the information sources in the sub-set of information sources for documents relevant to the search query; and (e) displaying search results from the output of the searching step, where the search results are ordered based upon, at least in part, the performance scores of the information sources from which the search results are obtained. In a further detailed embodiment, the performance scores are calculated based, at least in part, upon the number of times the respective information source is accessed by a community of users.
  • In yet another alternate detailed embodiment of the first aspect of the present invention, the method further includes the steps of (c) searching the information sources in the sub-set of information sources for document relevant to the search query; and (d) displaying the search results from the output of the searching step, where the search results are segregated for each of the information sources in the sub-set of information sources. In a further detailed embodiment, the searching step searches the information sources in the sub-set of information sources substantially in parallel and the displaying step displays the segregated searches in parallel.
  • In yet a further detailed embodiment of the first aspect of the present invention, the method further includes the steps of: (c) searching a standard information source (such as the World Wide Web) for documents relevant to the search query; and (d) displaying the results of the step of searching the standard information source along with an option, selectable by the user, for searching the sub-set of information sources for documents relevant to the search query upon selection of the option by the user. As mentioned above, this standard information source could be the World Wide Web and further, the sub-set of information sources may be maintained, for example, on a private computer network. In a further detailed embodiment, the analyzing step determines a plurality of subject matters from the query, the selecting step selects a sub-set of information sources for each of the plurality of the subject matters determined in the analyzing step, the displaying step displays the plurality of options for each subject matter determined in the analyzing step, where each option is identified by its respective subject matter in the displaying step and where each option is provided for searching the sub-set of information sources associated therewith for documents relevant to the search query upon selection of the option by the user.
  • In yet a further detailed embodiment of the first aspect of the present invention, the method further includes the steps of (c) searching a standard information source for documents relevant to the search query, (d) searching the sub-set of information sources for documents relevant to the search query, and (e) simultaneously displaying the results of the step of searching the standard information source and the step of searching the sub-set of information sources. In a further detailed embodiment, the displaying step segregates the results of the step of searching the standard information source from the step of searching the sub-set of information sources.
  • In yet a further detailed embodiment of the first aspect of the present invention, the analyzing step determines a plurality of subject matters from the query, and the selecting step selects a sub-set of information sources for each of the plurality of subject matters determined in the analyzing step. In a further detailed embodiment, the method further includes the step of automatically searching the sub-set of information sources associated with the subject matter having the closest match to the search query for documents relevant to the search query.
  • It is the second aspect of the present invention to provide a computer-implemented method for searching a plurality of information sources, where the information sources include at least one secure source. This method includes the steps of: (a) storing security credentials necessary for accessing the secure source; (b) accessing the secure source utilizing the stored security credentials; (c) accessing a non-secure source; (d) searching the accessed sources, substantially in parallel, for documents relevant to a search query; and (e) displaying results of the searching step. In a further detailed embodiment, the plurality of information sources includes a plurality of secure sources, the step of storing security credentials includes the step of storing respective security credentials necessary for accessing each secure source, and the step of accessing the secure source involves the step of accessing the plurality of secure sources, substantially in parallel, using the respective stored security credentials. In yet a further detailed embodiment, the method operates on a computer network system having a plurality of users and the step of storing security credentials includes the step of storing respective security credentials for accessing each secure server by each user of the computer network system. In an alternate detailed embodiment, the security credentials are stored in a database that includes a table for each user, where each table includes a set of respective security credentials for accessing each secure source by each respective user. It is within the scope of the invention that at least certain of the security credentials may be shared by certain users (or groups of users) during the accessing and/or searching steps.
  • In an alternate detailed embodiment of the second aspect of the present invention, the step of storing security credentials includes the steps of recording a user's security credentials as the user preliminarily enters the secure source and storing the recorded user's security credentials for the step of accessing the secure server. In yet a further detailed embodiment, the stored user's security credentials are reusable for multiple steps of accessing the secured server. In an alternate detailed embodiment, the security credentials are used substantially transparently to the user during the step of accessing the secure server. In yet another alternate detailed embodiment, the step of accessing the secure source further includes the step of storing session cookies set by the source for the duration of the search process.
  • It is a third aspect of the present invention to provide a computer-implemented method for searching a plurality of searchable information sources by a plurality of users to a computer network system, where the information sources include at least one secure source. The method includes the steps of: (a) for each user, storing security credentials necessary for accessing the secure source; (b) accessing, by each user, the secure source utilizing the stored security credentials for each user; and (c) searching the accessed secure source, by the plurality of users, substantially in parallel, for documents relevant to one or more search queries. In a further detailed embodiment, the method further includes the step of (d) creating a session record for each user accessing the secure source. In a further detailed embodiment, the session record includes cookies, session parameters, session IDs, and/or a session state. In yet a further detailed embodiment, the information sources include a plurality of secure sources, the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of the secure sources, the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user, and the searching step includes the step of searching the accessed secure sources, by the plurality of users, for documents relevant to one or more search queries. In yet a further detailed embodiment, a session record is created each time a user accesses a secure source.
  • In an alternate detailed embodiment of the third aspect of the present invention, the information sources include a plurality of secure sources, the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of secure sources, the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user, and the searching step includes the step of searching the accessed secured sources, by the plurality of users, for documents relevant to one or more search queries.
  • It is a fourth aspect of the present invention to provide a computer implemented method for generating searchable source brokers for defining interface parameters specific to each of the searchable sources. The method includes the steps of: (a) accessing a given searchable source; (b) performing an example search on the given searchable source to produce search results by that searchable source; and (c) identifying regular expressions from the search results. In a further detailed embodiment, the method further includes the step of storing the regular expressions for the given searchable source for subsequent reuse by a federated search system. In a further detailed embodiment, the step of identifying regular expressions is performed substantially automatically, the method further includes the step of reviewing, by a user, output of applying the regular expressions to search results produced by the given searchable source, and the method further includes the step of approving by the user the regular expressions based upon the reviewing step. In a further detailed embodiment, the method further includes a step of modifying the regular expressions by the user before the approving step, if the user determines the modifying step is necessary based upon the reviewing step. In an alternative detailed embodiment, the reviewing step involves the step of simultaneously displaying to the user the search results produced by the given search and the output of applying the regular expressions to the search results.
  • In an alternate detailed embodiment of the fourth aspect of the present invention, the step of identifying regular expressions includes the steps of: (i) parsing the search results to distill a structure of the search results; (ii) identifying repeating blocks of information from the parsed search results; (iii) identifying essential search-result elements from the repeating blocks of information; and (iv) generating a regular expression for each identified essential search-result element and a regular expression for the repeating block. In a further detailed embodiment, the essential search-result elements include a title, a URL, a date, a keywords, a summary, a passage, and/or a score.
  • It is a fifth aspect of the present invention to provide a computer implemented method for accessing information from a plurality of searchable information sources. The method includes the steps of: analyzing a user's search query to determine a subject matter of the query; selecting a subset of information sources from the plurality of information sources based upon the determined subject matter of the query, wherein at least one of the subset of information sources is a secure information source; accessing the secure information source utilizing stored security credentials for the information source; and searching the information sources in the subset of information sources for documents relevant to the search query. In a more detailed embodiment the searching step involves the step of searching the information sources in the subset of information sources, substantially in parallel, for documents relevant to the query. In an alternate detailed embodiment, the step of accessing the secure information source utilizes the stored security credentials substantially automatically and substantially transparently to the user.
  • In another alternate detailed embodiment of the fifth aspect of the present invention the step of searching the information sources in the subset of information sources utilizes source brokers for each of the information sources in the subset of information sources, where the source brokers define patterns of search-result information specific to their respective information source. In a further detailed embodiment, the source broker for the secure information source includes the stored security credentials utilized in the accessing step. In an alternate detailed embodiment, method further includes the step of defining the source broker for each of the information sources in the subset of information sources. In a further detailed embodiment, the defining step includes the steps of: preliminarily accessing the respective information source; preliminarily performing an example search on the respective information source to produce example search results; identifying regular expressions from the example search results; and storing the regular expressions as at least part of the source broker. In a further detailed embodiment, the defining step further includes the steps of detecting whether the respective information source is a secure information source, and if the detecting step determines that the respective information source is a secure information source, performing the additional steps of: providing a log-in form for the secure information source; logging into the secure information source by entering the appropriate log-in information to the log-in form by the user; recording security credential information provided by the user during the logging step; and storing the security credential information with the respective source broker.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a general block diagram of the system architecture of the exemplary embodiment of the present invention;
  • FIG. 2 is an example screen-shot illustrating the universal search interface of the exemplary embodiment;
  • FIG. 3 is an example screen-shot of the exemplary embodiment illustrating intelligent source selection capabilities combined with general search results;
  • FIG. 4 is an example screen shot of the exemplary embodiment illustrating intelligent query routing to subsets of information sources with general search results;
  • FIG. 5 is an illustration of a source taxonomy, an organization of searchable information sources in XML format, of the exemplary embodiment;
  • FIG. 6 is an illustration of a structure of mapping subjects to information sources, maintained in an XML file, of the exemplary embodiment;
  • FIG. 7 is a block diagram representation of the interplay between the intelligent source selection, federated search and adaptive learner functions of the exemplary embodiment;
  • FIG. 8 is an illustration of example entity lists according to the exemplary embodiment;
  • FIG. 9 is an illustration of a structure of mapping entity lists to information sources, maintained in an XML file, of the exemplary embodiment;
  • FIG. 10 is an illustration of a subject taxonomy and example documents linked to the subjects in the subject taxonomy, according to the exemplary embodiment;
  • FIG. 11 is an illustration of the information performance source ranking structure according to the exemplary embodiment;
  • FIG. 12 is an example output representation of a broker definition generated by the broker-definition tool according to the exemplary embodiment;
  • FIG. 13 a block diagram representation of the multi-user, multi-source, multi-modal secure information source architecture according to the exemplary embodiment;
  • FIG. 14 is an illustration of a session-details database utilized by the exemplary embodiment for secure information source handling;
  • FIG. 15 is an example screen shot of the exemplary embodiment illustrating an initial stage of the broker-definition tool;
  • FIG. 16 is an example screen shot of the exemplary embodiment illustrating an extraction testing stage of the broker-definition tool;
  • FIG. 17 is an example screen shot of the exemplary embodiment illustrating a query definition stage of the broker-definition tool;
  • FIG. 18 is an example screen shot of the exemplary embodiment illustrating another testing stage of the broker-definition tool; and
  • FIG. 19 is an example screen shot of the exemplary embodiment illustrating secure source handling stage of the broker-definition tool.
  • DETAILED DESCRIPTION
  • The present invention provides an enterprise-scale system and method for searching and retrieving electronic information from disparate electronic information sources within a large organization (an intranet) and/or from the Internet. At the heart of the system is a “federated search” architecture and system that enables a single search query from a user to be delivered (preferably, in real-time) to various searchable information sources.
  • As used herein, “information source”, “source” and “searchable information source” pertain to searchable information sources accessible over a data network such as, for example, the World Wide Web or a proprietary computer network. The searchable information sources will typically be search engines, or may include search engines or search capabilities associated therewith that provides the ability for a user to search the searchable information source for desired information. It is not necessary, however, for the searchable information source to have its own search capabilities embedded therein or associated therewith, as such search capabilities can be provided elsewhere. Examples of such searchable information sources accessible over the World Wide Web include, MSN.com, LYCOS.com, TEOMA.com, Intellihealth.com, WebMD.com, WSJ.com, etc. Likewise, “secure information source”, “secure source” and “secure searchable information source” pertain to such searchable information sources that require certain security credentials (such as passwords, for example) to access and/or perform searches therein/therewith.
  • As used herein, “search query” and “query” pertain to an expression of the information that a user or system wishes or requests to search for in one or more searchable information sources. While the expression will typically be in the form of a term or phrase typed into a field of an electronic form by the user, it is within the scope of the invention that the expression be automatically generated and presented to the searchable information source(s) and it is within the scope of the invention that the expression be pre-stored and presented to the searchable information source(s).
  • As used herein, “document” means an electronic body or collection of information or data that the user or system will typically be provided access to by the searchable information source(s) in the search result(s) provided by the searchable information source(s) (although some searchable information sources only identify the documents, without providing access). This is typically the body or collection of information or data that the user/system is ultimately seeking in the searching process.
  • As used herein, the act of “searching” an information source or within an information source, and the act of “searching by” an information source pertains to the act of applying the search query to one or more of the searchable information sources to produce search results, which may or may not provide the user/system access to documents; but which will usually provide at least the identity of document(s) if the search is successful. It is to be understood that the present invention is not limited to any specific searching algorithm or technique.
  • As used herein, the act of “comparing” or “matching” a search query (or any other expression of information/data) against another expression of information/data pertains to the use of any available techniques and/or algorithms to perform a lexical comparison of the expression (or a portion of the expression) against terms, phrases or other expressions of information or data in the other entity. The results of this comparison often do not necessitate exact matches to be considered “successful”; and, thus, often include confidence scores with the results that indicate the relative confidence or closeness of the comparison. While the exemplary embodiments herein often refer to lexical comparisons, it is within the scope of the invention that alternate techniques/algorithms be used when the comparison is not a language-based comparison.
  • FIG. 1 provides a functional flow diagram representation of the federated search system deployed according to an exemplary embodiment of the present invention. The searching function 10 provides a configurable, hierarchically organized group of information sources, described below, to users to fulfill different information needs and requests from the multiple groups of users. A simple search involves taking search query terms from the user to conduct the search. An advanced search enables users to select multiple groups of sources, or multiple sources within a group, and to control many settings, including the depth of the search, analysis options, and time-outs. Personalized searching preferences are stored for each user by the system. Searches initiated in the system are conducted in real-time, and results are displayed in configurable web page format or in XML format.
  • In the intelligent source selection function 12, a user's search query is analyzed to determine the subject matter corresponding to the user's query. Upon identifying this subject matter of the search query, a sub-set of information sources can be isolated from the vast body of information sources to perform the search. For example, a search for “pancreatic cancer treatment protocol” can be determined by the system to be broadly based on the subject-heading of “health”, and more specifically, on the specific subjects of “diseases and conditions”, and “endocrinal disorders”. The sub-set of information sources is selected by consulting an information source hierarchy, or subject-to-source map, to find the best sources for the identified subject matters. These best performing sources can automatically be given preference for searching in real-time in addition to user-selected information sources, or these best sources can be offered as recommendations to the user for performing further related searches.
  • The federated searching function 14 implements the actual real-time, distributed searching mechanism. This function receives as inputs the search query parameters and other optional advance settings, and accesses one or more groups of information sources to perform the federated searching in all or certain subsets of the information sources. Information sources from which the real-time federated searching may be conducted include visible Web sources 16 accessible over the Internet, invisible Web sources 18 accessible over the Internet, enterprise sources 20 (private information sources accessible by the system over the system's intranet, for example), and subscription sources 22, which may be accessible over the Internet or through separate network connections. Each information source in the sub-set of selected information sources is searched by the system in real-time, with user credentials being transparently proxied, if necessary, to each secure source 22. Multi-processing and multi-threading mechanisms are implemented for scalability to large numbers of concurrently searched sources as well as large numbers of concurrent users searching with the system. This federated searching function 14 translates a user's search query into the native forms required for each information source, communicates with each information source using native protocols and methods, navigates through one or more search result sets from each source, extracts search result records including uniquely defined fields of information for each of the records from each source, normalizes the results, removes duplicates, and performs composite relevance ranking based upon specified, configurable relevance ranking criteria. An XML result stream is produced that can be operated upon by other components in the system.
  • The analysis/filtering function 24 is optionally triggered by the user to perform real-time retrieval and analysis of the full-text contents (documents) for each result from the composite result set delivered from the federated searching function 14. Each “document” is retrieved from the corresponding information source in the essential text content along with relevant meta-data is extracted from it. This function 24, in essence, “converts” content from different document formats like Adobe PDF, Microsoft Word, etc. to native text. The text and meta-data content corresponding to each result record is then passed through a real-time filtering component that takes one or more search queries representing the user's input and then determines the strength of match of the result to the user's need. In this analysis/filtering function 24, the passages (sentences or paragraphs) from the documents matching the user's query are extracted and ranked to determine the strength of the match and to compute a native “analysis score” which is used for relevance ranking purposes. Next, a dynamic summary is composed from the extracted passages for each matching document. Each result record is then enhanced with additional meta-data including an “analysis score”, an updated relevance score, a dynamic summary snippet, as well as additional information when the result document doesn't match the user's query.
  • The categorization function 26 categorizes the results from the federated searching (and, optionally, the analysis/filtering function 24) into a configured subject taxonomy. An administrator first creates a taxonomy of subjects representing a given information domain, provides example documents for each subject, and runs an administrative tool to train the taxonomy and create a model that is used for the real-time categorization of the search result documents. During searching, the categorization process involves deriving a “fingerprint” (important terms representative of a respective content of the record, which can be phrases or individual words) from each result record and matching it with the taxonomy model configured for use in the system. The best matching subject is determined for each result record, and is tagged as additional meta-data in the result record. In the presentation function 28, the results from the previous steps of searching 10, analysis/filtering 24, and categorization 26 are received in XML. A standards-based template mechanism allows the results to be displayed rapidly in any desired format. Information can be organized into multiple views such as “by relevance,” “by source”, and “by concept.” The relevance view orders the results at decreasing order based upon the “relevance score”. The source view provides a graphical tree-view of the results organized by the sources from which they came from. And the concept view provides a graphical, tree-view of the results, organized into the matching taxonomy of subjects from the categorization process 26.
  • The tracking/alerts function 30 is an optional function that may be set up to run periodic searches for a given search query or set of search queries automatically and to alert the user when a desired set of results are obtained from the periodic searches, or when any results are obtained.
  • Referring to FIG. 2, an example screen display 32 of initial searching screen provides a field 34 into which a searcher can enter a search query. If the user enters the search query in this field, the exemplary embodiment will perform an automatic search as described in further detail below. Optionally, prior to entering a search query, the user can select specific subjects from the source taxonomy 36 (provided in this exemplary embodiment in the form of hyperlinks) to allow the search to be performed within narrow sub-sets of information sources specific to the subject matter of interest. The taxonomy 36 in the exemplary embodiment includes an upper level of subjects 38 that generally define a subject matter and a second tier of more specific subject matters 40. As will be discussed in further detail below, upon selecting an identified subject (hyperlink) in the source taxonomy 36 displayed in the window 32, the system will then perform the searching in the specific sub-set of sources represented by the subject heading/subject 38/40 selected by the user.
  • As shown in FIG. 3, an example screen shot 42 is provided that illustrates the results of performing a general search of the exemplary embodiment using the search query of “cjd”. In the exemplary embodiment, if no specific subject headings 38 or subjects 40 are selected from the subject taxonomy 36, then the exemplary embodiment will perform the search set forth in the search query from a federated group of Web search engines (such as “MSN”, “LYCOS”, “TEOMA”, etc.) and display the results of the search on the screen in order based upon relevance of the documents from the search results in comparison to the subject of the search query. Additionally, the exemplary embodiment also analyzes the search query to determine a subject matter (or subject matters) of the query and provides links to the subsets of information sources 44 (in the form of hyperlinks) associated with the subject matter(s) determined from the search query above the general search results. If the user selects the identified subsets of information sources 44, the system will perform the same search in the sub-set of information sources. Exemplary methods for identifying the subject matters from the search query 34 are discussed in further detail below. In the example shown in FIG. 3, the search query “cjd” was identified by the system as being related to the specific subject matters, “Health tips”, “Health news” and “Health discussions”. The system was able to make this recommendation based upon analyzing the query and identifying that the closest subject heading that it corresponded to was health; hence, the recommendation from the system that this search be conducted within “health-related” sources.
  • As shown in FIG. 4, when a general search is requested, the exemplary embodiment may also be configured to automatically perform the search within a sub-set of information sources corresponding to a subject matter matching the search query. The display 46 shown in FIG. 4 illustrates that the specific search for the search query “cjd” was automatically conducted within the sub-set of information sources associated with the “Health Tips” subject matter. The search results resulting from this specific search may come from information sources such as “American Medical Association”, “Intellihealth”, and “WebMD”, etc. for the best results on the subject.
  • FIG. 5 illustrates the exemplary structure of the source taxonomy 36, and FIG. 6 illustrates the exemplary subject-to-source map 42 (also referred to, herein, as a category-to-source map). As discussed above, the subject-to-source map 42 is used to identify one or more information sources corresponding to identified subject matters of the search query, to allow for more focused searching of the subject matter in these sources. The subject-to-source map 42, in the exemplary embodiment, is arranged as a hierarchy that includes an upper level of subject headings 38 (such as “health”), and for each subject heading 38 there are one or more information source subsets 41 such as “health news”, “health publications”, “health tips”, and “alternative medicine” linked thereto. Finally, for information source subset 41, there are linked to it one or more information sources 48. For example, the specific subject “health tips” will have linked to it information sources such as “American Medical Association”, “Intellihealth.com”, “WebMD.com”, etc.
  • FIG. 6 more specifically illustrates how a subject in the ontology is mapped to a group of sources or to a single source by an administrator in the exemplary embodiment. Health as a general subject 38 may be mapped to a group of searchable sources 40 called “health tips”. The more narrow subjects under the general subject “health”, such as “cancer”, may be mapped to specialized sources providing information on cancer treatment, cancer trials, etc. The ability to map the subject headers and specific subjects to information source(s) is completely flexible and can be tuned to the needs of the specific search scenario in which the system will be used.
  • Referring to FIG. 7, as discussed above, the intelligent source selection function 12 utilizes a query analysis algorithm to determine a subject matter or subject matters of the search query, where such identified subject matters are used to help the user identify specific sub-sets of information sources to perform more focused searches. Generally, the query analysis algorithm uses a combination of deterministic look-ups within a group of provided entities lists 50 along with fuzzy look-ups (“auto-categorization”) within a knowledge-base 54 to determine within a certain degree of confidence the subject matter of the query. Then, based upon the determined subject matter(s), subsets of information sources can be provided for these subject matter(s) using the subject-to-source map 42.
  • Examples of entity lists 50 can be found in FIG. 8. For example, an entity list can include a list of ticker symbols or an entity list can include a list of company names. Other representative entity lists could be, for example, health conditions, places, sports, etc. Generally, an entity list 50 is a list of words, names, or other terms that collectively fall under a general subject heading 38 or fall under a specific subject 40. As will be discussed in further detail below, the more general entity lists are referred in the exemplary embodiment as “fall through” lists (having a lower confidence level) and the more specific entity lists are referred to as non-fall through lists (having a higher confidence level).
  • FIG. 9 provides an example entity list-to-source mapping 52 which maps certain entity lists directly to specific subject matters. For example, the mapping shown in FIG. 9 includes the entity list “places” mapped to the specific subject matters “maps”, “travel guides”, “almanacs”, and “encyclopedias”. Additionally, the entity list “ticker symbols” is mapped to the subjects “financial discussions”, “financial tips”, “company profiles”, “SEC filings”, and “mutual funds”.
  • Referring again to FIG. 7, as mentioned above, the fuzzy look-up step involves a “digital fingerprint” match of terms in the search query with “digital fingerprint” of topics in a subject knowledge-base 54. This methodology is referred to as “auto-categorization”, emanating from the problem of trying to “automatically” find the “category” in a taxonomy that a stream of input text corresponds to. An example of the knowledge-base is shown in FIG. 10. The left pane 56 in the display illustrates a subject hierarchy labeled the “Whole Web Subject Taxonomy”. The first level 58 in the hierarchy are the general subject headings such as “Health”, the next level 60 in the hierarchy includes more specific subject headings such as “Alternative”, “Child Health”, and “Conditions and Diseases” and the most specific level 62 in the hierarchy includes very specific subject matters such as “Cancer”, “Cardio-Vascular Disorders”, “Communication Disorders”, “Digestive Disorders”, etc., which are specific subjects of the “Conditions and Diseases” subject heading in the second tier 60. The right pane 64 of the display provides a list of example documents 65 identified by the administrator as being relevant to the selected subject, “Digestive Disorders”, in the specific level 62 of the subject hierarchy 56.
  • Therefore, once the taxonomy of subjects 56 is created and example documents 65 are provided to represent content typically found for each subject, the system will then learn from these example documents to create the knowledge-base 54 of subject matter representing the ontology. In the general sense, the knowledge-base includes a list of words, phrases or other terms “learned” from the example documents provided for each subject. Generally, the methodology for “learning” from a taxonomy of subjects and example documents for each subject, is based upon creating topic or subject specific “digital fingerprints” using the familiar vector-space model for analyzing and representing a body of unstructured texts. The “digital fingerprints” for topics are, in essence, weighted vectors of terms (words and phrases) that best represent information most likely to be found in those specific topics. This “digital fingerprint” information is then stored in the “subject knowledge-base” for enabling the query analysis.
  • More specifically, in the vector-space algorithm, a vector-space model is trained off-line by parsing the collection of example documents for each subject to generate a representative vector of terms and frequencies for that subject. In the implementation of the exemplary embodiment, the terms identified can be individual words or phrases (phrases are determined via a measure known as mutual information). Typically, the subject matter vectors are normalized in some fashion, to account for variation in the size and number of training documents. In addition, a uniqueness score is calculated for each term associated with a given subject. This uniqueness score is often referred to as “IDF” for “inverse document frequency” since one over the number of documents that a term appears in is one way to measure uniqueness. In the present exemplary embodiment, the uniqueness score is one over the total of all normalized category vector weights for that term. To classify texts, a vector-space classifier parses the text to be classified to generate the vector of terms in frequencies. This vector is compared with the vectors computed off-line for each subject matter, taking into account the uniqueness of each term. In the implementation of the exemplary embodiment, for each subject matter that has a non-zero normalized weight for all terms in the text vector, and for each term in the text, the term frequency from the text is multiplied with the normalized weight for the subject matter, then that value is multiplied by the uniqueness score for the term exponentiated by a configurable constant. These values are summed to give a score for each subject matter. The resulting values determine which subject matters best match the text.
  • In the exemplary embodiment, the search query analysis program operates substantially as follows. Given a user's search query, at least portions of the search query (i.e., after possibly eliminating stock words, and/or after stemming remaining words to root form) are compared against zero or more of the entity lists 50, each of which may be stored in RAM as a dictionary. As discussed above, the general entity lists (having lower confidence levels) are designated as fall-through lists, while the more specific entity lists (having a higher confidence value) are designated as non-fall-through lists. Accordingly, the fall-through lists are assigned a confidence score of 1.0 and the non-fall-through lists are assigned confidence scores of 1.5. If the search query is matched with one or more of the non-fall-through lists, then the exemplary embodiment does not perform the “auto-categorization” of the search query; however, if not found in a non-fall-through list, then the query is compared against the “fingerprints” in the knowledge-base 54 to identify subject matters corresponding to the “fingerprint” of the search query. Any matches in this comparison will be assigned confidence levels from 0 to 1 depending upon the confidence of the match. The subject matters developed from the auto-categorization step are added to the array of subject matters developed in the comparison with the entity lists above. At this point, there exists an array of subject matters (entity list names and subject headings from the knowledge-base) along with associated confidence levels, where the array is sorted by the confidence level. Each entry in the subject matter array is linked to a sub-set of information sources using the subject-to-source map 42 as discussed above. In the exemplary embodiment, if a particular subject category from the array is not found in the subject-to-source map 42, the parent category will be checked for a sub-set of information sources. For example, if the subject matter heading “health/conditions&diseases/digestive_disorders” is not found, then a look-up will be made for “health/conditions&diseases”. This step is repeated until a sub-set of information sources is matched to the subject matter (i.e., if “health/conditions&diseases” is not matched with a sub-set of information sources, then a look-up will be made for the general heading of “health”). Thus, an array of searchable information source groups associated with the array of subject matters and associated confidence levels has been constructed.
  • Furthermore, each information source in each respective sub-set of information sources may also be ranked with respect to each other utilizing the adaptive learner function 56. Generally speaking, the adaptive learner function 56 provides a method for prioritizing the information sources by rating (in real-time) the information sources based upon the popularity of the source or upon other performance or statistical considerations (or combinations thereof) to provide performance scores 57 for the information sources. The adaptive learner process is a means to learn the on-going performance of sources (in the manner in which they return relevant results to users on various subjects), so that the intelligent source selection function 12 continually improves and keeps pace with the changing content or behavior of the individual sources. From a simplistic perspective, this method simply rates the up-to-minute popularity of each source for each subject in the ontology.
  • As shown in FIG. 11, an internal database 58 maintains an internal ranking of the performance of sources in specific subject areas. For example, the highlighted source in FIG. 11 “Mayo health” database has been rated as the best performing source by the system having a performance score 57 of 0.61. Some of the performance criteria utilized in adjusting this performance score include: (a) adjusting the performance score based upon the number of times users access the source from search result listings; (b) adjusting the score based upon the amount of time spent on each source; (c) adjusting the score based upon access problems or performance of the source (such as, lowering the score if users have trouble accessing the source at various times); and (d) adjusting the score based upon user feedback, such as through questionnaires or rating polls. The impact of the adaptive learner function 56 is not typically instantaneous to start with. Depending on the subject-spread of the queries being performed, the source is put to use, and the volume of users and queries, the adaptive learner process 56, over time, provides a reasonably accurate measure of the performance of specific sources on specific subjects.
  • As mentioned above, the adaptive learner process 56 gauges the “popularity” of a particular information source for a particular subject measured, in the exemplary embodiment, through result “click-throughs” from the community of users. The result links returned from the federated search function 14 are directed to a “click-through” handler when activated by a user. The “click-through” handler redirects the user's browser to the actual result after optionally updating the per-source category weights for the information sources that returned the result. Optionally, the per-source category weights can be adjusted by the “click-through” handler periodically (i.e., every 100th access) to reduce the rate of change. In the exemplary embodiment, each result link returned from the federated search function 14 include the following: the original result link; a list of the information sources that returned the result; the ESS query; and a list of the subjects assigned to the search query.
  • In addition to the “click-through” handling described above, the following measures can also be used to stabilize the “learning loop”.
      • 1. Measure the duration of time the user spent looking at/reading through a give result document and use this to discern the “usefulness” of the document to the user, and by correlation, the usefulness of the information source that returned that document for the subject corresponding to the search query;
      • 2. Categorize the result document matched up with the subject corresponding to the user's search query; and/or
      • 3. Assign a penalty (something the would reduce the weight value) to information sources, or are slow to respond periodically.
  • Referring again to FIG. 7, the federated search function 14 performs the substantially parallel real-time searches on the plurality of information sources. The federated search function 14 utilizes brokers 66 which are electronic definitions stored on the system that define for each of the information sources to the federated search function 14 how to interface with the respective information source; for example, how the federated search function 14 is to communicate with the information source, how the federated search function is to structure its queries (in its native form) to the specific information source, how the federated search function 14 interprets results from the particular information source, how the federated search function is to navigate through multiple “pages” of the results set from the specific information source, any security methods used by the particular information source, etc. An example broker definition for the Intellihealth.com information source is provided in FIG. 12.
  • The present invention also makes it possible for non-operational brokers (brokers can become non-operational if the information source they correspond to ceases to exist, moves to a different location, delivers different content, delivers content in a different format, has new capabilities for search and retrieval, has new security structures, etc.) to be healed automatically through an automated background testing process.
  • As mentioned above, the brokers 66 can provide the security parameters and credentials necessary for federated search system to access a secure or subscription information source or sources 22. Consequently, the present invention also provides a security handling architecture that enables the system to proxy user credentials for multiple users to multiple secure sources using multiple security methods in real-time.
  • As shown in FIG. 13, the multi-user, multi-source, multi-modal security architecture utilizes a security broker function 68 within the federated search system that utilizes user security information 70 and security parameters embedded within the brokers 66 to drive the multi-user session manager 72. The multi-user session manager 72 creates an active user session 74 for each secure source 22 respectively accessed by each user. Therefore, if, for example, WSJ Archives are accessed by thirty-three of the active users, then thirty-three active user sessions 74 will be created for each individual access.
  • The security broker 68 is invoked during the federated search function 14 for each secure information source in the search request. The security broker 68 examines the broker definition 66 to determine the type of authentication (e.g., basic authentication, challenge-response, log-in form, etc.) required by the secure information source 22. For secure information sources that use a log-in form, the broker definition 66 will also describe the log-in parameters used by the information source. Next, the security broker 68 retrieves the authentication credentials 70 assigned to the user for the secure information source. This information is stored in the user security database 70. Using the combined information, the security broker 68 performs the initial steps in the establishment of the per-user session and verifies that the session has been successfully initialized. If the secure information source uses session parameters, the security broker 68 extracts the parameters from the response and stores them in the respective active user session 74. From this point on, the federated search process 14 proceeds normally. If the secure information source 22 uses session parameters, the security broker 68 will be re-invoked at each step in the search process to transmit the appropriate session parameters for the respective active user session 74. As discussed above, the session manager 72 is responsible for maintaining a separate active user session 74 for each user/source combination. Separate “session parameters” are maintained by the session manager 72 for each active user session 74. FIG. 14 illustrates the conceptual organization of the internal security information structure maintained by the session manager.
  • As shown in FIG. 14, session parameters are stored in “Session Details” records and state is managed for each secure source searched by each user in real-time. Such session parameters may include, cookies, session parameters, session IDs, sessions date, etc. The session parameters will vary depending upon the mode, type of security encountered at each secure source. Using this dynamic security information structure, the session manager 72 maintains the integrity of the unique security requirements at each secure source 22 in a multi-user environment, while at the same time, not compromising a user's privacy of individual security requirements. It should be understood that it is within the scope of the invention that at least certain of the security credentials and/or session parameters may be shared by certain users (or groups of users) during the accessing and/or searching steps. These shared credentials/parameters may be included in the “Session Details” records for each user or in a shared record accessible for all users sharing the credentials/parameters.
  • FIG. 15 illustrates a visual broker-definition tool 76 (referred to as the “Agent Development Kit” or “ADK”) that provides the exemplary embodiment of the present invention with the ability to create the brokers 66 for the information sources using a substantially automated process. This broker-definition tool 76 automatically analyzes the structure and form from the search result content generated by a searchable information source to determine patterns that exist within it; and automatically generates the necessary pattern extraction logic for the broker substantially without any user involvement. The broker-definition tool 76, in this exemplary embodiment, utilizes familiar “wizards” interface in a left pane 78 to guide the user rapidly through the broker generation process. The right pane 80 provides visual results of the information source search result output or of the broker output. As can be seen in FIG. 15, the interface pane 78 first requests that the user enter the information source address in field 82 and activate the “Capture” icon 84. In the right pane 80 the graphical interface for the selected information source is presented. Next, the interface 78 requests that the user run a search query on the requested information source and wait for the results to be displayed. As can be seen in the right pane 80 on FIG. 15, the user has requested a search for documents related to “patio furniture”. Finally, this interface 78 requests that the user enter the number of results received on the page shown in the pane 80. When these three steps are completed, the user activates the “Next” icon 86.
  • Referring to FIG. 16, the broker-definition tool 76 then automatically extracts search results 88 from the search results generated by the information source shown in the pane 80. The broker-definition tool accomplishes this utilizing automatic pattern detection, extraction and generation. The basis for this process can be understood by noting that virtually every searchable source provides its search output through a program-generated HTML page. Inherent in this observation is the fact that program-generated pages (especially where repeating elements are included, like a series of search results) have some pattern driving its production. This makes it possible, in most cases, to put together a methodology to find that pattern, and generate logic to extract it. Consequently, the broker-definition tool extracts the search results from the information source, generally, using the following methodology; first, the HTML document corresponding to the result page shown in the pane 80 is saved locally to a file; next, the file is parsed utilizing a specialized parser that distills the “structure” of the page (locating tables, paragraphs, divisions, etc.) from the “cosmetics” of the page (what font is being used, what color is being used, where an image is inserted, etc.); next, with this distilled structure of the page, the broker-definition tool proceeds to find “blocks” of structure (paragraphs, table rows, tables, etc.) repeating some minimum number of times (the broker-definition tool takes the input provided by the user on the previous page answering the question “enter the number of results you received on the page.”); next, if at least some minimum number of repeating blocks are discovered, then the broker-definition tool looks to see that these blocks contain some essential elements that are typical of search results (“essential elements”, for example, are fields or entities such as a URL—a link to a detailed record, a title—a brief title of the individual results, a date, a summary, etc.); next, if the blocks have been found to contain at least some of these essential elements, the broker-definition tool proceeds to create “regular expressions for each of these fields” and one for the blocks representing the result record; with the regular expressions in place, the broker-definition tool proceeds to apply the regular expression on the text of the original result page and extracts only those portions of the text that correspond to the result records and fields contained within them; finally, these extracted results are then displayed in the left pane 88 as shown in FIG. 16.
  • A “regular expression” is a classic computer science device utilized to “extract” the desired portion of text or other information from a larger stream of text. See
      • http://www.python.org/doc/lib/re-syntax.html or
      • http://msdn.microsoft.com/library/default.asp?url=/library/enus/script56/html/js56jsgrpRegExpSyntax.asp
        for more information on regular expressions. Typically, regular expressions have been created by advanced/power users or developers for solving information extraction problems. The broker-definition tool methodology takes this powerful method and makes it work in a simple visual interface.
  • If the broker-definition tool 76 is successful in performing the automatic pattern detection, regular expression generation and result extraction for every single source available, then the broker generation process could indeed become 100% automatic. Nevertheless, the process is semi-automated because there are typically situations where there are exceptions that cannot be dealt with automatically by the broker-definition tool such as, for example: when unique fields of information exist within the result records, (for example, a thumbnail picture, a price, a delivery date, etc., that may all be specific to a search source, these need to be specified by the user and then the broker-definition tool can generate the expressions for them); and when the search result records vary in structure for each record (for example, the source may optionally include, for example, a special discount price only for a few of the returned records).
  • FIG. 17 illustrates a source-specific “search query translation” in the interface 78 of the broker-definition tool 76 to enable universal searches to be conducted using a single query language to multiple disparate sources. As shown in FIG. 17, in the interface pane 78 the user is able to select alternate languages other than English that are supported in the information source's query field. Then, the interface provides fields 92 where the user can specify the symbols or terms used for the boolean operations of a general search tool. Therefore, the system of the exemplary embodiment of the present invention implements capabilities such as searching for “all of the words”, “any of the words”, “phrase”, “boolean”. Boolean queries specifically allow users to combine terms using operators such as ‘AND’, ‘OR’, ‘AND NOT’, ‘NEAR’, ‘NEAR/N’ to accurately gather the type of information needed. Each information source, however, is equipped with different levels of capability for searching the information repositories they provide access to. Specifically, the query language syntax may vary widely. For example, in some sources, the search for
      • <“pancreatic cancer” and “treatment protocol”>
        may be expressed as
      • <+“pancreatic cancer”+“treatment protocol”>
        This means that queries provided for federated searching by users need to be “translated” into the native syntax for each source by the brokers 66. This query translation is specified through the broker definition process, and it enables universal searches to be conducted using a single query language to multiple disparate sources.
  • FIG. 18 illustrates a self-contained testing capability within the broker-definition tool 76 that permits a broker that has been created to be tested immediately. The interface pane 78 provides fields 94 for the user to enter a search query, a search type and list the number of pages in the results. These fields may also request a user name and password if the source is a secure source. Once these fields are filled in the user activates the “test icon” and a testing interface will actually perform a live query against the information source (for which the broker is being defined), just as the federated search function 14 would in the run-time system, and gathers the result data, and applies the broker definition to extract result records in all the defined fields of each result record. This extracted result set is presented in the right pane 80 to give instant feedback to the user on how well their broker definition is working and if it is ready for deploying to the run-time system.
  • FIG. 19 illustrates how the broker-definition tool 76 is able to capture security information for a secure source. The broker definition can capture information by multiple security methods including the standard “HTTP basic authentication”, and “web-based log-in forms”. As shown in FIG. 19, the interface pane 78 includes a form 98 in which the user can identify the type of security that is being used by the search engine and a field 100 where the user enters the URL or address of the secure information source. Once the log-in page for the secure source is loaded into the right pane 80, the broker-definition tool captures the necessary log-in details, such as navigating the log-in form, logging in, navigating to the search interface, etc., by “watching” (recoding) the user's interaction with the information source in the right pane 80. These security credentials will then be stored in the brokers 66 as discussed above. As also discussed above, the security broker 68 during the federated searching function 14 will essentially “replay” the log-in process to connect to the secure information source, and to supply the user's credentials for that source transparently, prior to performing a search. Nuances such as handling session cookies that may be set for each user, by each secure source, are transparently handled by the security broker 68 at run-time.
  • Following from the above description and invention summaries, it should be apparent to those of ordinary skill in the art that, while the systems and processes herein described constitute exemplary embodiments of the present invention, it is to be understood that the invention is not limited to these precise systems and processes and that changes may be made therein without departing from the scope of the invention as defined by the claims. Additionally, it is to be understood that the invention is defined by the claims and it is not intended that any limitations or elements describing the exemplary embodiments set forth herein are to be incorporated into the meaning of the claims unless such limitations or elements or explicitly listed in the claims. Likewise, it is to be understood that it is not necessary to meet any or all of the identified advantages or objects of the invention disclosed herein in order to fall within the scope of any claims, since the invention is defined by the claims and since inherent and/or unforeseen advantages of the present invention may exist even though they may not have been explicitly discussed herein.

Claims (19)

1. A computer implemented method for searching a plurality of searchable information sources, the information sources including at least one secure source and at least one non-secure source, the method comprising the steps of:
storing security credentials necessary for accessing the secure source;
accessing the secure source utilizing the stored security credentials;
accessing the non-secure source;
searching the accessed sources for documents relevant to a search query; and
displaying results of the searching step.
2. The computer implemented method of claim 1, wherein the searching step searches the accessed sources substantially in parallel.
3. The computer implemented method of claim 2, wherein:
the plurality of information sources includes a plurality of secure sources;
the step of storing security credentials includes the step of storing respective security credentials necessary for accessing each secure source; and
the step of accessing the secure source involves the step of accessing the plurality of secure sources, substantially in parallel, utilizing the respective stored security credentials.
4. The computer implemented method of claim 3, wherein:
the method operates on a computer network system having a plurality of users; and
the step of storing security credentials includes the step of storing respective security credentials for accessing each secure server by each user of the computer network system.
5. The computer implemented method of claim 4, wherein the security credentials are stored in a database, wherein the database includes a table for each user, and wherein each table includes the set of respective security credentials for accessing each secure source by the respective user.
6. The computer implemented method of claim 4, wherein at least certain of the security credentials are shared by certain groups of users during at least one of the accessing and searching steps.
7. The computer implemented method of claim 2, wherein the step of storing security credentials includes the steps of recording a user's security credentials as the user preliminarily enters the secure source and storing the recorded user's security credentials for the subsequent step of accessing the secure sever.
8. The computer implemented method of claim 7, wherein the stored user's security credentials are reusable for multiple steps of accessing the secure server.
9. The computer implemented method of claim 7, wherein the security credentials are used substantially transparently to the user during the step of accessing the secure server.
10. The computer implemented method of claim 7, wherein:
the step of accessing the secure source further includes the step of storing session cookies set by the source for use during the searching step.
11. The computer implemented method of claim 7, wherein the steps of recording a user's security credentials as the user preliminarily enters the secure source and storing the recorded user's security credentials for the subsequent step of accessing the secure sever, includes the steps of providing a visual tool to the user that displays a log-in page for the secure source and has the user perform the step of logging into the secure source provided by the visual tool, wherein the visual tool records the user's security credentials during the log-in step.
12. A computer implemented method for searching a plurality of searchable information sources by plurality of users to a computer network system, the information sources including at least one secure source, the method comprising the steps of:
for each user, storing security credentials necessary for accessing the secure source;
accessing, by each user, the secure source utilizing the stored security credentials for each user; and
searching the accessed secure source, by the plurality of users for documents relevant to one or more search queries.
13. The computer implemented method of claim 12, wherein the searching step includes the step of searching the accessed secure source, by the plurality of users substantially in parallel.
14. The computer implemented method of claim 12, further comprising the step of creating a session file for each user accessing the secure source.
15. The computer implemented method of claim 14, wherein the session file includes one or more elements take from a group consisting of:
cookies;
session parameters;
session ids; and
a session state.
16. The computer implemented method of claim 12, wherein:
the information sources include a plurality of secure sources;
the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of secure sources;
the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user; and
the searching step includes the step of searching the accessed secure sources, by the plurality of users, for documents relevant to one or more search queries.
17. The computer implemented method of claim 16, wherein, for each user, a session file is created for each secure source accessed by that user.
18. The computer implemented method of claim 12, wherein:
the information sources include a plurality of secure sources;
the storing step includes the step of storing, for each user, security credentials necessary for accessing one or more of the plurality of secure sources;
the accessing step includes the step of accessing, by each user, one or more of the plurality of secure sources utilizing the stored security credentials for each user; and
the searching step includes the step of searching the accessed secure sources, by the plurality of users, substantially in parallel, for documents relevant to one or more search queries.
19. The computer implemented method of claim 13, wherein at least certain of the security credentials are shared by certain groups of users during at least one of the accessing and searching steps.
US11/419,431 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services Abandoned US20060259476A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/419,431 US20060259476A1 (en) 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US36075402P 2002-03-01 2002-03-01
US10/378,554 US7567953B2 (en) 2002-03-01 2003-03-03 System and method for retrieving and organizing information from disparate computer network information sources
US11/419,431 US20060259476A1 (en) 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/378,554 Division US7567953B2 (en) 2002-03-01 2003-03-03 System and method for retrieving and organizing information from disparate computer network information sources

Publications (1)

Publication Number Publication Date
US20060259476A1 true US20060259476A1 (en) 2006-11-16

Family

ID=29406637

Family Applications (4)

Application Number Title Priority Date Filing Date
US10/378,554 Active 2024-11-21 US7567953B2 (en) 2002-03-01 2003-03-03 System and method for retrieving and organizing information from disparate computer network information sources
US11/419,431 Abandoned US20060259476A1 (en) 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services
US11/419,442 Abandoned US20060200462A1 (en) 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services
US12/494,181 Expired - Lifetime US8131755B2 (en) 2002-03-01 2009-06-29 System and method for retrieving and organizing information from disparate computer network information sources

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/378,554 Active 2024-11-21 US7567953B2 (en) 2002-03-01 2003-03-03 System and method for retrieving and organizing information from disparate computer network information sources

Family Applications After (2)

Application Number Title Priority Date Filing Date
US11/419,442 Abandoned US20060200462A1 (en) 2002-03-01 2006-05-19 System and Method for Retrieving and Organizing Information From Disparate Computer Network Information Services
US12/494,181 Expired - Lifetime US8131755B2 (en) 2002-03-01 2009-06-29 System and method for retrieving and organizing information from disparate computer network information sources

Country Status (1)

Country Link
US (4) US7567953B2 (en)

Cited By (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040181606A1 (en) * 2003-02-03 2004-09-16 Jens Astor Method for controlling an exchange
US20050060312A1 (en) * 2003-09-16 2005-03-17 Michael Curtiss Systems and methods for improving the ranking of news articles
US20050108266A1 (en) * 2003-11-14 2005-05-19 Microsoft Corporation Method and apparatus for browsing document content
US20070043723A1 (en) * 2005-03-28 2007-02-22 Elan Bitan Interactive user-controlled relevanace ranking retrieved information in an information search system
US20070288648A1 (en) * 2002-11-18 2007-12-13 Lara Mehanna Host-based intelligent results related to a character stream
US7568148B1 (en) * 2002-09-20 2009-07-28 Google Inc. Methods and apparatus for clustering news content
US20090248669A1 (en) * 2008-04-01 2009-10-01 Nitin Mangesh Shetti Method and system for organizing information
US20090265346A1 (en) * 2002-03-01 2009-10-22 Business Objects Americas System and Method for Retrieving and Organizing Information from Disparate Computer Network Information Sources
US20090281955A1 (en) * 2002-04-10 2009-11-12 Cullen Andrew A Iii Method of and system for enabling and managing sub-contracting entities
US20090327226A1 (en) * 2008-06-26 2009-12-31 Microsoft Corporation Library description of the user interface for federated search results
US20090327223A1 (en) * 2008-06-26 2009-12-31 Microsoft Corporation Query-driven web portals
CN101819616A (en) * 2010-03-22 2010-09-01 北京工业大学 Method for tracking leakage of private information
US20100306213A1 (en) * 2009-05-27 2010-12-02 Microsoft Corporation Merging Search Results
WO2011019934A1 (en) * 2009-08-12 2011-02-17 Volt Information Sciences, Inc System and method for productizing human capital labor employment positions/jobs
US7925568B2 (en) 2002-04-10 2011-04-12 Volt Information Sciences, Inc. Computer system and method for producing analytical data related to the project bid and requisition process
US7962504B1 (en) 2005-05-26 2011-06-14 Aol Inc. Sourcing terms into a search engine
US7966003B2 (en) 2004-07-09 2011-06-21 Tegic Communications, Inc. Disambiguating ambiguous characters
US20110173184A1 (en) * 2010-01-12 2011-07-14 Vmware, Inc. Extensible Tree Views for Managing Datacenter Resources
US8001199B2 (en) 2002-11-18 2011-08-16 Aol Inc. Reconfiguring an electronic message to effect an enhanced notification
US8041616B2 (en) 2005-08-01 2011-10-18 Volt Information Sciences, Inc. Outsourced service level agreement provisioning management system and method
US8090717B1 (en) 2002-09-20 2012-01-03 Google Inc. Methods and apparatus for ranking documents
US8156193B1 (en) 2002-11-18 2012-04-10 Aol Inc. Enhanced buddy list using mobile device identifiers
US20120130980A1 (en) * 2008-07-25 2012-05-24 Resolvo Systems Pte Ltd System and method for searching network-accessible sites for leaked source code
US8190462B2 (en) 2000-03-13 2012-05-29 Volt Information Sciences, Inc. System and method for internet based procurement and administrative management of workers
US8515823B2 (en) 2002-05-09 2013-08-20 Volt Information Sciences, Inc. System and method for enabling and maintaining vendor qualification
US8577972B1 (en) 2003-09-05 2013-11-05 Facebook, Inc. Methods and systems for capturing and managing instant messages
US8701014B1 (en) 2002-11-18 2014-04-15 Facebook, Inc. Account linking
US8799039B2 (en) 2002-04-24 2014-08-05 Iqnavigator, Inc. System and method for collecting and providing resource rate information using resource profiling
US8874672B2 (en) 2003-03-26 2014-10-28 Facebook, Inc. Identifying and using identities deemed to be known to a user
CN104303182A (en) * 2012-04-04 2015-01-21 夸特公司 Method and device for rapid provision of information
US8965964B1 (en) 2002-11-18 2015-02-24 Facebook, Inc. Managing forwarded electronic messages
US8972394B1 (en) 2009-07-20 2015-03-03 Google Inc. Generating a related set of documents for an initial set of documents
US8972391B1 (en) 2009-10-02 2015-03-03 Google Inc. Recent interest based relevance scoring
US9002867B1 (en) 2010-12-30 2015-04-07 Google Inc. Modifying ranking data based on document changes
US9009146B1 (en) 2009-04-08 2015-04-14 Google Inc. Ranking search results based on similar queries
US9020884B2 (en) 2002-04-10 2015-04-28 Iqnavigator, Inc. Method of and system for consultant re-seller business information transfer
US9092510B1 (en) 2007-04-30 2015-07-28 Google Inc. Modifying search result ranking based on a temporal element of user feedback
US9203879B2 (en) 2000-03-17 2015-12-01 Facebook, Inc. Offline alerts mechanism
US9203647B2 (en) 2002-11-18 2015-12-01 Facebook, Inc. Dynamic online and geographic location of a user
US9235627B1 (en) 2006-11-02 2016-01-12 Google Inc. Modifying search result ranking based on implicit user feedback
US9246975B2 (en) 2000-03-17 2016-01-26 Facebook, Inc. State change alerts mechanism
US9418104B1 (en) 2009-08-31 2016-08-16 Google Inc. Refining search results
US9623119B1 (en) * 2010-06-29 2017-04-18 Google Inc. Accentuating search results
US9647872B2 (en) 2002-11-18 2017-05-09 Facebook, Inc. Dynamic identification of other users to an online user
US9667585B2 (en) 2002-11-18 2017-05-30 Facebook, Inc. Central people lists accessible by multiple applications
US10187334B2 (en) 2003-11-26 2019-01-22 Facebook, Inc. User-defined electronic message preferences

Families Citing this family (192)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7673323B1 (en) 1998-10-28 2010-03-02 Bea Systems, Inc. System and method for maintaining security in a distributed computer network
US6968332B1 (en) * 2000-05-25 2005-11-22 Microsoft Corporation Facility for highlighting documents accessed through search or browsing
US7752266B2 (en) 2001-10-11 2010-07-06 Ebay Inc. System and method to facilitate translation of communications between entities over a network
US7949648B2 (en) * 2002-02-26 2011-05-24 Soren Alain Mortensen Compiling and accessing subject-specific information from a computer network
US20040078211A1 (en) * 2002-03-18 2004-04-22 Merck & Co., Inc. Computer assisted and/or implemented process and system for managing and/or providing a medical information portal for healthcare providers
US8078505B2 (en) 2002-06-10 2011-12-13 Ebay Inc. Method and system for automatically updating a seller application utilized in a network-based transaction facility
WO2004017226A2 (en) * 2002-08-15 2004-02-26 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Health Method and system for aggregating and disseminating time-sensitive information
US7117207B1 (en) * 2002-09-11 2006-10-03 George Mason Intellectual Properties, Inc. Personalizable semantic taxonomy-based search agent
US7076484B2 (en) * 2002-09-16 2006-07-11 International Business Machines Corporation Automated research engine
US7383513B2 (en) * 2002-09-25 2008-06-03 Oracle International Corporation Graphical condition builder for facilitating database queries
US20040093324A1 (en) * 2002-11-07 2004-05-13 International Business Machines Corporation System and method for data collection using subject records
US7599922B1 (en) * 2002-11-27 2009-10-06 Microsoft Corporation System and method for federated searching
US20040138988A1 (en) * 2002-12-20 2004-07-15 Bart Munro Method to facilitate a search of a database utilizing multiple search criteria
US8543564B2 (en) 2002-12-23 2013-09-24 West Publishing Company Information retrieval systems with database-selection aids
US20040133574A1 (en) * 2003-01-07 2004-07-08 Science Applications International Corporaton Vector space method for secure information sharing
US20040220914A1 (en) * 2003-05-02 2004-11-04 Dominic Cheung Content performance assessment optimization for search listings in wide area network searches
US20050065928A1 (en) * 2003-05-02 2005-03-24 Kurt Mortensen Content performance assessment optimization for search listings in wide area network searches
US7403939B1 (en) 2003-05-30 2008-07-22 Aol Llc Resolving queries based on automatic determination of requestor geographic location
US7401072B2 (en) * 2003-06-10 2008-07-15 Google Inc. Named URL entry
US8869061B1 (en) 2003-08-29 2014-10-21 Microsoft Corporation User interface for searching an electronic document
US7756750B2 (en) 2003-09-02 2010-07-13 Vinimaya, Inc. Method and system for providing online procurement between a buyer and suppliers over a network
US7822661B1 (en) 2003-09-24 2010-10-26 SuperMedia LLC Information distribution system and method utilizing a position adjustment factor
US7516086B2 (en) * 2003-09-24 2009-04-07 Idearc Media Corp. Business rating placement heuristic
US7590936B1 (en) * 2003-09-30 2009-09-15 Microsoft Corporation Method for extracting information associated with a search term
US7603547B2 (en) * 2003-10-10 2009-10-13 Bea Systems, Inc. Security control module
US7610587B2 (en) * 2003-11-05 2009-10-27 Hewlett-Packard Development Company, L.P. System and method for creating a best-match object at run time
US20050131872A1 (en) * 2003-12-16 2005-06-16 Microsoft Corporation Query recognizer
US20050149496A1 (en) * 2003-12-22 2005-07-07 Verity, Inc. System and method for dynamic context-sensitive federated search of multiple information repositories
US8005937B2 (en) * 2004-03-02 2011-08-23 Fatpot Technologies, Llc Dynamically integrating disparate computer-aided dispatch systems
US20050203892A1 (en) * 2004-03-02 2005-09-15 Jonathan Wesley Dynamically integrating disparate systems and providing secure data sharing
US20050203909A1 (en) * 2004-03-12 2005-09-15 Yongjun Zhao Device for searching for information from networked users and related methods
US8055553B1 (en) 2006-01-19 2011-11-08 Verizon Laboratories Inc. Dynamic comparison text functionality
US9189568B2 (en) 2004-04-23 2015-11-17 Ebay Inc. Method and system to display and search in a language independent manner
JP4200933B2 (en) * 2004-04-27 2008-12-24 コニカミノルタホールディングス株式会社 Information retrieval device
US7827175B2 (en) * 2004-06-10 2010-11-02 International Business Machines Corporation Framework reactive search facility
US7836411B2 (en) * 2004-06-10 2010-11-16 International Business Machines Corporation Search framework metadata
US9626437B2 (en) * 2004-06-10 2017-04-18 International Business Machines Corporation Search scheduling and delivery tool for scheduling a search using a search framework profile
US9223868B2 (en) 2004-06-28 2015-12-29 Google Inc. Deriving and using interaction profiles
US7562069B1 (en) * 2004-07-01 2009-07-14 Aol Llc Query disambiguation
US8078607B2 (en) * 2006-03-30 2011-12-13 Google Inc. Generating website profiles based on queries from webistes and user activities on the search results
US8620915B1 (en) 2007-03-13 2013-12-31 Google Inc. Systems and methods for promoting personalized search results based on personal information
US7577641B2 (en) * 2004-09-07 2009-08-18 Sas Institute Inc. Computer-implemented system and method for analyzing search queries
US7321889B2 (en) * 2004-09-10 2008-01-22 Suggestica, Inc. Authoring and managing personalized searchable link collections
US7734606B2 (en) * 2004-09-15 2010-06-08 Graematter, Inc. System and method for regulatory intelligence
KR100590029B1 (en) * 2004-09-17 2006-06-14 전자부품연구원 Method of providing table field elements by get_data operation in tv-anytime metadata service
EP1638336A1 (en) * 2004-09-17 2006-03-22 Korea Electronics Technology Institute Method for providing requested fields by get-data operation in TV-Anytime metadata service
WO2006036972A2 (en) * 2004-09-27 2006-04-06 Ubmatrix, Inc. Method for searching data elements on the web using a conceptual metadata and contextual metadata search engine
US20060075327A1 (en) * 2004-09-29 2006-04-06 Joe Sriver User interface for presentation of a document
US20060074900A1 (en) * 2004-09-30 2006-04-06 Nanavati Amit A Selecting keywords representative of a document
US8595225B1 (en) * 2004-09-30 2013-11-26 Google Inc. Systems and methods for correlating document topicality and popularity
US8595223B2 (en) 2004-10-15 2013-11-26 Microsoft Corporation Method and apparatus for intranet searching
KR101159342B1 (en) 2004-10-15 2012-06-25 마이크로소프트 코포레이션 Method and apparatus for intranet searching
US20060130045A1 (en) * 2004-11-19 2006-06-15 Jonathan Wesley Systems and methods for dynamically updating computer systems
US7680771B2 (en) * 2004-12-20 2010-03-16 International Business Machines Corporation Apparatus, system, and method for database provisioning
US7272597B2 (en) 2004-12-29 2007-09-18 Aol Llc Domain expert search
US7349896B2 (en) * 2004-12-29 2008-03-25 Aol Llc Query routing
US7818314B2 (en) * 2004-12-29 2010-10-19 Aol Inc. Search fusion
US7571157B2 (en) 2004-12-29 2009-08-04 Aol Llc Filtering search results
CN101288073B (en) * 2005-01-13 2013-04-24 汤姆森环球资源公司 Systems, methods, and software for retrieving information using multiple query languages
US20060179026A1 (en) * 2005-02-04 2006-08-10 Bechtel Michael E Knowledge discovery tool extraction and integration
US20060179069A1 (en) * 2005-02-04 2006-08-10 Bechtel Michael E Knowledge discovery tool navigation
US7890503B2 (en) * 2005-02-07 2011-02-15 Microsoft Corporation Method and system for performing secondary search actions based on primary search result attributes
US7505985B2 (en) * 2005-02-25 2009-03-17 International Business Machines Corporation System and method of generating string-based search expressions using templates
US20060224628A1 (en) * 2005-03-29 2006-10-05 Bea Systems, Inc. Modeling for data services
US8086615B2 (en) * 2005-03-28 2011-12-27 Oracle International Corporation Security data redaction
US8037041B2 (en) * 2005-04-11 2011-10-11 Alden Byird Investments, Llc System for dynamic keyword aggregation, search query generation and submission to third-party information search utilities
US7650335B2 (en) * 2005-04-20 2010-01-19 The Board Of Trustees Of The University Of Illinois High-level database management system
US7748046B2 (en) * 2005-04-29 2010-06-29 Microsoft Corporation Security claim transformation with intermediate claims
US7748027B2 (en) * 2005-05-11 2010-06-29 Bea Systems, Inc. System and method for dynamic data redaction
US20070011271A1 (en) * 2005-05-20 2007-01-11 Baker David V Multi-source data retrieval system
JP2006331014A (en) * 2005-05-25 2006-12-07 Oki Electric Ind Co Ltd Information provision device, information provision method and information provision program
WO2006133252A2 (en) * 2005-06-08 2006-12-14 The Regents Of The University Of California Doubly ranked information retrieval and area search
US20070027751A1 (en) * 2005-07-29 2007-02-01 Chad Carson Positioning advertisements on the bases of expected revenue
US7725485B1 (en) * 2005-08-01 2010-05-25 Google Inc. Generating query suggestions using contextual information
KR100809415B1 (en) * 2005-12-08 2008-03-05 한국전자통신연구원 system for extending a data query using an ontology and method threrfor
US7693819B2 (en) * 2005-12-29 2010-04-06 Sap Ag Database access system and method for transferring portions of an ordered record set responsive to multiple requests
US20070255958A1 (en) * 2006-05-01 2007-11-01 Microsoft Corporation Claim transformations for trust relationships
CN105608110A (en) * 2006-05-19 2016-05-25 约恩·吕森根 Source search engine
US7792841B2 (en) * 2006-05-30 2010-09-07 Microsoft Corporation Extraction and summarization of sentiment information
US8572182B2 (en) 2006-07-21 2013-10-29 Blackberry Limited Handling notifications in instant messaging systems
US8639782B2 (en) 2006-08-23 2014-01-28 Ebay, Inc. Method and system for sharing metadata between interfaces
US20080082549A1 (en) * 2006-10-02 2008-04-03 Vic Baker Multi-Dimensional Web-Enabled Data Viewer
US11392595B2 (en) * 2006-10-26 2022-07-19 EMB Partners, LLC Techniques for determining relevant electronic content in response to queries
US8316227B2 (en) 2006-11-01 2012-11-20 Microsoft Corporation Health integration platform protocol
US8417537B2 (en) * 2006-11-01 2013-04-09 Microsoft Corporation Extensible and localizable health-related dictionary
US8533746B2 (en) * 2006-11-01 2013-09-10 Microsoft Corporation Health integration platform API
US8375362B1 (en) * 2006-11-28 2013-02-12 Emc Corporation Wizard for web service search adapter
US7822734B2 (en) * 2006-12-12 2010-10-26 Yahoo! Inc. Selecting and presenting user search results based on an environment taxonomy
US8918318B2 (en) * 2007-01-16 2014-12-23 Nec Corporation Extended recognition dictionary learning device and speech recognition system
US20080183691A1 (en) * 2007-01-30 2008-07-31 International Business Machines Corporation Method for a networked knowledge based document retrieval and ranking utilizing extracted document metadata and content
US20080201197A1 (en) * 2007-02-16 2008-08-21 Rearden Commerce, Inc. System and Method for Peer Person- And Situation-Based Recommendations
US7904958B2 (en) * 2007-02-27 2011-03-08 Symantec Corporation Spam honeypot domain identification
US20080222105A1 (en) * 2007-03-09 2008-09-11 Joseph Matheny Entity recommendation system using restricted information tagged to selected entities
US8082208B2 (en) * 2007-07-09 2011-12-20 John Patrick Gavin Compilation and analysis of company information
US8744891B1 (en) * 2007-07-26 2014-06-03 United Services Automobile Association (Usaa) Systems and methods for dynamic business decision making
US20090030769A1 (en) * 2007-07-27 2009-01-29 Rearden Commerce, Inc. System and Method for Latency Management Assistant
US20090030609A1 (en) * 2007-07-27 2009-01-29 Rearden Commerce, Inc. System and Method for Proactive Agenda Management
US20090049379A1 (en) * 2007-08-14 2009-02-19 Yahoo! Inc. User interface to browse syndication data mixing module configurations
US20090094212A1 (en) * 2007-10-09 2009-04-09 Jon Scott Zaccagnino Natural local search engine
US7958136B1 (en) * 2008-03-18 2011-06-07 Google Inc. Systems and methods for identifying similar documents
US20090307003A1 (en) * 2008-05-16 2009-12-10 Daniel Benyamin Social advertisement network
US8725716B1 (en) * 2008-05-30 2014-05-13 Google Inc. Customized web summaries and alerts based on custom search engines
US10025855B2 (en) * 2008-07-28 2018-07-17 Excalibur Ip, Llc Federated community search
US8832098B2 (en) * 2008-07-29 2014-09-09 Yahoo! Inc. Research tool access based on research session detection
US20100031190A1 (en) * 2008-07-29 2010-02-04 Yahoo! Inc. System and method for copying information into a target document
US9641537B2 (en) * 2008-08-14 2017-05-02 Invention Science Fund I, Llc Conditionally releasing a communiqué determined to be affiliated with a particular source entity in response to detecting occurrence of one or more environmental aspects
US9305238B2 (en) * 2008-08-29 2016-04-05 Oracle International Corporation Framework for supporting regular expression-based pattern matching in data streams
US8204897B1 (en) * 2008-09-09 2012-06-19 Google Inc. Interactive search querying
US8126857B2 (en) * 2008-09-12 2012-02-28 Melissa Data Corp. Proactive information monitoring systems and methods
US9607324B1 (en) 2009-01-23 2017-03-28 Zakta, LLC Topical trust network
US10007729B1 (en) 2009-01-23 2018-06-26 Zakta, LLC Collaboratively finding, organizing and/or accessing information
US10191982B1 (en) 2009-01-23 2019-01-29 Zakata, LLC Topical search portal
US20100205198A1 (en) * 2009-02-06 2010-08-12 Gilad Mishne Search query disambiguation
US8145859B2 (en) * 2009-03-02 2012-03-27 Oracle International Corporation Method and system for spilling from a queue to a persistent store
US9836538B2 (en) * 2009-03-03 2017-12-05 Microsoft Technology Licensing, Llc Domain-based ranking in document search
US9892435B2 (en) 2009-03-10 2018-02-13 Gearbox Llc Computational systems and methods for health services planning and matching
US9858540B2 (en) 2009-03-10 2018-01-02 Gearbox, Llc Computational systems and methods for health services planning and matching
US10319471B2 (en) 2009-03-10 2019-06-11 Gearbox Llc Computational systems and methods for health services planning and matching
US20100235178A1 (en) * 2009-03-10 2010-09-16 Searette Llc Computational systems and methods for health services planning and matching
US9911165B2 (en) 2009-03-10 2018-03-06 Gearbox, Llc Computational systems and methods for health services planning and matching
US9886729B2 (en) 2009-03-10 2018-02-06 Gearbox, Llc Computational systems and methods for health services planning and matching
US20100235354A1 (en) * 2009-03-12 2010-09-16 International Business Machines Corporation Collaborative search engine system
US8387076B2 (en) 2009-07-21 2013-02-26 Oracle International Corporation Standardized database connectivity support for an event processing server
US8321450B2 (en) 2009-07-21 2012-11-27 Oracle International Corporation Standardized database connectivity support for an event processing server in an embedded context
US8527458B2 (en) 2009-08-03 2013-09-03 Oracle International Corporation Logging framework for a data stream processing server
US8386466B2 (en) 2009-08-03 2013-02-26 Oracle International Corporation Log visualization tool for a data stream processing server
US8326830B2 (en) * 2009-10-06 2012-12-04 Business Objects Software Limited Pattern recognition in web search engine result pages
US8621376B2 (en) * 2009-10-28 2013-12-31 Yahoo! Inc. Developer interface and associated methods for system for querying and consuming web-based data
CN102754059A (en) * 2009-12-24 2012-10-24 三星电子株式会社 Display device for displaying a webpage and display method for same
US9305057B2 (en) 2009-12-28 2016-04-05 Oracle International Corporation Extensible indexing framework using data cartridges
US8959106B2 (en) 2009-12-28 2015-02-17 Oracle International Corporation Class loading using java data cartridges
US9430494B2 (en) 2009-12-28 2016-08-30 Oracle International Corporation Spatial data cartridge for event processing systems
US8306964B2 (en) * 2010-07-20 2012-11-06 Microsoft Corporation Extraction of rich search information from index servers via an alternative asynchronous data path
US8713049B2 (en) 2010-09-17 2014-04-29 Oracle International Corporation Support for a parameterized query/view in complex event processing
US8612293B2 (en) 2010-10-19 2013-12-17 Citizennet Inc. Generation of advertising targeting information based upon affinity information obtained from an online social network
US20120117118A1 (en) * 2010-11-10 2012-05-10 Sony Corporation Search and deep linking in internet-enabled tv
EP2453395A1 (en) * 2010-11-15 2012-05-16 Deloitte Innovation B.V. Method and system to analyze processes
US9189280B2 (en) 2010-11-18 2015-11-17 Oracle International Corporation Tracking large numbers of moving objects in an event processing system
US10068266B2 (en) 2010-12-02 2018-09-04 Vinimaya Inc. Methods and systems to maintain, check, report, and audit contract and historical pricing in electronic procurement
US9063927B2 (en) 2011-04-06 2015-06-23 Citizennet Inc. Short message age classification
US8990416B2 (en) 2011-05-06 2015-03-24 Oracle International Corporation Support for a new insert stream (ISTREAM) operation in complex event processing (CEP)
US8706756B2 (en) * 2011-05-11 2014-04-22 Futurewei Technologies, Inc. Method, system and apparatus of hybrid federated search
US9329975B2 (en) 2011-07-07 2016-05-03 Oracle International Corporation Continuous query language (CQL) debugger in complex event processing (CEP)
US9002892B2 (en) 2011-08-07 2015-04-07 CitizenNet, Inc. Systems and methods for trend detection using frequency analysis
US20130041920A1 (en) * 2011-08-08 2013-02-14 International Business Machines Corporation Finding relationships and hierarchies using taxonomies
US20130110585A1 (en) * 2011-11-02 2013-05-02 Invisiblehand Software Ltd. Data Processing
US8645361B2 (en) 2012-01-20 2014-02-04 Microsoft Corporation Using popular queries to decide when to federate queries
US9053497B2 (en) 2012-04-27 2015-06-09 CitizenNet, Inc. Systems and methods for targeting advertising to groups with strong ties within an online social network
US9477711B2 (en) * 2012-05-16 2016-10-25 Google Inc. Knowledge panel
US9922120B2 (en) * 2012-08-24 2018-03-20 Microsoft Technology Licensing, Llc Online learning of click-through rates on federated search results
US9563663B2 (en) 2012-09-28 2017-02-07 Oracle International Corporation Fast path evaluation of Boolean predicates
US11288277B2 (en) 2012-09-28 2022-03-29 Oracle International Corporation Operator sharing for continuous queries over archived relations
US10417649B2 (en) * 2012-09-28 2019-09-17 Oracle International Corporation Business process global searching
US8874569B2 (en) 2012-11-29 2014-10-28 Lexisnexis, A Division Of Reed Elsevier Inc. Systems and methods for identifying and visualizing elements of query results
US10956422B2 (en) 2012-12-05 2021-03-23 Oracle International Corporation Integrating event processing with map-reduce
US9098587B2 (en) 2013-01-15 2015-08-04 Oracle International Corporation Variable duration non-event pattern matching
US10298444B2 (en) 2013-01-15 2019-05-21 Oracle International Corporation Variable duration windows on continuous data streams
US9390135B2 (en) 2013-02-19 2016-07-12 Oracle International Corporation Executing continuous event processing (CEP) queries in parallel
US9047249B2 (en) 2013-02-19 2015-06-02 Oracle International Corporation Handling faults in a continuous event processing (CEP) system
US9483559B2 (en) * 2013-03-06 2016-11-01 Microsoft Technology Licensing, Llc Reformulating query terms in structured search
US9477645B2 (en) 2013-03-13 2016-10-25 Sap Se Systems and methods of active text markup
US9418113B2 (en) 2013-05-30 2016-08-16 Oracle International Corporation Value based windows on relations in continuous data streams
US9547640B2 (en) * 2013-10-16 2017-01-17 International Business Machines Corporation Ontology-driven annotation confidence levels for natural language processing
US9124575B2 (en) 2013-11-27 2015-09-01 Sap Se Self-single sign-on
US9934279B2 (en) 2013-12-05 2018-04-03 Oracle International Corporation Pattern matching across multiple input data streams
US9639526B2 (en) * 2014-01-10 2017-05-02 Microsoft Technology Licensing, Llc Mobile language translation of web content
KR102155484B1 (en) * 2014-03-26 2020-09-14 삼성전자 주식회사 User terminal and control method thereof
US9619537B2 (en) 2014-04-15 2017-04-11 Sap Se Converting data objects from single- to multi-source database environment
US9244978B2 (en) 2014-06-11 2016-01-26 Oracle International Corporation Custom partitioning of a data stream
US9712645B2 (en) 2014-06-26 2017-07-18 Oracle International Corporation Embedded event processing
US9886486B2 (en) 2014-09-24 2018-02-06 Oracle International Corporation Enriching events with dynamically typed big data for event processing
US10120907B2 (en) 2014-09-24 2018-11-06 Oracle International Corporation Scaling event processing using distributed flows and map-reduce operations
US10629310B2 (en) * 2017-12-27 2020-04-21 Michigan Health Information Network Shared Services Systems and methods for facilitating communication of health information
CN104915413B (en) * 2015-06-05 2018-09-07 广东顺德中山大学卡内基梅隆大学国际联合研究院 A kind of health detecting method and system
US10885130B1 (en) * 2015-07-02 2021-01-05 Melih Abdulhayoglu Web browser with category search engine capability
US20170004134A1 (en) * 2015-07-03 2017-01-05 Microsoft Technology Licensing, Llc Asynchronous search query
WO2017018901A1 (en) 2015-07-24 2017-02-02 Oracle International Corporation Visually exploring and analyzing event streams
US10033702B2 (en) * 2015-08-05 2018-07-24 Intralinks, Inc. Systems and methods of secure data exchange
US10318885B2 (en) 2015-09-15 2019-06-11 International Business Machines Corporation Cognitive system virtual corpus training and utilization
WO2017135837A1 (en) 2016-02-01 2017-08-10 Oracle International Corporation Pattern based automated test data generation
WO2017135838A1 (en) 2016-02-01 2017-08-10 Oracle International Corporation Level of detail control for geostreaming
US20180046720A1 (en) * 2016-02-14 2018-02-15 Ousmane Conde XoomDat, real-time search and analytics information system
US20190073404A1 (en) * 2016-03-18 2019-03-07 University Of Helsinki Information retrieval control
US10628400B2 (en) * 2016-08-19 2020-04-21 Microsoft Technology Licensing, Llc Automatic content tagging
US11042574B2 (en) * 2016-10-05 2021-06-22 International Business Machines Corporation Contextual enhancing of content participation in search results
US20180285399A1 (en) * 2017-04-03 2018-10-04 American Chemical Society Systems and methods for query and index optimization for retrieving data in instances of a formulation data structure from a database
US10643178B1 (en) 2017-06-16 2020-05-05 Coupa Software Incorporated Asynchronous real-time procurement system
CN110390094B (en) * 2018-04-20 2023-05-23 伊姆西Ip控股有限责任公司 Method, electronic device and computer program product for classifying documents
US11188447B2 (en) * 2019-03-06 2021-11-30 International Business Machines Corporation Discovery of computer code actions and parameters
US20220197916A1 (en) * 2020-12-22 2022-06-23 International Business Machines Corporation Dynamic facet ranking
US20220318284A1 (en) * 2020-12-31 2022-10-06 Proofpoint, Inc. Systems and methods for query term analytics
FR3138222A1 (en) * 2022-07-21 2024-01-26 Airbus Cybersecurity Sas DATA COLLECTION SYSTEM ARCHITECTURE

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5628011A (en) * 1993-01-04 1997-05-06 At&T Network-based intelligent information-sourcing arrangement
US5859972A (en) * 1996-05-10 1999-01-12 The Board Of Trustees Of The University Of Illinois Multiple server repository and multiple server remote application virtual client computer
US6175830B1 (en) * 1999-05-20 2001-01-16 Evresearch, Ltd. Information management, retrieval and display system and associated method
US6233586B1 (en) * 1998-04-01 2001-05-15 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated query object
US6263342B1 (en) * 1998-04-01 2001-07-17 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated datastore object
US6272488B1 (en) * 1998-04-01 2001-08-07 International Business Machines Corporation Managing results of federated searches across heterogeneous datastores with a federated collection object
US20010037332A1 (en) * 2000-04-27 2001-11-01 Todd Miller Method and system for retrieving search results from multiple disparate databases
US20020028443A1 (en) * 1999-09-27 2002-03-07 Jay M. Short Method of dna shuffling with polynucleotides produced by blocking or interrupting a synthesis or amplification process
US6370541B1 (en) * 1999-09-21 2002-04-09 International Business Machines Corporation Design and implementation of a client/server framework for federated multi-search and update across heterogeneous datastores
US20020055946A1 (en) * 1996-06-28 2002-05-09 Randy Prager Enterprise, stream-based, information management system
US20020120685A1 (en) * 1999-06-01 2002-08-29 Alok Srivastava System for dynamically invoking remote network services using service descriptions stored in a service registry
US20020124116A1 (en) * 2000-12-26 2002-09-05 Yaung Alan T. Messaging service in a federated content management system
US6466933B1 (en) * 1999-09-21 2002-10-15 International Business Machines Corporation Delayed delivery of query results or other data from a federated server to a federated client until such information is needed
US20020164199A1 (en) * 1998-11-13 2002-11-07 Michael Derek Overton Connector device assembly
US6484186B1 (en) * 2000-02-15 2002-11-19 Novell, Inc. Method for backing up consistent versions of open files
US20020174122A1 (en) * 1999-09-21 2002-11-21 Kehsing J. Chou Architecture to enable search gateways as part of federated search
US20020188621A1 (en) * 2000-08-28 2002-12-12 Emotion Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20030004931A1 (en) * 1999-09-21 2003-01-02 Basuki N. Soetarman Managing results of federated searches across heterogeneous datastores with a federated result set cursor object
US20030004988A1 (en) * 2001-06-13 2003-01-02 Ken Hirasawa Drawings data mangement system, method and program
US20030041054A1 (en) * 2001-08-27 2003-02-27 Jianchang Mao Method and apparatus for merging result lists from multiple search engines
US7031961B2 (en) * 1999-05-05 2006-04-18 Google, Inc. System and method for searching and recommending objects from a categorically organized information repository

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US37332A (en) * 1863-01-06 Improvement in machines for drawing bolts and spikes
US5768580A (en) * 1995-05-31 1998-06-16 Oracle Corporation Methods and apparatus for dynamic classification of discourse
US6650998B1 (en) * 1996-03-11 2003-11-18 At&T Corp. Information Search System for enabling a user of a user terminal to search a data source
US5940821A (en) * 1997-05-21 1999-08-17 Oracle Corporation Information presentation in a knowledge base search and retrieval system
US6038560A (en) * 1997-05-21 2000-03-14 Oracle Corporation Concept knowledge base search and retrieval system
US6028605A (en) * 1998-02-03 2000-02-22 Documentum, Inc. Multi-dimensional analysis of objects by manipulating discovered semantic properties
US6513027B1 (en) * 1999-03-16 2003-01-28 Oracle Corporation Automated category discovery for a terminological knowledge base
US6665681B1 (en) * 1999-04-09 2003-12-16 Entrieva, Inc. System and method for generating a taxonomy from a plurality of documents
US7181438B1 (en) * 1999-07-21 2007-02-20 Alberti Anemometer, Llc Database access system
US6859937B1 (en) * 1999-12-15 2005-02-22 Microsoft Corporation Context-sensitive options panel
US6868525B1 (en) * 2000-02-01 2005-03-15 Alberti Anemometer Llc Computer graphic display visualization system and method
US20010039592A1 (en) * 2000-02-24 2001-11-08 Carden Francis W. Web address assignment process
US6629294B2 (en) * 2000-03-10 2003-09-30 General Electric Company Tool and method for improving the quality of board design and modeling
US6446083B1 (en) * 2000-05-12 2002-09-03 Vastvideo, Inc. System and method for classifying media items
US7865358B2 (en) * 2000-06-26 2011-01-04 Oracle International Corporation Multi-user functionality for converting data from a first form to a second form
US8396859B2 (en) * 2000-06-26 2013-03-12 Oracle International Corporation Subject matter context search engine
US20030120653A1 (en) * 2000-07-05 2003-06-26 Sean Brady Trainable internet search engine and methods of using
US6463430B1 (en) * 2000-07-10 2002-10-08 Mohomine, Inc. Devices and methods for generating and managing a database
US6941294B2 (en) * 2000-08-28 2005-09-06 Emotion, Inc. Method and apparatus for digital media management, retrieval, and collaboration
US6647383B1 (en) * 2000-09-01 2003-11-11 Lucent Technologies Inc. System and method for providing interactive dialogue and iterative search functions to find information
JP2002288201A (en) * 2001-03-23 2002-10-04 Fujitsu Ltd Question-answer processing method, question-answer processing program, recording medium for the question- answer processing program, and question-answer processor
US6920448B2 (en) * 2001-05-09 2005-07-19 Agilent Technologies, Inc. Domain specific knowledge-based metasearch system and methods of using
US7519605B2 (en) * 2001-05-09 2009-04-14 Agilent Technologies, Inc. Systems, methods and computer readable media for performing a domain-specific metasearch, and visualizing search results therefrom
US6994612B2 (en) * 2002-02-13 2006-02-07 Micron Technology, Inc. Methods for conditioning surfaces of polishing pads after chemical-mechanical polishing
US7567953B2 (en) * 2002-03-01 2009-07-28 Business Objects Americas System and method for retrieving and organizing information from disparate computer network information sources
US7085771B2 (en) * 2002-05-17 2006-08-01 Verity, Inc System and method for automatically discovering a hierarchy of concepts from a corpus of documents
US7721192B2 (en) * 2002-11-27 2010-05-18 Microsoft Corporation User interface for a resource search tool
US8285698B2 (en) * 2009-11-17 2012-10-09 International Business Machines Corporation Securing search queries

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5628011A (en) * 1993-01-04 1997-05-06 At&T Network-based intelligent information-sourcing arrangement
US5859972A (en) * 1996-05-10 1999-01-12 The Board Of Trustees Of The University Of Illinois Multiple server repository and multiple server remote application virtual client computer
US20020055946A1 (en) * 1996-06-28 2002-05-09 Randy Prager Enterprise, stream-based, information management system
US6233586B1 (en) * 1998-04-01 2001-05-15 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated query object
US6263342B1 (en) * 1998-04-01 2001-07-17 International Business Machines Corp. Federated searching of heterogeneous datastores using a federated datastore object
US6272488B1 (en) * 1998-04-01 2001-08-07 International Business Machines Corporation Managing results of federated searches across heterogeneous datastores with a federated collection object
US20020164199A1 (en) * 1998-11-13 2002-11-07 Michael Derek Overton Connector device assembly
US7031961B2 (en) * 1999-05-05 2006-04-18 Google, Inc. System and method for searching and recommending objects from a categorically organized information repository
US6175830B1 (en) * 1999-05-20 2001-01-16 Evresearch, Ltd. Information management, retrieval and display system and associated method
US20020120685A1 (en) * 1999-06-01 2002-08-29 Alok Srivastava System for dynamically invoking remote network services using service descriptions stored in a service registry
US6370541B1 (en) * 1999-09-21 2002-04-09 International Business Machines Corporation Design and implementation of a client/server framework for federated multi-search and update across heterogeneous datastores
US20030004931A1 (en) * 1999-09-21 2003-01-02 Basuki N. Soetarman Managing results of federated searches across heterogeneous datastores with a federated result set cursor object
US6466933B1 (en) * 1999-09-21 2002-10-15 International Business Machines Corporation Delayed delivery of query results or other data from a federated server to a federated client until such information is needed
US20020174122A1 (en) * 1999-09-21 2002-11-21 Kehsing J. Chou Architecture to enable search gateways as part of federated search
US20020028443A1 (en) * 1999-09-27 2002-03-07 Jay M. Short Method of dna shuffling with polynucleotides produced by blocking or interrupting a synthesis or amplification process
US6484186B1 (en) * 2000-02-15 2002-11-19 Novell, Inc. Method for backing up consistent versions of open files
US20010037332A1 (en) * 2000-04-27 2001-11-01 Todd Miller Method and system for retrieving search results from multiple disparate databases
US20020194197A1 (en) * 2000-08-28 2002-12-19 Emotion, Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20020194200A1 (en) * 2000-08-28 2002-12-19 Emotion Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20020194198A1 (en) * 2000-08-28 2002-12-19 Emotion, Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20020188621A1 (en) * 2000-08-28 2002-12-12 Emotion Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20020124116A1 (en) * 2000-12-26 2002-09-05 Yaung Alan T. Messaging service in a federated content management system
US20030004988A1 (en) * 2001-06-13 2003-01-02 Ken Hirasawa Drawings data mangement system, method and program
US20030041054A1 (en) * 2001-08-27 2003-02-27 Jianchang Mao Method and apparatus for merging result lists from multiple search engines

Cited By (120)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8712819B2 (en) 2000-03-13 2014-04-29 Volt Information Sciences, Inc. System and method for internet based procurement of goods and services
US8190462B2 (en) 2000-03-13 2012-05-29 Volt Information Sciences, Inc. System and method for internet based procurement and administrative management of workers
US9736209B2 (en) 2000-03-17 2017-08-15 Facebook, Inc. State change alerts mechanism
US9203879B2 (en) 2000-03-17 2015-12-01 Facebook, Inc. Offline alerts mechanism
US9246975B2 (en) 2000-03-17 2016-01-26 Facebook, Inc. State change alerts mechanism
US8131755B2 (en) * 2002-03-01 2012-03-06 SAP America, Inc. System and method for retrieving and organizing information from disparate computer network information sources
US20090265346A1 (en) * 2002-03-01 2009-10-22 Business Objects Americas System and Method for Retrieving and Organizing Information from Disparate Computer Network Information Sources
US9020884B2 (en) 2002-04-10 2015-04-28 Iqnavigator, Inc. Method of and system for consultant re-seller business information transfer
US20090281955A1 (en) * 2002-04-10 2009-11-12 Cullen Andrew A Iii Method of and system for enabling and managing sub-contracting entities
US7925568B2 (en) 2002-04-10 2011-04-12 Volt Information Sciences, Inc. Computer system and method for producing analytical data related to the project bid and requisition process
US8204820B2 (en) 2002-04-10 2012-06-19 Volt Information Sciences, Inc. Computer system and method for producing analytical data related to the project bid and requisition process
US8364557B2 (en) 2002-04-10 2013-01-29 Volt Information Sciences Inc. Method of and system for enabling and managing sub-contracting entities
US8799039B2 (en) 2002-04-24 2014-08-05 Iqnavigator, Inc. System and method for collecting and providing resource rate information using resource profiling
US8515823B2 (en) 2002-05-09 2013-08-20 Volt Information Sciences, Inc. System and method for enabling and maintaining vendor qualification
US8225190B1 (en) 2002-09-20 2012-07-17 Google Inc. Methods and apparatus for clustering news content
US7568148B1 (en) * 2002-09-20 2009-07-28 Google Inc. Methods and apparatus for clustering news content
US8090717B1 (en) 2002-09-20 2012-01-03 Google Inc. Methods and apparatus for ranking documents
US10496652B1 (en) 2002-09-20 2019-12-03 Google Llc Methods and apparatus for ranking documents
US9361369B1 (en) 2002-09-20 2016-06-07 Google Inc. Method and apparatus for clustering news online content based on content freshness and quality of content source
US10095752B1 (en) 2002-09-20 2018-10-09 Google Llc Methods and apparatus for clustering news online content based on content freshness and quality of content source
US8843479B1 (en) 2002-09-20 2014-09-23 Google Inc. Methods and apparatus for ranking documents
US9477714B1 (en) 2002-09-20 2016-10-25 Google Inc. Methods and apparatus for ranking documents
US9729489B2 (en) 2002-11-18 2017-08-08 Facebook, Inc. Systems and methods for notification management and delivery
US9203647B2 (en) 2002-11-18 2015-12-01 Facebook, Inc. Dynamic online and geographic location of a user
US8001199B2 (en) 2002-11-18 2011-08-16 Aol Inc. Reconfiguring an electronic message to effect an enhanced notification
US8005919B2 (en) 2002-11-18 2011-08-23 Aol Inc. Host-based intelligent results related to a character stream
US9515977B2 (en) 2002-11-18 2016-12-06 Facebook, Inc. Time based electronic message delivery
US9560000B2 (en) 2002-11-18 2017-01-31 Facebook, Inc. Reconfiguring an electronic message to effect an enhanced notification
US9571440B2 (en) 2002-11-18 2017-02-14 Facebook, Inc. Notification archive
US9571439B2 (en) 2002-11-18 2017-02-14 Facebook, Inc. Systems and methods for notification delivery
US8156193B1 (en) 2002-11-18 2012-04-10 Aol Inc. Enhanced buddy list using mobile device identifiers
US9621376B2 (en) 2002-11-18 2017-04-11 Facebook, Inc. Dynamic location of a subordinate user
US9647872B2 (en) 2002-11-18 2017-05-09 Facebook, Inc. Dynamic identification of other users to an online user
US9667585B2 (en) 2002-11-18 2017-05-30 Facebook, Inc. Central people lists accessible by multiple applications
US9769104B2 (en) 2002-11-18 2017-09-19 Facebook, Inc. Methods and system for delivering multiple notifications
US9356890B2 (en) 2002-11-18 2016-05-31 Facebook, Inc. Enhanced buddy list using mobile device identifiers
US9319356B2 (en) 2002-11-18 2016-04-19 Facebook, Inc. Message delivery control settings
US9774560B2 (en) 2002-11-18 2017-09-26 Facebook, Inc. People lists
US8452849B2 (en) 2002-11-18 2013-05-28 Facebook, Inc. Host-based intelligent results related to a character stream
US9852126B2 (en) 2002-11-18 2017-12-26 Facebook, Inc. Host-based intelligent results related to a character stream
US9313046B2 (en) 2002-11-18 2016-04-12 Facebook, Inc. Presenting dynamic location of a user
US9253136B2 (en) 2002-11-18 2016-02-02 Facebook, Inc. Electronic message delivery based on presence information
US9894018B2 (en) 2002-11-18 2018-02-13 Facebook, Inc. Electronic messaging using reply telephone numbers
US9047364B2 (en) 2002-11-18 2015-06-02 Facebook, Inc. Intelligent client capability-based results related to a character stream
US8701014B1 (en) 2002-11-18 2014-04-15 Facebook, Inc. Account linking
US10033669B2 (en) 2002-11-18 2018-07-24 Facebook, Inc. Managing electronic messages sent to reply telephone numbers
US8775560B2 (en) 2002-11-18 2014-07-08 Facebook, Inc. Host-based intelligent results related to a character stream
US20070288648A1 (en) * 2002-11-18 2007-12-13 Lara Mehanna Host-based intelligent results related to a character stream
US10389661B2 (en) 2002-11-18 2019-08-20 Facebook, Inc. Managing electronic messages sent to mobile devices associated with electronic messaging accounts
US8819176B2 (en) 2002-11-18 2014-08-26 Facebook, Inc. Intelligent map results related to a character stream
US10778635B2 (en) 2002-11-18 2020-09-15 Facebook, Inc. People lists
US9203794B2 (en) 2002-11-18 2015-12-01 Facebook, Inc. Systems and methods for reconfiguring electronic messages
US9171064B2 (en) 2002-11-18 2015-10-27 Facebook, Inc. Intelligent community based results related to a character stream
US9075868B2 (en) 2002-11-18 2015-07-07 Facebook, Inc. Intelligent results based on database queries
US8954531B2 (en) 2002-11-18 2015-02-10 Facebook, Inc. Intelligent messaging label results related to a character stream
US8954530B2 (en) 2002-11-18 2015-02-10 Facebook, Inc. Intelligent results related to a character stream
US8954534B2 (en) 2002-11-18 2015-02-10 Facebook, Inc. Host-based intelligent results related to a character stream
US8965964B1 (en) 2002-11-18 2015-02-24 Facebook, Inc. Managing forwarded electronic messages
US9075867B2 (en) 2002-11-18 2015-07-07 Facebook, Inc. Intelligent results using an assistant
US9053174B2 (en) 2002-11-18 2015-06-09 Facebook, Inc. Intelligent vendor results related to a character stream
US9053175B2 (en) 2002-11-18 2015-06-09 Facebook, Inc. Intelligent results using a spelling correction agent
US9053173B2 (en) 2002-11-18 2015-06-09 Facebook, Inc. Intelligent results related to a portion of a search query
US20040181606A1 (en) * 2003-02-03 2004-09-16 Jens Astor Method for controlling an exchange
US9516125B2 (en) 2003-03-26 2016-12-06 Facebook, Inc. Identifying and using identities deemed to be known to a user
US9531826B2 (en) 2003-03-26 2016-12-27 Facebook, Inc. Managing electronic messages based on inference scores
US9736255B2 (en) 2003-03-26 2017-08-15 Facebook, Inc. Methods of providing access to messages based on degrees of separation
US8874672B2 (en) 2003-03-26 2014-10-28 Facebook, Inc. Identifying and using identities deemed to be known to a user
US9070118B2 (en) 2003-09-05 2015-06-30 Facebook, Inc. Methods for capturing electronic messages based on capture rules relating to user actions regarding received electronic messages
US8577972B1 (en) 2003-09-05 2013-11-05 Facebook, Inc. Methods and systems for capturing and managing instant messages
US10102504B2 (en) 2003-09-05 2018-10-16 Facebook, Inc. Methods for controlling display of electronic messages captured based on community rankings
US10459926B2 (en) 2003-09-16 2019-10-29 Google Llc Systems and methods for improving the ranking of news articles
US7577655B2 (en) 2003-09-16 2009-08-18 Google Inc. Systems and methods for improving the ranking of news articles
US20090276429A1 (en) * 2003-09-16 2009-11-05 Google Inc. Systems and methods for improving the ranking of news articles
US8332382B2 (en) 2003-09-16 2012-12-11 Google Inc. Systems and methods for improving the ranking of news articles
US20050060312A1 (en) * 2003-09-16 2005-03-17 Michael Curtiss Systems and methods for improving the ranking of news articles
US8645368B2 (en) 2003-09-16 2014-02-04 Google Inc. Systems and methods for improving the ranking of news articles
US9037575B2 (en) 2003-09-16 2015-05-19 Google Inc. Systems and methods for improving the ranking of news articles
US8126876B2 (en) 2003-09-16 2012-02-28 Google Inc. Systems and methods for improving the ranking of news articles
US7284006B2 (en) * 2003-11-14 2007-10-16 Microsoft Corporation Method and apparatus for browsing document content
US20050108266A1 (en) * 2003-11-14 2005-05-19 Microsoft Corporation Method and apparatus for browsing document content
US10187334B2 (en) 2003-11-26 2019-01-22 Facebook, Inc. User-defined electronic message preferences
US7966003B2 (en) 2004-07-09 2011-06-21 Tegic Communications, Inc. Disambiguating ambiguous characters
US8583087B2 (en) 2004-07-09 2013-11-12 Nuance Communications, Inc. Disambiguating ambiguous characters
US7617193B2 (en) * 2005-03-28 2009-11-10 Elan Bitan Interactive user-controlled relevance ranking retrieved information in an information search system
US20070043723A1 (en) * 2005-03-28 2007-02-22 Elan Bitan Interactive user-controlled relevanace ranking retrieved information in an information search system
US8874606B2 (en) 2005-05-26 2014-10-28 Facebook, Inc. Sourcing terms into a search engine
US7962504B1 (en) 2005-05-26 2011-06-14 Aol Inc. Sourcing terms into a search engine
US8996560B2 (en) 2005-05-26 2015-03-31 Facebook, Inc. Search engine utilizing user navigated documents
US9753972B2 (en) 2005-05-26 2017-09-05 Facebook, Inc. Searching based on user interest
US8041616B2 (en) 2005-08-01 2011-10-18 Volt Information Sciences, Inc. Outsourced service level agreement provisioning management system and method
US10229166B1 (en) 2006-11-02 2019-03-12 Google Llc Modifying search result ranking based on implicit user feedback
US11188544B1 (en) 2006-11-02 2021-11-30 Google Llc Modifying search result ranking based on implicit user feedback
US9235627B1 (en) 2006-11-02 2016-01-12 Google Inc. Modifying search result ranking based on implicit user feedback
US11816114B1 (en) 2006-11-02 2023-11-14 Google Llc Modifying search result ranking based on implicit user feedback
US9811566B1 (en) 2006-11-02 2017-11-07 Google Inc. Modifying search result ranking based on implicit user feedback
US9092510B1 (en) 2007-04-30 2015-07-28 Google Inc. Modifying search result ranking based on a temporal element of user feedback
US20090248669A1 (en) * 2008-04-01 2009-10-01 Nitin Mangesh Shetti Method and system for organizing information
US8001154B2 (en) 2008-06-26 2011-08-16 Microsoft Corporation Library description of the user interface for federated search results
US20090327226A1 (en) * 2008-06-26 2009-12-31 Microsoft Corporation Library description of the user interface for federated search results
US20090327223A1 (en) * 2008-06-26 2009-12-31 Microsoft Corporation Query-driven web portals
US20120130980A1 (en) * 2008-07-25 2012-05-24 Resolvo Systems Pte Ltd System and method for searching network-accessible sites for leaked source code
US9009146B1 (en) 2009-04-08 2015-04-14 Google Inc. Ranking search results based on similar queries
US20100306213A1 (en) * 2009-05-27 2010-12-02 Microsoft Corporation Merging Search Results
US9495460B2 (en) 2009-05-27 2016-11-15 Microsoft Technology Licensing, Llc Merging search results
US8972394B1 (en) 2009-07-20 2015-03-03 Google Inc. Generating a related set of documents for an initial set of documents
US8977612B1 (en) 2009-07-20 2015-03-10 Google Inc. Generating a related set of documents for an initial set of documents
US20110040695A1 (en) * 2009-08-12 2011-02-17 Wyatt Wasicek System and method for productizing human capital labor employment positions/jobs
JP2013502012A (en) * 2009-08-12 2013-01-17 ボルト インフォメーション サイエンシズ インク Systems and methods for commercializing human capital labor employment status / duties
WO2011019934A1 (en) * 2009-08-12 2011-02-17 Volt Information Sciences, Inc System and method for productizing human capital labor employment positions/jobs
US8788357B2 (en) * 2009-08-12 2014-07-22 Iqnavigator, Inc. System and method for productizing human capital labor employment positions/jobs
US9418104B1 (en) 2009-08-31 2016-08-16 Google Inc. Refining search results
US9697259B1 (en) 2009-08-31 2017-07-04 Google Inc. Refining search results
US9390143B2 (en) 2009-10-02 2016-07-12 Google Inc. Recent interest based relevance scoring
US8972391B1 (en) 2009-10-02 2015-03-03 Google Inc. Recent interest based relevance scoring
US8700611B2 (en) * 2010-01-12 2014-04-15 Vmware, Inc. Extensible tree views for managing datacenter resources
US20110173184A1 (en) * 2010-01-12 2011-07-14 Vmware, Inc. Extensible Tree Views for Managing Datacenter Resources
CN101819616A (en) * 2010-03-22 2010-09-01 北京工业大学 Method for tracking leakage of private information
US9623119B1 (en) * 2010-06-29 2017-04-18 Google Inc. Accentuating search results
US9002867B1 (en) 2010-12-30 2015-04-07 Google Inc. Modifying ranking data based on document changes
CN104303182A (en) * 2012-04-04 2015-01-21 夸特公司 Method and device for rapid provision of information

Also Published As

Publication number Publication date
US7567953B2 (en) 2009-07-28
US20030212673A1 (en) 2003-11-13
US20090265346A1 (en) 2009-10-22
US20060200462A1 (en) 2006-09-07
US8131755B2 (en) 2012-03-06

Similar Documents

Publication Publication Date Title
US7567953B2 (en) System and method for retrieving and organizing information from disparate computer network information sources
US6598046B1 (en) System and method for retrieving documents responsive to a given user&#39;s role and scenario
US6751611B2 (en) Method and system for creating improved search queries
US7003506B1 (en) Method and system for creating an embedded search link document
US6647383B1 (en) System and method for providing interactive dialogue and iterative search functions to find information
US7337158B2 (en) System and method for providing an intelligent multi-step dialog with a user
KR101303488B1 (en) Search systems and methods using in-line contextual queries
US7349895B2 (en) Semi-automatic annotation of multimedia objects
US6567805B1 (en) Interactive automated response system
US7062488B1 (en) Task/domain segmentation in applying feedback to command control
US7181438B1 (en) Database access system
US6778979B2 (en) System for automatically generating queries
US20110029563A1 (en) System and method for searching data sources
US20080270393A1 (en) Techniques for personalized and adaptive search services
US20060277168A1 (en) Method and system for assessing relevant properties of work contexts for use by information services
US20060122997A1 (en) System and method for text searching using weighted keywords
JP2004534324A (en) Extensible interactive document retrieval system with index
Agichtein et al. Learning to find answers to questions on the web
Cassel et al. Client Side Personalization.
Buzzi et al. Accessibility and usability of search engine interfaces: Preliminary testing
Hoe‐Lian Goh et al. Collaborative querying using the query graph visualizer
Chen Generative AI Frameworks for Web for Good: Food Pantry Information Seeking as an Example
JP2010211563A (en) Answering support method and system
Yeung Weighting Document Genre in Enterprise Search

Legal Events

Date Code Title Description
AS Assignment

Owner name: BUSINESS OBJECTS AMERICAS, CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION SERIAL NO.TO 11/419,431. INCORRECT APPLICATION NO. 11/419,443 WAS TYPED IN THE ORIGINAL COVERSHEET. PREVIOUSLY RECORDED ON REEL 020487 FRAME 0541. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECT APPLICATION NO. 11/419,431.;ASSIGNOR:INXIGHT SOFTWARE, INC.;REEL/FRAME:020500/0529

Effective date: 20071214

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION