US20150100870A1 - Harvesting data from page - Google Patents
Harvesting data from page Download PDFInfo
- Publication number
- US20150100870A1 US20150100870A1 US14/570,671 US201414570671A US2015100870A1 US 20150100870 A1 US20150100870 A1 US 20150100870A1 US 201414570671 A US201414570671 A US 201414570671A US 2015100870 A1 US2015100870 A1 US 2015100870A1
- Authority
- US
- United States
- Prior art keywords
- page
- feed
- representation
- identifying
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G06F17/3089—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G06F17/2247—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/14—Tree-structured documents
- G06F40/143—Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
Definitions
- This document relates to harvesting data from a page.
- the invention relates to harvesting data from a page.
- Some implementations of the present invention relate to automatically determining which parts of a website and/or web page comprise the “important” or “targeted” text to mine.
- a computer-implemented method for obtaining data from a page includes initiating a harvesting process for a page available in a computer system.
- the method includes identifying a feed representation that has been created for the page.
- the method includes retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation.
- Implementations can include any, all or none of the following features.
- the method can further include identifying, before retrieving the portion of the page, at least a part of the feed representation to be used for retrieving the portion from the page, the part of the feed representation including the information.
- the method can further include using the identified part of the feed representation to identify the portion of the page as matching the information in the feed representation.
- Using the identified part of the feed representation can include comparing the identified part of the feed representation with contents of the page.
- the feed representation can include at least excerpts of content from the page.
- the feed representation can include at least one representation selected from: an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof.
- the method can further include identifying at least one feed entry in the feed representation, the feed entry relating to a portion of the page that links to another page; determining a URL of the other page; retrieving page content from the other page using the determined URL; and identifying, in the retrieved page content, the portion of the page as matching content from the identified feed entry.
- Retrieving the portion from the page based on the information can include using a text recognition technique.
- the method can further include determining, using the identified feed representation, which content from the page not to retrieve in the harvesting process; and identifying the portion from the page as not being included in the determined content of the page not to retrieve.
- the method can further include causing the determined content of the page not to be retrieved in the harvesting process.
- a computer program product is tangibly embodied in a computer-readable medium and includes instructions that when executed by a processor perform a method for obtaining data from a page.
- the method includes initiating a harvesting process for a page available in a computer system.
- the method includes identifying a feed representation that has been created for the page.
- the method includes retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation.
- a computer-implemented method for obtaining data from a page includes identifying a page as a target for content retrieval, the page including multiple content portions.
- the method includes identifying a feed representation that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions.
- the method includes processing each of the multiple feed entries by: accessing the identified page; identifying any of the multiple content portions that match contents of the feed entry being processed; and retrieving at least one of the multiple content portions based on the identified content portion.
- the method includes storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries.
- Implementations can include any, all or none of the following features.
- At least a first content portion of the multiple content portions can link to another page, and processing a first feed entry of the multiple feed entries relating to the first content portion can include: accessing the other page to which the first content portion links; identifying contents of the accessed other page that match contents of the first feed entry; and retrieving the identified contents of the accessed other page.
- the feed representation can include at least excerpts of content from the identified page.
- the feed representation can include at least one representation selected from: an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof. Identifying contents of the accessed page that match contents of the feed entry being processed can include using a text recognition technique.
- the method can further include determining, using the identified feed representation, which content from the identified page not to retrieve in the content retrieval; and identifying the at least one of the multiple content portion as not being included in the determined content of the page not to retrieve.
- the method can further include causing any of the multiple content portions identified as matching contents of the feed entry being processed not to be retrieved in the content retrieval.
- a computer program product is tangibly embodied in a computer-readable medium and includes instructions that when executed by a processor perform a method for obtaining data from a page.
- the method includes identifying a page as a target for content retrieval, the page including multiple content portions.
- the method includes identifying a feed representation that that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions.
- the method includes processing each of the multiple feed entries by: accessing the identified page; identifying any of the multiple content portions that match contents of the feed entry being processed; and retrieving at least one of the multiple content portions based on the identified content portion.
- the method includes storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries.
- Advantages of some implementations include: automatically targeting the harvesting activity to the desired content within sites, pages and/or parts of sites or pages; and providing a less labor intensive or computationally intensive approach to mining and harvesting the content of sites and pages with varying structure and content.
- FIG. 1 is an example of a portion of a page from which content can be harvested.
- FIG. 2 shows an example of a system that can retrieve content using a feed representation.
- FIG. 3 is an example of a flow chart for a method that can be performed.
- FIG. 4 is another example of a flow chart for a method that can be performed.
- FIG. 5 is a block diagram of a computing system that can be used in connection with computer-implemented methods described in this document.
- FIG. 1 a portion of a web page 100 is shown.
- the web page 100 is created using a known markup language and is made publicly available at the address http://novaspivack.typepad.com/ where it can be viewed using a web browser.
- the web page 100 can make selected portions of its content available in a feed representation.
- the feed representation of a site or page can contain blurbs comprising excerpts (or in some cases, full-text) of the content of the site.
- a news site's feed for example, can provide blurbs or full text for each news article in the site or site section it represents.
- the feed representation contains some or all of the content that, according to the publisher of the page 100 or another creator of the feed representation, is considered to be “most important” or the “main content” of the page (for example, news articles), compared to other content that is “less important” or “peripheral content” (for example, ads or sections of the page containing comments and/or annotations to the page etc.) that the page may contain, when judged against a standard of relevance.
- a feed representation can be provided using an RSS feed or Atom feed, or other extensible markup language (XML) or rich data format (RDF) feed formats, to name a few examples, or any other type of serialized “data feed” representation of the content.
- RSS refers to protocols or technologies including, but not limited to: RDF Site Summary (sometimes referred to as RSS 0.9, RSS 1.0); Rich Site Summary (sometimes referred to as RSS 0.91, RSS 1.0); and Really Simple Syndication (sometimes referred to as RSS 2.0).
- the web page 100 includes a link 102 that provides a feed representation of the page 100 . The information in such a feed can be used to guide and target mining efforts aimed at page 100 .
- the feed for the page 100 may have an entry that contains the following excerpt:
- content is harvested as follows. First, the URL to which the feed entry (Table 1) points is determined. In this example, that URL is http://novaspivack.typepad.com/nova_spivacks_weblog/2006/08/what_am_i_upto.html. Next, the content from that URL is automatically retrieved. Next, it is determined which part of this page is the “main content”—the content that should be mined. This determination is made by identifying the part of the page that matches the text from the feed entry. In this example, that is the part of the page starting with: “What is Radar Networks up to? Shel Israel and I just finished up working together for 10 days. I needed Shel's perspective on what we are working on at Radar Networks.” The matching part can be identified using any technique for comparing content, such as text recognition.
- an implementation of a mining agent can automatically look for the part of the page that matches this text and identify it as the part that matters.
- the determination of which part(s) of the page should be mined is made by the content provider, the publisher of the feed, when they decide which content to publish in their feed—the agent simply mines the content portions that are referenced from the feed.
- the identified portion is the part of the page that is mined; the rest is ignored.
- more contents can be mined.
- the agent can determine where in the layout to find the “important” content that it is supposed to mine.
- Such an agent can be configured and used with an aim toward harvesting only the main content of a specific site or page, and not the advertisements or other peripheral content. It could also be used conversely to figure out which content to ignore—for example, if the goal is to filter out the main content, so that the peripheral content can be mined, in which case the agent mines everything except what is provided in the feed for a given page.
- FIG. 2 shows an example of a system 200 that can retrieve content using a feed representation.
- the system 200 here includes a first device 202 and a second device 204 .
- the first and second devices are both connected to at least one network 206 , such as the Internet, an intranet or a cellular telephone network, to name a few examples.
- the first device 202 comprises a server device and the second device comprises a client device, the devices being configured to communicate over the World Wide Web (WWW).
- WWW World Wide Web
- the first device can make one or more pages available, for example to the second device and/or other entities on the network 206 .
- pages 208 and 210 are shown for clarity, but other implementations can make available dozens, hundreds or millions of pages or more.
- the page 208 contains links to the other pages 210 . That is, the page 208 includes a portion 208 A linking to the page 210 A; a portion 208 B linking to the page 210 B; and a portion 208 C linking to the page 210 C. Users visiting the page 208 can access any of the pages 210 by activating the corresponding link(s) on the page 208 . As other examples, a user can access any of the pages 210 directly by entering its address into a browser or other client program, or by navigating to the page using a link on another page (not shown). For example, the page 208 in some implementations can include the web page 100 ( FIG. 1 ).
- the pages 210 are shown as residing within the same device as the pages 210 (i.e., the first device 202 ). In other implementations, one or more of the pages 210 can be located on another device or in another system. That is, the pages 210 need not have been published by the same entity as the page 208 , or be controlled by that entity.
- the first device also makes available a feed representation 212 associated with the page 208 .
- the feed representation can have any of a number of types.
- the feed representation 212 can be an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof.
- the publisher of the page 208 can provide the feed representation 212 to complement the provision of information through the page 208 , for example to highlight selected portions of that page's content.
- the feed representation 212 in some implementations can include the feed representation for the web page 100 available through the link 102 ( FIG. 1 ).
- the feed representation 212 includes at least one or more excerpts of content from the page 208 .
- the feed representation includes a part 212 A associated with the portion 218 A; a part 212 B associated with the portion 218 B; and a part 212 C associated with the portion 218 C.
- a feed entry in any of the parts 212 A-C can include the contents shown in the exemplary Table 1 above.
- the second device 204 can be configured for seeking out information available through the network 206 that is of interest according to one or more relevance standards.
- the second device can also retrieve identified contents and store them temporarily or indefinitely for one or more purposes, such as to perform additional processing on the information, or to forward it to another entity (not shown), to name just a few examples.
- the second device includes a content harvester 214 that is configured to perform such content retrieval.
- the content harvester 214 can initiate a harvesting process for a page available in the computer system 206 .
- the content harvester 214 can provide for storing and/or other processing of the retrieved content.
- the second device also includes an information identifier 216 that can identify the information or other content to be retrieved, and pass this information on to the content harvester 214 .
- the information identifier 216 can identify a feed representation that has been created for the page.
- the information identifier 216 can identify at least a part of the feed representation to be used for retrieving a portion from the page.
- the content harvester 214 can retrieve and store at least a portion from the page based on information in the identified feed representation.
- the information identifier 216 can use the identified part 212 A to identify the portion 208 A as matching the information in the feed representation.
- the information identifier 216 can use any of several techniques in this operation. For example, the information identifier 216 can compare the identified part 212 A with contents of the page to identify the portion 208 A.
- retrieving the portion from the page based on the information can include using a text recognition technique, such as by parsing text in the feed entry and in the page content, and using the text recognition to match the feed entry with the page portion.
- the content harvester 214 can in some implementations retrieve at least that portion 208 A from the page 208 .
- the information identifier 216 can determine a page identifier, such as a uniform resource locator (URL) of the other page to which the page links.
- the content harvester 214 can then retrieve page content from the other page using the determined URL.
- the information identifier 216 can identify, in the retrieved page content, the portion of the page as matching content from an identified feed entry. Based on the identification, the matching page portion is retrieved in the harvesting process.
- a uniform resource locator URL
- the above examples focus on retrieving some or all of the content that has been chosen for inclusion in a feed representation.
- the feed representation can be used for retrieval of content that has not been chosen for inclusion in a feed representation. This can provide the advantage of helping to avoid information that qualifies as the main or central content of a page according to a relevance standard.
- the information identifier 216 can be configured to ignore or omit contents that have entries in the feed representation 212 when identifying portions of the page 208 . That is, the information identifier 216 can use the feed representation 212 to determine which content from the page 208 that is not to be retrieved in the harvesting process. For example, the information identifier 216 can find one or more portions of the page 208 that is not included in the feed representation, and also identify such content as being a candidate for retrieval.
- the content harvester 214 can be configured so that the determined content of the page—i.e., contents that have entries in the feed representation is not retrieved in the harvesting process.
- FIG. 3 is an example of a flow chart for a method 300 that can be performed.
- the method 300 can be performed by a processor executing instructions in a computer-readable medium.
- the method 300 can be performed to obtain data from a page in the system 100 ( FIG. 1 ).
- the method 300 includes a step 310 of initiating a harvesting process for a page available in a computer system. For example, this can involve initiating or launching any or all of the second device 204 , the content harvester 214 or the information identifier 216 .
- the harvesting process can be directed to the page 208 and/or to any or all of the pages 210 .
- the method 300 includes a step 320 of identifying a feed representation that has been created for the page.
- the information identifier 216 can identify the feed representation 212 as having been created for the page 208 .
- the method 300 includes a step 330 of retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation.
- the content harvester 214 can retrieve any or all of the portions 208 A-C from the page 208 , and/or any or all contents from any of the pages 210 and store it in the second device 204 .
- One or more other steps can be performed before, in between, and/or after the steps of the method 300 .
- the second device 204 or another device can be configured to process retrieved content.
- FIG. 4 is another example of a flow chart for a method 400 that can be performed.
- the method 400 can be performed by a processor executing instructions in a computer-readable medium.
- the method 400 can be performed to obtain data from a page in the system 100 ( FIG. 1 ).
- Other examples or implementations of individual steps in the method 400 can also be found in the description above and/or in the drawings.
- the method 400 includes a step 410 of identifying a page as a target for content retrieval, the page including multiple content portions.
- the method 400 includes a step 420 of identifying a feed representation that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions.
- the method 400 includes looped steps 430 - 470 of processing each of the multiple feed entries.
- the step 440 in the loop includes accessing the identified page.
- the step 450 in the loop includes identifying any of the multiple content portions that match contents of the feed entry being processed.
- the step 460 in the loop includes retrieving at least one of the multiple content portions based on the identified content portion.
- the step 470 in the loop indicates that the loop can be performed for each feed entry.
- the method 400 includes a step 480 of storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries.
- One or more additional steps can be performed with the method 400 , for example as described above with reference to method 300 .
- the processing of a feed entry can include: accessing the other page to which the first content portion links; identifying contents of the accessed other page that match contents of the first feed entry; and retrieving the identified contents of the accessed other page.
- FIG. 5 is a schematic diagram of a generic computer system 1100 .
- the system 1100 can be used for the operations described in association with any of the computer-implement methods described previously, according to one implementation.
- the system 1100 includes a processor 1110 , a memory 1120 , a storage device 1130 , and an input/output device 1140 .
- Each of the components 1110 , 1120 , 1130 , and 1140 are interconnected using a system bus 1150 .
- the processor 1110 is capable of processing instructions for execution within the system 1100 .
- the processor 1110 is a single-threaded processor.
- the processor 1110 is a multi-threaded processor.
- the processor 1110 is capable of processing instructions stored in the memory 1120 or on the storage device 1130 to display graphical information for a user interface on the input/output device 1140 .
- the memory 1120 stores information within the system 1100 .
- the memory 1120 is a computer-readable medium.
- the memory 1120 is a volatile memory unit.
- the memory 1120 is a non-volatile memory unit.
- the storage device 1130 is capable of providing mass storage for the system 1100 .
- the storage device 1130 is a computer-readable medium.
- the storage device 1130 may be a floppy disk device, a hard disk device, an optical disk device, or a tape device.
- the input/output device 1140 provides input/output operations for the system 1100 .
- the input/output device 1140 includes a keyboard and/or pointing device.
- the input/output device 1140 includes a display unit for displaying graphical user interfaces.
- the features described can be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them.
- the apparatus can be implemented in a computer program product tangibly embodied in an information carrier, e.g., in a machine-readable storage device or in a propagated signal, for execution by a programmable processor; and method steps can be performed by a programmable processor executing a program of instructions to perform functions of the described implementations by operating on input data and generating output.
- the described features can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device.
- a computer program is a set of instructions that can be used, directly or indirectly, in a computer to perform a certain activity or bring about a certain result.
- a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
- Suitable processors for the execution of a program of instructions include, by way of example, both general and special purpose microprocessors, and the sole processor or one of multiple processors of any kind of computer.
- a processor will receive instructions and data from a read-only memory or a random access memory or both.
- the essential elements of a computer are a processor for executing instructions and one or more memories for storing instructions and data.
- a computer will also include, or be operatively coupled to communicate with, one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks.
- Storage devices suitable for tangibly embodying computer program instructions and data include all forms of nonvolatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.
- semiconductor memory devices such as EPROM, EEPROM, and flash memory devices
- magnetic disks such as internal hard disks and removable disks
- magneto-optical disks and CD-ROM and DVD-ROM disks.
- the processor and the memory can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).
- ASICs application-specific integrated circuits
- the features can be implemented on a computer having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user and a keyboard and a pointing device such as a mouse or a trackball by which the user can provide input to the computer.
- a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user and a keyboard and a pointing device such as a mouse or a trackball by which the user can provide input to the computer.
- the features can be implemented in a computer system that includes a back-end component, such as a data server, or that includes a middleware component, such as an application server or an Internet server, or that includes a front-end component, such as a client computer having a graphical user interface or an Internet browser, or any combination of them.
- the components of the system can be connected by any form or medium of digital data communication such as a communication network. Examples of communication networks include, e.g., a LAN, a WAN, and the computers and networks forming the Internet.
- the computer system can include clients and servers.
- a client and server are generally remote from each other and typically interact through a network, such as the described one.
- the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
Abstract
Description
- This patent application is a Continuation of U.S. application Ser. No. 11/835,079, entitled “HARVESTING DATA FROM PAGE”, filed Aug. 7, 2007 which claims priority to Provisional Patent Application No. 60/821,891, filed Aug. 9, 2006 and entitled “HARVESTING DATA FROM PAGE”, the entire contents of which are incorporated herein by reference.
- This document relates to harvesting data from a page.
- Current approaches for harvesting content from web pages face the situation that each site and page can have a unique layout comprised of multiple components in various places, such as content sections, ads, frames, columns, content boxes, page content that is divided into sub-divisions or sub-objects, web page sub-components, content articles that run or continue across several sections or pages, etc. In response to this situation, present tools for crawling and mining content from such pages have sometimes needed to be specifically programmed for the unique layout and structure of each site and/or page so that they know where the content of interest is located in the layout for that site. In other words, the programming tells the tool what parts of the page represent content to keep, and content to discard, and what sections of the page correspond to various types of content. For example, when mining a news site, it may be desired to collect and operate on the body text of the news articles in the site, but to ignore the ads and other sidebar content, etc. Existing approaches in this regard have involved programming specific mining agents, or programming a general agent with specific rules or templates. Moreover, such programming often need to be kept up to date for each site and/or page as the content and structure of the sites and pages change over time. This can be a labor intensive process that does not scale well to mining very large numbers of sites/pages with differing layouts and structure. Another existing solution uses statistical or natural language processing methods, or machine learning methods, to try to figure out automatically which parts of sites and pages should be kept and which should be discarded, and which parts of sites and pages correspond to various types of content.
- The invention relates to harvesting data from a page.
- Some implementations of the present invention relate to automatically determining which parts of a website and/or web page comprise the “important” or “targeted” text to mine.
- In a first aspect, a computer-implemented method for obtaining data from a page includes initiating a harvesting process for a page available in a computer system. The method includes identifying a feed representation that has been created for the page. The method includes retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation.
- Implementations can include any, all or none of the following features. The method can further include identifying, before retrieving the portion of the page, at least a part of the feed representation to be used for retrieving the portion from the page, the part of the feed representation including the information. The method can further include using the identified part of the feed representation to identify the portion of the page as matching the information in the feed representation. Using the identified part of the feed representation can include comparing the identified part of the feed representation with contents of the page. The feed representation can include at least excerpts of content from the page. The feed representation can include at least one representation selected from: an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof. The method can further include identifying at least one feed entry in the feed representation, the feed entry relating to a portion of the page that links to another page; determining a URL of the other page; retrieving page content from the other page using the determined URL; and identifying, in the retrieved page content, the portion of the page as matching content from the identified feed entry. Retrieving the portion from the page based on the information can include using a text recognition technique. The method can further include determining, using the identified feed representation, which content from the page not to retrieve in the harvesting process; and identifying the portion from the page as not being included in the determined content of the page not to retrieve. The method can further include causing the determined content of the page not to be retrieved in the harvesting process.
- In a second aspect, a computer program product is tangibly embodied in a computer-readable medium and includes instructions that when executed by a processor perform a method for obtaining data from a page. The method includes initiating a harvesting process for a page available in a computer system. The method includes identifying a feed representation that has been created for the page. The method includes retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation.
- In a third aspect, a computer-implemented method for obtaining data from a page includes identifying a page as a target for content retrieval, the page including multiple content portions. The method includes identifying a feed representation that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions. The method includes processing each of the multiple feed entries by: accessing the identified page; identifying any of the multiple content portions that match contents of the feed entry being processed; and retrieving at least one of the multiple content portions based on the identified content portion. The method includes storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries.
- Implementations can include any, all or none of the following features. At least a first content portion of the multiple content portions can link to another page, and processing a first feed entry of the multiple feed entries relating to the first content portion can include: accessing the other page to which the first content portion links; identifying contents of the accessed other page that match contents of the first feed entry; and retrieving the identified contents of the accessed other page. The feed representation can include at least excerpts of content from the identified page. The feed representation can include at least one representation selected from: an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof. Identifying contents of the accessed page that match contents of the feed entry being processed can include using a text recognition technique. The method can further include determining, using the identified feed representation, which content from the identified page not to retrieve in the content retrieval; and identifying the at least one of the multiple content portion as not being included in the determined content of the page not to retrieve. The method can further include causing any of the multiple content portions identified as matching contents of the feed entry being processed not to be retrieved in the content retrieval.
- In a fourth aspect, a computer program product is tangibly embodied in a computer-readable medium and includes instructions that when executed by a processor perform a method for obtaining data from a page. The method includes identifying a page as a target for content retrieval, the page including multiple content portions. The method includes identifying a feed representation that that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions. The method includes processing each of the multiple feed entries by: accessing the identified page; identifying any of the multiple content portions that match contents of the feed entry being processed; and retrieving at least one of the multiple content portions based on the identified content portion. The method includes storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries.
- Advantages of some implementations include: automatically targeting the harvesting activity to the desired content within sites, pages and/or parts of sites or pages; and providing a less labor intensive or computationally intensive approach to mining and harvesting the content of sites and pages with varying structure and content.
-
FIG. 1 is an example of a portion of a page from which content can be harvested. -
FIG. 2 shows an example of a system that can retrieve content using a feed representation. -
FIG. 3 is an example of a flow chart for a method that can be performed. -
FIG. 4 is another example of a flow chart for a method that can be performed. -
FIG. 5 is a block diagram of a computing system that can be used in connection with computer-implemented methods described in this document. - Like reference symbols in the various drawings indicate like elements.
- There will now be described an exemplary implementation that relates to automatically determining which parts of a website and/or web page comprise the “important” body text to mine. The description makes reference to
FIG. 1 , in which a portion of aweb page 100 is shown. For example, theweb page 100 is created using a known markup language and is made publicly available at the address http://novaspivack.typepad.com/ where it can be viewed using a web browser. - The
web page 100 can make selected portions of its content available in a feed representation. For example, the feed representation of a site or page can contain blurbs comprising excerpts (or in some cases, full-text) of the content of the site. A news site's feed, for example, can provide blurbs or full text for each news article in the site or site section it represents. Thus, the feed representation contains some or all of the content that, according to the publisher of thepage 100 or another creator of the feed representation, is considered to be “most important” or the “main content” of the page (for example, news articles), compared to other content that is “less important” or “peripheral content” (for example, ads or sections of the page containing comments and/or annotations to the page etc.) that the page may contain, when judged against a standard of relevance. Such a feed representation can be provided using an RSS feed or Atom feed, or other extensible markup language (XML) or rich data format (RDF) feed formats, to name a few examples, or any other type of serialized “data feed” representation of the content. When mentioned herein, RSS refers to protocols or technologies including, but not limited to: RDF Site Summary (sometimes referred to as RSS 0.9, RSS 1.0); Rich Site Summary (sometimes referred to as RSS 0.91, RSS 1.0); and Really Simple Syndication (sometimes referred to as RSS 2.0). Here, theweb page 100 includes alink 102 that provides a feed representation of thepage 100. The information in such a feed can be used to guide and target mining efforts aimed atpage 100. - For example, the feed for the
page 100 may have an entry that contains the following excerpt: -
TABLE 1 What is Radar Networks up to? Shel Israel and I just finished up working together for 10 days. I needed Shel's perspective on what we are working on at Radar Networks. - In one implementation, content is harvested as follows. First, the URL to which the feed entry (Table 1) points is determined. In this example, that URL is http://novaspivack.typepad.com/nova_spivacks_weblog/2006/08/what_am_i_upto.html. Next, the content from that URL is automatically retrieved. Next, it is determined which part of this page is the “main content”—the content that should be mined. This determination is made by identifying the part of the page that matches the text from the feed entry. In this example, that is the part of the page starting with: “What is Radar Networks up to? Shel Israel and I just finished up working together for 10 days. I needed Shel's perspective on what we are working on at Radar Networks.” The matching part can be identified using any technique for comparing content, such as text recognition.
- In other words, an implementation of a mining agent can automatically look for the part of the page that matches this text and identify it as the part that matters. Rather than the mining agent having to somehow parse or analyze the page to determine which content it should mine, the determination of which part(s) of the page should be mined is made by the content provider, the publisher of the feed, when they decide which content to publish in their feed—the agent simply mines the content portions that are referenced from the feed. In this example, the identified portion is the part of the page that is mined; the rest is ignored. In other implementations, more contents can be mined. Thus, without the agent being specifically programmed for the layout of this particular weblog, the agent can determine where in the layout to find the “important” content that it is supposed to mine.
- Such an agent (or methods performed in harvesting operations), can be configured and used with an aim toward harvesting only the main content of a specific site or page, and not the advertisements or other peripheral content. It could also be used conversely to figure out which content to ignore—for example, if the goal is to filter out the main content, so that the peripheral content can be mined, in which case the agent mines everything except what is provided in the feed for a given page.
-
FIG. 2 shows an example of a system 200 that can retrieve content using a feed representation. The system 200 here includes afirst device 202 and asecond device 204. The first and second devices are both connected to at least onenetwork 206, such as the Internet, an intranet or a cellular telephone network, to name a few examples. In some implementations, thefirst device 202 comprises a server device and the second device comprises a client device, the devices being configured to communicate over the World Wide Web (WWW). - The first device can make one or more pages available, for example to the second device and/or other entities on the
network 206. In this example, only afew pages - Here, the
page 208 contains links to theother pages 210. That is, thepage 208 includes aportion 208A linking to thepage 210A; aportion 208B linking to thepage 210B; and aportion 208C linking to thepage 210C. Users visiting thepage 208 can access any of thepages 210 by activating the corresponding link(s) on thepage 208. As other examples, a user can access any of thepages 210 directly by entering its address into a browser or other client program, or by navigating to the page using a link on another page (not shown). For example, thepage 208 in some implementations can include the web page 100 (FIG. 1 ). - In this example, the
pages 210 are shown as residing within the same device as the pages 210 (i.e., the first device 202). In other implementations, one or more of thepages 210 can be located on another device or in another system. That is, thepages 210 need not have been published by the same entity as thepage 208, or be controlled by that entity. - Here, the first device also makes available a
feed representation 212 associated with thepage 208. The feed representation can have any of a number of types. In some implementations, thefeed representation 212 can be an RSS feed, an Atom feed, an XML feed, an RDF feed, a serialized data feed representation, and combinations thereof. In short, the publisher of thepage 208 can provide thefeed representation 212 to complement the provision of information through thepage 208, for example to highlight selected portions of that page's content. For example, thefeed representation 212 in some implementations can include the feed representation for theweb page 100 available through the link 102 (FIG. 1 ). - The
feed representation 212 includes at least one or more excerpts of content from thepage 208. Here, the feed representation includes apart 212A associated with the portion 218A; apart 212B associated with the portion 218B; and apart 212C associated with the portion 218C. For example, a feed entry in any of theparts 212A-C can include the contents shown in the exemplary Table 1 above. - The
second device 204 can be configured for seeking out information available through thenetwork 206 that is of interest according to one or more relevance standards. The second device can also retrieve identified contents and store them temporarily or indefinitely for one or more purposes, such as to perform additional processing on the information, or to forward it to another entity (not shown), to name just a few examples. - Here, the second device includes a
content harvester 214 that is configured to perform such content retrieval. For example, thecontent harvester 214 can initiate a harvesting process for a page available in thecomputer system 206. Thecontent harvester 214 can provide for storing and/or other processing of the retrieved content. - Here, the second device also includes an
information identifier 216 that can identify the information or other content to be retrieved, and pass this information on to thecontent harvester 214. As one example, theinformation identifier 216 can identify a feed representation that has been created for the page. As another example, theinformation identifier 216 can identify at least a part of the feed representation to be used for retrieving a portion from the page. Thecontent harvester 214 can retrieve and store at least a portion from the page based on information in the identified feed representation. - Assume, for example, that a feed entry in the past 212A of the
feed representation 212 includes the contents in Table 1 above. Theinformation identifier 216 can use the identifiedpart 212A to identify theportion 208A as matching the information in the feed representation. Theinformation identifier 216 can use any of several techniques in this operation. For example, theinformation identifier 216 can compare the identifiedpart 212A with contents of the page to identify theportion 208A. As another example, retrieving the portion from the page based on the information can include using a text recognition technique, such as by parsing text in the feed entry and in the page content, and using the text recognition to match the feed entry with the page portion. - With the
information identifier 216 having identified, say, theportion 208A as corresponding to an entry in thepart 212A of thefeed representation 212, thecontent harvester 214 can in some implementations retrieve at least thatportion 208A from thepage 208. - In contrast, when the feed entries correspond to a page that links to content on one or more pages, for example like the
page 208, theinformation identifier 216 can determine a page identifier, such as a uniform resource locator (URL) of the other page to which the page links. Thecontent harvester 214 can then retrieve page content from the other page using the determined URL. Theinformation identifier 216 can identify, in the retrieved page content, the portion of the page as matching content from an identified feed entry. Based on the identification, the matching page portion is retrieved in the harvesting process. - The above examples focus on retrieving some or all of the content that has been chosen for inclusion in a feed representation. Other approaches can be used. For example, the feed representation can be used for retrieval of content that has not been chosen for inclusion in a feed representation. This can provide the advantage of helping to avoid information that qualifies as the main or central content of a page according to a relevance standard.
- In some implementations, the
information identifier 216 can be configured to ignore or omit contents that have entries in thefeed representation 212 when identifying portions of thepage 208. That is, theinformation identifier 216 can use thefeed representation 212 to determine which content from thepage 208 that is not to be retrieved in the harvesting process. For example, theinformation identifier 216 can find one or more portions of thepage 208 that is not included in the feed representation, and also identify such content as being a candidate for retrieval. Thecontent harvester 214 can be configured so that the determined content of the page—i.e., contents that have entries in the feed representation is not retrieved in the harvesting process. -
FIG. 3 is an example of a flow chart for amethod 300 that can be performed. Themethod 300 can be performed by a processor executing instructions in a computer-readable medium. For example, themethod 300 can be performed to obtain data from a page in the system 100 (FIG. 1 ). - As shown, the
method 300 includes astep 310 of initiating a harvesting process for a page available in a computer system. For example, this can involve initiating or launching any or all of thesecond device 204, thecontent harvester 214 or theinformation identifier 216. The harvesting process can be directed to thepage 208 and/or to any or all of thepages 210. - The
method 300 includes astep 320 of identifying a feed representation that has been created for the page. For example, theinformation identifier 216 can identify thefeed representation 212 as having been created for thepage 208. - The
method 300 includes astep 330 of retrieving and storing, as part of the harvesting process, at least a portion from the page based on information in the identified feed representation. For example, thecontent harvester 214 can retrieve any or all of theportions 208A-C from thepage 208, and/or any or all contents from any of thepages 210 and store it in thesecond device 204. - One or more other steps can be performed before, in between, and/or after the steps of the
method 300. For example, thesecond device 204 or another device can be configured to process retrieved content. - As another example, the following is an outline description of an implementation of a harvesting method.
- 1. Get the RSS or Atom feed for site or page x
-
- a. For each feed entry, k, in the feed for x,
- i. Get the URL, L, in site x that the entry represents.
- ii. Get the full-content of the web page or file that L represents
- iii. Find the part of that page or file that matches the content in k
- 1. Get the content of that part of L
- 2. This content is the main content of that page
- a. For each feed entry, k, in the feed for x,
- A related example will now be described with reference to
FIG. 4 , which is another example of a flow chart for amethod 400 that can be performed. Themethod 400 can be performed by a processor executing instructions in a computer-readable medium. For example, themethod 400 can be performed to obtain data from a page in the system 100 (FIG. 1 ). Other examples or implementations of individual steps in themethod 400 can also be found in the description above and/or in the drawings. - As shown, the
method 400 includes astep 410 of identifying a page as a target for content retrieval, the page including multiple content portions. - The
method 400 includes astep 420 of identifying a feed representation that has been created for the identified page, the identified feed representation including multiple feed entries each corresponding to at least some of the multiple content portions. - The
method 400 includes looped steps 430-470 of processing each of the multiple feed entries. - The
step 440 in the loop includes accessing the identified page. - The
step 450 in the loop includes identifying any of the multiple content portions that match contents of the feed entry being processed. - The
step 460 in the loop includes retrieving at least one of the multiple content portions based on the identified content portion. - The
step 470 in the loop indicates that the loop can be performed for each feed entry. - The
method 400 includes astep 480 of storing, as a result of the content retrieval, each retrieved content portion obtained from the processing of the multiple feed entries. - One or more additional steps can be performed with the
method 400, for example as described above with reference tomethod 300. - When one or more content portion of the page links to another page, the processing of a feed entry can include: accessing the other page to which the first content portion links; identifying contents of the accessed other page that match contents of the first feed entry; and retrieving the identified contents of the accessed other page.
- Other approaches in line with one or more aspects of this description can be used.
-
FIG. 5 is a schematic diagram of ageneric computer system 1100. Thesystem 1100 can be used for the operations described in association with any of the computer-implement methods described previously, according to one implementation. Thesystem 1100 includes aprocessor 1110, amemory 1120, astorage device 1130, and an input/output device 1140. Each of thecomponents system bus 1150. Theprocessor 1110 is capable of processing instructions for execution within thesystem 1100. In one implementation, theprocessor 1110 is a single-threaded processor. In another implementation, theprocessor 1110 is a multi-threaded processor. Theprocessor 1110 is capable of processing instructions stored in thememory 1120 or on thestorage device 1130 to display graphical information for a user interface on the input/output device 1140. - The
memory 1120 stores information within thesystem 1100. In one implementation, thememory 1120 is a computer-readable medium. In one implementation, thememory 1120 is a volatile memory unit. In another implementation, thememory 1120 is a non-volatile memory unit. - The
storage device 1130 is capable of providing mass storage for thesystem 1100. In one implementation, thestorage device 1130 is a computer-readable medium. In various different implementations, thestorage device 1130 may be a floppy disk device, a hard disk device, an optical disk device, or a tape device. - The input/
output device 1140 provides input/output operations for thesystem 1100. In one implementation, the input/output device 1140 includes a keyboard and/or pointing device. In another implementation, the input/output device 1140 includes a display unit for displaying graphical user interfaces. - The features described can be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. The apparatus can be implemented in a computer program product tangibly embodied in an information carrier, e.g., in a machine-readable storage device or in a propagated signal, for execution by a programmable processor; and method steps can be performed by a programmable processor executing a program of instructions to perform functions of the described implementations by operating on input data and generating output. The described features can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. A computer program is a set of instructions that can be used, directly or indirectly, in a computer to perform a certain activity or bring about a certain result. A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
- Suitable processors for the execution of a program of instructions include, by way of example, both general and special purpose microprocessors, and the sole processor or one of multiple processors of any kind of computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memories for storing instructions and data. Generally, a computer will also include, or be operatively coupled to communicate with, one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of nonvolatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).
- To provide for interaction with a user, the features can be implemented on a computer having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user and a keyboard and a pointing device such as a mouse or a trackball by which the user can provide input to the computer.
- The features can be implemented in a computer system that includes a back-end component, such as a data server, or that includes a middleware component, such as an application server or an Internet server, or that includes a front-end component, such as a client computer having a graphical user interface or an Internet browser, or any combination of them. The components of the system can be connected by any form or medium of digital data communication such as a communication network. Examples of communication networks include, e.g., a LAN, a WAN, and the computers and networks forming the Internet.
- The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a network, such as the described one. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
- A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of this description.
- A number of embodiments have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of this disclosure. Accordingly, other embodiments are within the scope of the following claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/570,671 US20150100870A1 (en) | 2006-08-09 | 2014-12-15 | Harvesting data from page |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US82189106P | 2006-08-09 | 2006-08-09 | |
US11/835,079 US8924838B2 (en) | 2006-08-09 | 2007-08-07 | Harvesting data from page |
US14/570,671 US20150100870A1 (en) | 2006-08-09 | 2014-12-15 | Harvesting data from page |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/835,079 Continuation US8924838B2 (en) | 2006-08-09 | 2007-08-07 | Harvesting data from page |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150100870A1 true US20150100870A1 (en) | 2015-04-09 |
Family
ID=39082904
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/835,079 Expired - Fee Related US8924838B2 (en) | 2006-08-09 | 2007-08-07 | Harvesting data from page |
US14/570,671 Abandoned US20150100870A1 (en) | 2006-08-09 | 2014-12-15 | Harvesting data from page |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/835,079 Expired - Fee Related US8924838B2 (en) | 2006-08-09 | 2007-08-07 | Harvesting data from page |
Country Status (2)
Country | Link |
---|---|
US (2) | US8924838B2 (en) |
WO (1) | WO2008021832A2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140040070A1 (en) * | 2012-02-23 | 2014-02-06 | Arsen Pereymer | Publishing on mobile devices with app building |
US9607089B2 (en) | 2009-04-15 | 2017-03-28 | Vcvc Iii Llc | Search and search optimization using a pattern of a location identifier |
US9613149B2 (en) | 2009-04-15 | 2017-04-04 | Vcvc Iii Llc | Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata |
US10033799B2 (en) | 2002-11-20 | 2018-07-24 | Essential Products, Inc. | Semantically representing a target entity using a semantic object |
US10628847B2 (en) | 2009-04-15 | 2020-04-21 | Fiver Llc | Search-enhanced semantic advertising |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7584208B2 (en) * | 2002-11-20 | 2009-09-01 | Radar Networks, Inc. | Methods and systems for managing offers and requests in a network |
US7433876B2 (en) | 2004-02-23 | 2008-10-07 | Radar Networks, Inc. | Semantic web portal and platform |
US20090076887A1 (en) | 2007-09-16 | 2009-03-19 | Nova Spivack | System And Method Of Collecting Market-Related Data Via A Web-Based Networking Environment |
EP2304676A1 (en) * | 2008-06-23 | 2011-04-06 | Double Verify Inc. | Automated monitoring and verification of internet based advertising |
US9037567B2 (en) | 2009-04-15 | 2015-05-19 | Vcvc Iii Llc | Generating user-customized search results and building a semantics-enhanced search engine |
CN102129632A (en) * | 2010-01-13 | 2011-07-20 | 阿里巴巴集团控股有限公司 | Method, device and system for capturing webpage information |
CN103971244B (en) | 2013-01-30 | 2018-08-17 | 阿里巴巴集团控股有限公司 | A kind of publication of merchandise news and browsing method, apparatus and system |
US11282091B2 (en) | 2016-09-30 | 2022-03-22 | Transitiv, Inc. | Systems, methods, and devices for dynamic page feed management |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040158799A1 (en) * | 2003-02-07 | 2004-08-12 | Breuel Thomas M. | Information extraction from html documents by structural matching |
US20050108363A1 (en) * | 2002-11-25 | 2005-05-19 | Shin Torigoe | Web page update notification method and web page update notification device |
US20060230011A1 (en) * | 2004-11-22 | 2006-10-12 | Truveo, Inc. | Method and apparatus for an application crawler |
US20060287989A1 (en) * | 2005-06-16 | 2006-12-21 | Natalie Glance | Extracting structured data from weblogs |
US20070079236A1 (en) * | 2005-10-04 | 2007-04-05 | Microsoft Corporation | Multi-form design with harmonic composition for dynamically aggregated documents |
US20070198459A1 (en) * | 2006-02-14 | 2007-08-23 | Boone Gary N | System and method for online information analysis |
US20080034058A1 (en) * | 2006-08-01 | 2008-02-07 | Marchex, Inc. | Method and system for populating resources using web feeds |
US7765209B1 (en) * | 2005-09-13 | 2010-07-27 | Google Inc. | Indexing and retrieval of blogs |
Family Cites Families (202)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69217228T2 (en) * | 1991-08-07 | 1997-08-21 | Unisys Corp | METHOD FOR SETTING UP MULTI-OBJECT CONDITIONS IN FILES |
JP3662946B2 (en) * | 1993-09-22 | 2005-06-22 | 株式会社東芝 | File management system and portable electronic device |
US5548749A (en) | 1993-10-29 | 1996-08-20 | Wall Data Incorporated | Semantic orbject modeling system for creating relational database schemas |
US5819086A (en) | 1995-06-07 | 1998-10-06 | Wall Data Incorporated | Computer system for creating semantic object models from existing relational database schemas |
US5717924A (en) * | 1995-07-07 | 1998-02-10 | Wall Data Incorporated | Method and apparatus for modifying existing relational database schemas to reflect changes made in a corresponding object model |
US5925100A (en) | 1996-03-21 | 1999-07-20 | Sybase, Inc. | Client/server system with methods for prefetching and managing semantic objects based on object-based prefetch primitive present in client's executing application |
US5966686A (en) | 1996-06-28 | 1999-10-12 | Microsoft Corporation | Method and system for computing semantic logical forms from syntax trees |
US5905496A (en) * | 1996-07-03 | 1999-05-18 | Sun Microsystems, Inc. | Workflow product navigation system |
US6724931B1 (en) * | 1996-12-02 | 2004-04-20 | Hsu Shin-Yi | Compilable plain english-like language for extracting objects from an image using a primitive image map |
US5905498A (en) | 1996-12-24 | 1999-05-18 | Correlate Technologies Ltd | System and method for managing semantic network display |
DE19812812A1 (en) * | 1997-04-25 | 1999-09-23 | Whd Elektron Prueftech Gmbh | Construction of security elements for documents and devices for checking documents with such security elements, as well as methods for use |
US6182068B1 (en) | 1997-08-01 | 2001-01-30 | Ask Jeeves, Inc. | Personalized search methods |
US6173287B1 (en) * | 1998-03-11 | 2001-01-09 | Digital Equipment Corporation | Technique for ranking multimedia annotations of interest |
US6530083B1 (en) * | 1998-06-19 | 2003-03-04 | Gateway, Inc | System for personalized settings |
US6411952B1 (en) | 1998-06-24 | 2002-06-25 | Compaq Information Technologies Group, Lp | Method for learning character patterns to interactively control the scope of a web crawler |
US7197451B1 (en) * | 1998-07-02 | 2007-03-27 | Novell, Inc. | Method and mechanism for the creation, maintenance, and comparison of semantic abstracts |
US6363377B1 (en) * | 1998-07-30 | 2002-03-26 | Sarnoff Corporation | Search data processor |
TW451143B (en) * | 1998-11-05 | 2001-08-21 | Ecomagents Inc | Method for controlling access to information |
US6654741B1 (en) * | 1999-05-03 | 2003-11-25 | Microsoft Corporation | URL mapping methods and systems |
US6571234B1 (en) * | 1999-05-11 | 2003-05-27 | Prophet Financial Systems, Inc. | System and method for managing online message board |
CA2272739C (en) | 1999-05-25 | 2003-10-07 | Suhayya Abu-Hakima | Apparatus and method for interpreting and intelligently managing electronic messages |
US7185075B1 (en) * | 1999-05-26 | 2007-02-27 | Fujitsu Limited | Element management system with dynamic database updates based on parsed snooping |
WO2000075788A1 (en) | 1999-05-26 | 2000-12-14 | Fujitsu Network Communications, Inc. | Network element management system |
US6711585B1 (en) * | 1999-06-15 | 2004-03-23 | Kanisa Inc. | System and method for implementing a knowledge management system |
US6816857B1 (en) | 1999-11-01 | 2004-11-09 | Applied Semantics, Inc. | Meaning-based advertising and document relevance determination |
KR100350791B1 (en) | 1999-09-22 | 2002-09-09 | 엘지전자 주식회사 | User profile for video service system |
US6200614B1 (en) * | 1999-10-04 | 2001-03-13 | Stephen W. Brawley | Comestible poultry product and means and method for preparation for cooking |
GB9925227D0 (en) * | 1999-10-25 | 1999-12-22 | Internet Limited | Data storage retrieval and access system |
US7630986B1 (en) | 1999-10-27 | 2009-12-08 | Pinpoint, Incorporated | Secure data interchange |
US20020059223A1 (en) * | 1999-11-30 | 2002-05-16 | Nash Paul R. | Locator based assisted information browsing |
WO2001039587A1 (en) | 1999-12-01 | 2001-06-07 | Connectivcorp | A system and method for content recognition over the internet |
US6748441B1 (en) | 1999-12-02 | 2004-06-08 | Microsoft Corporation | Data carousel receiving and caching |
US6839701B1 (en) * | 2000-01-21 | 2005-01-04 | International Business Machines | Hitmask for querying hierarchically related content entities |
US6311194B1 (en) | 2000-03-15 | 2001-10-30 | Taalee, Inc. | System and method for creating a semantic web and its applications in browsing, searching, profiling, personalization and advertising |
US20050021862A1 (en) * | 2000-03-31 | 2005-01-27 | Dickens Coal Llc | Automatic selection of content-delivery provider using link mapping database |
US7177798B2 (en) * | 2000-04-07 | 2007-02-13 | Rensselaer Polytechnic Institute | Natural language interface using constrained intermediate dictionary of results |
US20030208472A1 (en) | 2000-04-11 | 2003-11-06 | Pham Peter Manh | Method and apparatus for transparent keyword-based hyperlink |
WO2001081829A1 (en) * | 2000-04-27 | 2001-11-01 | Brio Technology, Inc. | Method and apparatus for processing jobs on an enterprise-wide computer system |
US6868447B1 (en) * | 2000-05-09 | 2005-03-15 | Sun Microsystems, Inc. | Mechanism and apparatus for returning results of services in a distributed computing environment |
US6789077B1 (en) | 2000-05-09 | 2004-09-07 | Sun Microsystems, Inc. | Mechanism and apparatus for web-based searching of URI-addressable repositories in a distributed computing environment |
US6643650B1 (en) | 2000-05-09 | 2003-11-04 | Sun Microsystems, Inc. | Mechanism and apparatus for using messages to look up documents stored in spaces in a distributed computing environment |
GB0011426D0 (en) | 2000-05-11 | 2000-06-28 | Charteris Limited | A method for transforming documents written in different XML-based languages |
US6704729B1 (en) * | 2000-05-19 | 2004-03-09 | Microsoft Corporation | Retrieval of relevant information categories |
US20010049700A1 (en) | 2000-05-26 | 2001-12-06 | Shinobu Ichikura | Information processing apparatus, information processing method and storage medium |
US6785666B1 (en) | 2000-07-11 | 2004-08-31 | Revenue Science, Inc. | Method and system for parsing navigation information |
US7092928B1 (en) | 2000-07-31 | 2006-08-15 | Quantum Leap Research, Inc. | Intelligent portal engine |
DE60017727T2 (en) * | 2000-08-18 | 2005-12-29 | Exalead | Search tool and process for searching using categories and keywords |
SG97922A1 (en) * | 2000-08-21 | 2003-08-20 | Kent Ridge Digital Labs | Knowledge discovery system |
US6513059B1 (en) * | 2000-08-24 | 2003-01-28 | Cambira Corporation | Adaptive collaborative intelligent network system |
JP3790661B2 (en) | 2000-09-08 | 2006-06-28 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Access control system |
US6678679B1 (en) * | 2000-10-10 | 2004-01-13 | Science Applications International Corporation | Method and system for facilitating the refinement of data queries |
US20020049689A1 (en) * | 2000-10-20 | 2002-04-25 | Srinivas Venkatram | Systems and methods for visual optimal ordered knowledge learning structures |
US7356507B2 (en) | 2000-10-30 | 2008-04-08 | Amazon.Com, Inc. | Network based user-to-user payment service |
US7103556B2 (en) | 2000-11-02 | 2006-09-05 | Jpmorgan Chase Bank, N.A. | System and method for aggregate portfolio client support |
US20020103920A1 (en) | 2000-11-21 | 2002-08-01 | Berkun Ken Alan | Interpretive stream metadata extraction |
US6996566B1 (en) * | 2000-11-21 | 2006-02-07 | International Business Machines Corporation | Method and system for an object model with embedded metadata and mapping information |
US6795815B2 (en) | 2000-12-13 | 2004-09-21 | George Guonan Zhang | Computer based knowledge system |
US20020082900A1 (en) | 2000-12-27 | 2002-06-27 | Johnson Alan D. | Method and system for collecting market research and user trend data via the internet and dispensing rebate certificates |
US20040111386A1 (en) | 2001-01-08 | 2004-06-10 | Goldberg Jonathan M. | Knowledge neighborhoods |
US7299202B2 (en) | 2001-02-07 | 2007-11-20 | Exalt Solutions, Inc. | Intelligent multimedia e-catalog |
US6847974B2 (en) * | 2001-03-26 | 2005-01-25 | Us Search.Com Inc | Method and apparatus for intelligent data assimilation |
US7703009B2 (en) | 2001-04-09 | 2010-04-20 | Huang Evan S | Extensible stylesheet designs using meta-tag information |
US20020161626A1 (en) | 2001-04-27 | 2002-10-31 | Pierre Plante | Web-assistant based e-marketing method and system |
US7246164B2 (en) | 2001-05-10 | 2007-07-17 | Whoglue, Inc. | Distributed personal relationship information management system and methods |
US7099885B2 (en) | 2001-05-25 | 2006-08-29 | Unicorn Solutions | Method and system for collaborative ontology modeling |
US20020194154A1 (en) | 2001-06-05 | 2002-12-19 | Levy Joshua Lerner | Systems, methods and computer program products for integrating biological/chemical databases using aliases |
US20020194201A1 (en) | 2001-06-05 | 2002-12-19 | Wilbanks John Thompson | Systems, methods and computer program products for integrating biological/chemical databases to create an ontology network |
MXPA03011976A (en) | 2001-06-22 | 2005-07-01 | Nervana Inc | System and method for knowledge retrieval, management, delivery and presentation. |
US20040230572A1 (en) | 2001-06-22 | 2004-11-18 | Nosa Omoigui | System and method for semantic knowledge retrieval, management, capture, sharing, discovery, delivery and presentation |
US20030028871A1 (en) * | 2001-07-20 | 2003-02-06 | Annie Wang | Behavior profile system and method |
US20030046344A1 (en) * | 2001-08-31 | 2003-03-06 | International Business Machines Corp. | Method and system for controlling and securing teleconference sessions |
US20080148193A1 (en) | 2001-09-13 | 2008-06-19 | John Moetteli | System and method of efficient web browsing |
US7284196B2 (en) | 2001-10-05 | 2007-10-16 | Vitria Technology, Inc. | Vocabulary and syntax based data transformation |
US8015204B2 (en) | 2001-10-16 | 2011-09-06 | Microsoft Corporation | Scoped access control metadata element |
US20030093551A1 (en) * | 2001-10-17 | 2003-05-15 | Graham Taylor | Adaptive software interface |
US7216002B1 (en) * | 2001-10-22 | 2007-05-08 | Gateway Inc. | System and method for group content selection |
FR2832236B1 (en) | 2001-11-13 | 2004-04-16 | Inst Nat Rech Inf Automat | SEMANTIC WEB PORTAL GRAPHIC INTERFACE |
US7970826B2 (en) | 2001-12-06 | 2011-06-28 | Hewlett-Packard Development Company, L.P. | Transformational conversation definition language |
US7072883B2 (en) | 2001-12-21 | 2006-07-04 | Ut-Battelle Llc | System for gathering and summarizing internet information |
US7739121B2 (en) | 2002-01-29 | 2010-06-15 | One Network Enterprises, Inc. | Method and apparatus for providing intelligent and controlled access to supply chain information |
US20030144892A1 (en) | 2002-01-29 | 2003-07-31 | International Business Machines Corporation | Method, system, and storage medium for providing knowledge management services |
US7421660B2 (en) * | 2003-02-04 | 2008-09-02 | Cataphora, Inc. | Method and apparatus to visually present discussions for data mining purposes |
US7343365B2 (en) * | 2002-02-20 | 2008-03-11 | Microsoft Corporation | Computer system architecture for automatic context associations |
US20030163513A1 (en) | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | Providing role-based views from business web portals |
US20060004732A1 (en) * | 2002-02-26 | 2006-01-05 | Odom Paul S | Search engine methods and systems for generating relevant search results and advertisements |
AU2003227310A1 (en) | 2002-04-05 | 2003-10-20 | Lisa Seeman | Networked accessibility enhancer system |
US20060184617A1 (en) | 2005-02-11 | 2006-08-17 | Nicholas Frank C | Method and system for the creating, managing, and delivery of feed formatted content |
US6946715B2 (en) * | 2003-02-19 | 2005-09-20 | Micron Technology, Inc. | CMOS image sensor and method of fabrication |
US7065707B2 (en) * | 2002-06-24 | 2006-06-20 | Microsoft Corporation | Segmenting and indexing web pages using function-based object models |
DE60335472D1 (en) | 2002-07-23 | 2011-02-03 | Quigo Technologies Inc | SYSTEM AND METHOD FOR AUTOMATED IMAGING OF KEYWORDS AND KEYPHRASES ON DOCUMENTS |
US20040083199A1 (en) * | 2002-08-07 | 2004-04-29 | Govindugari Diwakar R. | Method and architecture for data transformation, normalization, profiling, cleansing and validation |
AU2002951244A0 (en) | 2002-09-06 | 2002-09-19 | Telstra New Wave Pty Ltd | A development system for a dialog system |
US7200862B2 (en) * | 2002-09-30 | 2007-04-03 | Microsoft Corporation | Securing uniform resource identifier namespaces |
US20040073430A1 (en) * | 2002-10-10 | 2004-04-15 | Ranjit Desai | Intelligent media processing and language architecture for speech applications |
US7249123B2 (en) * | 2002-10-31 | 2007-07-24 | International Business Machines Corporation | System and method for building social networks based on activity around shared virtual objects |
US7584208B2 (en) * | 2002-11-20 | 2009-09-01 | Radar Networks, Inc. | Methods and systems for managing offers and requests in a network |
US7398261B2 (en) | 2002-11-20 | 2008-07-08 | Radar Networks, Inc. | Method and system for managing and tracking semantic objects |
US7640267B2 (en) | 2002-11-20 | 2009-12-29 | Radar Networks, Inc. | Methods and systems for managing entities in a computing device using semantic objects |
WO2004055647A2 (en) | 2002-12-13 | 2004-07-01 | Applied Minds, Inc. | Meta-web |
US20040181604A1 (en) | 2003-03-13 | 2004-09-16 | Immonen Pekka S. | System and method for enhancing the relevance of push-based content |
WO2004088479A2 (en) * | 2003-03-26 | 2004-10-14 | Victor Hsieh | Online intelligent multilingual comparison-shop agents for wireless networks |
US20040194181P1 (en) | 2003-03-31 | 2004-09-30 | Kazunari Iwaki | Torenia plant named SUNRENILAPIHO-KAI |
US20050015357A1 (en) * | 2003-05-21 | 2005-01-20 | Active Path Solutions, Inc. | System and method for content development |
US20040260701A1 (en) | 2003-05-27 | 2004-12-23 | Juha Lehikoinen | System and method for weblog and sharing in a peer-to-peer environment |
US7502779B2 (en) | 2003-06-05 | 2009-03-10 | International Business Machines Corporation | Semantics-based searching for information in a distributed data processing system |
US20040260680A1 (en) | 2003-06-19 | 2004-12-23 | International Business Machines Corporation | Personalized indexing and searching for information in a distributed data processing system |
WO2005008358A2 (en) | 2003-07-22 | 2005-01-27 | Kinor Technologies Inc. | Information access using ontologies |
US7577682B2 (en) * | 2003-07-31 | 2009-08-18 | Sap Ag | Semantic objects |
US7774333B2 (en) * | 2003-08-21 | 2010-08-10 | Idia Inc. | System and method for associating queries and documents with contextual advertisements |
KR100493902B1 (en) | 2003-08-28 | 2005-06-10 | 삼성전자주식회사 | Method And System For Recommending Contents |
US7895523B2 (en) * | 2003-09-04 | 2011-02-22 | International Business Machines Corporation | Method, system and program product for obscuring supplemental web content |
US7552109B2 (en) | 2003-10-15 | 2009-06-23 | International Business Machines Corporation | System, method, and service for collaborative focused crawling of documents on a network |
US20060235873A1 (en) | 2003-10-22 | 2006-10-19 | Jookster Networks, Inc. | Social network-based internet search engine |
US20050114487A1 (en) * | 2003-11-12 | 2005-05-26 | Jin Peng | Notification framework and method of distributing notification |
US20050144158A1 (en) | 2003-11-18 | 2005-06-30 | Capper Liesl J. | Computer network search engine |
US7526459B2 (en) | 2003-11-28 | 2009-04-28 | Manyworlds, Inc. | Adaptive social and process network systems |
US20050131778A1 (en) | 2003-12-11 | 2005-06-16 | International Business Machines Corporation | Customized subscription builder |
US20050144162A1 (en) | 2003-12-29 | 2005-06-30 | Ping Liang | Advanced search, file system, and intelligent assistant agent |
US8676837B2 (en) | 2003-12-31 | 2014-03-18 | Google Inc. | Systems and methods for personalizing aggregated news content |
US20050149510A1 (en) | 2004-01-07 | 2005-07-07 | Uri Shafrir | Concept mining and concept discovery-semantic search tool for large digital databases |
US7483891B2 (en) | 2004-01-09 | 2009-01-27 | Yahoo, Inc. | Content presentation and management system associating base content and relevant additional content |
KR20040017824A (en) | 2004-01-20 | 2004-02-27 | (주)나우정보통신 | Information search system which it follows in the Pattern-Forecast-Analysis to use the pattern of the web document and list |
US8086591B2 (en) | 2004-01-23 | 2011-12-27 | Microsoft Corporation | Combining domain-tuned search systems |
US7197502B2 (en) * | 2004-02-18 | 2007-03-27 | Friendly Polynomials, Inc. | Machine-implemented activity management system using asynchronously shared activity data objects and journal data items |
US7433876B2 (en) | 2004-02-23 | 2008-10-07 | Radar Networks, Inc. | Semantic web portal and platform |
US7260573B1 (en) | 2004-05-17 | 2007-08-21 | Google Inc. | Personalizing anchor text scores in a search engine |
US20050267872A1 (en) | 2004-06-01 | 2005-12-01 | Yaron Galai | System and method for automated mapping of items to documents |
WO2007001247A2 (en) * | 2004-06-02 | 2007-01-04 | Yahoo! Inc. | Content-management system for user behavior targeting |
US20050278309A1 (en) * | 2004-06-02 | 2005-12-15 | Perry Evans | System and method for mining and searching localized business-marketing and informational data |
US7788260B2 (en) * | 2004-06-14 | 2010-08-31 | Facebook, Inc. | Ranking search results based on the frequency of clicks on the search results by members of a social network who are within a predetermined degree of separation |
WO2006011819A1 (en) * | 2004-07-30 | 2006-02-02 | Eurekster, Inc. | Adaptive search engine |
GB2418999A (en) * | 2004-09-09 | 2006-04-12 | Surfcontrol Plc | Categorizing uniform resource locators |
US7584161B2 (en) * | 2004-09-15 | 2009-09-01 | Contextware, Inc. | Software system for managing information in context |
US7694311B2 (en) | 2004-09-29 | 2010-04-06 | International Business Machines Corporation | Grammar-based task analysis of web logs |
KR100855754B1 (en) | 2004-10-30 | 2008-09-03 | 에스케이커뮤니케이션즈 주식회사 | Apparatus and method for interlinking the classified objects having the property and computer readable medium processing the method |
CN101296848A (en) | 2005-01-08 | 2008-10-29 | 纽约布伊尔特股份有限公司 | Snap top tote apparatus |
US8302011B2 (en) * | 2005-01-24 | 2012-10-30 | A9.Com, Inc. | Technique for modifying presentation of information displayed to end users of a computer system |
US7788293B2 (en) * | 2005-03-02 | 2010-08-31 | Google Inc. | Generating structured information |
WO2006099299A2 (en) * | 2005-03-11 | 2006-09-21 | Yahoo! Inc. | System and method for managing listings |
JP4721740B2 (en) * | 2005-03-23 | 2011-07-13 | 富士通株式会社 | Program for managing articles or topics |
US8468048B2 (en) | 2005-04-22 | 2013-06-18 | Google Inc. | Suggesting targeting information for ads, such as websites and/or categories of websites for example |
US7734631B2 (en) | 2005-04-25 | 2010-06-08 | Microsoft Corporation | Associating information with an electronic document |
US20060259357A1 (en) | 2005-05-12 | 2006-11-16 | Fu-Sheng Chiu | Intelligent dynamic market data collection and advertising delivery system |
KR100676048B1 (en) | 2005-05-13 | 2007-01-30 | 에스케이 텔레콤주식회사 | Method and apparatus for providing personalized service of rss documents and system including the apparatus |
US7769742B1 (en) | 2005-05-31 | 2010-08-03 | Google Inc. | Web crawler scheduler that utilizes sitemaps from websites |
US10510043B2 (en) * | 2005-06-13 | 2019-12-17 | Skyword Inc. | Computer method and apparatus for targeting advertising |
JP4238849B2 (en) | 2005-06-30 | 2009-03-18 | カシオ計算機株式会社 | Web page browsing apparatus, Web page browsing method, and Web page browsing processing program |
US20070016771A1 (en) * | 2005-07-11 | 2007-01-18 | Simdesk Technologies, Inc. | Maintaining security for file copy operations |
US8166010B2 (en) * | 2005-07-26 | 2012-04-24 | Taptu Limited | Processing and sending search results over a wireless network to a mobile device |
US7739708B2 (en) * | 2005-07-29 | 2010-06-15 | Yahoo! Inc. | System and method for revenue based advertisement placement |
CN101288067B (en) * | 2005-08-09 | 2012-04-04 | 沙力股份有限公司 | Methods and apparatuses to assemble, extract and deploy content from electronic documents |
US7653617B2 (en) * | 2005-08-29 | 2010-01-26 | Google Inc. | Mobile sitemaps |
US20090234711A1 (en) | 2005-09-14 | 2009-09-17 | Jorey Ramer | Aggregation of behavioral profile data using a monetization platform |
US20070061198A1 (en) * | 2005-09-14 | 2007-03-15 | Jorey Ramer | Mobile pay-per-call campaign creation |
US7596950B2 (en) | 2005-09-16 | 2009-10-06 | General Electric Company | Augmentor radial fuel spray bar with counterswirling heat shield |
JP2007094592A (en) | 2005-09-27 | 2007-04-12 | Fusion Kk | Marketing data collection and analysis system, server system, and marketing data collection and analysis program |
US9165039B2 (en) | 2005-11-29 | 2015-10-20 | Kang Jo Mgmt, Limited Liability Company | Methods and systems for providing personalized contextual search results |
US20070124202A1 (en) * | 2005-11-30 | 2007-05-31 | Chintano, Inc. | Systems and methods for collecting data and measuring user behavior when viewing online content |
US7933914B2 (en) * | 2005-12-05 | 2011-04-26 | Microsoft Corporation | Automatic task creation and execution using browser helper objects |
KR100753934B1 (en) | 2005-12-08 | 2007-08-31 | 한국전자통신연구원 | Intelligent multi agent system for providing personalized service and method thereof |
US8655984B2 (en) * | 2005-12-21 | 2014-02-18 | Vringo Infrastructure Inc. | Content aggregation service for mobile environment |
US7814111B2 (en) | 2006-01-03 | 2010-10-12 | Microsoft International Holdings B.V. | Detection of patterns in data records |
US7657546B2 (en) | 2006-01-26 | 2010-02-02 | International Business Machines Corporation | Knowledge management system, program product and method |
US8868540B2 (en) | 2006-03-01 | 2014-10-21 | Oracle International Corporation | Method for suggesting web links and alternate terms for matching search queries |
US7599931B2 (en) | 2006-03-03 | 2009-10-06 | Microsoft Corporation | Web forum crawler |
US7606810B1 (en) * | 2006-04-27 | 2009-10-20 | Colin Jeavons | Editorial related advertising content delivery system |
US8688742B2 (en) * | 2006-05-31 | 2014-04-01 | Red Hat, Inc. | Open overlay for social networks and online services |
US7937582B1 (en) * | 2006-06-21 | 2011-05-03 | Google Inc. | Secure XML feeds |
US7676465B2 (en) * | 2006-07-05 | 2010-03-09 | Yahoo! Inc. | Techniques for clustering structurally similar web pages based on page features |
US7680858B2 (en) | 2006-07-05 | 2010-03-16 | Yahoo! Inc. | Techniques for clustering structurally similar web pages |
US8020206B2 (en) | 2006-07-10 | 2011-09-13 | Websense, Inc. | System and method of analyzing web content |
US7707161B2 (en) * | 2006-07-18 | 2010-04-27 | Vulcan Labs Llc | Method and system for creating a concept-object database |
US20080059519A1 (en) * | 2006-09-02 | 2008-03-06 | Tony Grifftih | System, method, and apparatus for providing storage operations on an online computer system |
US7734623B2 (en) * | 2006-11-07 | 2010-06-08 | Cycorp, Inc. | Semantics-based method and apparatus for document analysis |
US20080235383A1 (en) | 2007-03-22 | 2008-09-25 | Eric Schneider | Methods, Systems, Products, And Devices For Generating And Processing DNS Friendly Identifiers |
US9305096B2 (en) | 2007-04-30 | 2016-04-05 | Microsoft Technology Licensing, Llc | Uniform resource identifier template manipulation |
US8522195B2 (en) * | 2007-09-14 | 2013-08-27 | Exigen Properties, Inc. | Systems and methods to generate a software framework based on semantic modeling and business rules |
US20090076887A1 (en) * | 2007-09-16 | 2009-03-19 | Nova Spivack | System And Method Of Collecting Market-Related Data Via A Web-Based Networking Environment |
US20090077094A1 (en) * | 2007-09-17 | 2009-03-19 | Yan Bodain | Method and system for ontology modeling based on the exchange of annotations |
US20090089278A1 (en) * | 2007-09-27 | 2009-04-02 | Krishna Leela Poola | Techniques for keyword extraction from urls using statistical analysis |
US8195634B2 (en) * | 2007-09-28 | 2012-06-05 | Microsoft Corporation | Domain-aware snippets for search results |
US8103676B2 (en) * | 2007-10-11 | 2012-01-24 | Google Inc. | Classifying search results to determine page elements |
US20090106307A1 (en) * | 2007-10-18 | 2009-04-23 | Nova Spivack | System of a knowledge management and networking environment and method for providing advanced functions therefor |
US20090138565A1 (en) * | 2007-11-26 | 2009-05-28 | Gil Shiff | Method and System for Facilitating Content Analysis and Insertion |
JP5102593B2 (en) | 2007-11-30 | 2012-12-19 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Apparatus and method for controlling display of document data |
US20090144240A1 (en) | 2007-12-04 | 2009-06-04 | Yahoo!, Inc. | Method and systems for using community bookmark data to supplement internet search results |
US7895235B2 (en) * | 2007-12-19 | 2011-02-22 | Yahoo! Inc. | Extracting semantic relations from query logs |
US7774380B2 (en) | 2007-12-21 | 2010-08-10 | International Business Machines Corporation | Technique for finding rest resources using an n-ary tree structure navigated using a collision free progressive hash |
US20090254414A1 (en) | 2008-04-07 | 2009-10-08 | Michael Schwarz | Method and system for managing advertisement quality of sponsored advertisements |
US7966564B2 (en) | 2008-05-08 | 2011-06-21 | Adchemy, Inc. | Web page server process using visitor context and page features to select optimized web pages for display |
US8001106B2 (en) | 2008-06-27 | 2011-08-16 | Yahoo! Inc. | Systems and methods for tokenizing and interpreting uniform resource locators |
US20100004975A1 (en) * | 2008-07-03 | 2010-01-07 | Scott White | System and method for leveraging proximity data in a web-based socially-enabled knowledge networking environment |
US8543713B2 (en) | 2008-08-19 | 2013-09-24 | Apple Inc. | Computing environment arranged to support predetermined URL patterns |
US8520979B2 (en) * | 2008-08-19 | 2013-08-27 | Digimarc Corporation | Methods and systems for content processing |
US8176079B1 (en) * | 2008-09-23 | 2012-05-08 | Symantec Corporation | Restricting access to network resources through recursive URL classification |
US20100153160A1 (en) | 2008-12-12 | 2010-06-17 | Smart Technologies Ulc | System for supporting coordination of resources for events in an organization |
US8429751B2 (en) | 2009-03-13 | 2013-04-23 | Trustwave Holdings, Inc. | Method and apparatus for phishing and leeching vulnerability detection |
US10628847B2 (en) | 2009-04-15 | 2020-04-21 | Fiver Llc | Search-enhanced semantic advertising |
US9037567B2 (en) | 2009-04-15 | 2015-05-19 | Vcvc Iii Llc | Generating user-customized search results and building a semantics-enhanced search engine |
US8200617B2 (en) | 2009-04-15 | 2012-06-12 | Evri, Inc. | Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata |
US8862579B2 (en) | 2009-04-15 | 2014-10-14 | Vcvc Iii Llc | Search and search optimization using a pattern of a location identifier |
US8150859B2 (en) * | 2010-02-05 | 2012-04-03 | Microsoft Corporation | Semantic table of contents for search results |
-
2007
- 2007-08-07 WO PCT/US2007/075379 patent/WO2008021832A2/en active Application Filing
- 2007-08-07 US US11/835,079 patent/US8924838B2/en not_active Expired - Fee Related
-
2014
- 2014-12-15 US US14/570,671 patent/US20150100870A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050108363A1 (en) * | 2002-11-25 | 2005-05-19 | Shin Torigoe | Web page update notification method and web page update notification device |
US20040158799A1 (en) * | 2003-02-07 | 2004-08-12 | Breuel Thomas M. | Information extraction from html documents by structural matching |
US20060230011A1 (en) * | 2004-11-22 | 2006-10-12 | Truveo, Inc. | Method and apparatus for an application crawler |
US20060287989A1 (en) * | 2005-06-16 | 2006-12-21 | Natalie Glance | Extracting structured data from weblogs |
US7765209B1 (en) * | 2005-09-13 | 2010-07-27 | Google Inc. | Indexing and retrieval of blogs |
US20070079236A1 (en) * | 2005-10-04 | 2007-04-05 | Microsoft Corporation | Multi-form design with harmonic composition for dynamically aggregated documents |
US20070198459A1 (en) * | 2006-02-14 | 2007-08-23 | Boone Gary N | System and method for online information analysis |
US20080034058A1 (en) * | 2006-08-01 | 2008-02-07 | Marchex, Inc. | Method and system for populating resources using web feeds |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10033799B2 (en) | 2002-11-20 | 2018-07-24 | Essential Products, Inc. | Semantically representing a target entity using a semantic object |
US9607089B2 (en) | 2009-04-15 | 2017-03-28 | Vcvc Iii Llc | Search and search optimization using a pattern of a location identifier |
US9613149B2 (en) | 2009-04-15 | 2017-04-04 | Vcvc Iii Llc | Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata |
US10628847B2 (en) | 2009-04-15 | 2020-04-21 | Fiver Llc | Search-enhanced semantic advertising |
US20140040070A1 (en) * | 2012-02-23 | 2014-02-06 | Arsen Pereymer | Publishing on mobile devices with app building |
Also Published As
Publication number | Publication date |
---|---|
WO2008021832A2 (en) | 2008-02-21 |
WO2008021832A3 (en) | 2008-10-09 |
US8924838B2 (en) | 2014-12-30 |
US20080189267A1 (en) | 2008-08-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8924838B2 (en) | Harvesting data from page | |
US9268856B2 (en) | System and method for inclusion of interactive elements on a search results page | |
US9116990B2 (en) | Enhancing freshness of search results | |
US8498974B1 (en) | Refining search results | |
US7519621B2 (en) | Extracting information from Web pages | |
US7475074B2 (en) | Web search system and method thereof | |
US8463786B2 (en) | Extracting topically related keywords from related documents | |
US20120239667A1 (en) | Keyword extraction from uniform resource locators (urls) | |
JP5507469B2 (en) | Providing content using stored query information | |
US20080201632A1 (en) | System and method for annotating documents | |
US10423672B2 (en) | Network resource-specific search assistance | |
US20080201320A1 (en) | System and method for searching annotated document collections | |
US20090204602A1 (en) | Apparatus and methods for presenting linking abstracts for search results | |
US20130073536A1 (en) | Indexing of urls with fragments | |
CN102625936A (en) | Query suggestions from documents | |
EP2519896A2 (en) | Search suggestion clustering and presentation | |
US9514113B1 (en) | Methods for automatic footnote generation | |
US20110231386A1 (en) | Indexing and searching employing virtual documents | |
US20110208715A1 (en) | Automatically mining intents of a group of queries | |
US8515946B2 (en) | Location description for federation and discoverability | |
JP2009122807A (en) | Associative retrieval system | |
US10223460B2 (en) | Application partial deep link to a corresponding resource | |
JP4759600B2 (en) | Text search device, text search method, text search program and recording medium thereof | |
JP2006155556A (en) | Text mining method and text mining server | |
US20160232237A1 (en) | Method and device for an engine to crawl, validate, and provide open-type abstract information of a webpage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EVRI INC., WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RADAR NETWORKS, INC.;REEL/FRAME:034556/0685 Effective date: 20100309 Owner name: RADAR NETWORKS, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SPIVACK, NOVA T.;JONES, CHRISTOPHER;TUCKER, LEWIS W.;SIGNING DATES FROM 20081125 TO 20081209;REEL/FRAME:034556/0614 Owner name: VCVC III LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EVRI INC.;REEL/FRAME:034556/0785 Effective date: 20131223 |
|
AS | Assignment |
Owner name: RADAR NETWORKS, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:VENTURE LENDING & LEASING IV, INC. AND VENTURE LENDING & LEASING V, INC.;REEL/FRAME:043602/0015 Effective date: 20170815 |
|
AS | Assignment |
Owner name: FIVER LLC, DELAWARE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VCVC III LLC;REEL/FRAME:044100/0429 Effective date: 20170920 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |