WO2001039022A2 - Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity - Google Patents

Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity Download PDF

Info

Publication number
WO2001039022A2
WO2001039022A2 PCT/US2000/032243 US0032243W WO0139022A2 WO 2001039022 A2 WO2001039022 A2 WO 2001039022A2 US 0032243 W US0032243 W US 0032243W WO 0139022 A2 WO0139022 A2 WO 0139022A2
Authority
WO
WIPO (PCT)
Prior art keywords
advertising
advertiser
candidate
outlet
outlets
Prior art date
Application number
PCT/US2000/032243
Other languages
French (fr)
Other versions
WO2001039022A8 (en
Inventor
Vladimir Victorovich Schipunov
Young Bean Song
Michael Edward Wolf
Will Medford
Mark Smucker
David Debusk
Original Assignee
Avenue A, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Avenue A, Inc. filed Critical Avenue A, Inc.
Priority to AU17974/01A priority Critical patent/AU1797401A/en
Publication of WO2001039022A2 publication Critical patent/WO2001039022A2/en
Publication of WO2001039022A8 publication Critical patent/WO2001039022A8/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0255Targeted advertisements based on user history

Definitions

  • the present invention is directed to electronic advertising techniques.
  • Figure 1 is a high-level block diagram showing the environment in which the facility preferably operates.
  • a software facility for identifying Internet publishers and other electronic publishers on which to place advertising messages for particular advertisers using an assessment of user inclination and affinity is provided.
  • the facility determines which of the publishers' web sites are commonly visited by visitors to the advertiser's web site. In particular, the facility does so by assessing a metric, called user inclination, that reflects the percentage of users observed to visit both the publisher web site and the advertiser's web site.
  • the facility preferably uses this inclination metric, and/or variations thereon, to select Internet publishers upon which to place advertising messages for the advertiser.
  • the facility preferably also performs an analysis to identify additional "affinity publishers" that are heavily visited by visitors to publisher web sites that have proven to have a high return on investment for the advertiser in question.
  • FIG. 1 is a high-level block diagram showing the environment in which the facility preferably operates.
  • the diagram shows a number of Internet user computer systems 101-104.
  • An Internet user preferably uses one such Internet user computer system to connect, via the Internet 120, to an Internet publisher computer system, such as Internet publisher computer systems 131 and 132, to retrieve and display a Web page.
  • Internet publisher refers to individuals and organizations that make web pages accessible via the World Wide Web, and, in particular, those that sell the opportunity to advertise in some manner ("advertising space”) on those web pages.
  • the Web page contains a reference to a URL in the domain of the Internet advertising service computer system 140.
  • the Internet user computer systems sends a request to the Internet advertising service computer system to return data comprising an advertising message, such as a banner advertising message.
  • the Internet advertising service computer system selects an advertising message to transmit to the Internet user computer system in response the request, and either itself transmits the selected advertising message or redirects the request containing an identification of the selected advertising message to an Internet content distributor computer system, such as Internet content distributor computer systems 151 and 152.
  • an Internet content distributor computer system such as Internet content distributor computer systems 151 and 152.
  • the displayed advertising message preferably includes one or more links to Web pages of the Internet advertiser's Web site.
  • the Internet user computer system references the link to retrieve the Web page from the appropriate Internet advertiser computer system, such as Internet advertiser computer system 161 or 162.
  • the link to the web page of the Internet advertiser's web page is preferably processed through the Internet advertising service computer system 140 to permit the Internet advertising service computer system 140 to monitor the traversal of such links.
  • the Internet user may traverse several pages, and may take such actions as purchasing an item or bidding in an auction. Revenue from such actions typically finances, and is often the motivation for, the Internet advertiser's Internet advertising.
  • an advertiser may instrument particular web pages on its web site in a way that notifies the advertising service when a user visits that page of the advertiser's web site.
  • the Internet advertising service computer system 140 preferably includes one or more central processing units (CPUs) 141 for executing computer programs such as the facility, a computer memory 142 for storing programs and data, and a computer-readable media drive 143, such as a CD-ROM drive, for reading programs and data stored on a computer-readable medium.
  • the Internet advertising service computer system preferably stores a log entry each time it processes a request to return an advertising message, a request to traverse a link to a web page of the Internet advertiser's web page, or notification that the user has visited a particular page of the Internet advertiser's web site.
  • Each log entry preferably contains a user identifier identifying the user performing the noted action.
  • the user identifiers contained by log entries are collected by storing the user identifiers in a persistent "cookie" stored on the computer system of each user for the domain of the advertising service.
  • a persistent "cookie" stored on the computer system of each user for the domain of the advertising service.
  • the facility performs its inclination and affinity analyses based on the contents of this stored log.
  • log entries covering a significant period of time such as three months or six months, are used in the analyses.
  • only users that have seen advertising messages or triggered action tags over a period greater than 24 hours are used in the analyses. Additional similar filtering techniques may also be used.
  • the facility performs its inclination and/or affinity analyses based upon other data regarding user behavior, such as data gathered by observing the web traffic for a user and analyzing contents or other attributes of advertising messages appearing therein, or based upon data obtained from other sources.
  • the inclination metric is calculated by dividing the number of unique users that visited the publisher in question and the home page of the advertiser (or another page of the advertiser's web site) by the number of unique users that visited the publisher in question. Table 1 below shows the inclination analysis for a sample advertiser named Garments.com.
  • the facility selects a group of publishers with which the Internet advertising service has placed advertising messages. For example, the facility may select all of the publishers with which the Internet advertising service has placed advertising messages for any advertiser.
  • the facility For each of these publishers, the facility identifies the number of different users, identified by unique user identifiers, that the Internet advertising service has observed visiting the publisher. This number is preferably obtained by reading the web server log for records indicating that an advertising message was displayed at the publisher to a user having a unique user identifier. In the example, the facility determines that 50,000 different users were observed visiting the Sweater City publisher.
  • the facility determines, for each publisher, the number of unique user identifiers seen at the publisher that were also seen at the home page of the advertiser's web site.
  • the facility preferably determines this number for each publisher by, for each of the unique user identifiers seen at the publisher's web site, deternrining whether the log contains a record indicating that a user having the same user identifier visited the advertiser's home page.
  • the facility determines that, of the 50,000 different users observed to visit the Sweater City publisher's web site, 1,000 of these users were also seen at the advertiser's home page.
  • the facility determines the inclination level of visitors to each of the publishers toward the advertiser by dividing the number of user identifiers seen at the advertiser's home page over the total number of unique user identifiers seen at the publisher. In the example, the facility calculates an inclination of visitors to the Sweater City publisher's web site to the advertiser's home page of 2.0% by dividing 1,000 user identifiers seen at the client's home page by 50,000 unique user identifiers seen at Sweater City.
  • inclination metrics determined as described above may be significantly biased, however. If the Internet advertising service had been presenting Garments.com advertising messages on BigPortal and not on LittlePortal, this would tend to increase the number of visitors to Garments.com that were also visitors to BigPortal relative to the number of visitors to Garments.com that were visitors to LittlePortal. In fact, if the advertiser had been advertising on AnotherPortal, and if a disproportionate number of users who visit AnotherPortal also visit BigPortal, then the BigPortal inclination would also appear fairly high. The high inclination is due, at least in part, to the BigPortal advertising campaign.
  • the facility uses a corrected measure of inclination called "pure inclination.” Pure inclination is the percentage of visitors to the publisher who have not seen an advertising message by the advertiser who visit the advertiser's web site. To determine pure inclination, the facility separates the unique user identifiers seen on each publisher into two groups: those who have seen one or more advertising messages for Garments.com, and those who have not. Table 2 below shows the pure inclination analysis for Garments.com.
  • this determination of pure inclination indicates that Sweater City is a site where Garments.com visitors tend to congregate. This determination of pure inclination further indicates that advertising messages placed on LittlePortal and BigPortal would have almost the same advertising effectiveness for Garments.com.
  • the facility preferably selects publishers at which to purchase space for future advertising messages for the advertiser on the basis of the pure inclinations of each publisher.
  • advertiser web sites are heavily linked to related web sites.
  • some advertiser web sites are heavily linked to affiliate web sites, such as the web sites of companies that have common ownership with the advertiser, or that have other business relationships with the advertiser.
  • some embodiments of the facility also exclude from the pure inclination metric users that visited the publisher and saw an advertising message for a web site related to the advertiser web site.
  • pure inclination is determined by dividing the number of unique users visiting the publisher before they viewed an advertising message for the advertiser by the number of those users that visited the advertiser's home page.
  • the facility preferably also determines a third metric for analyzing the effectiveness of advertising on particular publishers for specific advertisers called "view inclination.”
  • the facility determines view inclination by determining, of the unique user identifiers that have visited the publisher that have also seen an advertising message of the advertiser's, the percentage of those user identifiers seen at the advertiser's home page. Table 3 shows the calculation of view inclination for Garments.com.
  • the facility preferably also uses a fourth metric to measure the effectiveness of advertising performed for the advertiser, called "comparative inclination.” To determine comparative inclination, the facility preferably subtracts the pure inclination for each publisher from the view inclination for that publisher. A calculation of comparative inclination for the example is shown below in Table 4.
  • the facility preferably also uses an affinity analysis to identify Internet publishers on which to place advertisements for a particular advertiser.
  • affinity analysis the facility first selects one or more Internet publishers that have produced the highest return on investment when presenting advertisements for the advertiser in the past. For each of the selected publishers, the facility identifies one or more "affinity sites" — that is, additional Internet publishers that have been visited by a significant number of the users that have visited the selected publisher. Because the affinity sites are visited by many of the same users that visit the Mgh-performing sites, they are likely to perform similarly well for the advertiser. For this reason, the facility preferably also places advertisements on one or more of the affinity sites.
  • Tables 5 and 6 below show an example of determining affinity metrics from the advertiser's perspective, between (a) a high return on investment publisher in a previous campaign for the advertiser and (b) other publishers.
  • Table 5 shows a return on investment score for each of the publishers used in an earlier campaign for advertiser Garments.com.
  • These return on investment scores are typically determined based upon, for a set of advertising messages for the advertiser presented on the publisher, factors indicating the level of success of the advertising from the advertiser's perspective as: the percentage of such advertisements that were "clicked-through;" the percentage of users that viewed such advertisements that later visited the advertiser's web page; the percentage of users that viewed such an advertising message that purchased something from the advertiser; the average price of items purchased from the advertiser by users that viewed such advertising messages; the average profit margin of items purchased from the advertiser by users that viewed such advertising messages, etc.
  • Table 5 It can be seen that the Clothes Horse and Entertaining Magazine publishers have significantly higher return on investment scores in the previous campaign than the other publishers. Accordingly, the facility proceeds to identify publishers having a high affinity with the Clothes Horse and Entertaining Magazine publishers. Table 6 shows the determination of the affinity metric between the high return on investment publisher Clothes Horse and other, "candidate" publishers about which data is available.
  • the facility preferably selects these two candidate publishers for use in the current advertising campaign for Garments.com.
  • the facility may preferably be used to place advertising messages delivered to such special-purpose devices as useral digital assistants, cellular and satellite phones, pagers, devices installed in automobiles and other vehicles, automatic teller machines, televisions, and other home appliances.

Abstract

A facility for selecting advertising outlets on which to place advertising messages for an advertiser is described. For each of a first group of advertising outlets, the facility assesses the rate at which visitors to the advertiser also visit the advertising outlet. The facility selects an advertising outlet among the first group having the highest assessed rate. For each of a second group of advertising outlets, the facility assesses the tendency of a high-performing advertising outlet to drive its visitors to the advertising outlet among the second group of advertising outlets. The facility selects an advertising outlet among the second group to which the high-performing advertising outlet has the greatest assessed tendency to drive its visitors.

Description

TARGETING ELECTRONIC ADVERTISING PLACEMENT IN ACCORDANCE WITH AN ANALYSIS OF USER INCLINATION
AND AFFINITY
TECHNICAL FIELD
The present invention is directed to electronic advertising techniques.
BACKGROUND
As computer use, and particularly the use of the World Wide Web, becomes more and more prevalent, the volumes of Internet advertising presented grow larger and larger. As part of this growth, the number of Internet publishers on which it is possible to purchase advertising space for Internet advertising is rapidly expanding. As the number of Internet publishers grows, it becomes increasingly important to successfully identify Internet publishers that provide an effective venue for the Internet advertising messages of particular advertisers.
Accordingly, a facility for more effectively targeting Internet advertising placement for an Internet advertiser to particular Internet publishers would have significant utility.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is a high-level block diagram showing the environment in which the facility preferably operates.
DETAILED DESCRIPTION
A software facility for identifying Internet publishers and other electronic publishers on which to place advertising messages for particular advertisers using an assessment of user inclination and affinity is provided. In order to identify publishers on which to place advertising messages of an advertiser, the facility determines which of the publishers' web sites are commonly visited by visitors to the advertiser's web site. In particular, the facility does so by assessing a metric, called user inclination, that reflects the percentage of users observed to visit both the publisher web site and the advertiser's web site. The facility preferably uses this inclination metric, and/or variations thereon, to select Internet publishers upon which to place advertising messages for the advertiser. The facility preferably also performs an analysis to identify additional "affinity publishers" that are heavily visited by visitors to publisher web sites that have proven to have a high return on investment for the advertiser in question.
Figure 1 is a high-level block diagram showing the environment in which the facility preferably operates. The diagram shows a number of Internet user computer systems 101-104. An Internet user preferably uses one such Internet user computer system to connect, via the Internet 120, to an Internet publisher computer system, such as Internet publisher computer systems 131 and 132, to retrieve and display a Web page. The term "Internet publisher" refers to individuals and organizations that make web pages accessible via the World Wide Web, and, in particular, those that sell the opportunity to advertise in some manner ("advertising space") on those web pages.
In cases where an Internet advertiser, through the Internet advertising service, has purchased advertising space on the Web page provided to the Internet user computer system by the Internet publisher computer system, the Web page contains a reference to a URL in the domain of the Internet advertising service computer system 140. When a user computer system receives a Web page that contains such a reference, the Internet user computer systems sends a request to the Internet advertising service computer system to return data comprising an advertising message, such as a banner advertising message. When the Internet advertising service computer system receives such a request, it selects an advertising message to transmit to the Internet user computer system in response the request, and either itself transmits the selected advertising message or redirects the request containing an identification of the selected advertising message to an Internet content distributor computer system, such as Internet content distributor computer systems 151 and 152. When the Internet user computer system receives the selected advertising message, the Internet user computer system displays it within the Web page.
The displayed advertising message preferably includes one or more links to Web pages of the Internet advertiser's Web site. When the Internet user selects one of these links in the advertising message, the Internet user computer system references the link to retrieve the Web page from the appropriate Internet advertiser computer system, such as Internet advertiser computer system 161 or 162. The link to the web page of the Internet advertiser's web page is preferably processed through the Internet advertising service computer system 140 to permit the Internet advertising service computer system 140 to monitor the traversal of such links. In visiting the Internet advertiser's Web site, the Internet user may traverse several pages, and may take such actions as purchasing an item or bidding in an auction. Revenue from such actions typically finances, and is often the motivation for, the Internet advertiser's Internet advertising. In some embodiments, an advertiser may instrument particular web pages on its web site in a way that notifies the advertising service when a user visits that page of the advertiser's web site.
The Internet advertising service computer system 140 preferably includes one or more central processing units (CPUs) 141 for executing computer programs such as the facility, a computer memory 142 for storing programs and data, and a computer-readable media drive 143, such as a CD-ROM drive, for reading programs and data stored on a computer-readable medium. The Internet advertising service computer system preferably stores a log entry each time it processes a request to return an advertising message, a request to traverse a link to a web page of the Internet advertiser's web page, or notification that the user has visited a particular page of the Internet advertiser's web site. Each log entry preferably contains a user identifier identifying the user performing the noted action. In some embodiments, the user identifiers contained by log entries are collected by storing the user identifiers in a persistent "cookie" stored on the computer system of each user for the domain of the advertising service. Each time an HTTP request is transmitted from such a user to a web server in the domain of the advertising service, the user identifier stored in the cookie is included in the request.
In some embodiments, the facility performs its inclination and affinity analyses based on the contents of this stored log. In some embodiments, log entries covering a significant period of time, such as three months or six months, are used in the analyses. In some embodiments, only users that have seen advertising messages or triggered action tags over a period greater than 24 hours are used in the analyses. Additional similar filtering techniques may also be used. In other embodiments, the facility performs its inclination and/or affinity analyses based upon other data regarding user behavior, such as data gathered by observing the web traffic for a user and analyzing contents or other attributes of advertising messages appearing therein, or based upon data obtained from other sources.
The inclination metric measures where an advertiser naturally finds its customers, and is formally stated for a particular publisher as
p(visited advertiser| visited publisher):
the probability that a particular user who visited the publisher also visited the advertiser.
The inclination metric is calculated by dividing the number of unique users that visited the publisher in question and the home page of the advertiser (or another page of the advertiser's web site) by the number of unique users that visited the publisher in question. Table 1 below shows the inclination analysis for a sample advertiser named Garments.com.
Figure imgf000007_0001
Table 1
To perform the analysis, the facility selects a group of publishers with which the Internet advertising service has placed advertising messages. For example, the facility may select all of the publishers with which the Internet advertising service has placed advertising messages for any advertiser.
For each of these publishers, the facility identifies the number of different users, identified by unique user identifiers, that the Internet advertising service has observed visiting the publisher. This number is preferably obtained by reading the web server log for records indicating that an advertising message was displayed at the publisher to a user having a unique user identifier. In the example, the facility determines that 50,000 different users were observed visiting the Sweater City publisher.
The facility then determines, for each publisher, the number of unique user identifiers seen at the publisher that were also seen at the home page of the advertiser's web site. The facility preferably determines this number for each publisher by, for each of the unique user identifiers seen at the publisher's web site, deternrining whether the log contains a record indicating that a user having the same user identifier visited the advertiser's home page. In the example, the facility determines that, of the 50,000 different users observed to visit the Sweater City publisher's web site, 1,000 of these users were also seen at the advertiser's home page. The facility then determines the inclination level of visitors to each of the publishers toward the advertiser by dividing the number of user identifiers seen at the advertiser's home page over the total number of unique user identifiers seen at the publisher. In the example, the facility calculates an inclination of visitors to the Sweater City publisher's web site to the advertiser's home page of 2.0% by dividing 1,000 user identifiers seen at the client's home page by 50,000 unique user identifiers seen at Sweater City.
Since a publisher with high inclination is a web site where visitors to, and likely customers of, Garments.com tend to congregate, advertising at that publisher would seem to be likely to "hit" users who are natural Garments.com customers. In the above example, users who visit the Sweater City web site are users who like sweaters, and so visit Garments.com more than an average user. As advertising at Sweater City may be effective, the facility preferably favors purchasing advertising space for Garments.com from Sweater City over purchasing it from the other two publishers.
In some cases, inclination metrics determined as described above may be significantly biased, however. If the Internet advertising service had been presenting Garments.com advertising messages on BigPortal and not on LittlePortal, this would tend to increase the number of visitors to Garments.com that were also visitors to BigPortal relative to the number of visitors to Garments.com that were visitors to LittlePortal. In fact, if the advertiser had been advertising on AnotherPortal, and if a disproportionate number of users who visit AnotherPortal also visit BigPortal, then the BigPortal inclination would also appear fairly high. The high inclination is due, at least in part, to the BigPortal advertising campaign.
To remove this "advertising bias," the facility in one embodiment uses a corrected measure of inclination called "pure inclination." Pure inclination is the percentage of visitors to the publisher who have not seen an advertising message by the advertiser who visit the advertiser's web site. To determine pure inclination, the facility separates the unique user identifiers seen on each publisher into two groups: those who have seen one or more advertising messages for Garments.com, and those who have not. Table 2 below shows the pure inclination analysis for Garments.com.
Figure imgf000009_0001
Table 2
Like the above-discussed determination of inclination, this determination of pure inclination indicates that Sweater City is a site where Garments.com visitors tend to congregate. This determination of pure inclination further indicates that advertising messages placed on LittlePortal and BigPortal would have almost the same advertising effectiveness for Garments.com.
If one publisher has higher pure inclination than another, there is significant reason to believe that the publisher with the higher pure inclination will respond to a campaign better than the other publisher, as users on the first publisher seem to be more inclined to the product than users who visit the second publisher. Accordingly, the facility preferably selects publishers at which to purchase space for future advertising messages for the advertiser on the basis of the pure inclinations of each publisher. In some cases, advertiser web sites are heavily linked to related web sites. For example, some advertiser web sites are heavily linked to affiliate web sites, such as the web sites of companies that have common ownership with the advertiser, or that have other business relationships with the advertiser. In such cases, some embodiments of the facility also exclude from the pure inclination metric users that visited the publisher and saw an advertising message for a web site related to the advertiser web site.
In a variation of pure inclination used by the facility, pure inclination is determined by dividing the number of unique users visiting the publisher before they viewed an advertising message for the advertiser by the number of those users that visited the advertiser's home page.
The facility preferably also determines a third metric for analyzing the effectiveness of advertising on particular publishers for specific advertisers called "view inclination." The facility determines view inclination by determining, of the unique user identifiers that have visited the publisher that have also seen an advertising message of the advertiser's, the percentage of those user identifiers seen at the advertiser's home page. Table 3 shows the calculation of view inclination for Garments.com.
Figure imgf000010_0001
Table 3 The facility preferably also uses a fourth metric to measure the effectiveness of advertising performed for the advertiser, called "comparative inclination." To determine comparative inclination, the facility preferably subtracts the pure inclination for each publisher from the view inclination for that publisher. A calculation of comparative inclination for the example is shown below in Table 4.
Figure imgf000011_0001
Table 4
It can be seen in Table 4 that advertising messages presented on BigPortal are likely to be significantly more effective than advertising messages presented on the other two publishers.
In addition to using one or more forms of inclination to identify Internet publishers on which to place advertisements for a particular advertiser, the facility preferably also uses an affinity analysis to identify Internet publishers on which to place advertisements for a particular advertiser. In its affinity analysis, the facility first selects one or more Internet publishers that have produced the highest return on investment when presenting advertisements for the advertiser in the past. For each of the selected publishers, the facility identifies one or more "affinity sites" — that is, additional Internet publishers that have been visited by a significant number of the users that have visited the selected publisher. Because the affinity sites are visited by many of the same users that visit the Mgh-performing sites, they are likely to perform similarly well for the advertiser. For this reason, the facility preferably also places advertisements on one or more of the affinity sites. Tables 5 and 6 below show an example of determining affinity metrics from the advertiser's perspective, between (a) a high return on investment publisher in a previous campaign for the advertiser and (b) other publishers. Table 5 shows a return on investment score for each of the publishers used in an earlier campaign for advertiser Garments.com. These return on investment scores are typically determined based upon, for a set of advertising messages for the advertiser presented on the publisher, factors indicating the level of success of the advertising from the advertiser's perspective as: the percentage of such advertisements that were "clicked-through;" the percentage of users that viewed such advertisements that later visited the advertiser's web page; the percentage of users that viewed such an advertising message that purchased something from the advertiser; the average price of items purchased from the advertiser by users that viewed such advertising messages; the average profit margin of items purchased from the advertiser by users that viewed such advertising messages, etc.
Figure imgf000012_0001
Table 5 It can be seen that the Clothes Horse and Entertaining Magazine publishers have significantly higher return on investment scores in the previous campaign than the other publishers. Accordingly, the facility proceeds to identify publishers having a high affinity with the Clothes Horse and Entertaining Magazine publishers. Table 6 shows the determination of the affinity metric between the high return on investment publisher Clothes Horse and other, "candidate" publishers about which data is available.
Figure imgf000013_0001
Table 6 The affinity metric, formally stated as:
p(visited candidate publisher|visited high return on investment publisher) p(visited candidate publisher)
is determined by dividing the product of the number of unique user identifiers visiting both the high return on investment publisher and the candidate publisher and the total number of active user identifiers by the number of users visiting" the high return on investment publisher, and further divided by the number of users visiting the candidate publisher.
It can be seen by comparing the affinity scores for the four shown candidate publishers that the Cologne Central and Fashions By Monique publishers have the highest affinities with high return on investment publisher Clothes Horse. Accordingly, the facility preferably selects these two candidate publishers for use in the current advertising campaign for Garments.com.
While embodiments of the facility described above place advertising messages on World Wide Web sites for presentation to users on general-purpose computer systems using Web browsers, additional embodiments of the facility may be used with other communication channels and/or other types of devices. In particular, the facility may preferably be used to place advertising messages delivered to such special-purpose devices as useral digital assistants, cellular and satellite phones, pagers, devices installed in automobiles and other vehicles, automatic teller machines, televisions, and other home appliances.

Claims

1. A computer-readable medium whose contents cause a computing system to assess, for a selected electronic advertiser having a web site and each of a plurality of electronic publishers each also having a website, a measure of the desirability of placing with the electronic publisher one or more advertising messages for the selected electronic advertiser by: for each of a plurality of users, storing a user identifier on a computer system used by the user; when one of the plurality of users visits the electronic advertiser website, receiving and storing an indication of a first type indicating that the user visited the electronic advertiser website, the indication containing the user identifier stored on the computer system used by the user; when one of the plurality of users visits the website of one of the plurality of electronic publishers, receiving and storing an indication of a second type indicating that the user visited the electronic publisher website, the indication containing the user identifier stored on the computer system used by the user and an identifier of the electronic publisher; selecting the user identifiers contained in stored indications of the first type; determining the number of unique selected user identifiers; for each of the electronic publishers, determining the number of selected user identifiers that are contained in at least one indication of the second type that also contains an identifier of the electronic publisher to obtain a count for the electronic publisher; dividing the count for the electronic publisher by the number of unique selected user identifiers to obtain an inclination metric for the electronic publisher; analyzing the inclination metrics obtained for the electronic publishers; and selecting one or more of the electronic publishers on which to place an advertising message for the advertiser based upon the analysis.
2. A method in a computing system for assessing, for a selected advertiser and each of a plurality of candidate advertising outlets, a measure of the desirability of placing with the candidate advertising outlet one or more advertising messages for the selected advertiser, comprising, for each of the plurality of candidate advertising outlets: identifying a plurality of users that have visited the candidate advertising outlet; counting the number of identified users that have also visited the selected advertiser; and generating for the candidate advertising outlet a metric that compares the number of identified users to the number of counted users and constitutes a measure of the desirability of placing with the candidate advertising outlet one or more advertising messages for the selected advertiser.
3. The method of claim 2 wherein the candidate advertising outlets are web publishers.
4. The method of claim 2 wherein the candidate advertising outlets are Internet publishers.
5. The method of claim 2 wherein the candidate advertising outlets are electronic publishers.
6. The method of claim 2 wherein the metric is generated by dividing the number of counted users by the number of identified users.
7. The method of claim 2 wherein the counting counts the number of identified users that (a) have also visited the selected advertiser and (b) have not viewed an advertising message for the selected advertiser, and wherein the metric is generated by dividing the number of counted users by the number of identified users.
8. The method of claim 2 wherein the counting counts the number of identified users that have also visited the selected advertiser without first viewing an advertising message for the selected advertiser, and wherein the metric is generated by dividing the number of counted users by the number of identified users.
9. The method of claim 2 wherein a related advertiser is related to the selected advertiser, and wherein the counting counts the number of identified users that (a) have also visited the selected advertiser, (b) have not viewed an advertising message for the selected advertiser, and (c) have not viewed an advertising message for the related advertiser, and wherein the metric is generated by dividing the number of counted users by the number of identified users.
10. The method of claim 2 wherein a related advertiser is related to the selected advertiser, and wherein the counting counts the number of identified users that have also visited the selected advertiser without first (a) viewing an advertising message for the selected advertiser or (b) viewing an advertising message for the related advertiser, and wherein the metric is generated by dividing the number of counted users by the number of identified users.
11. The method of claim 2 wherein the counting counts the number of identified users that (a) have also visited the selected advertiser and (b) have viewed an advertising message for the selected advertiser, and wherein the metric is generated by dividing the number of counted users by the number of identified users.
12. The method of claim 2 wherein the counting increments the count for each identified user that (a) visited the selected advertiser and (b) has viewed an advertising message for the selected advertiser and decrements the count for each identified user that (c) visited the selected advertiser and (d) has not viewed an advertising message for the selected advertiser, and wherein the metric is generated by dividing the count by the number of identified users.
13. The method of claim 2, further comprising displaying the generated metric for each candidate advertising outlet.
14. The method of claim 2, further comprising: analyzing the generated metrics; and selecting a candidate advertising outlet on which to place one or more advertising messages for the selected advertiser based upon results of the analysis.
15. The method of claim 2, further comprising discerning users that have visited the candidate advertising outlets and those that have visited the selected advertiser by analyzing the contents of logs of one or more web servers that collectively receive a request when a user visits one of the candidate advertising outlets and when a user visits the selected advertiser.
16. The method of claim 2, further comprising discerning whether a user has visited the candidate advertising outlets and whether the user has visited the selected advertiser by analyzing information traffic flowing to or from the user.
17. The method of claim 16 wherein the analysis analyzes universal resource locators contained in the traffic.
18. The method of claim 16 wherein the analysis analyzes filenames contained in the traffic.
19. The method of claim 16 wherein the analysis analyzes content contained in the traffic.
20. The method of claim 16 wherein the analysis analyzes textual content contained in the traffic.
21. The method of claim 16 wherein the analysis analyzes visual content contained in the traffic.
22. One or more computer memories collectively containing an advertising outlet inclination data structure, the data structure containing information indicating, for a selected advertiser having a web page and each of a plurality of candidate advertising outlets, the fraction of visitors to the web page of the selected advertiser that also visited the candidate advertising outlet, such that the contents of the data structure may be used to select a candidate advertising outlet on which to place an advertising message for the selected advertiser.
23. One or more computer memories collectively containing an advertising outlet inclination data structure, the data structure containing information indicating, for a selected advertiser having a web page and each of a plurality of candidate advertising outlets, the fraction of visitors to the web page of the selected advertiser that both (a) visited the candidate advertising outlet and (b) did not view an advertising message for the advertiser, such that the contents of the data structure may be used to select a candidate advertising outlet on which to place an advertising message for the selected advertiser.
24. One or more computer memories collectively containing an advertising outlet inclination data structure, the data structure containing information indicating, for a selected advertiser having a web page and each of a plurality of candidate advertising outlets, the fraction of visitors to the web page of the selected advertiser that also visited the candidate advertising outlet before first viewing an advertising message for the advertiser, such that the contents of the data structure may be used to select a candidate advertising outlet on which to place an advertising message for the selected advertiser.
25. A method in a computing system for assessing, for a selected electronic advertiser and each of a plurality of candidate electronic publishers each having a website, a measure of the desirability of placing with the candidate electronic publisher one or more advertising messages for the selected candidate electronic advertiser, comprising: selecting a distinguished electronic publisher that produced favorable results when an advertising message for the selected electronic advertiser was earlier placed on the distinguished electronic publisher, the distinguished electronic publisher having a website; for each of a plurality of users, storing a user identifier on a computer system used by the user, the number of stored user identifiers constituting a first quantity; when one of the plurality of users visits the distinguished electronic publisher advertiser website, receiving and storing an indication of a first type indicating that the user visited the distinguished electronic publisher website, the indication containing the user identifier stored on the computer system used by the user; when one of the plurality of users visits the website of one of the plurality of candidate electronic publishers, receiving and storing an indication of a second type indicating that the user visited the candidate electronic publisher website, the indication containing the user identifier stored on the computer system used by the user and an identifier of the candidate electronic publisher; selecting the user identifiers contained in stored indications of the first type; determining the number of unique selected user identifiers, constituting a second quantity; for each of the candidate electronic publishers, selecting stored indications of the second type that contain an identifier of the candidate electronic publisher; determining the number of unique user identifiers that are contained in at least one of the selected indications of the second type, constituting a third quantity; determining the number of unique user identifiers that are contained in at least one of the selected indications of the second type that are also selected, constituting a fourth quantity; dividing the product of the first and third quantities by the product of the second and fourth quantities to obtain an affinity metric for the candidate electronic publisher; analyzing the affinity metrics obtained for the candidate electronic publishers; and selecting one or more of the candidate electronic publishers on which to place an advertising message for the advertiser based upon the analysis.
26. The method of claim 25 wherein candidate electronic publishers for which an affinity greater than one is obtained are selected.
27. The method of claim 25 wherein candidate electronic publishers for which an affinity greater than five is obtained are selected.
28. A method in a computing system for assessing, for a selected advertiser and each of a plurality of candidate advertising outlets, a measure of the desirability of placing with the candidate advertising outlet an advertising messages for the selected advertiser, comprising, for each of the plurality of candidate advertising outlets: identifying a distinguished advertising outlet as likely to produce a good result when an advertising message for the selected advertiser is place on the distinguished advertising outlet; for each of the candidate advertising outlets, measuring the tendency of visitors to the distinguished advertising outlet to visit the candidate advertising outlet to obtain an affinity metric for the candidate advertising outlets; and based upon an analysis of the affinity metrics obtained for the candidate advertising outlets, selecting one or more candidate advertising outlets on which to place an advertising message for the selected advertiser.
29. The method of claim 28, further comprising: for each of a plurality of advertising outlets on which advertising messages for the advertiser have already been placed, generating a success metric characterizing the level of success attributable to placing an advertising message for the advertiser on the advertising outlet; and using the generated success metrics to select one of the advertising outlets on which advertising messages for the advertiser have already been placed as the distinguished advertising outlet.
30. The method of claim 29 wherein the success metrics are generated based upon a click-through rate for advertising messages placed on the advertising outlet.
31. The method of claim 29 wherein the success metrics are generated based upon a conversion rate for advertising messages placed on the advertising outlet.
32. The method of claim 29 wherein the success metrics are generated based upon an average purchase amount for advertising messages placed on the advertising outlet.
33. The method of claim 29 wherein the success metrics are generated based upon an factor specified by the selected advertiser for advertising messages placed on the advertising outlet.
34. One or more computer memories collectively containing an advertising outlet affinity data structure relating to a selected advertiser and a selected advertising outlet on which an advertising message for the selected advertiser has been successfully placed, the data structure containing information indicating, for each of a plurality of candidate advertising outlets, the extent to which visitors to the selected advertising outlet also visited the candidate advertising outlet, such that the contents of the data structure may be used to select one or more of the candidate advertising outlet on which to place an advertising message for the selected advertiser.
35. A method in a computing system for selecting advertising outlets on which to place advertising messages for an advertiser, comprising: for each of a first plurality of advertising outlets, assessing the rate at which visitors to the advertiser also visit the advertising outlet; selecting an advertising outlet among the first plurality having the highest rate; for each of a second plurality of advertising outlets, assessing the tendency of a high-perforrning advertising outlet to drive its visitors to the advertising outlet among the second plurality of advertising outlets; and selecting an advertising outlet among the second plurality of advertising outlets to which the high-performing advertising outlet has the greatest tendency to drive its visitors.
36. A method in a data processing system for selecting advertising outlets at which to advertise on behalf of an advertiser comprising: for each of a plurality of advertising outlets, determining a first number of consumers observed to visit the advertising outlet; for each of the advertising outlets, of the number of different consumers observed to visit the advertising outlet, determining a second number of consumers that also visited the advertiser; for each advertising outlet, dividing the second value by the first value to obtain an inclination value; and selecting advertising outlets at which to advertise on behalf of the advertiser based on the inclination values of the advertising outlets.
37. A method in a data processing system for selecting advertising outlets at which to advertise on behalf of an advertiser comprising: for each of a plurality of advertising outlets, determining a first number of consumers observed to visit the advertising outlet; for each of the advertising outlets, of the number of different consumers observed to visit the advertising outlet, deterrnining a second number of consumers that (a) also visited the advertiser, and (b) were not observed to receive an advertising message for the advertiser; for each advertising outlet, dividing the second value by the first value to obtain an inclination value; and selecting advertising outlets at which to advertise on behalf of the advertiser based on the inclination values of the advertising, outlets^
PCT/US2000/032243 1999-11-22 2000-11-22 Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity WO2001039022A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU17974/01A AU1797401A (en) 1999-11-22 2000-11-22 Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16706099P 1999-11-22 1999-11-22
US60/167,060 1999-11-22
US70200400A 2000-10-30 2000-10-30
US09/702,004 2000-10-30

Publications (2)

Publication Number Publication Date
WO2001039022A2 true WO2001039022A2 (en) 2001-05-31
WO2001039022A8 WO2001039022A8 (en) 2002-09-26

Family

ID=26862830

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/032243 WO2001039022A2 (en) 1999-11-22 2000-11-22 Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity

Country Status (3)

Country Link
US (1) US20020072971A1 (en)
AU (1) AU1797401A (en)
WO (1) WO2001039022A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193855A (en) * 2016-12-30 2017-09-22 杭州博采网络科技股份有限公司 A kind of data analysis system and method

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004524593A (en) * 2000-05-24 2004-08-12 オーバーチュア サービシズ インコーポレイテッド Online media exchange
US6832207B1 (en) 2000-11-28 2004-12-14 Almond Net, Inc. Super saturation method for information-media
US20020116223A1 (en) * 2001-02-20 2002-08-22 Aurora Health Care, Inc. System and method for selection of a primary care physician
US8046259B1 (en) 2002-10-23 2011-10-25 Amazon Technologies, Inc. Method and system for conducting a chat
US20040243704A1 (en) * 2003-04-14 2004-12-02 Alfredo Botelho System and method for determining the unique web users and calculating the reach, frequency and effective reach of user web access
US20050015800A1 (en) * 2003-07-17 2005-01-20 Holcomb Thomas J. Method and system for managing television advertising
US7346839B2 (en) * 2003-09-30 2008-03-18 Google Inc. Information retrieval based on historical data
US20050240475A1 (en) * 2004-04-23 2005-10-27 Margiloff William A Systems and methods for universal online advertising
US20070271145A1 (en) * 2004-07-20 2007-11-22 Vest Herb D Consolidated System for Managing Internet Ads
US20060095322A1 (en) * 2004-11-03 2006-05-04 Dierks Timothy M Determining prospective advertising hosts using data such as crawled documents and document access statistics
US8036932B2 (en) 2004-11-19 2011-10-11 Repucom America, Llc Method and system for valuing advertising content
US8712831B2 (en) * 2004-11-19 2014-04-29 Repucom America, Llc Method and system for quantifying viewer awareness of advertising images in a video source
US7809752B1 (en) 2005-04-14 2010-10-05 AudienceScience Inc. Representing user behavior information
US20090076907A1 (en) * 2005-04-21 2009-03-19 Louis Robert Litwin Method and system for providing media content
US20070037513A1 (en) * 2005-08-15 2007-02-15 International Business Machines Corporation System and method for targeted message delivery and subscription
US8122049B2 (en) * 2006-03-20 2012-02-21 Microsoft Corporation Advertising service based on content and user log mining
WO2007147080A1 (en) 2006-06-16 2007-12-21 Almondnet, Inc. Media properties selection method and system based on expected profit from profile-based ad delivery
WO2007149888A2 (en) 2006-06-19 2007-12-27 Almondnet, Inc. Providing collected profiles to media properties having specified interests
US20080098325A1 (en) * 2006-10-23 2008-04-24 Carnet Williams Method and system for facilitating social payment or commercial transactions
US20080154717A1 (en) * 2006-12-22 2008-06-26 Yahoo! Inc. Publisher scoring
US7970891B1 (en) * 2007-01-17 2011-06-28 Google Inc. Tracking links in web browsers
US20090063268A1 (en) * 2007-09-04 2009-03-05 Burgess David A Targeting Using Historical Data
US20090094313A1 (en) * 2007-10-03 2009-04-09 Jay Feng System, method, and computer program product for sending interactive requests for information
US20090100359A1 (en) * 2007-10-10 2009-04-16 Microsoft Corporation Method including audio files for generating template based video advertisements
US20090100362A1 (en) * 2007-10-10 2009-04-16 Microsoft Corporation Template based method for creating video advertisements
US20090100331A1 (en) * 2007-10-10 2009-04-16 Microsoft Corporation Method including a timer for generating template based video advertisements
US8396738B1 (en) * 2008-02-22 2013-03-12 Bank Of America Corporation System and method for evaluating third party marketing services
US8887194B2 (en) * 2008-06-19 2014-11-11 Verizon Patent And Licensing Inc. Method and system for providing interactive advertisement customization
US20100031147A1 (en) * 2008-07-31 2010-02-04 Chipln Inc. Method and system for mixing of multimedia content
US8145530B2 (en) * 2008-10-01 2012-03-27 Google Inc. Targeting based placement identification
US8335721B2 (en) 2008-10-01 2012-12-18 Google Inc. Placement identification and reservation
AU2009298596A1 (en) * 2008-10-01 2010-04-08 Google Inc. Placement identification and reservation
US20110184809A1 (en) * 2009-06-05 2011-07-28 Doapp, Inc. Method and system for managing advertisments on a mobile device
US20110035256A1 (en) * 2009-08-05 2011-02-10 Roy Shkedi Systems and methods for prioritized selection of media properties for providing user profile information used in advertising
US9754285B1 (en) * 2009-09-30 2017-09-05 Google Inc. Identifying alternate content distribution locations
US20110282730A1 (en) * 2010-05-13 2011-11-17 AdChoice, Inc. System and method for selecting and implementing an internet advertising campaign
US8639544B1 (en) 2010-12-22 2014-01-28 Alberobello Capital Corporation Identifying potentially unfair practices in content and serving relevant advertisements
US20140156387A1 (en) * 2012-12-04 2014-06-05 Facebook, Inc. Generating Advertising Metrics Using Location Information
US20160027040A1 (en) * 2014-07-25 2016-01-28 Facebook, Inc. Determining contributions of various user interactions to a conversion
WO2017053780A1 (en) 2015-09-23 2017-03-30 Iwear Holdings Corp. Sending messages wirelessly from a garment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5960409A (en) * 1996-10-11 1999-09-28 Wexler; Daniel D. Third-party on-line accounting system and method therefor
US6487538B1 (en) * 1998-11-16 2002-11-26 Sun Microsystems, Inc. Method and apparatus for local advertising

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
No Search *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193855A (en) * 2016-12-30 2017-09-22 杭州博采网络科技股份有限公司 A kind of data analysis system and method

Also Published As

Publication number Publication date
AU1797401A (en) 2001-06-04
WO2001039022A8 (en) 2002-09-26
US20020072971A1 (en) 2002-06-13

Similar Documents

Publication Publication Date Title
WO2001039022A2 (en) Targeting electronic advertising placement in accordance with an analysis of user inclination and affinity
US7254547B1 (en) Dynamically targeting online advertising messages to users
JP5053483B2 (en) Network for retargeted ad distribution
US6182050B1 (en) Advertisements distributed on-line using target criteria screening with method for maintaining end user privacy
KR101671722B1 (en) Online ad detection and ad campaign analysis
US20170149752A1 (en) Method and Device for Publishing Cross-Network User Behavioral Data
AU2006218442B2 (en) Providing history and transaction volume information of a content source to users
US7930218B1 (en) Personalized promotion of new content
US20100125505A1 (en) System for broadcast of personalized content
US20060184421A1 (en) Dynamically optimizing the presentation of advertising messages
JP2019523919A (en) Method for identifying behavior preference of user, method for presenting recommended information, and device
WO2001039023A2 (en) Method and facility for capturing behavioral and profile data during a customer visit to a web site
US20020133417A1 (en) Increases in sales rank as a measure of interest
US20120010943A1 (en) Systems and methods for providing a reverse frequency cap in advertisement viewing
US20110060659A1 (en) Method and system for ranking information items for display
US20020138335A1 (en) Targeted advertising method and system
KR20060129172A (en) Methods and apparatus for posting messages on documents delivered over a computer network
US20070239533A1 (en) Allocating and monetizing advertising space in offline media through online usage and pricing model
WO2001044979A9 (en) System and method for tracking web campaign effectiveness
WO2001009789A1 (en) Method and apparatus for tracking and analyzing online usage
KR20070103557A (en) Method of providing advertisement and event optimized for web user and system thereof
WO2010138861A2 (en) Contextual content targeting
US20150066644A1 (en) Automated targeting of information to an application user based on retargeting and utilizing email marketing
JP2002245339A (en) System for deciding consideration for internet advertisement and system for preventing illegal action
US20030023511A1 (en) Automated system and method for tracking online activity to initiating information source

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

AK Designated states

Kind code of ref document: C1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

D17 Declaration under article 17(2)a
122 Ep: pct application non-entry in european phase