US20080248873A1 - Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content - Google Patents

Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content Download PDF

Info

Publication number
US20080248873A1
US20080248873A1 US12/060,327 US6032708A US2008248873A1 US 20080248873 A1 US20080248873 A1 US 20080248873A1 US 6032708 A US6032708 A US 6032708A US 2008248873 A1 US2008248873 A1 US 2008248873A1
Authority
US
United States
Prior art keywords
content
subset
content submissions
submissions
members
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/060,327
Inventor
Belinda Lang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Liberty Peak Ventures LLC
Original Assignee
American Express Travel Related Services Co Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by American Express Travel Related Services Co Inc filed Critical American Express Travel Related Services Co Inc
Priority to PCT/US2008/058995 priority Critical patent/WO2008124385A1/en
Priority to US12/060,327 priority patent/US20080248873A1/en
Assigned to AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC. reassignment AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LANG, BELINDA
Publication of US20080248873A1 publication Critical patent/US20080248873A1/en
Assigned to III HOLDINGS 1, LLC reassignment III HOLDINGS 1, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC.
Assigned to LIBERTY PEAK VENTURES, LLC reassignment LIBERTY PEAK VENTURES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: III HOLDINGS 1, LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07FCOIN-FREED OR LIKE APPARATUS
    • G07F17/00Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/32Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements

Definitions

  • the present invention generally relates online competitions, and more particularly to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content.
  • the present invention provides systems, methods and computer program products for running a multi-stage online elimination competition based on member generated content.
  • Content is submitted by and voted on, in part, by members, after the content survives a multi-stage filtering process involving predetermined evaluation criteria and evaluated by members, automated screening procedures, internal competition staff, and an advisory committee.
  • a member can enter member-generated content for consideration in the competition.
  • a first evaluation stage subjects the content to automated word-based screening and preliminary vendor screening before being accepted into submission.
  • all members rate submitted content, and can report objectionable content to have it flagged for vendor review and possible removal.
  • the third stage has a succession of iterative internal vendor reviews of the top member voted content from each distinct succession of predefined voting periods.
  • the fourth stage matches content with potential implementation of the content to provide a check on feasibility of the content winning, with feasibility determined by the purposes, aims, and scopes of each individual competition.
  • the fifth stage submits the content to an advisory committee for voting and narrowing down the potential winners. The members again vote on the remaining content to determine a winner.
  • Such member submissions may take place over any technology that allows for an electronic parsing of the contained information, such as e-mail, filling in of a web-based vendor generated form, an SMS text message, or similar means of communication.
  • Member voting may take place over any technology that allows communication with the members, such as mail, e-mail, conventional phone, cellular phone, SMS text message, web pages, or similar means of communication.
  • FIG. 1 is a block diagram of a competition system in accordance with an example embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating the flow of a piece of content through the submission and judging process according to an example embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating the content submission process according to an example embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention.
  • FIG. 5 is a flowchart illustrating an elimination decision flow during one period of an iterative judging process according to an example embodiment of the present invention.
  • FIG. 6 is an example computer system used in one embodiment of the present invention.
  • the present invention is directed to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content and is now described in more detail herein in terms of an exemplary competition system for selecting a community service report, as described below. This is for convenience only and is not intended to limit the application of the present invention. In fact, after reading the following description, it will be apparent to one skilled in the relevant art(s) how to implement the following invention in alternative embodiments (e.g., competitions for best member generated artwork, or best member generated fictional short stories, etc.).
  • the main participants in the competition are cardmembers, and non-cardmembers are encouraged to become a cardmember in order to participate.
  • ideas for community service projects are solicited from cardmembers and other cardmembers are allowed to review and vote on the projects.
  • projects are internally narrowed down to a list of the top (e.g., 100) projects.
  • the top projects are submitted to an advisory committee of judges, such as high profile celebrities and/or experts.
  • the advisory committee narrows the projects down further (e.g., top 50), the results of which are then submitted to the cardmembers for several rounds of voting on which project should win an endowment from the card provider for third-party sponsor.
  • Competition system 100 could be used, for example, to select as a winning charity project idea a plan to distribute water purification devices to some of the world's poorest countries and train the denizens on how to use the devices.
  • cardmember “member,” “participant,” “competitor,” “user,” and/or the plural form of these terms are used interchangeably throughout herein to refer to those persons or entities capable of accessing, using, being affected by and/or benefiting from the tool that the present invention provides for a multi-stage online elimination competition based on member generated content.
  • “Content” may encompass any amalgamation of material that is discernable to the public at large and transmittable, such as text, images, video, audio, links to websites, or anything else communicative. Exact limits on types of eligible content may be enforced on a competition specific basis.
  • “Member generated content” includes any competition-eligible content generated by a particular member personally, as well as any content that the member has appropriate permission to represent as his or her own in the competition.
  • a participant system 102 represents an interface a member utilizes to communicate with and participate in the competition.
  • Such a system can encompass a myriad of devices that facilitate communication, such as, but not limited to: a personal computer connected to the Internet, a conventional telephone, a fax machine, a cellular phone, a mailbox, or a personal digital assistant (PDA) or similar digital personal device capable of external communication.
  • PDA personal digital assistant
  • a communications engine 104 facilitates communication between participant system 102 and the other components of competition system 100 , such as a parsing engine 106 , an internal review engine 108 , and an advisory review engine 110 .
  • Communications engine 104 may consist of any form of communications technology, both automated such as fax machines, network routers, personal computers connected to the Internet, and the like, and manual such as telephone operators and the postal system, and the like.
  • Parsing engine 106 parses the content submitted by the participant system 102 and screen out any content that fails a set of predefined criteria.
  • the predefined criteria used by the parsing engine 106 may be distinct, overlapping, or similar to the predefined criteria utilized by the internal review engine 108 and the advisory review engine 110 , described below. Moreover, such a screening may be automated or manual. If content passes screening performed by the parsing engine 106 , it is then submitted to internal review engine 108 for a more detailed review of submitted content.
  • An internal review engine 108 performs a more detailed review and screening of the submitted content utilizing predefined criteria.
  • the review is conducted with the aim of narrowing down the entries in the competition utilizing the predefined criteria.
  • Such a review may be automated or manual, and may utilize any number of distinct or overlapping sets of predefined criteria. Further, such a review may be conducted during any part of the competition to cause the removal, combination, reclassification, or other similar alteration of a plurality of content submissions.
  • the predefined criteria used by the internal review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and advisory review engine 110 .
  • Internal review engine 108 may analyze content obtained for different sources within competition system 100 , such as communications engine 104 or the parsing engine 106 . Moreover, content within a specific competition may be reviewed by the internal review engine 108 one time or a plurality of times, and either with a simple review or an iterative review (described below), depending on the design of the competition.
  • Advisory review engine 110 performs a high-level review and screening of the submitted content utilizing predefined criteria. Such a review is conducted with the aim of narrowing down the entries in the competition which have passed through one or more applications of internal review engine 108 described above. Such a review may also be automated or manual.
  • the predefined criteria used by the advisory review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and internal review engine 108 .
  • FIG. 2 represents a flowchart illustrating a process flow of content through competition system 100 in accordance with an example embodiment of the present invention.
  • Blocks 224 collectively represent an example content submission process, which is defined in greater detail with respect to FIG. 3 below.
  • Blocks 226 collectively represent an example for gradually eliminating competition entries until a single entry or a group of entries is determined to be the competition winner.
  • the member submits content through participant system 102 to the communications engine 104 for inclusion in the competition.
  • the type of content, form of submission, and method of submission may take on multiple configurations.
  • a member is any potential user that has gone through a registration process and submits a community service project idea to the competition through a form on the competition's website.
  • parsing engine 106 parses the member submitted content and flags content that contained certain pre-determined content, for instance text containing profanity. If such content is flagged, the process proceeds to block 206 , where the submitting member is prompted to resubmit a competition entry if they desire further consideration in the competition, otherwise the submission method then ends.
  • Block 208 utilizes a higher level of review than block 204 , and can analyze the content and compare it to a set of pre-defined submission criteria. Examples of such criteria that would prompt entry rejection include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, the inclusion of content that violates the rules of the particular competition, and the like.
  • the content moves on to public availability through communications engine 104 , which would enable review and voting on by all members, possible including the content-submitting member, in block 210 .
  • members may flag specific entries for further review, which will be explained in greater detail in connection with FIG. 4 .
  • the member may review content which has passed the content submission process 224 . Further, members may rate the content in accordance with their own preference.
  • cardmembers may log on to the competition webpage, view a list of all submitted projects, and view a detailed profile of each individual submitted charity idea. Cardmembers may then rate each idea, such as with a 1-5 star rating, where 1 star is least desirable and 5 stars is most desirable. The average star ratings of each project are evaluated in conjunction with the number of total rankings that each submitted project received, such that there is a bias toward projects with significant numbers of ratings over those with an equal average rating but fewer total ratings.
  • the top ranked content from block 210 is subjected to a feasibility check for the consequences of the specific content winning the overall competition by internal review engine 108 . Any content submissions rejected during this step will be removed from the competition in block 222 . The content submissions that are qualified in block 214 will be passed along to block 216 , detailed below.
  • Block 214 is iterative because all content passed on from block 210 is not examined at once, but rather several times over the course of the competition. The time the iterative judging process runs is described in terms of a submission period.
  • the top X ranked content entries are evaluated and either qualified or rejected.
  • the top X+Y ranked content entries from periods 1 and 2 are evaluated, with those entries evaluated during period 1 keeping their previously determined qualified or rejected status. These entries are not reevaluated.
  • the top X+Y+Z ranked content entries are evaluated from periods 1-3, with those entries evaluated during periods 1 and 2 keeping their previously determined qualified or rejected status. These entries also are not reevaluated. This process continues until the submission periods are over. Thus, the total number of submissions qualified from block 210 is reduced, and the submissions qualified under block 214 are then passed on to block 216 .
  • the evaluative criteria used in block 214 can be different from the criteria utilized in block 208 .
  • the iterative review in block 214 can be layered with multiple sets of evaluative criteria, where only content submissions that are qualified under an iterative review using a first set of evaluative criteria are entered into consideration of an iterative review using a second set of evaluative criteria.
  • the first set of evaluative criteria is used to provide a feasibility check on the foreseeable ability to implement a charity project in the content submission.
  • the second set of evaluative criteria is used to match each charity project with an organization that can effectively implement the described project. After being qualified content qualified in both will be promoted to the next level of the competition.
  • An example round of the iterative content feasibility check can be seen in FIG. 5 and its related discussion.
  • advisory review engine 110 utilizes a set of predefined evaluative criteria to analyze, rate, and narrow down the remaining content submissions through, for example, a conventional scoring of the content. This evaluation may be either automated or manual. Moreover, the evaluative criteria may vary between different embodiments.
  • advisory review engine 110 is a small committee with high profile members, possibly including such people as celebrities or respected participants in a community relevant to the competition; this allows the competition to receive several benefits, such as increased publicity, respectability, or accuracy in determining which submissions deserve to win the competition.
  • the advisory review engine 110 evaluates and ranks the content submissions that were qualified from block 214 based on predetermined criteria. After receiving the rankings of the advisory review engine 110 , the specific content submissions are again separated out by the competition system 100 so that a predetermined number of “top ranking” submissions may be made publicly available by the communications engine 104 and passed along to block 218 , with all other submissions being eliminated from the contest in block 222 .
  • the member community votes on the top ranked content submissions from block 216 .
  • the voting may take place in a multitude of fashions through communications engine 104 , from clicking on a web page selection button, to sending an SMS text message, to calling a specified phone number, to other similar technologies.
  • the voting also can take place in any number of voting rounds, so that content submissions are narrowed down after the first vote in some fashion and members may vote again on the newly narrowed list of top ranked content submissions, with this repeating until a winner or a group of winners is chosen.
  • Content submissions that win the member vote in block 218 proceed to block 220 as winners of the competition. All other content submissions lose the competition, progressing to block 222 .
  • any rankings obtained during block 218 of content submissions that progress to block 222 could be utilized in providing tiered awards for the non-winners of the competition (e.g., a second place prize, a finalists' prize, an honorable mention prize, etc.).
  • FIG. 3 is a flowchart illustrating a content submission process 300 method according to an example embodiment of the present invention.
  • a registered member submits content from the participant system 102 to the competition system 100 for consideration.
  • Such content can take on many forms, so long as it conveys information and is capable of being parsed by electronic systems. In one exemplary embodiment, such content takes on the form of descriptions of potential community service projects and brief biographies of the member submitting the project.
  • Parsing engine 106 performs a screening of the content in block 304 to rule out any submissions that fail a previously identified set of criteria.
  • Example criteria that qualify an entry for rejection by the automated screening include the use of profanity or other unacceptable words.
  • the process proceeds to block 306 where the member is notified of the rejection and prompted to resubmit alternate content if they wish to be considered in the competition.
  • the method thus proceeds to block 308 , where the member may either resubmit alternate content, taking them back to block 302 , or quitting the method altogether.
  • Example decision criteria that can be used in block 310 include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, or inclusion of content that violates the rules of the particular competition.
  • the method will proceed to block 313 wherein an appropriate communication is sent to the participant system 102 through the communications engine 104 .
  • Such a process can be automated by having the internal review engine 108 in block 310 specify a rejection type and having that rejection type elicit a pre-determined response which varies by rejection type.
  • the communication in block 313 could read: “Thank you for your contribution. Unfortunately, the project you submitted did not meet our submission criteria. References to third parties—including people, companies, and brands—are not permitted due to Copyright and Trademark concerns. We invite you to revise your entry, which is included below, and try again.” The process would then proceed to block 306 , as described above.
  • the internal review engine 108 conducts a rating of content according to pre-established competition criteria.
  • the method would pass into block 312 , wherein an escalated review of the content could take place by the internal review engine 108 .
  • Such a review could be ‘escalated’ as compared to the review in block 310 by, for example, having multiple manual reviewers examine the content or utilizing a different algorithm to review the content.
  • the method would proceed to the above described block 313 . If the content is accepted by the escalated review in block 312 , the method would proceed to the above described block 316 . If the escalated review in block 312 still cannot determine whether the content fails to meet the pre-defined criteria, the method would proceed to block 314 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, the reviewers could contact the credit card issuer sponsoring the community project competition for their decision on the content. After block 314 , the method proceeds to block 326 where it stops.
  • Step 318 the method moves on to block 318 , wherein the approved content is displayed publicly through communications engine 104 .
  • the method moves on to block 320 , wherein an appropriate communication is sent to the participant system 102 through the communications engine 104 .
  • Both Steps 318 and 320 can be automated to increase efficiency, although automation is not required.
  • block 322 the content is made available for perusal, comment, and rating (and possible flagging for review as described below in more detail with respect to FIG. 4 ) by any member through communications engine 104 .
  • the method proceeds to block 324 , wherein a submission is considered complete.
  • FIG. 4 is a flowchart illustrating a process 400 for providing a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention.
  • the content in question is automatically appended to the report or otherwise displayed in block 404 so as to be capable of review by the internal review engine 108 .
  • the report with the appended or otherwise displayed content submission is communicated to the internal review engine 108 in block 406 to again judge the submission against a set of pre-defined contest eligibility criteria, which may or may not be the same as utilized in block 310 in FIG. 3 as described above.
  • the process proceeds to block 410 wherein the submitted content is removed from the list of accepted submissions and the public listing of such submissions as accessible through the communications engine 104 .
  • the process proceeds to block 412 , wherein a communication is sent through the communications engine 104 both to the member who reported a problem with the content in question and the member who submitted the content in question. Both blocks 410 and 412 can be automated so as to increase efficiency, yet this is not required.
  • the process proceeds to block 414 , where the submitting member is prompted through the communications engine 104 to submit other content into the contest if so desired. The method then progresses to block 416 , where the user reported violation portion ends.
  • block 406 If the decision in block 406 is to accept the submitted content as in accord with the pre-defined contest eligibility criteria utilized in block 406 , then the process proceeds to block 420 , where a message is sent to the reporting member through the communications engine 104 indicating that the content has been reviewed but still deemed acceptable. Following block 420 , the process proceeds to block 422 where the user reported violation portion ends. Both blocks 420 and 422 could be automated to increase efficiency, but this is not required.
  • the process progresses to block 408 where an escalated review of the content by the internal review engine 108 takes place.
  • a review could be ‘escalated’ in comparison to the review in block 406 by having, for instance, multiple reviewers examine the content, a different algorithm examine the content, or a reviewer higher up within the organization examine the content.
  • the process proceeds to block 418 wherein a higher level is requested to review the content.
  • a higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, in the charity project competition, the internal review engine 108 contacts the card issuer for their decision on the content.
  • the method proceeds to block 424 where it stops.
  • FIG. 5 is a flowchart illustrating a process 500 providing elimination decision flow during one period of an iterative judging step in the internal review engine according to an example of the present invention.
  • the review period consists of a week, and the second review period 500 is depicted.
  • the top ranked content submissions from the preliminary member rankings are selected for review. These top ranked submissions may include submissions that have been submitted during any submission period to date, in this case within week 1 or week 2, even if the submissions were qualified or disqualified in week 1.
  • the submissions that were reviewed in the previous submission period, week 1 are removed from consideration during this period and keep their qualified or rejected status assigned to them in week 1.
  • the remaining non-evaluated projects are assigned to individual reviewers within the internal review engine 108 .
  • those individual reviewers will compare each project against a set of predefined criteria, such as in this embodiment where the criteria are the feasibility of enacting the suggested charity project detailed in the content submission.
  • the individual reviewers must decide whether to accept, reject, or further examine a content submission.
  • the process proceeds to block 512 , where the content submission is added to a “qualified list”, which is maintained in block 518 .
  • This qualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already qualified ideas.
  • the process proceeds to block 516 , where the content submission is added to a “disqualified list”, which is maintained in block 520 .
  • This disqualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already disqualified ideas, even if they still rank in the top specified portion of rated content submissions for that particular review period.
  • the method proceeds to block 522 . If this is not the last submission period, the method will return to block 502 where it will re-commence during the next submission period. If this is the last submission period and there are no more iterations to proceed through, the method proceeds to block 524 where it stops and the qualified list functions as the list of content submissions that have passed through this iterative screening.
  • the individual reviewer in block 510 may defer the content submission to an escalated review in block 514 .
  • the escalated review is a panel made up of all of the individual reviewers who were assigned content submissions in block 506 , but this could also possibly include other reviewers, different reviewing algorithms, utilizing different evaluative criteria, etc. Determination of acceptance of the content submission will lead to block 512 , described above, and determination of rejection of the content submission will lead to block 516 , also described above.
  • the present invention may be implemented using hardware, software or a combination thereof and may be implemented in one or more computer systems or other processing systems.
  • the manipulations performed by the present invention were often referred to in terms, such as reviewing, screening, or flagging, which are commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein which form part of the present invention. Rather, the operations are machine operations.
  • Useful machines for performing the operation of the present invention include general purpose digital computers or similar devices.
  • the invention is directed toward one or more computer systems capable of carrying out the functionality described herein.
  • An example of a computer system 600 is shown in FIG. 6 .
  • the computer system 600 includes one or more processors, such as processor 604 .
  • the processor 604 is connected to a communication infrastructure 606 (e.g., a communications bus, cross-over bar, or network).
  • a communication infrastructure 606 e.g., a communications bus, cross-over bar, or network.
  • Computer system 600 can include a display interface 602 that forwards graphics, text, and other data from the communication infrastructure 606 (or from a frame buffer not shown) for display on the display unit 630 .
  • Computer system 600 also includes a main memory 608 , preferably random access memory (RAM), and may also include a secondary memory 610 .
  • the secondary memory 610 may include, for example, a hard disk drive 612 and/or a removable storage drive 614 , representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc.
  • the removable storage drive 614 reads from and/or writes to a removable storage unit 618 in a well known manner.
  • Removable storage unit 618 represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive 614 .
  • the removable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data.
  • secondary memory 610 may include other similar devices for allowing computer programs or other instructions to be loaded into computer system 600 .
  • Such devices may include, for example, a removable storage unit 622 and an interface 620 .
  • Examples of such may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an erasable programmable read only memory (EPROM), or programmable read only memory (PROM)) and associated socket, and other removable storage units 622 and interfaces 620 , which allow software and data to be transferred from the removable storage unit 622 to computer system 600 .
  • EPROM erasable programmable read only memory
  • PROM programmable read only memory
  • Computer system 600 may also include a communications interface 624 .
  • Communications interface 624 allows software and data to be transferred between computer system 600 and external devices. Examples of communications interface 624 may include a modem, a network interface (such as an Ethernet card), a communications port, a Personal Computer Memory Card International Association (PCMCIA) slot and card, etc.
  • Software and data transferred via communications interface 624 are in the form of signals 628 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 624 . These signals 628 are provided to communications interface 624 via a communications path (e.g., channel) 626 . This channel 626 carries signals 628 and may be implemented using wire or cable, fiber optics, a telephone line, a cellular link, a radio frequency (RF) link and other communications channels.
  • RF radio frequency
  • computer program medium and “computer usable medium” are used to generally refer to media such as removable storage drive 614 , a hard disk installed in hard disk drive 612 , and signals 628 .
  • These computer program products provide software to computer system 600 .
  • the invention is directed to such computer program products.
  • Computer programs are stored in main memory 608 and/or secondary memory 610 . Computer programs may also be received via communications interface 624 . Such computer programs, when executed, enable the computer system 600 to perform the features of the present invention, as discussed herein. In particular, the computer programs, when executed, enable the processor 604 to perform the features of the present invention. Accordingly, such computer programs represent controllers of the computer system 600 .
  • the software may be stored in a computer program product and loaded into computer system 600 using removable storage drive 614 , hard drive 612 or communications interface 624 .
  • the control logic when executed by the processor 604 , causes the processor 604 to perform the functions of the invention as described herein.
  • the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs).
  • ASICs application specific integrated circuits
  • the invention is implemented using a combination of both hardware and software.
  • FIGS. 1-6 which highlight the functionality and advantages of the present invention, are presented for example purposes only.
  • the architecture of the present invention is sufficiently flexible and configurable, such that it may be utilized (and navigated) in ways other than that shown in the accompanying figures.

Abstract

Methods, systems and computer program products provide a multi-stage online elimination competition based on member generated content that involves members submitting content for consideration, then preliminary multi-level screening of the submission with passing content published for consideration. Published content is evaluated and considered by members, who can rate each content submission, leave a submission unrated, or flag a submission for eligibility review. The submissions are then iteratively narrowed down rated using internal guidelines and member ratings. The submissions are then further narrowed down by an advisory committee. The remaining submissions are then voted on by members, in at least one elimination rounds, and a winner or group of winners is chosen.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application claims priority to, and the benefit of, U.S. Provisional Patent Application Ser. No. 60/909,745, filed Apr. 3, 2007, which is hereby incorporated by reference in its entirety.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention generally relates online competitions, and more particularly to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content.
  • 2. Related Art
  • There are many considerations inherent in running an online elimination competition. For instance, online competitions must contend with securing the involvement and interest of the general public. Moreover, since online competitions have a potential to generate a multitude of entries, competitions must narrow down the entries to choose a winner in both a money-conscious and resource-effective way. Still, competitors have a great potential for enjoyment through competitions, and the use of an online competition has the benefit of reaching many potential users.
  • It would be useful to have a multi-stage online elimination competition based on member generated content which includes member evaluation, vender evaluation, expert evaluation, as well as automatic parsing all in combination to arrive at a competition winner. Such a method could be used to implement a competition for a variety of socially beneficial goals, such as choosing a worthy charity project for a large vender, and result in the very real consequences of putting corporate money to good use by providing necessities, such as much needed safe drinking water to the children of the world's poorest countries.
  • BRIEF DESCRIPTION OF THE INVENTION
  • The present invention provides systems, methods and computer program products for running a multi-stage online elimination competition based on member generated content. Content is submitted by and voted on, in part, by members, after the content survives a multi-stage filtering process involving predetermined evaluation criteria and evaluated by members, automated screening procedures, internal competition staff, and an advisory committee.
  • A member can enter member-generated content for consideration in the competition. A first evaluation stage subjects the content to automated word-based screening and preliminary vendor screening before being accepted into submission. In the second stage, all members rate submitted content, and can report objectionable content to have it flagged for vendor review and possible removal. The third stage has a succession of iterative internal vendor reviews of the top member voted content from each distinct succession of predefined voting periods. The fourth stage matches content with potential implementation of the content to provide a check on feasibility of the content winning, with feasibility determined by the purposes, aims, and scopes of each individual competition. The fifth stage submits the content to an advisory committee for voting and narrowing down the potential winners. The members again vote on the remaining content to determine a winner.
  • Such member submissions may take place over any technology that allows for an electronic parsing of the contained information, such as e-mail, filling in of a web-based vendor generated form, an SMS text message, or similar means of communication. Member voting may take place over any technology that allows communication with the members, such as mail, e-mail, conventional phone, cellular phone, SMS text message, web pages, or similar means of communication.
  • Further features and advantages of the present invention as well as the structure and operation of various embodiments of the present invention are described in detail below with reference to the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The features and advantages of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference numbers indicate identical or functionally similar elements.
  • FIG. 1 is a block diagram of a competition system in accordance with an example embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating the flow of a piece of content through the submission and judging process according to an example embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating the content submission process according to an example embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention.
  • FIG. 5 is a flowchart illustrating an elimination decision flow during one period of an iterative judging process according to an example embodiment of the present invention.
  • FIG. 6 is an example computer system used in one embodiment of the present invention.
  • DETAILED DESCRIPTION
  • The present invention is directed to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content and is now described in more detail herein in terms of an exemplary competition system for selecting a community service report, as described below. This is for convenience only and is not intended to limit the application of the present invention. In fact, after reading the following description, it will be apparent to one skilled in the relevant art(s) how to implement the following invention in alternative embodiments (e.g., competitions for best member generated artwork, or best member generated fictional short stories, etc.).
  • The main participants in the competition are cardmembers, and non-cardmembers are encouraged to become a cardmember in order to participate. Generally, ideas for community service projects are solicited from cardmembers and other cardmembers are allowed to review and vote on the projects. In addition, projects are internally narrowed down to a list of the top (e.g., 100) projects. The top projects are submitted to an advisory committee of judges, such as high profile celebrities and/or experts. The advisory committee narrows the projects down further (e.g., top 50), the results of which are then submitted to the cardmembers for several rounds of voting on which project should win an endowment from the card provider for third-party sponsor. Competition system 100 could be used, for example, to select as a winning charity project idea a plan to distribute water purification devices to some of the world's poorest countries and train the denizens on how to use the devices.
  • The terms “cardmember,” “member,” “participant,” “competitor,” “user,” and/or the plural form of these terms are used interchangeably throughout herein to refer to those persons or entities capable of accessing, using, being affected by and/or benefiting from the tool that the present invention provides for a multi-stage online elimination competition based on member generated content.
  • “Content” may encompass any amalgamation of material that is discernable to the public at large and transmittable, such as text, images, video, audio, links to websites, or anything else communicative. Exact limits on types of eligible content may be enforced on a competition specific basis. “Member generated content” includes any competition-eligible content generated by a particular member personally, as well as any content that the member has appropriate permission to represent as his or her own in the competition.
  • More detailed descriptions of the function of each component will be discussed in relation to later figures.
  • A participant system 102 represents an interface a member utilizes to communicate with and participate in the competition. Such a system can encompass a myriad of devices that facilitate communication, such as, but not limited to: a personal computer connected to the Internet, a conventional telephone, a fax machine, a cellular phone, a mailbox, or a personal digital assistant (PDA) or similar digital personal device capable of external communication.
  • A communications engine 104 facilitates communication between participant system 102 and the other components of competition system 100, such as a parsing engine 106, an internal review engine 108, and an advisory review engine 110. Communications engine 104 may consist of any form of communications technology, both automated such as fax machines, network routers, personal computers connected to the Internet, and the like, and manual such as telephone operators and the postal system, and the like.
  • Parsing engine 106 parses the content submitted by the participant system 102 and screen out any content that fails a set of predefined criteria. The predefined criteria used by the parsing engine 106 may be distinct, overlapping, or similar to the predefined criteria utilized by the internal review engine 108 and the advisory review engine 110, described below. Moreover, such a screening may be automated or manual. If content passes screening performed by the parsing engine 106, it is then submitted to internal review engine 108 for a more detailed review of submitted content.
  • An internal review engine 108 performs a more detailed review and screening of the submitted content utilizing predefined criteria. In addition the review is conducted with the aim of narrowing down the entries in the competition utilizing the predefined criteria. Such a review may be automated or manual, and may utilize any number of distinct or overlapping sets of predefined criteria. Further, such a review may be conducted during any part of the competition to cause the removal, combination, reclassification, or other similar alteration of a plurality of content submissions. Moreover, the predefined criteria used by the internal review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and advisory review engine 110. Internal review engine 108 may analyze content obtained for different sources within competition system 100, such as communications engine 104 or the parsing engine 106. Moreover, content within a specific competition may be reviewed by the internal review engine 108 one time or a plurality of times, and either with a simple review or an iterative review (described below), depending on the design of the competition.
  • Advisory review engine 110 performs a high-level review and screening of the submitted content utilizing predefined criteria. Such a review is conducted with the aim of narrowing down the entries in the competition which have passed through one or more applications of internal review engine 108 described above. Such a review may also be automated or manual. In addition, the predefined criteria used by the advisory review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and internal review engine 108.
  • FIG. 2 represents a flowchart illustrating a process flow of content through competition system 100 in accordance with an example embodiment of the present invention. Blocks 224 collectively represent an example content submission process, which is defined in greater detail with respect to FIG. 3 below. Blocks 226 collectively represent an example for gradually eliminating competition entries until a single entry or a group of entries is determined to be the competition winner.
  • In block 202, the member submits content through participant system 102 to the communications engine 104 for inclusion in the competition. The type of content, form of submission, and method of submission may take on multiple configurations. In an example embodiment, a member is any potential user that has gone through a registration process and submits a community service project idea to the competition through a form on the competition's website.
  • In block 204, parsing engine 106 parses the member submitted content and flags content that contained certain pre-determined content, for instance text containing profanity. If such content is flagged, the process proceeds to block 206, where the submitting member is prompted to resubmit a competition entry if they desire further consideration in the competition, otherwise the submission method then ends.
  • If content passes the screening in block 204, it then proceeds to the competition vendor's preliminary screening in block 208 utilizing the internal review engine 108. Block 208 utilizes a higher level of review than block 204, and can analyze the content and compare it to a set of pre-defined submission criteria. Examples of such criteria that would prompt entry rejection include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, the inclusion of content that violates the rules of the particular competition, and the like.
  • Upon successful passing of the vendor preliminary screening in block 208, the content moves on to public availability through communications engine 104, which would enable review and voting on by all members, possible including the content-submitting member, in block 210. During this block, members may flag specific entries for further review, which will be explained in greater detail in connection with FIG. 4. Otherwise, the member may review content which has passed the content submission process 224. Further, members may rate the content in accordance with their own preference. These ratings are used such that content must achieve a certain member rating threshold in order to advance on to block 214, such as being within a specific number or percentage from the top when the content is arranged by numeric ranking, receiving at least a specified minimum of rankings which would indicate member interest, or a weighted combination of any comparison factors (including those discussed above). The term “top ranked” refers to those content entries which have passed this threshold.
  • In one exemplary embodiment, cardmembers may log on to the competition webpage, view a list of all submitted projects, and view a detailed profile of each individual submitted charity idea. Cardmembers may then rate each idea, such as with a 1-5 star rating, where 1 star is least desirable and 5 stars is most desirable. The average star ratings of each project are evaluated in conjunction with the number of total rankings that each submitted project received, such that there is a bias toward projects with significant numbers of ratings over those with an equal average rating but fewer total ratings.
  • In block 214, the top ranked content from block 210 is subjected to a feasibility check for the consequences of the specific content winning the overall competition by internal review engine 108. Any content submissions rejected during this step will be removed from the competition in block 222. The content submissions that are qualified in block 214 will be passed along to block 216, detailed below.
  • Block 214 is iterative because all content passed on from block 210 is not examined at once, but rather several times over the course of the competition. The time the iterative judging process runs is described in terms of a submission period. In an example embodiment of the invention, during submission period 1 the top X ranked content entries are evaluated and either qualified or rejected. During period 2, the top X+Y ranked content entries from periods 1 and 2 are evaluated, with those entries evaluated during period 1 keeping their previously determined qualified or rejected status. These entries are not reevaluated. During period 3, the top X+Y+Z ranked content entries are evaluated from periods 1-3, with those entries evaluated during periods 1 and 2 keeping their previously determined qualified or rejected status. These entries also are not reevaluated. This process continues until the submission periods are over. Thus, the total number of submissions qualified from block 210 is reduced, and the submissions qualified under block 214 are then passed on to block 216.
  • The evaluative criteria used in block 214 can be different from the criteria utilized in block 208. In addition, the iterative review in block 214 can be layered with multiple sets of evaluative criteria, where only content submissions that are qualified under an iterative review using a first set of evaluative criteria are entered into consideration of an iterative review using a second set of evaluative criteria. For instance, the first set of evaluative criteria is used to provide a feasibility check on the foreseeable ability to implement a charity project in the content submission. The second set of evaluative criteria is used to match each charity project with an organization that can effectively implement the described project. After being qualified content qualified in both will be promoted to the next level of the competition. An example round of the iterative content feasibility check can be seen in FIG. 5 and its related discussion.
  • In block 216, the content that is qualified from block 214 is presented to an advisory review engine 110 for evaluation and ranking. Advisory review engine 110 utilizes a set of predefined evaluative criteria to analyze, rate, and narrow down the remaining content submissions through, for example, a conventional scoring of the content. This evaluation may be either automated or manual. Moreover, the evaluative criteria may vary between different embodiments. In an example embodiment advisory review engine 110 is a small committee with high profile members, possibly including such people as celebrities or respected participants in a community relevant to the competition; this allows the competition to receive several benefits, such as increased publicity, respectability, or accuracy in determining which submissions deserve to win the competition.
  • The advisory review engine 110 evaluates and ranks the content submissions that were qualified from block 214 based on predetermined criteria. After receiving the rankings of the advisory review engine 110, the specific content submissions are again separated out by the competition system 100 so that a predetermined number of “top ranking” submissions may be made publicly available by the communications engine 104 and passed along to block 218, with all other submissions being eliminated from the contest in block 222.
  • In block 218, the member community votes on the top ranked content submissions from block 216. The voting may take place in a multitude of fashions through communications engine 104, from clicking on a web page selection button, to sending an SMS text message, to calling a specified phone number, to other similar technologies. The voting also can take place in any number of voting rounds, so that content submissions are narrowed down after the first vote in some fashion and members may vote again on the newly narrowed list of top ranked content submissions, with this repeating until a winner or a group of winners is chosen. Content submissions that win the member vote in block 218 proceed to block 220 as winners of the competition. All other content submissions lose the competition, progressing to block 222. However, any rankings obtained during block 218 of content submissions that progress to block 222 could be utilized in providing tiered awards for the non-winners of the competition (e.g., a second place prize, a finalists' prize, an honorable mention prize, etc.).
  • FIG. 3 is a flowchart illustrating a content submission process 300 method according to an example embodiment of the present invention. In block 302, a registered member submits content from the participant system 102 to the competition system 100 for consideration. Such content can take on many forms, so long as it conveys information and is capable of being parsed by electronic systems. In one exemplary embodiment, such content takes on the form of descriptions of potential community service projects and brief biographies of the member submitting the project.
  • Parsing engine 106 performs a screening of the content in block 304 to rule out any submissions that fail a previously identified set of criteria. Example criteria that qualify an entry for rejection by the automated screening include the use of profanity or other unacceptable words.
  • If the content fails the screening in block 304, the process proceeds to block 306 where the member is notified of the rejection and prompted to resubmit alternate content if they wish to be considered in the competition. The method thus proceeds to block 308, where the member may either resubmit alternate content, taking them back to block 302, or quitting the method altogether.
  • If the content passes the screening in block 304, it proceeds to the screening that takes place in block 310 through the internal review engine 108. Example decision criteria that can be used in block 310 include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, or inclusion of content that violates the rules of the particular competition.
  • If the content fails the screening in block 310, the method will proceed to block 313 wherein an appropriate communication is sent to the participant system 102 through the communications engine 104. Such a process can be automated by having the internal review engine 108 in block 310 specify a rejection type and having that rejection type elicit a pre-determined response which varies by rejection type. For example, if the content is rejected because of the inclusion of a third party reference, the communication in block 313 could read: “Thank you for your contribution. Unfortunately, the project you submitted did not meet our submission criteria. References to third parties—including people, companies, and brands—are not permitted due to Copyright and Trademark concerns. We invite you to revise your entry, which is included below, and try again.” The process would then proceed to block 306, as described above.
  • If the content passes the screening in block 310, in block 316 the internal review engine 108 conducts a rating of content according to pre-established competition criteria.
  • If the internal review engine 108 cannot determine whether the content passes or fails the screening in block 310, the method would pass into block 312, wherein an escalated review of the content could take place by the internal review engine 108. Such a review could be ‘escalated’ as compared to the review in block 310 by, for example, having multiple manual reviewers examine the content or utilizing a different algorithm to review the content.
  • If content is rejected by the escalated review in block 312, the method would proceed to the above described block 313. If the content is accepted by the escalated review in block 312, the method would proceed to the above described block 316. If the escalated review in block 312 still cannot determine whether the content fails to meet the pre-defined criteria, the method would proceed to block 314 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, the reviewers could contact the credit card issuer sponsoring the community project competition for their decision on the content. After block 314, the method proceeds to block 326 where it stops.
  • Once the method has progressed to block 316 and has been rated according to program criteria, the method moves on to block 318, wherein the approved content is displayed publicly through communications engine 104. Next the method moves on to block 320, wherein an appropriate communication is sent to the participant system 102 through the communications engine 104. Both Steps 318 and 320 can be automated to increase efficiency, although automation is not required.
  • In block 322 the content is made available for perusal, comment, and rating (and possible flagging for review as described below in more detail with respect to FIG. 4) by any member through communications engine 104. After block 322, the method proceeds to block 324, wherein a submission is considered complete.
  • FIG. 4 is a flowchart illustrating a process 400 for providing a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention. After the content has been submitted (described above with respect to FIG. 3), it is available through the communications engine 104 for members to view and comment on. If a member believes that a specific content has been accepted into submission in violation of the rules, they may contact the communications engine 104 as provided in block 402 to initiate a review of the content.
  • After the member has initiated the report in block 402, the content in question is automatically appended to the report or otherwise displayed in block 404 so as to be capable of review by the internal review engine 108. Following block 404, the report with the appended or otherwise displayed content submission is communicated to the internal review engine 108 in block 406 to again judge the submission against a set of pre-defined contest eligibility criteria, which may or may not be the same as utilized in block 310 in FIG. 3 as described above.
  • If the decision in block 406 is to reject the submitted content as a violation of the pre-defined contest eligibility criteria utilized in block 406, then the process proceeds to block 410 wherein the submitted content is removed from the list of accepted submissions and the public listing of such submissions as accessible through the communications engine 104. Next, the process proceeds to block 412, wherein a communication is sent through the communications engine 104 both to the member who reported a problem with the content in question and the member who submitted the content in question. Both blocks 410 and 412 can be automated so as to increase efficiency, yet this is not required. Next, the process proceeds to block 414, where the submitting member is prompted through the communications engine 104 to submit other content into the contest if so desired. The method then progresses to block 416, where the user reported violation portion ends.
  • If the decision in block 406 is to accept the submitted content as in accord with the pre-defined contest eligibility criteria utilized in block 406, then the process proceeds to block 420, where a message is sent to the reporting member through the communications engine 104 indicating that the content has been reviewed but still deemed acceptable. Following block 420, the process proceeds to block 422 where the user reported violation portion ends. Both blocks 420 and 422 could be automated to increase efficiency, but this is not required.
  • If the internal review engine 108 in block 406 is unable to determine if the submitted content is in violation of the pre-defined contest eligibility criteria utilized in block 406, the process progresses to block 408 where an escalated review of the content by the internal review engine 108 takes place. Such a review could be ‘escalated’ in comparison to the review in block 406 by having, for instance, multiple reviewers examine the content, a different algorithm examine the content, or a reviewer higher up within the organization examine the content.
  • If the escalated review in block 408 results in rejection of the content, the process proceeds to block 410 as described above. If the escalated review in block 408 results in the acceptance of the content, the process proceeds to block 420, as described above.
  • If the escalated review in block 408 cannot determine whether the content submission should be accepted or rejected, the process proceeds to block 418 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, in the charity project competition, the internal review engine 108 contacts the card issuer for their decision on the content. After block 418, the method proceeds to block 424 where it stops.
  • FIG. 5 is a flowchart illustrating a process 500 providing elimination decision flow during one period of an iterative judging step in the internal review engine according to an example of the present invention. Here, the review period consists of a week, and the second review period 500 is depicted.
  • In block 502, the top ranked content submissions from the preliminary member rankings are selected for review. These top ranked submissions may include submissions that have been submitted during any submission period to date, in this case within week 1 or week 2, even if the submissions were qualified or disqualified in week 1. In block 504, the submissions that were reviewed in the previous submission period, week 1, are removed from consideration during this period and keep their qualified or rejected status assigned to them in week 1. In block 506, the remaining non-evaluated projects are assigned to individual reviewers within the internal review engine 108. In block 508, those individual reviewers will compare each project against a set of predefined criteria, such as in this embodiment where the criteria are the feasibility of enacting the suggested charity project detailed in the content submission. In block 510, the individual reviewers must decide whether to accept, reject, or further examine a content submission.
  • If the individual reviewer in block 510 decides to accept the content submission as in conformance with their evaluation criteria, the process proceeds to block 512, where the content submission is added to a “qualified list”, which is maintained in block 518. This qualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already qualified ideas.
  • If the individual reviewer in block 510 decides to reject the content submission as not in conformance with their evaluation criteria, the process proceeds to block 516, where the content submission is added to a “disqualified list”, which is maintained in block 520. This disqualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already disqualified ideas, even if they still rank in the top specified portion of rated content submissions for that particular review period.
  • After blocks 518 and 520, the method proceeds to block 522. If this is not the last submission period, the method will return to block 502 where it will re-commence during the next submission period. If this is the last submission period and there are no more iterations to proceed through, the method proceeds to block 524 where it stops and the qualified list functions as the list of content submissions that have passed through this iterative screening.
  • If the individual reviewer in block 510 is unable to determine with sufficient certainty whether the content submission satisfied the predetermined evaluation criteria, they may defer the content submission to an escalated review in block 514. In the present embodiment, the escalated review is a panel made up of all of the individual reviewers who were assigned content submissions in block 506, but this could also possibly include other reviewers, different reviewing algorithms, utilizing different evaluative criteria, etc. Determination of acceptance of the content submission will lead to block 512, described above, and determination of rejection of the content submission will lead to block 516, also described above.
  • The present invention (i.e., systems 100, 102, engines 104, 106, 108, 110, or any part(s) or function(s) thereof) may be implemented using hardware, software or a combination thereof and may be implemented in one or more computer systems or other processing systems. However, the manipulations performed by the present invention were often referred to in terms, such as reviewing, screening, or flagging, which are commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein which form part of the present invention. Rather, the operations are machine operations. Useful machines for performing the operation of the present invention include general purpose digital computers or similar devices.
  • In fact, in one embodiment, the invention is directed toward one or more computer systems capable of carrying out the functionality described herein. An example of a computer system 600 is shown in FIG. 6.
  • The computer system 600 includes one or more processors, such as processor 604. The processor 604 is connected to a communication infrastructure 606 (e.g., a communications bus, cross-over bar, or network). Various software embodiments are described in terms of this exemplary computer system. After reading this description, it will become apparent to a person skilled in the relevant art(s) how to implement the invention using other computer systems and/or architectures.
  • Computer system 600 can include a display interface 602 that forwards graphics, text, and other data from the communication infrastructure 606 (or from a frame buffer not shown) for display on the display unit 630.
  • Computer system 600 also includes a main memory 608, preferably random access memory (RAM), and may also include a secondary memory 610. The secondary memory 610 may include, for example, a hard disk drive 612 and/or a removable storage drive 614, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. The removable storage drive 614 reads from and/or writes to a removable storage unit 618 in a well known manner. Removable storage unit 618 represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive 614. As will be appreciated, the removable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data.
  • In alternative embodiments, secondary memory 610 may include other similar devices for allowing computer programs or other instructions to be loaded into computer system 600. Such devices may include, for example, a removable storage unit 622 and an interface 620. Examples of such may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an erasable programmable read only memory (EPROM), or programmable read only memory (PROM)) and associated socket, and other removable storage units 622 and interfaces 620, which allow software and data to be transferred from the removable storage unit 622 to computer system 600.
  • Computer system 600 may also include a communications interface 624. Communications interface 624 allows software and data to be transferred between computer system 600 and external devices. Examples of communications interface 624 may include a modem, a network interface (such as an Ethernet card), a communications port, a Personal Computer Memory Card International Association (PCMCIA) slot and card, etc. Software and data transferred via communications interface 624 are in the form of signals 628 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 624. These signals 628 are provided to communications interface 624 via a communications path (e.g., channel) 626. This channel 626 carries signals 628 and may be implemented using wire or cable, fiber optics, a telephone line, a cellular link, a radio frequency (RF) link and other communications channels.
  • In this document, the terms “computer program medium” and “computer usable medium” are used to generally refer to media such as removable storage drive 614, a hard disk installed in hard disk drive 612, and signals 628. These computer program products provide software to computer system 600. The invention is directed to such computer program products.
  • Computer programs (also referred to as computer control logic) are stored in main memory 608 and/or secondary memory 610. Computer programs may also be received via communications interface 624. Such computer programs, when executed, enable the computer system 600 to perform the features of the present invention, as discussed herein. In particular, the computer programs, when executed, enable the processor 604 to perform the features of the present invention. Accordingly, such computer programs represent controllers of the computer system 600.
  • In an embodiment where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system 600 using removable storage drive 614, hard drive 612 or communications interface 624. The control logic (software), when executed by the processor 604, causes the processor 604 to perform the functions of the invention as described herein.
  • In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of the hardware state machine so as to perform the functions described herein will be apparent to persons skilled in the relevant art(s).
  • In yet another embodiment, the invention is implemented using a combination of both hardware and software.
  • While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art(s) that various changes in form and detail can be made therein without departing from the spirit and scope of the present invention. Thus, the present invention should not be limited by any of the above described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
  • In addition, it should be understood that the FIGS. 1-6, which highlight the functionality and advantages of the present invention, are presented for example purposes only. The architecture of the present invention is sufficiently flexible and configurable, such that it may be utilized (and navigated) in ways other than that shown in the accompanying figures.
  • Further, the purpose of the foregoing Abstract is to enable the U.S. Patent and Trademark Office and the public generally, and especially the scientists, engineers and practitioners in the art who are not familiar with patent or legal terms or phraseology, to determine quickly from a cursory inspection the nature and essence of the technical disclosure of the application. The Abstract is not intended to be limiting as to the scope of the present invention in any way. It is also to be understood that the blocks and procedures recited in the claims need not be performed in the order presented.

Claims (21)

1. A method for running a multi-stage online elimination competition comprising the steps of:
receiving via a communications engine a plurality of content submissions submitted by members;
screening the plurality of content submissions against a first set of predefined criteria;
creating a first subset of content submissions from the plurality of content submissions that did not fail the screening;
generating at least one of a rating of the first subset of content submissions and a request for re-screening of the plurality of content submissions contained in the first subset of content submissions based on an evaluation of the first subset of content submissions by members;
evaluating iteratively the first subset of content submissions utilizing the ratings by members and a second set of predefined criteria, and removing one or more of the plurality of content submissions, resulting in a second subset of content submissions;
evaluating of the second subset of content submissions by an advisory committee utilizing a third set of predefined criteria and removing one or more of the plurality of content submissions resulting in a third subset of content submissions, with said advisory committee comprising committee components selected by a competition sponsor; and
evaluating and voting on the third subset of content submissions by members.
2. The method of claim 1, wherein a plurality of said content submissions are combined into a single content submission based on a fourth set of predefined criteria.
3. The method of claim 1, wherein said members are the subset of potential users that have registered with the provider of said competition.
4. The method of claim 1, wherein said screening includes screening for at least one of profane and offensive content.
5. The method of claim 1, wherein said screening is performed at least in part using a text-matching parsing algorithm.
6. The method of claim 1, wherein said second set of predefined criteria includes screening for the feasibility of implementing a particular content submission.
7. The method of claim 1, wherein said content submission includes a proposed charity sponsorship and a profile of the plurality of submitting members.
8. The method of claim 1, wherein said third set of predefined criteria includes a personal preference based score.
9. The method of claim 1, wherein said evaluating and voting on the third subset of content submissions by members occurs in a plurality of elimination rounds.
10. The method of claim 1, wherein said evaluating is biased in favor of content submissions that receive quantitatively more member ratings over content submissions that receive an equivalent average rating.
11. A system for running a multi-stage online elimination competition, the system, comprising:
a communications engine configured to receive a plurality of content submissions submitted by members;
a parsing engine configured to screen the plurality of content submissions against a first set of predefined criteria;
an internal review engine configured to:
create a first subset of content submissions from the plurality of content submissions that did not fail the screening,
generate at least one of a rating of the first subset of content submissions and a request for re-screening of the plurality of content submissions contained in the first subset of content submissions based on an evaluation of the first subset of content submissions by members, and
evaluate iteratively the first subset of content submissions utilizing the ratings by members and a second set of predefined criteria, and removing one or more of the plurality of content submissions, resulting in a second subset of content submissions; and
an advisory review engine configured to evaluate the second subset of content submissions by an advisory committee utilizing a third set of predefined criteria and removing one or more of the plurality of content submissions resulting in a third subset of content submissions, with said advisory committee comprising committee components selected by a competition sponsor and evaluate and vote on the third subset of content submissions by members.
12. The system of claim 11, wherein one or more of the plurality of said content submissions are combined into a single content submission based on a fourth set of predefined criteria.
13. The system of claim 11, wherein said members are the subset of potential users that have registered with the provider of said competition.
14. The system of claim 11, wherein said first set of predefined criteria includes screening for at least one of profane and offensive content.
15. The system of claim 11, wherein said screening module is configured to parse text based on a text-matching parsing algorithm.
16. The system of claim 11, wherein said second set of predefined criteria includes screening for the feasibility of implementing a particular content submission.
17. The system of claim 11, wherein said content submission includes an idea to sponsor a particular charity project or organization and a profile of the plurality of submitting members.
18. The system of claim 11, wherein said third set of predefined criteria includes a personal preference based scoring.
19. The system of claim 11, wherein said module to evaluate and vote on the third subset of content submissions by members occurs in a plurality of elimination rounds.
20. The system of claim 11, wherein said evaluating iteratively the first subset of content submissions utilizing the ratings by members is biased in favor of content submissions that receive quantitatively more member ratings over content submissions that receive an equivalent average rating.
21. A computer-readable medium having stored thereon sequences of instructions, the sequences of instructions including instructions which when executed by a computer system causes the computer system to perform:
receiving via a communications engine a plurality of content submissions submitted by members;
screening the plurality of content submissions against a first set of predefined criteria;
creating a first subset of content submissions from the plurality of content submissions that did not fail the screening;
generating at least one of a rating of the first subset of content submissions and a request for re-screening of the plurality of content submissions contained in the first subset of content submissions based on an evaluation of the first subset of content submissions by members;
evaluating iteratively the first subset of content submissions utilizing the ratings by members and a second set of predefined criteria, and removing a plurality of content submissions, resulting in a second subset of content submissions;
evaluating of the second subset of content submissions by an advisory committee utilizing a third set of predefined criteria and resulting in a third subset of content submissions, with said advisory committee comprising committee components selected by a competition sponsor; and
evaluating and voting on the third subset of content submissions by members.
US12/060,327 2007-04-03 2008-04-01 Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content Abandoned US20080248873A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/US2008/058995 WO2008124385A1 (en) 2007-04-03 2008-04-01 Methods for running a multi-stage online elimination competition based on member generated content
US12/060,327 US20080248873A1 (en) 2007-04-03 2008-04-01 Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US90974507P 2007-04-03 2007-04-03
US12/060,327 US20080248873A1 (en) 2007-04-03 2008-04-01 Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content

Publications (1)

Publication Number Publication Date
US20080248873A1 true US20080248873A1 (en) 2008-10-09

Family

ID=39827433

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/060,327 Abandoned US20080248873A1 (en) 2007-04-03 2008-04-01 Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content

Country Status (2)

Country Link
US (1) US20080248873A1 (en)
WO (1) WO2008124385A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100075762A1 (en) * 2008-09-24 2010-03-25 Incredible Technologies Segmented Memory Control System for Gaming Devices
US20100121650A1 (en) * 2009-06-19 2010-05-13 Hughes John M System and method for content development
US8663017B1 (en) * 2013-03-15 2014-03-04 International Awards Group, LLC Matrix judging systems and methods
US9707474B1 (en) 2015-01-09 2017-07-18 TwoTube, LLC Group-judged multimedia competition
CN108475400A (en) * 2015-10-26 2018-08-31 美莱纽恩株式会社 Competition method and device on line
US10124261B1 (en) 2015-01-09 2018-11-13 TwoTube, LLC Group-judged multimedia competition
US20210342408A1 (en) * 2020-05-04 2021-11-04 Big Idea Lab, Inc. Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects
US11235224B1 (en) * 2020-11-30 2022-02-01 International Business Machines Corporation Detecting and removing bias in subjective judging

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9720901B2 (en) 2015-11-19 2017-08-01 King Abdulaziz City For Science And Technology Automated text-evaluation of user generated text

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030033161A1 (en) * 2001-04-24 2003-02-13 Walker Jay S. Method and apparatus for generating and marketing supplemental information
US20030195795A1 (en) * 2000-01-12 2003-10-16 Chacker Aaron R. Method and system for an online talent business
US20040225569A1 (en) * 2000-03-28 2004-11-11 Renee Bunnell Method and system for creating a multi-tiered, e-commerce extranet for a community of businesses
US20060252547A1 (en) * 2000-05-01 2006-11-09 Invoke Solutions, Inc. Large Group Interactions
US7162433B1 (en) * 2000-10-24 2007-01-09 Opusone Corp. System and method for interactive contests
US20070162951A1 (en) * 2000-04-28 2007-07-12 Rashkovskiy Oleg B Providing content interruptions
US20070282874A1 (en) * 2003-08-19 2007-12-06 Rapid Intelligence Pty Ltd. Content System
US7308413B1 (en) * 1999-05-05 2007-12-11 Tota Michael J Process for creating media content based upon submissions received on an electronic multi-media exchange
US20090177519A1 (en) * 1999-05-05 2009-07-09 Tota Michael J Process for creating media content based upon submissions received on an electronic multi-media exchange
US7596598B2 (en) * 2005-10-21 2009-09-29 Birthday Alarm, Llc Multi-media tool for creating and transmitting artistic works

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7308413B1 (en) * 1999-05-05 2007-12-11 Tota Michael J Process for creating media content based upon submissions received on an electronic multi-media exchange
US8090605B2 (en) * 1999-05-05 2012-01-03 Virtual Creative Artists, LLC Process for creating media content based upon submissions received on an electronic multi-media exchange
US20090177519A1 (en) * 1999-05-05 2009-07-09 Tota Michael J Process for creating media content based upon submissions received on an electronic multi-media exchange
US20030195795A1 (en) * 2000-01-12 2003-10-16 Chacker Aaron R. Method and system for an online talent business
US20040225569A1 (en) * 2000-03-28 2004-11-11 Renee Bunnell Method and system for creating a multi-tiered, e-commerce extranet for a community of businesses
US20090304358A1 (en) * 2000-04-28 2009-12-10 Rashkovskiy Oleg B Providing Content Interruptions
US20070162951A1 (en) * 2000-04-28 2007-07-12 Rashkovskiy Oleg B Providing content interruptions
US20060252547A1 (en) * 2000-05-01 2006-11-09 Invoke Solutions, Inc. Large Group Interactions
US20090024457A1 (en) * 2000-10-24 2009-01-22 Iman Foroutan System and method for interactive contests
US7162433B1 (en) * 2000-10-24 2007-01-09 Opusone Corp. System and method for interactive contests
US20030033161A1 (en) * 2001-04-24 2003-02-13 Walker Jay S. Method and apparatus for generating and marketing supplemental information
US20070282874A1 (en) * 2003-08-19 2007-12-06 Rapid Intelligence Pty Ltd. Content System
US7596598B2 (en) * 2005-10-21 2009-09-29 Birthday Alarm, Llc Multi-media tool for creating and transmitting artistic works

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100075762A1 (en) * 2008-09-24 2010-03-25 Incredible Technologies Segmented Memory Control System for Gaming Devices
US20100121650A1 (en) * 2009-06-19 2010-05-13 Hughes John M System and method for content development
US8663017B1 (en) * 2013-03-15 2014-03-04 International Awards Group, LLC Matrix judging systems and methods
US9707474B1 (en) 2015-01-09 2017-07-18 TwoTube, LLC Group-judged multimedia competition
US10124261B1 (en) 2015-01-09 2018-11-13 TwoTube, LLC Group-judged multimedia competition
CN108475400A (en) * 2015-10-26 2018-08-31 美莱纽恩株式会社 Competition method and device on line
US20210342408A1 (en) * 2020-05-04 2021-11-04 Big Idea Lab, Inc. Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects
US11748439B2 (en) * 2020-05-04 2023-09-05 Big Idea Lab, Inc. Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects
US11235224B1 (en) * 2020-11-30 2022-02-01 International Business Machines Corporation Detecting and removing bias in subjective judging

Also Published As

Publication number Publication date
WO2008124385A1 (en) 2008-10-16

Similar Documents

Publication Publication Date Title
US20080248873A1 (en) Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content
US20220036480A1 (en) Synchronous and asynchronous electronic voting terminal system and network
Casas-Arce et al. Women and power: unpopular, unwilling, or held back?
US20160294753A1 (en) System and Method for Implementing an Integrity-Based Social Network Filtering System and Related Environment
Maestas et al. Shifting the blame: Federalism, media, and public assignment of blame following Hurricane Katrina
Steunenberg et al. The transposition of European law in EU member states: between process and politics
Cass et al. Preserving Competition: Economic Analysis, Legal Standards and Microsoft
US10592596B2 (en) Techniques for providing a narrative summary for fantasy games
Deck et al. On the robustness of higher order risk preferences
Vaz de Melo et al. Forecasting in the NBA and other team sports: Network effects in action
Lee Executive capacity to control legislatures and presidential choice of cabinet ministers in East Asian democracies
Weld et al. Making Online Communities' Better': A Taxonomy of Community Values on Reddit
Daaji et al. Multi-criteria web services selection: Balancing the quality of design and quality of service
CN110059850A (en) Exam pool optimization method and device calculates equipment and computer readable storage medium
JP2006268304A (en) Contributed data evaluation device
Leung How do one's peers on a leaderboard affect oneself?
CN107045685A (en) A kind of network authorization operating method and device
US20140200969A1 (en) Rating items
Haan Facebook's Alternative Facts
López et al. Analysis of local online review systems as digital word-of-mouth
Collins Is the sum greater than its parts? Circuit court composition and judicial behavior in the courts of appeals
Risch Procedural Posture and Social Choice
Zhang et al. Social Media Moderations, User Ban, and Content Generation: Evidence from Zhihu
Pagnozzi et al. Multi-object auctions with resale: An experimental analysis
Provost Antitrust law and distributive politics in the American states

Legal Events

Date Code Title Description
AS Assignment

Owner name: AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY,

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LANG, BELINDA;REEL/FRAME:020734/0482

Effective date: 20080331

AS Assignment

Owner name: III HOLDINGS 1, LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC.;REEL/FRAME:032722/0746

Effective date: 20140324

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: LIBERTY PEAK VENTURES, LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:III HOLDINGS 1, LLC;REEL/FRAME:045660/0060

Effective date: 20180315