WO2002003239A1 - Apparatus and method for selecting and automating data entry in electronic forms - Google Patents

Apparatus and method for selecting and automating data entry in electronic forms Download PDF

Info

Publication number
WO2002003239A1
WO2002003239A1 PCT/US2001/040084 US0140084W WO0203239A1 WO 2002003239 A1 WO2002003239 A1 WO 2002003239A1 US 0140084 W US0140084 W US 0140084W WO 0203239 A1 WO0203239 A1 WO 0203239A1
Authority
WO
WIPO (PCT)
Prior art keywords
field
region
instructions
dialog box
selection
Prior art date
Application number
PCT/US2001/040084
Other languages
French (fr)
Inventor
Anthony Gary Martin
Original Assignee
The Gator Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Gator Corporation filed Critical The Gator Corporation
Priority to EP01927355A priority Critical patent/EP1295218A1/en
Priority to CA002382884A priority patent/CA2382884A1/en
Priority to AU2001253815A priority patent/AU2001253815A1/en
Priority to JP2002507241A priority patent/JP2004502257A/en
Publication of WO2002003239A1 publication Critical patent/WO2002003239A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/174Form filling; Merging

Definitions

  • the invention generally relates to presenting data for selection, and automating entry of selected data into electronic forms, and more particularly to presenting a dialog box containing hot-spots for selecting data according to associated insertion formats, where selected data can be inserted into a form according to an associated insertion format.
  • HTML hypertext markup language
  • Java JavaScript
  • Visual Basic etc.
  • some Internet browsers such as Microsoft Internet Explorer 5
  • Microsoft Internet Explorer 5 maintain a history list of answers a user has stored in a form.
  • the browser prompts the user with a list of possible completions to the form's field.
  • this technique facilitates data entry, it does not provide any centralized location for the inspection and entry of data into the form.
  • this method fails to remove the tedium incident to addressing every field entry for which a value is to be inserted. That is, each field needs to be clicked upon or typed in to trigger data entry.
  • the list of entries can be very long as it includes every entry ever entered into that form's field. And, there is no central location containing a single set of current user data that is to be entered into the form. And, there is no opportunity to select only a portion of a previously recorded entry.
  • a form is received.
  • a dialog box is displayed containing dialog entries that are inserted into the form according to insertion formats associated with the dialog entries.
  • a particular insertion format for a dialog entry is selected by a user activating a "hotspot", button, or other selection region associated with a dialog entry. Insertion formats are configured to insert an entire entry or just a portion thereof into a form.
  • a dialog box has an entry containing a text string, and it is desired to either select the entire string, or just a portion thereof, such as for entry into an electronic form.
  • a first selection region is defined proximate the text string such that its selection (e.g., by clicking on or simply hovering a pointer over the selection region) causes the entire string to be highlighted.
  • Second, third, etc. selection regions can be defined with respect to portions of the string, such as for individual words, where selection causes the portions (e.g., words) of the string to be high-lighted.
  • hovering a pointer over a selection region causes the region's associated data to be highlighted, and clicking on a selection region causes its associated data to be inserted into an electronic form.
  • FIG. 1 illustrates an overview of one embodiment for data entry.
  • FIGS. 2 illustrates a user interface according to one embodiment of the invention.
  • FIGS. 3 illustrate selection regions and associated visual cues indicating insertion format controlling transfer of a helper dialog entry to a form.
  • FIG. 4 illustrates a suitable computing environment in which certain aspects of the claimed invention may be practiced.
  • FIG. 1 illustrates an overview of one embodiment for data entry, such as receiving and filling out an electronic form.
  • form is intended to include registration forms, login forms, and other structures / data structures having entries to be filled out by a recipient of the data structure.
  • a first operation 100 is to monitor for receipt of a form. It is assumed that receipt of a form triggers the invention, however, it will be appreciated that other environments may benefit from using the invention as well, such as aiding answering queries posed by application programs. It is further assumed a network browser, such as Internet Explorer, is receiving and processing data defining the form, however, other applications may also be used.
  • a form is recognized by scanning received browser data for a form's definition.
  • HTML Hypertext Markup Language
  • form identification is simply a matter of watching for a ⁇ FORM> tag definition.
  • forms may also be defined through other constructions, such as by way of compiled Java programs, JavaScript, active server pages (ASP), etc. It may also be necessary to inspect binary data to identify form definitions.
  • the browser provides internal hooks for identifying whether received network data contains a form definition.
  • a test is performed at 104 to determine if a helper dialog box (containing entries to insert into a form) is already visible.
  • the dialog box is expected to remain on the display as one navigates or browses to different network locations. If the dialog is not already visible, then the dialog box is popped up 106 onto the user's display. Once the helper dialog box is displayed, one has opportunity to update information stored within the helper dialog box (see FIGS. 2).
  • popping up the dialog box may also be' manually triggered if a form is not automatically recognized when monitoring 100 the network.
  • a service or background executing program can wait 108 for manual requests to pop up the dialog box. If at 110 a manual trigger is received, then the helper dialog is popped-up.
  • a Microsoft Windows operating system Tray Icon service is used, where displaying the dialog box is triggered by generating a click event for the tray icon, e.g., by using a mouse or other pointing device to click on the tray icon, or by causing a click event to be generated for the icon.
  • keyboard activity is monitored for pressing of a certain control sequence to trigger display of the dialog box.
  • a test may be performed at 112 to determine if an automatic mode should be used to fill out the form.
  • Automatic mode means that an attempt is made by the helper system to fill the form's fields with data the form is received. If in automatic mode, a test is performed at 114 to determine if the current form is being viewed for the first time. If so, a user is required to fill out the form, either conventionally by typing directly into the form, or as discussed below, and the helper system monitors 116 the entries to learn insertion values for subsequent display of the form.
  • the source location or address of a form can be tracked and associated with monitored values 116 so that only values for a particular form origin are available for insertion into the form.
  • Source tracking can also be used when it is known certain forms require a particular entry format, e.g., first-name first or last-name first for a "name" form field.
  • dialog entries are displayed 106
  • the system waits for a user to select dialog entries to transfer to the form. It is assumed selection is controlled by way of a mouse or equivalent input device, where one activates, by way of clicks, drags, etc. a selection region to cause insertion of a dialog entry or sub- portion thereof into the form. Insertion is made according to an insertion format associated with the activated selection region. Selection regions can be defined as image hotspots, buttons, switches, toggles, etc. within the helper dialog, or as provided below, within a dialog entry.
  • each dialog entry can have multiple associated selection regions, so that the same dialog entry may be highlighted and inserted into a form, where the highlighting indicates what portion of the entry will be inserted.
  • selection regions are automatically defined for each word in multiple-word strings.
  • insertion format refers to what portion of a data entry that will be inserted into a form, where highlighting an entry provides a cue, before transferring a dialog entry to a form, of the portion of the dialog entry to be inserted into the form.
  • highlighting is intended to include other methods for calling attention to different formats for inserting a dialog box entry, such as generating a visual cue, an audio cue, or both, or taking some other action as needed or desired by visually or physically impaired individuals.
  • a next operation is to monitor 120 a location of a selection tool, e.g., a mouse pointer or other device used to perform selections.
  • a selection tool e.g., a mouse pointer or other device used to perform selections.
  • non-mouse selection tools such as those utilized by visually impaired or physically impaired individuals, may also be utilized to select dialog entries. If at 122 the selection tool 304 (FIGS. 3) is near a selection region 300 (FIGS. 3) for a dialog entry, the dialog entry is highlighted 124 according to the insertion format for the selection region.
  • selection regions are automatically defined for each word in multiple-word strings.
  • the appropriate dialog entry or portion thereof is inserted 128 into the form according to the insertion format associated with the activated selection region.
  • dialog box contents associated with a selection region can be dragged and then dropped onto the form. Dropping may be made on the form generally, or within a particular form field. It is understood that "drag and drop” generally means a selection region is clicked on with a mouse (or a mouse button- down event or equivalent generated for the selection region), and without releasing the mouse button (or receiving a mouse button-up event), the clicked-on selection region is dragged to the form, or to a particular field in the form. The mouse button is then released, causing transfer of the contents of the selection region for the dialog entry to the form according to the insertion format for the dragged and dropped selection region.
  • a selection region for a dialog entry can be double-clicked to cause activation of the region and insertion of dialog entry data to the form according to the insertion format associated with an activated selection region. It will be appreciated that other activation techniques, such as shift-single-click, voice- selected, or some other activation combination depending on user interface considerations, may be used to initiate transfer to the form.
  • a field of the form currently having insertion focus receives the dialog entry according to the insertion format. If no form field currently has insertion focus, then a default field is chosen. In one embodiment, the default field is the first field defined for the form. In another embodiment, the data defining the form is inspected to determine whether a default first field is identified within the form's definition.
  • next-field command is typically a tab character, which is transmitted to the form and interpreted by the form to cause movement of the insertion focus.
  • a different character or control sequence may be required depending on how the form is encoded and the environment displaying the form.
  • a default field for insertion may be determined in a number of other ways, including matching dialog entries with form definitions. For example, if the dialog entry is known to contain a name, then the form can be searched for field tags corresponding to a name. Such searching will facilitated by encoding the form in the Extensible Markup Language (XML), or equivalent languages that associate semantic meaning with form field definitions.
  • XML Extensible Markup Language
  • FIGS. 2 provide for a user interface according to one embodiment of the invention.
  • the user interface for storing typical user information to be inserted into a form.
  • FIGS.2 illustrate a "My Info - Update" dialog box 200.
  • This dialog box is broken into two general sections 202, 204, corresponding to contact information 202 and user credit card information 204. As discussed above, the contents of these sections are used to fill out electronic forms. As illustrated, different interface sections are selected by clicking on a tab for an area of interest.
  • contact information includes field entries for one's name 206, Email address 208, telephone number 210, facsimile number 212, and mailing address 214.
  • the billing information 204 includes entries for a credit card category 216 (e.g., work card, personal card, etc.), card type 218 (e.g., Visa, MasterCard, Discover, etc.), name on card 220, card number 222, expiration information 224, and billing address reference 226.
  • the FIG. 2A contact information 202 includes selectable address radio buttons 228 (or equivalent) for designating different contact addresses, e.g., home, work, other.
  • the FIG. 2B credit card information 204 configures the billing address reference 226 as a selectable drop down list corresponding to the radio button 228 definitions. As illustrated, a card category 216 of personal is selected, and a home address used as the billing address reference 226. Selecting a personal card category automatically causes the home address to be selected as the billing address.
  • dialog entries are filled out.
  • FIGS. 3 illustrate the above-described multi-word text string example. As discussed above for FIG. 1, the illustrated dialogs appear when manually invoked by a user or automatically on detection of an electronic form.
  • FIG. 3 A illustrates a first selection region 300 (a darker box) adjacent a name field 302.
  • moving a selection tool 304 over e.g., "hovering" the first selection region causes the entire dialog entry to be highlighted. This visually cues a user that the entire dialog entry field is selected and will be transferred to a form if the first selection region is then activated.
  • a selection tool 304 over e.g., "hovering”
  • FIG. 3B illustrates a second selection region 306 that has been defined as the first word of the name string in the name field 302.
  • moving a selection tool over the second selection region 306 causes the region to be highlighted. This visually cues a user that only the contents of the region will be transferred to a form, in this case, the first name Arthur.
  • the second selection region can be clicked on and then dragged and. dropped into the form.
  • differently configured dialog boxes are presented for different electronic forms, so that dialog boxes may be tailored to different types of forms.
  • a form may be designed to receive non-text data, such as graphics files, databases, and other non-text data.
  • a dialog (not shown) may be configured with entries corresponding to such non-text data that may be fully or partially selected and inserted into the form.
  • a dialog entry contains a graphics image.
  • Selection regions can be defined for the image such that it is sub-divided into different sections (like an "image map" in a web browser context), where selecting one of the image's selection regions causes that selected portion of the image to be inserted into the form-
  • OLE Object Linking and Embedding
  • Microsoft ActiveX controls are used to select and manipulate the dialog box image, and then transfer appropriate image data to corresponding OLE or ActiveX controls within the form.
  • two radio buttons 308, 310 are provided to control whether a particular user's data is being updated 308 or entered into a form 310.
  • the dialog's selection regions are deactivated so that the dialog entries may be revised without inadvertent entry into a form.
  • FIG. 4 illustrates a suitable computing environment in which certain aspects of the claimed invention may be practiced.
  • the figure and following discussion are intended to provide a brief, general description of a suitable computing environment in which portions of the invention may be implemented.
  • the invention may be described by reference to different high-level program modules and/or low-level hardware contexts. Those skilled in the art will realize that program module references can be interchanged with low-level instructions. .
  • Program modules include procedures, functions, programs, components, data structures, and the like, that perform particular tasks or implement particular abstract data types.
  • the modules may be incorporated into single and multi-processor computing devices, as well as hand-held devices and controllable consumer devices (e.g., Personal Digital Assistants (PDAs), cellular telephones, etc.). It is understood that modules may be implemented on a single computing device, or processed over a distributed network environment, where modules can be located in both local and remote memory storage devices.
  • An exemplary system for implementing the client computing devices discussed above includes a computing device 402 having system bus 404 for coupling together various components within the computing device.
  • the system bus 404 may be any of several types of bus structures, such as PCI, AGP, VESA, ISA, etc.
  • processors 406 such as those by Intel, programmable gate arrays, and the like, volatile and non- volatile memory 408 such as RAM, ROM, NVRAM, etc., storage devices 410, a video interface 412 for presenting output to an output device such as a cathode ray tube (CRT) monitor, display panel, projector, etc., input/output interface ports 414 for communicating with devices, and a network interface 420.
  • CTR cathode ray tube
  • Storage devices include computer-readable media such as hard-drives, floppy-disks, optical storage, magnetic cassettes, tapes, flash memory cards, memory sticks, digital video disks, biological-based storage, and the like, and may communicate with system bus 404 through a physical and/or logical interface 426.
  • Program modules such as for a web browser configured to display a form, can be stored within the memory 408, storage devices 410, or implemented as an ASIC.
  • Computing device 402 may be a computer, or other device such as a router, switch, telephone, radio, household appliance, etc. Computing device 402 may operate in a networked 424 environment using logical connections to one or more remote computing devices 416, 418. Remote computing devices can be configured as having some or all of the features of computing device 402. A modem 422 may be used to form network connections. If we assume a viewpoint of the invention as being implemented in computing device 402, then remote computing devices 416, 418 include remote network servers and other devices utilizing network application protocols such as HTTP (e.g., web servers), File Transfer Protocol (FTP), Gopher, Wide Area Information Server (WAIS), and the like to deliver forms to the invention.
  • HTTP e.g., web servers
  • FTP File Transfer Protocol
  • WAIS Wide Area Information Server
  • computing devices 402, 416, 418 may be embodied as single devices, or as a combination of separate components. Having described and illustrated the principles of the invention with reference to illustrated embodiments, it will be recognized that the illustrated embodiments can be modified in arrangement and detail without departing from such principles. For example, while the foregoing description focused ⁇ for expository convenience - on filling out forms, it will be recognized that the same techniques for defining selection regions and visually cueing impending data transfers can be applied to other transaction environments.

Abstract

Display of a dialog box (or dialog boxes) containing selectable data such as dialog entries containing text or graphics images. In one embodiment, regions (300, 306) are associated with dialog entries (302), where activation of a region (300, 306) causes a portion of a dialog entry (306), or the entire dialog entry (302), to be selected depending on the characteristics of the activated region. In one embodiment, when an electronic form is received, the dialog box can be automatically or manually displayed. In this embodiment, activation of a region (300, 306) within a displayed dialog box causes the selected portion of a dialog entry (302, 306) from the activation to be inserted into the form according to various insertion techniques.

Description

Apparatus And Method For Selecting And Automating Data Entry In Electronic Forms
Field of the Invention
The invention generally relates to presenting data for selection, and automating entry of selected data into electronic forms, and more particularly to presenting a dialog box containing hot-spots for selecting data according to associated insertion formats, where selected data can be inserted into a form according to an associated insertion format.
Background
The proliferation of affordable computing systems has facilitated distribution of electronic paperwork such as forms. Such distribution has recently been applied to networking contexts, such as delivery of forms through Internet Browser application programs including Netscape Navigator, Microsoft Internet Explorer, Opera, and others. For example, the hypertext markup language (HTML), the most common language used to describe "web pages", provides a construction, e.g., the <FORM> tag, that can be used to define an electronic form for display by a receiving browser. Other languages, such as Java, JavaScript, Visual Basic, etc. also provide methods for defining forms for display to a user.
Unfortunately, these forms are typically lengthy, as each site seeks to learn as much as possible about users, their interests, and other personal and demographic data that can be used for later solicitations. And, many sites now require completing the forms as a condition precedent to obtaining services from the site. Thus, in a typical example of a user browsing Internet vendor web sites for purchasing a gift, the user may be required to fill out many, largely duplicative, forms at each vendor's web site. Repeated filling out of the forms can get quite tedious.
In an effort to alleviate some of the burden incident to this, some Internet browsers, such as Microsoft Internet Explorer 5, maintain a history list of answers a user has stored in a form. Thus, when a user starts to enter an answer into the form (or the form field is double-clicked upon), the browser prompts the user with a list of possible completions to the form's field. However, although this technique facilitates data entry, it does not provide any centralized location for the inspection and entry of data into the form. In particular, this method fails to remove the tedium incident to addressing every field entry for which a value is to be inserted. That is, each field needs to be clicked upon or typed in to trigger data entry. Further, the list of entries can be very long as it includes every entry ever entered into that form's field. And, there is no central location containing a single set of current user data that is to be entered into the form. And, there is no opportunity to select only a portion of a previously recorded entry.
Summary
The invention provides for completion of forms. In one embodiment, a form is received. In response to receiving the form, or through manual invocation, a dialog box is displayed containing dialog entries that are inserted into the form according to insertion formats associated with the dialog entries. A particular insertion format for a dialog entry is selected by a user activating a "hotspot", button, or other selection region associated with a dialog entry. Insertion formats are configured to insert an entire entry or just a portion thereof into a form.
For example, assume a dialog box has an entry containing a text string, and it is desired to either select the entire string, or just a portion thereof, such as for entry into an electronic form. In one embodiment, a first selection region is defined proximate the text string such that its selection (e.g., by clicking on or simply hovering a pointer over the selection region) causes the entire string to be highlighted. Second, third, etc. selection regions can be defined with respect to portions of the string, such as for individual words, where selection causes the portions (e.g., words) of the string to be high-lighted. In one embodiment, hovering a pointer over a selection region causes the region's associated data to be highlighted, and clicking on a selection region causes its associated data to be inserted into an electronic form.
Brief Description of the Drawings
Features and advantages of the invention will become apparent to one skilled in the art to which the invention pertains from review of the following detailed description and claimed embodiments of the invention, in conjunction with the drawings in which: FIG. 1 illustrates an overview of one embodiment for data entry.
FIGS. 2 illustrates a user interface according to one embodiment of the invention.
FIGS. 3 illustrate selection regions and associated visual cues indicating insertion format controlling transfer of a helper dialog entry to a form.
FIG. 4 illustrates a suitable computing environment in which certain aspects of the claimed invention may be practiced.
Detailed Description
FIG. 1 illustrates an overview of one embodiment for data entry, such as receiving and filling out an electronic form. As used herein, the term "form" is intended to include registration forms, login forms, and other structures / data structures having entries to be filled out by a recipient of the data structure.
As illustrated, a first operation 100 is to monitor for receipt of a form. It is assumed that receipt of a form triggers the invention, however, it will be appreciated that other environments may benefit from using the invention as well, such as aiding answering queries posed by application programs. It is further assumed a network browser, such as Internet Explorer, is receiving and processing data defining the form, however, other applications may also be used. In a browser context, a form is recognized by scanning received browser data for a form's definition. In the case of receiving Hypertext Markup Language (HTML) data, form identification is simply a matter of watching for a <FORM> tag definition. However, forms may also be defined through other constructions, such as by way of compiled Java programs, JavaScript, active server pages (ASP), etc. It may also be necessary to inspect binary data to identify form definitions. In an alternate embodiment, the browser provides internal hooks for identifying whether received network data contains a form definition.
If a form is identified at 102, in one embodiment a test is performed at 104 to determine if a helper dialog box (containing entries to insert into a form) is already visible. The dialog box is expected to remain on the display as one navigates or browses to different network locations. If the dialog is not already visible, then the dialog box is popped up 106 onto the user's display. Once the helper dialog box is displayed, one has opportunity to update information stored within the helper dialog box (see FIGS. 2).
Note that it is assumed a user is manipulating a computing device utilizing a monitor as an output device, and that program code implementing the invention is being executed such that it has access to the user's display. However, it will be appreciated that the invention need not be executed by the user's computing device to obtain access to the display, e.g., such as in an X Windows environment. Also, the "user" may be another computing device, and the output "display" may in fact be a data file, communication pathway, or the like.
In one embodiment, popping up the dialog box may also be' manually triggered if a form is not automatically recognized when monitoring 100 the network. For example, a service or background executing program can wait 108 for manual requests to pop up the dialog box. If at 110 a manual trigger is received, then the helper dialog is popped-up. In one embodiment, a Microsoft Windows operating system Tray Icon service is used, where displaying the dialog box is triggered by generating a click event for the tray icon, e.g., by using a mouse or other pointing device to click on the tray icon, or by causing a click event to be generated for the icon. In another embodiment, keyboard activity is monitored for pressing of a certain control sequence to trigger display of the dialog box.
A test may be performed at 112 to determine if an automatic mode should be used to fill out the form. Automatic mode means that an attempt is made by the helper system to fill the form's fields with data the form is received. If in automatic mode, a test is performed at 114 to determine if the current form is being viewed for the first time. If so, a user is required to fill out the form, either conventionally by typing directly into the form, or as discussed below, and the helper system monitors 116 the entries to learn insertion values for subsequent display of the form.
If not visiting the form for the first time, previously used values are known, and are automatically entered 118 into appropriate locations on the form. In one embodiment, the source location or address of a form can be tracked and associated with monitored values 116 so that only values for a particular form origin are available for insertion into the form. Source tracking can also be used when it is known certain forms require a particular entry format, e.g., first-name first or last-name first for a "name" form field.
If in manual mode at 112, after the helper dialog is displayed 106, the system waits for a user to select dialog entries to transfer to the form. It is assumed selection is controlled by way of a mouse or equivalent input device, where one activates, by way of clicks, drags, etc. a selection region to cause insertion of a dialog entry or sub- portion thereof into the form. Insertion is made according to an insertion format associated with the activated selection region. Selection regions can be defined as image hotspots, buttons, switches, toggles, etc. within the helper dialog, or as dispussed below, within a dialog entry.
In one embodiment, each dialog entry can have multiple associated selection regions, so that the same dialog entry may be highlighted and inserted into a form, where the highlighting indicates what portion of the entry will be inserted. Such an arrangement facilitates compactly displaying the helper dialog, since display space is not wasted on separate dialog entries for each of the possible insertion formats that may be associated with a single dialog entry (see FIGS. 3). In one embodiment, selection regions are automatically defined for each word in multiple-word strings.
As used herein and the claims that follow, the phrase "insertion format" refers to what portion of a data entry that will be inserted into a form, where highlighting an entry provides a cue, before transferring a dialog entry to a form, of the portion of the dialog entry to be inserted into the form. Such an arrangement facilitates compactly displaying the helper dialog, since display space is not wasted on separate dialog entries for each of the possible insertion formats that may be associated with a single dialog entry (see FIGS. 3). As used herein and the claims that follow, the term "highlighting" is intended to include other methods for calling attention to different formats for inserting a dialog box entry, such as generating a visual cue, an audio cue, or both, or taking some other action as needed or desired by visually or physically impaired individuals.
If at 112 the helper system is operating in manual mode, a next operation is to monitor 120 a location of a selection tool, e.g., a mouse pointer or other device used to perform selections. It will be appreciated that non-mouse selection tools, such as those utilized by visually impaired or physically impaired individuals, may also be utilized to select dialog entries. If at 122 the selection tool 304 (FIGS. 3) is near a selection region 300 (FIGS. 3) for a dialog entry, the dialog entry is highlighted 124 according to the insertion format for the selection region.
Thus, in the above multi-word text string example, when the selection tool 304 is near the first selection region 300, the entire name is highlighted (FIG. 3A), but when the selection tool is near one of the other selection regions for the words in the name, such as a selection region 306 (FIGS. 3) for just the first name, only the associated word is highlighted. (Highlighting may be accomplished by drawing a box around a selection region, e.g., a name, changing its color, or performing some other action to cue selection.) In one embodiment, selection regions are automatically defined for each word in multiple-word strings.
If at 126 activation for a selection region occurs, then the appropriate dialog entry or portion thereof is inserted 128 into the form according to the insertion format associated with the activated selection region.
In one embodiment, various techniques are available for activating the transfer of dialog entries to the form. For example, dialog box contents associated with a selection region can be dragged and then dropped onto the form. Dropping may be made on the form generally, or within a particular form field. It is understood that "drag and drop" generally means a selection region is clicked on with a mouse (or a mouse button- down event or equivalent generated for the selection region), and without releasing the mouse button (or receiving a mouse button-up event), the clicked-on selection region is dragged to the form, or to a particular field in the form. The mouse button is then released, causing transfer of the contents of the selection region for the dialog entry to the form according to the insertion format for the dragged and dropped selection region.
In addition to drag and drop, a selection region for a dialog entry can be double-clicked to cause activation of the region and insertion of dialog entry data to the form according to the insertion format associated with an activated selection region. It will be appreciated that other activation techniques, such as shift-single-click, voice- selected, or some other activation combination depending on user interface considerations, may be used to initiate transfer to the form.
In a double-click transfer, a user double-clicks on a selection region. In response, a field of the form currently having insertion focus (e.g., an input cursor or equivalent) receives the dialog entry according to the insertion format. If no form field currently has insertion focus, then a default field is chosen. In one embodiment, the default field is the first field defined for the form. In another embodiment, the data defining the form is inspected to determine whether a default first field is identified within the form's definition.
After inserting a dialog entry into the form, the insertion focus is advanced to another field within the form (if any). Advancement may be effected by sending a next- field command to the form. A next-field command is typically a tab character, which is transmitted to the form and interpreted by the form to cause movement of the insertion focus. However, depending on how the form is encoded and the environment displaying the form, a different character or control sequence may be required.
It will be appreciated a default field for insertion may be determined in a number of other ways, including matching dialog entries with form definitions. For example, if the dialog entry is known to contain a name, then the form can be searched for field tags corresponding to a name. Such searching will facilitated by encoding the form in the Extensible Markup Language (XML), or equivalent languages that associate semantic meaning with form field definitions.
FIGS. 2 provide for a user interface according to one embodiment of the invention. The user interface for storing typical user information to be inserted into a form. FIGS.2 illustrate a "My Info - Update" dialog box 200. This dialog box is broken into two general sections 202, 204, corresponding to contact information 202 and user credit card information 204. As discussed above, the contents of these sections are used to fill out electronic forms. As illustrated, different interface sections are selected by clicking on a tab for an area of interest.
As illustrated in FIG. 2A, contact information includes field entries for one's name 206, Email address 208, telephone number 210, facsimile number 212, and mailing address 214. In FIG. 2B, the billing information 204 includes entries for a credit card category 216 (e.g., work card, personal card, etc.), card type 218 (e.g., Visa, MasterCard, Discover, etc.), name on card 220, card number 222, expiration information 224, and billing address reference 226.
The FIG. 2A contact information 202 includes selectable address radio buttons 228 (or equivalent) for designating different contact addresses, e.g., home, work, other. The FIG. 2B credit card information 204 configures the billing address reference 226 as a selectable drop down list corresponding to the radio button 228 definitions. As illustrated, a card category 216 of personal is selected, and a home address used as the billing address reference 226. Selecting a personal card category automatically causes the home address to be selected as the billing address.
Note that there is no requirement that dialog entries be filled out. One may individually determine the extent to which private information is retained by the helper system.
FIGS. 3 illustrate the above-described multi-word text string example. As discussed above for FIG. 1, the illustrated dialogs appear when manually invoked by a user or automatically on detection of an electronic form.
FIG. 3 A illustrates a first selection region 300 (a darker box) adjacent a name field 302. As illustrated, moving a selection tool 304 over (e.g., "hovering") the first selection region causes the entire dialog entry to be highlighted. This visually cues a user that the entire dialog entry field is selected and will be transferred to a form if the first selection region is then activated. Thus, to drag and drop the entire name in the name field 302, and enter it into the form, one would click on and then drag and drop the first selection region 300 to the form.
FIG. 3B illustrates a second selection region 306 that has been defined as the first word of the name string in the name field 302. As illustrated, moving a selection tool over the second selection region 306 causes the region to be highlighted. This visually cues a user that only the contents of the region will be transferred to a form, in this case, the first name Noah. Thus, to insert just the first name of the name field 302 into a form, the second selection region can be clicked on and then dragged and. dropped into the form. In one embodiment, differently configured dialog boxes are presented for different electronic forms, so that dialog boxes may be tailored to different types of forms. For example, a form may be designed to receive non-text data, such as graphics files, databases, and other non-text data. Thus, a dialog (not shown) may be configured with entries corresponding to such non-text data that may be fully or partially selected and inserted into the form.
For example, assume a dialog entry contains a graphics image. Selection regions can be defined for the image such that it is sub-divided into different sections (like an "image map" in a web browser context), where selecting one of the image's selection regions causes that selected portion of the image to be inserted into the form- In one embodiment, Object Linking and Embedding (OLE) or Microsoft ActiveX controls are used to select and manipulate the dialog box image, and then transfer appropriate image data to corresponding OLE or ActiveX controls within the form.
In one embodiment, two radio buttons 308, 310 are provided to control whether a particular user's data is being updated 308 or entered into a form 310. When the "Update my info" button 308 is selected, the dialog's selection regions are deactivated so that the dialog entries may be revised without inadvertent entry into a form.
FIG. 4 illustrates a suitable computing environment in which certain aspects of the claimed invention may be practiced. The figure and following discussion are intended to provide a brief, general description of a suitable computing environment in which portions of the invention may be implemented. The invention may be described by reference to different high-level program modules and/or low-level hardware contexts. Those skilled in the art will realize that program module references can be interchanged with low-level instructions. .
Program modules include procedures, functions, programs, components, data structures, and the like, that perform particular tasks or implement particular abstract data types. The modules may be incorporated into single and multi-processor computing devices, as well as hand-held devices and controllable consumer devices (e.g., Personal Digital Assistants (PDAs), cellular telephones, etc.). It is understood that modules may be implemented on a single computing device, or processed over a distributed network environment, where modules can be located in both local and remote memory storage devices.
An exemplary system for implementing the client computing devices discussed above includes a computing device 402 having system bus 404 for coupling together various components within the computing device. The system bus 404 may be any of several types of bus structures, such as PCI, AGP, VESA, ISA, etc. Typically, attached to the bus 404 are processors 406 such as those by Intel, programmable gate arrays, and the like, volatile and non- volatile memory 408 such as RAM, ROM, NVRAM, etc., storage devices 410, a video interface 412 for presenting output to an output device such as a cathode ray tube (CRT) monitor, display panel, projector, etc., input/output interface ports 414 for communicating with devices, and a network interface 420. Storage devices include computer-readable media such as hard-drives, floppy-disks, optical storage, magnetic cassettes, tapes, flash memory cards, memory sticks, digital video disks, biological-based storage, and the like, and may communicate with system bus 404 through a physical and/or logical interface 426. Program modules, such as for a web browser configured to display a form, can be stored within the memory 408, storage devices 410, or implemented as an ASIC.
Computing device 402 may be a computer, or other device such as a router, switch, telephone, radio, household appliance, etc. Computing device 402 may operate in a networked 424 environment using logical connections to one or more remote computing devices 416, 418. Remote computing devices can be configured as having some or all of the features of computing device 402. A modem 422 may be used to form network connections. If we assume a viewpoint of the invention as being implemented in computing device 402, then remote computing devices 416, 418 include remote network servers and other devices utilizing network application protocols such as HTTP (e.g., web servers), File Transfer Protocol (FTP), Gopher, Wide Area Information Server (WAIS), and the like to deliver forms to the invention. It will be appreciated that computing devices 402, 416, 418 may be embodied as single devices, or as a combination of separate components. Having described and illustrated the principles of the invention with reference to illustrated embodiments, it will be recognized that the illustrated embodiments can be modified in arrangement and detail without departing from such principles. For example, while the foregoing description focused ~ for expository convenience - on filling out forms, it will be recognized that the same techniques for defining selection regions and visually cueing impending data transfers can be applied to other transaction environments.
And, even though the foregoing discussion has focused on particular embodiments, it is understood that other configurations are contemplated. In particular, even though expressions such as "in one embodiment", "in another embodiment", and the like are used herein, these phrases are meant to generally reference embodiment possibilities, and are not intended to limit the invention to those particular embodiments. Unless indicated otherwise, some or all of different indicated embodiments may be combined. Consequently, in view of the wide variety of permutations to the above- described embodiments, the detailed description is intended to be illustrative only, and should not be taken as limiting the scope of the invention.
What is claimed as the invention, is all such modifications as may come within the scope and spirit of the following claims and equivalents thereto.

Claims

ClaimsWhat is claimed is:
1. A method for selecting data within a dialog box, comprising: defining a field within the dialog box; defining a region within the dialog box, wherein activating said first region causes selection of the field of the dialog box; and defining a second region within the field, wherein activating said second region causes selection of a portion of the field.
2. The method of claim 1, further comprising: deteraiining if a selection tool overlaps said first region, and if so, highlighting the entire first field of the dialog box; and determining if the selection tool overlaps said second region, and if so, highlighting the portion of the first field; wherein said highlighting provides a cue corresponding to activation of said first region or said second region.
3. The method of claim 2, wherein the cue is one of a visual cue and an auditory cue.
4. The method of claim 2, wherein the selection tool is a mouse.
5. The method of claim 1 , further comprising: receiving a form having a first form field; displaying said dialog box in response to said receiving; receiving an activation for one of said first region or said second region, said activation causing a corresponding selection of the first field; and inserting said corresponding selection of the first field into said first form field.
6. The method of claim 5, further comprising: receiving a form having at least one form field; displaying said dialog box in response to said receiving; receiving an activation for one of said first region or said second region, said activation determining a selection of the first field; and identifying a selection type for said selection of the first field; matching said selection type to a first form field of said at least one form field; and inserting said selection of the first field into said first form field.
7. The method of claim 1, further comprising: displaying the dialog box.
8. The method of claim 1 , wherein the first field is a graphical image.
9. The method of claim 8, wherein said first region and said second region are hot spot regions defined with respect to the graphical image.
10. A readable medium having instructions encoded thereon capable, when executed by a processor, of directing the processor to: define a first field within a dialog box; define a first region within the dialog box; respond to activating said first region by selecting the entire first field of the dialog box; define a second region within the first field; and respond to activating said second region by selecting a portion of the first field.
11. The medium of claim 10, said instructions including further instructions capable of directing the processor to: determine if a selection tool overlaps said first region, and if so, highlighting the entire first field of the dialog box so as to provide a cue corresponding to activation of said first region; and determine if the selection tool overlaps said second region, and if so, highlighting the portion of the first field so as to provide a cue corresponding to activation of said second region.
12. The medium of claim 11, wherein said instructions for said cue include selected ones of: instructions to direct the processor to provide a visual cue, and instructions to direct the processor to provide an auditory cue.
13. The medium of claim 10, said instructions including further instructions capable of directing the processor to: receive a form having a first form field; display said dialog box in response to said receiving; receive an activation for one of said first region or said second region, said activation causing a corresponding selection of the first field; and insert said corresponding selection of the first field into said first form field.
14. The medium of claim 13, said instructions including further instructions capable of directing the processor to: receive a form having at least one form field; display said dialog box in response to said receiving; receive an activation for one of said first region or said second region, said activation determining a selection of the first field; and identify a selection type for said selection of the first field; match said selection type to a first form field of said at least one form field; and insert said selection of the first field into said first form field.
15. The medium of claim 10, said instructions including further instructions capable of directing the processor to: display the dialog box.
16. The medium of claim 10, wherein the first field is a graphical image.
17. The medium of claim 16, wherein said first region and said second region are hot spot regions define with respect to the graphical image.
18. A method, comprising: receiving a form defining data fields; displaying a dialog box containing selectable data for insertion into the form according to an insertion format; defining a first region within the dialog box for configuring the insertion format as the entire selectable data; defining a second region within the selectable data for configuring the insertion format as a sub-portion of the selectable data; receiving an activation of a selected one of said defined regions; configuring the insertion format according to said activation; and > inserting the selectable data into the form according to the insertion format.
19. The method of claim 18, further comprising: associating a field type with said selectable data of the dialog box; and determining a corresponding field type within the form; wherein said inserting comprises inserting the selectable data within the corresponding field.
20. The method of claim 18, further comprising: highlighting said selectable data according to the insertion format.
21. The method of claim 18, further comprising: determining a location of a selection tool; determining if the location is proximate a third region having an associated format for configuring the insertion format; and if so, highlighting said selectable data according to the associated format.
22. The method of claim 21 , wherein the selection tool is a mouse pointer.
23. The method of claim 18, wherein the form is only partially displayed.
24. The method of claim 18, wherein said activation includes receiving a double-click event.
25. The method of claim 18, wherein said activation comprises: receiving a drag event corresponding to dragging the selected one of said defined regions from the dialog box; and receiving a drop event corresponding to dropping the selected one of said defined regions within the form at a drop location; wherein said inserting further comprises inserting said selectable data at the drop location.
26. The method of claim 25, further comprising: determining a first field of the form corresponding to drop location; wherein said inserting further comprises inserting said selectable data into the first field.
27. The method of claim 18, further comprising: hiding the dialog box until said receiving the form; and displaying the dialog box responsive to said receiving the form.
28. A readable medium having encoded thereon instructions capable of directing a processor to: receive a form defining data fields; display a dialog box containing selectable data for insertion into the form according to an insertion format; define a first region within the dialog box for configuring the insertion format as the entire selectable data; define a second region within the selectable data for configuring the insertion format as a sub-portion of the selectable data; receive an activation of a selected one of said defined regions; configure the insertion format according to said activation; and insert the selectable data into the form according to the insertion format.
29. The medium of claim 28, said instructions including further instructions for directing said processor to: associate a field type with said selectable data of the dialog box; and determine a corresponding field type within the form; wherein said instructions for said inserting said selectable data comprise instructions to insert said selectable data within the corresponding field.
30. The medium of claim 28, said instructions including further instructions for directing said processor to: highlight said selectable data according to the insertion format. >
31. The medium of claim 28, said instructions including further instructions for directing said processor to: determine a location of a selection tool; determine if the location is proximate a third region having an associated format for configuring the insertion format; and if so, highlighting said selectable data according to the associated format.
32. The medium of claim 31 , wherein the instructions for deteπnining the location of the selection tool include instructions for determining a mouse pointer location.
33. The medium of claim 28, wherein the instructions for displaying the form include instructions for only partially displaying the form.
34. The medium of claim 28, said instructions for receiving the activation include further instructions for directing said processor to: receive a double-click event.
35. The medium of claim 28, said instructions for receiving the activation include further instructions for directing said processor to: receive a drag event corresponding to dragging the selected one of said defined regions from the dialog box; and receive a drop event corresponding to dropping the selected one of said defined regions within the form at a drop location; wherein said instructions for said inserting said selectable data comprises instructions to insert said selectable data at the drop location.
36. The medium of claim 35, said instructions including furthe instructions for directing said processor to: determine a first field of the form corresponding to the associated drop location; wherein said instructions for said inserting said selectable data comprises instructions to insert said selectable data into the first field.
37. The medium of claim 28, said instructions including further instructions for directing said processor to: hide the dialog box until the form is received; and display the dialog box when the form is.
PCT/US2001/040084 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry in electronic forms WO2002003239A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP01927355A EP1295218A1 (en) 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry in electronic forms
CA002382884A CA2382884A1 (en) 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry in electronic forms
AU2001253815A AU2001253815A1 (en) 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry in electronic forms
JP2002507241A JP2004502257A (en) 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry into electronic forms

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60306500A 2000-06-26 2000-06-26
US09/603,065 2000-06-26

Publications (1)

Publication Number Publication Date
WO2002003239A1 true WO2002003239A1 (en) 2002-01-10

Family

ID=24413954

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/040084 WO2002003239A1 (en) 2000-06-26 2001-02-12 Apparatus and method for selecting and automating data entry in electronic forms

Country Status (5)

Country Link
EP (1) EP1295218A1 (en)
JP (1) JP2004502257A (en)
AU (1) AU2001253815A1 (en)
CA (1) CA2382884A1 (en)
WO (1) WO2002003239A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012068520A3 (en) * 2010-11-18 2012-07-12 Google Inc. On-demand auto-fill
US20120191568A1 (en) * 2011-01-21 2012-07-26 Ebay Inc. Drag and drop purchasing bin
CN111629248A (en) * 2020-05-12 2020-09-04 深圳Tcl数字技术有限公司 Dialog box control method, terminal device and readable storage medium
US10796082B2 (en) 2002-03-26 2020-10-06 Aatrix Software, Inc. Method and apparatus for creating and filing forms
US11861302B2 (en) 2019-02-04 2024-01-02 Aatrix Software, Inc. AUF XML specification compiler

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9846689B2 (en) * 2008-01-29 2017-12-19 Adobe Systems Incorporated Method and system to provide portable database functionality in an electronic form
US10372804B2 (en) 2016-05-17 2019-08-06 Bruce HASSEL Interactive audio validation/assistance system and methodologies

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5721901A (en) * 1992-07-20 1998-02-24 International Business Machines Corporation Method and apparatus for displaying a dialog box enabling user selections from a database
US5794259A (en) * 1996-07-25 1998-08-11 Lextron Systems, Inc Apparatus and methods to enhance web browsing on the internet

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5721901A (en) * 1992-07-20 1998-02-24 International Business Machines Corporation Method and apparatus for displaying a dialog box enabling user selections from a database
US5794259A (en) * 1996-07-25 1998-08-11 Lextron Systems, Inc Apparatus and methods to enhance web browsing on the internet

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Internet Start-Up Gator.com Introduces Gator, the Web's First Smart Online Companion", INTERNET ARTICLE, 14 June 1999 (1999-06-14), XP002180713, Retrieved from the Internet <URL:http://www.gator.com/company/press/pr061499.html> [retrieved on 20011017] *
MARET P ET AL: "MULTIMEDIA INFORMATION INTERCHANGE: WEB FORMS MEET DATA SERVERS", PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS, LOS ALAMITOS, CA, US, vol. 2, 7 June 1999 (1999-06-07), pages 499 - 505, XP000964627 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10796082B2 (en) 2002-03-26 2020-10-06 Aatrix Software, Inc. Method and apparatus for creating and filing forms
WO2012068520A3 (en) * 2010-11-18 2012-07-12 Google Inc. On-demand auto-fill
US20170046325A1 (en) * 2010-11-18 2017-02-16 Google Inc. On-Demand Auto-Fill
US10515144B2 (en) 2010-11-18 2019-12-24 Google Llc On-demand auto-fill
US20120191568A1 (en) * 2011-01-21 2012-07-26 Ebay Inc. Drag and drop purchasing bin
US11861302B2 (en) 2019-02-04 2024-01-02 Aatrix Software, Inc. AUF XML specification compiler
CN111629248A (en) * 2020-05-12 2020-09-04 深圳Tcl数字技术有限公司 Dialog box control method, terminal device and readable storage medium

Also Published As

Publication number Publication date
JP2004502257A (en) 2004-01-22
AU2001253815A1 (en) 2002-01-14
EP1295218A1 (en) 2003-03-26
CA2382884A1 (en) 2002-01-10

Similar Documents

Publication Publication Date Title
US5737560A (en) Graphical method and system for accessing information on a communications network
US6233591B1 (en) Dropping hyperlink onto document object
US6690390B1 (en) Interactive on-line help for completing a task
US9063757B2 (en) Interactive application assistance, such as for web applications
US6310630B1 (en) Data processing system and method for internet browser history generation
US7770122B1 (en) Codeless dynamic websites including general facilities
US5914714A (en) System and method for changing the characteristics of a button by direct manipulation
USRE43751E1 (en) Browser system having simplified URL address registering method
US6810410B1 (en) Customizing a client application using an options page stored on a server computer
US7278092B2 (en) System, method and apparatus for selecting, displaying, managing, tracking and transferring access to content of web pages and other sources
US20060107234A1 (en) Computer-implemented graphical user interface previews
US6924797B1 (en) Arrangement of information into linear form for display on diverse display devices
US20070276811A1 (en) Graphical User Interface for Displaying and Organizing Search Results
US20020010718A1 (en) Method and apparatus for displaying miniaturized graphical representations of documents for alternative viewing selection
US20070256005A1 (en) Field-link autofill
EP2290536A2 (en) System and method for delivering remotely stored applications and information
US6904569B1 (en) Link-level browser instance control
WO1997044726A9 (en) Internet hyperlink drag and drop
US20070198943A1 (en) System and Method for Distributing News Articles and Other Information in an Organization
WO2000004434A2 (en) A computer interface method and apparatus with portable network organization system and targeted advertising
US20060036991A1 (en) Predictive help method, system and program product for software systems
JP2001060205A (en) Document display method, computer program product, and document display device
US6661419B2 (en) Animation packager for an on-line book
US6567801B1 (en) Automatically initiating a knowledge portal query from within a displayed document
US20030191729A1 (en) System for automating a web browser application

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2382884

Country of ref document: CA

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2001927355

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2001927355

Country of ref document: EP